2024-04-27T07:15:14.523 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-27T07:15:14.523 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063 --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/orig.config.yaml 2024-04-27T07:15:14.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-27T07:15:14.668 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063 branch: main description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672063' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 4e213a58e787437ff508e6c890ccd5fd32dc96b5 owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 4710 sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f sleep_before_teardown: 0 subset: 356/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e213a58e787437ff508e6c890ccd5fd32dc96b5 targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMQvfk5z/n4oBsLwJefDFolxd3mzFYuYDWvzXZMkzcD5wQzdFEG410kvrFV5pBgSwHaPKebTZoFh0YOMvFLuVI= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK7Y+ghfjsFhcvBWvkk/ZJADSemIyJzj5rOztiAltQf6XQWFu04V0YBkOeUEAeserw2Rz3vrhtlJkRMiuaBc7DU= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_main/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_20:24:13 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-27T07:15:14.668 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa; will attempt to use it 2024-04-27T07:15:14.669 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks 2024-04-27T07:15:14.669 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-27T07:15:14.670 INFO:teuthology.task.internal:Checking packages... 2024-04-27T07:15:14.694 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f' 2024-04-27T07:15:14.694 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:15:14.694 INFO:teuthology.packaging:ref: None 2024-04-27T07:15:14.695 INFO:teuthology.packaging:tag: None 2024-04-27T07:15:14.695 INFO:teuthology.packaging:branch: main 2024-04-27T07:15:14.695 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:15:14.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-27T07:15:15.000 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1670.g1fb5d106 2024-04-27T07:15:15.001 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-27T07:15:15.011 INFO:teuthology.task.internal:no buildpackages task found 2024-04-27T07:15:15.012 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-27T07:15:15.039 INFO:teuthology.task.internal:Saving configuration 2024-04-27T07:15:15.059 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-27T07:15:15.064 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-27T07:15:15.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-27 07:10:12.611062', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMQvfk5z/n4oBsLwJefDFolxd3mzFYuYDWvzXZMkzcD5wQzdFEG410kvrFV5pBgSwHaPKebTZoFh0YOMvFLuVI='} 2024-04-27T07:15:15.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-27 07:10:12.612792', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK7Y+ghfjsFhcvBWvkk/ZJADSemIyJzj5rOztiAltQf6XQWFu04V0YBkOeUEAeserw2Rz3vrhtlJkRMiuaBc7DU='} 2024-04-27T07:15:15.110 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-27T07:15:15.117 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-27T07:15:15.117 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-27T07:15:15.117 INFO:teuthology.run_tasks:Running task console_log... 2024-04-27T07:15:15.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbe2ee10160>, signals=[15]) 2024-04-27T07:15:15.204 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-27T07:15:15.211 INFO:teuthology.task.internal:Opening connections... 2024-04-27T07:15:15.211 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:15:15.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-27T07:15:15.292 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-04-27T07:15:15.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-27T07:15:15.366 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-27T07:15:15.373 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-27T07:15:15.391 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-27T07:15:15.391 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-27T07:15:15.448 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-27T07:15:15.449 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-27T07:15:15.450 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-27T07:15:15.450 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-27T07:15:15.471 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-04-27T07:15:15.488 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-04-27T07:15:15.488 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-04-27T07:15:15.544 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-04-27T07:15:15.544 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-04-27T07:15:15.544 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-27T07:15:15.545 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-27T07:15:15.545 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-04-27T07:15:15.571 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-27T07:15:15.581 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-27T07:15:15.631 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-27T07:15:15.631 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-27T07:15:15.634 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-04-27T07:15:15.649 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-27T07:15:15.655 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-27T07:15:15.655 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-27T07:15:15.691 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-04-27T07:15:15.807 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-27T07:15:15.856 INFO:teuthology.run_tasks:Running task kernel... 2024-04-27T07:15:15.871 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-27T07:15:15.872 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-27T07:15:15.872 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-27T07:15:15.872 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-27T07:15:15.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:15:15.889 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-27T07:15:15.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:15:15.890 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-04-27T07:15:15.946 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-04-27T07:15:15.946 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-437.el9.x86_64 2024-04-27T07:15:15.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-04-27T07:15:15.948 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-437.el9.x86_64 2024-04-27T07:15:15.948 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-437.el9.x86_64 2024-04-27T07:15:15.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-04-27T07:15:18.255 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-27T07:15:18.306 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-27T07:15:20.565 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-27T07:15:24.874 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.2 MB 00:00 2024-04-27T07:15:27.416 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-27T07:15:28.717 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-27T07:15:33.766 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-27T07:15:35.403 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-04-27T07:15:35.647 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-27T07:15:35.648 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-27T07:15:35.728 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:15:35.729 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:15:35.729 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:15:35.826 DEBUG:teuthology.orchestra.run.smithi082:> echo no | sudo yum reinstall kernel || true 2024-04-27T07:15:36.320 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:03 ago on Sat 27 Apr 2024 07:15:33 AM UTC. 2024-04-27T07:15:36.439 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:15:36.453 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:36.453 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-04-27T07:15:36.453 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:36.453 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalling: 2024-04-27T07:15:36.453 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 255 k 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 0 2024-04-27T07:15:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:Operation aborted. 2024-04-27T07:15:36.504 INFO:teuthology.orchestra.run.smithi082.stdout:Is this ok [y/N]: 2024-04-27T07:15:36.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum reinstall -y kernel || true 2024-04-27T07:15:36.998 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:03 ago on Sat 27 Apr 2024 07:15:33 AM UTC. 2024-04-27T07:15:37.112 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:15:37.113 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:37.113 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-04-27T07:15:37.113 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalling: 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 255 k 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 0 2024-04-27T07:15:37.114 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:15:37.502 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-437.el9.x86_64.rpm 983 kB/s | 255 kB 00:00 2024-04-27T07:15:37.502 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:15:37.502 INFO:teuthology.orchestra.run.smithi082.stdout:Total 657 kB/s | 255 kB 00:00 2024-04-27T07:15:37.521 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:15:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:15:37.894 INFO:teuthology.orchestra.run.smithi082.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-27T07:15:37.894 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:15:38.636 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:15:38.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-27T07:15:39.377 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:15:39.377 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:39.377 INFO:teuthology.orchestra.run.smithi082.stdout:Reinstalled: 2024-04-27T07:15:39.378 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-27T07:15:39.378 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:15:39.378 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:15:39.565 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-04-27T07:15:39.610 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-27T07:15:39.611 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-27T07:15:39.611 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-27T07:15:39.611 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-27T07:15:39.611 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-27T07:15:39.641 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-04-27T07:15:39.675 DEBUG:teuthology.parallel:result is None 2024-04-27T07:15:46.620 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 836 kB/s | 6.2 MB 00:07 2024-04-27T07:15:48.195 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-27T07:15:49.954 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-27T07:15:54.938 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-27T07:15:56.810 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-27T07:15:56.810 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-27T07:15:56.913 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:15:56.914 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:15:56.914 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:15:57.017 DEBUG:teuthology.orchestra.run.smithi100:> echo no | sudo yum reinstall kernel || true 2024-04-27T07:15:57.515 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:03 ago on Sat 27 Apr 2024 07:15:54 AM UTC. 2024-04-27T07:15:57.644 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:15:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:57.656 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-27T07:15:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:57.656 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 255 k 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2024-04-27T07:15:57.657 INFO:teuthology.orchestra.run.smithi100.stderr:Operation aborted. 2024-04-27T07:15:57.713 INFO:teuthology.orchestra.run.smithi100.stdout:Is this ok [y/N]: 2024-04-27T07:15:57.714 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum reinstall -y kernel || true 2024-04-27T07:15:58.199 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:04 ago on Sat 27 Apr 2024 07:15:54 AM UTC. 2024-04-27T07:15:58.314 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalling: 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 255 k 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 0 2024-04-27T07:15:58.315 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:15:58.515 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-437.el9.x86_64.rpm 2.9 MB/s | 255 kB 00:00 2024-04-27T07:15:58.515 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:15:58.516 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.2 MB/s | 255 kB 00:00 2024-04-27T07:15:58.533 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:15:58.718 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:15:58.718 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:15:58.723 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:15:58.723 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:15:58.862 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:15:58.950 INFO:teuthology.orchestra.run.smithi100.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-27T07:15:58.950 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:15:59.593 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:15:59.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-27T07:16:00.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-27T07:16:00.291 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:16:00.291 INFO:teuthology.orchestra.run.smithi100.stdout:Reinstalled: 2024-04-27T07:16:00.291 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-27T07:16:00.291 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:16:00.291 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:16:00.463 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-04-27T07:16:00.510 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-27T07:16:00.510 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-27T07:16:00.510 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-27T07:16:00.510 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-27T07:16:00.510 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-27T07:16:00.545 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-04-27T07:16:00.566 DEBUG:teuthology.parallel:result is None 2024-04-27T07:16:00.566 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-27T07:16:00.573 INFO:teuthology.task.internal:Creating test directory... 2024-04-27T07:16:00.573 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-27T07:16:00.576 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-27T07:16:00.621 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-27T07:16:00.628 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-27T07:16:00.650 INFO:teuthology.task.internal:Creating archive directory... 2024-04-27T07:16:00.650 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-27T07:16:00.653 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-27T07:16:00.752 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-27T07:16:00.759 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-27T07:16:00.759 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-27T07:16:00.761 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-27T07:16:00.792 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-27T07:16:00.793 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-27T07:16:00.802 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-27T07:16:00.803 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-27T07:16:00.804 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-27T07:16:00.811 INFO:teuthology.task.internal:Configuring sudo... 2024-04-27T07:16:00.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-27T07:16:00.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-27T07:16:00.873 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-27T07:16:00.882 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-27T07:16:00.882 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-27T07:16:00.915 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-27T07:16:00.931 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-27T07:16:01.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-27T07:16:01.063 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-27T07:16:01.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-27T07:16:01.186 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:16:01.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-27T07:16:01.252 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-27T07:16:01.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-27T07:16:01.339 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-27T07:16:01.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-27T07:16:01.459 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:16:01.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-27T07:16:01.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-27T07:16:01.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-04-27T07:16:01.566 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T07:16:01.603 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T07:16:01.955 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-27T07:16:01.963 INFO:teuthology.task.internal:Starting timer... 2024-04-27T07:16:01.963 INFO:teuthology.run_tasks:Running task pcp... 2024-04-27T07:16:01.988 INFO:teuthology.run_tasks:Running task selinux... 2024-04-27T07:16:02.019 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-27T07:16:02.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-27T07:16:02.080 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-27T07:16:02.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-04-27T07:16:02.138 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-04-27T07:16:02.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-27T07:16:02.140 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-27T07:16:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-27T07:16:02.167 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-04-27T07:16:02.185 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-04-27T07:16:02.185 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive'} 2024-04-27T07:16:02.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T07:16:02.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:16:02.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T07:16:02.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:16:02.256 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-27T07:16:02.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-27T07:16:02.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-04-27T07:16:02.320 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-27T07:16:02.329 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-27T07:16:02.346 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-27T07:16:02.347 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-27T07:19:29.765 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2024-04-27T07:19:29.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-27T07:19:29.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-27T07:19:29.846 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-27T07:19:29.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-27T07:19:29.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-27T07:19:29.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-27T07:19:30.009 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-04-27T07:19:30.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-27T07:19:30.086 INFO:teuthology.run_tasks:Running task clock... 2024-04-27T07:19:30.096 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-27T07:19:30.096 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-27T07:19:30.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T07:19:30.099 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-27T07:19:30.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T07:19:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-27T07:19:30.135 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-27T07:19:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-27T07:19:30.158 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-27T07:19:30.165 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-27T07:19:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-27T07:19:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-27T07:19:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-04-27T07:19:30.193 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-27T07:19:30.198 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-04-27T07:19:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-27T07:19:30.223 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-27T07:19:30.243 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.247 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-27T07:19:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T07:19:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-27T07:19:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:19:30.282 INFO:teuthology.run_tasks:Running task install... 2024-04-27T07:19:30.290 DEBUG:teuthology.task.install:project ceph 2024-04-27T07:19:30.291 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f'}} 2024-04-27T07:19:30.291 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f'} 2024-04-27T07:19:30.291 INFO:teuthology.task.install:Using flavor: default 2024-04-27T07:19:30.298 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-27T07:19:30.298 INFO:teuthology.task.install:extra packages: [] 2024-04-27T07:19:30.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f', 'tag': None, 'wait_for_package': False} 2024-04-27T07:19:30.298 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:19:30.299 INFO:teuthology.packaging:ref: None 2024-04-27T07:19:30.299 INFO:teuthology.packaging:tag: None 2024-04-27T07:19:30.299 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:19:30.299 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:19:30.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-27T07:19:30.301 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f', 'tag': None, 'wait_for_package': False} 2024-04-27T07:19:30.301 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:19:30.301 INFO:teuthology.packaging:ref: None 2024-04-27T07:19:30.301 INFO:teuthology.packaging:tag: None 2024-04-27T07:19:30.301 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:19:30.301 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:19:30.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-27T07:19:30.618 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/ 2024-04-27T07:19:30.618 INFO:teuthology.task.install.rpm:Package version is 17.2.7-907.g2be3efa9 2024-04-27T07:19:30.652 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/ 2024-04-27T07:19:30.652 INFO:teuthology.task.install.rpm:Package version is 17.2.7-907.g2be3efa9 2024-04-27T07:19:30.734 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-27T07:19:30.734 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:19:30.734 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-27T07:19:30.759 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-27T07:19:30.759 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:19:30.759 INFO:teuthology.packaging:ref: None 2024-04-27T07:19:30.759 INFO:teuthology.packaging:tag: None 2024-04-27T07:19:30.759 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:19:30.759 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:19:30.759 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-27T07:19:30.821 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/2be3efa97a7972f8e925bd899b474329979b74d6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-27T07:19:30.822 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:19:30.822 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-27T07:19:30.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-27T07:19:30.848 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-27T07:19:30.848 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:19:30.848 INFO:teuthology.packaging:ref: None 2024-04-27T07:19:30.848 INFO:teuthology.packaging:tag: None 2024-04-27T07:19:30.848 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:19:30.848 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:19:30.848 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-27T07:19:30.897 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-27T07:19:30.914 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-27T07:19:30.960 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-04-27T07:19:30.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-04-27T07:19:30.987 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-27T07:19:31.050 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-27T07:19:31.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-27T07:19:31.186 INFO:teuthology.orchestra.run.smithi100.stdout:48 files removed 2024-04-27T07:19:31.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw 2024-04-27T07:19:31.276 INFO:teuthology.orchestra.run.smithi082.stdout:48 files removed 2024-04-27T07:19:31.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw 2024-04-27T07:19:31.848 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 205 kB/s | 77 kB 00:00 2024-04-27T07:19:31.875 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 247 kB/s | 77 kB 00:00 2024-04-27T07:19:32.258 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-04-27T07:19:32.259 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-27T07:19:32.608 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-04-27T07:19:32.668 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.8 kB/s | 1.8 kB 00:00 2024-04-27T07:19:33.544 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.0 MB 00:00 2024-04-27T07:19:35.451 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-27T07:19:35.584 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-04-27T07:19:39.044 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 19 MB 00:02 2024-04-27T07:19:41.827 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-04-27T07:19:43.261 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-27T07:19:44.619 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-04-27T07:19:46.286 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-27T07:19:47.815 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-27T07:19:52.873 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-27T07:19:55.018 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 14 M 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.1 M 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 5.0 M 2024-04-27T07:19:55.020 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 22 M 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 637 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 457 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 4.9 M 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 45 k 2024-04-27T07:19:55.021 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 118 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 156 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 320 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 293 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 99 k 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:Install 22 Packages 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2024-04-27T07:19:55.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:19:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 58 M 2024-04-27T07:19:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:19:57.062 INFO:teuthology.orchestra.run.smithi082.stdout:(1/24): ceph-radosgw-17.2.7-907.g2be3efa9.el9.x 9.1 MB/s | 14 MB 00:01 2024-04-27T07:19:57.104 INFO:teuthology.orchestra.run.smithi082.stdout:(2/24): ceph-selinux-17.2.7-907.g2be3efa9.el9.x 607 kB/s | 25 kB 00:00 2024-04-27T07:19:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:(3/24): ceph-base-17.2.7-907.g2be3efa9.el9.x86_ 2.9 MB/s | 5.0 MB 00:01 2024-04-27T07:19:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:(4/24): libcephfs2-17.2.7-907.g2be3efa9.el9.x86 3.9 MB/s | 637 kB 00:00 2024-04-27T07:19:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:(5/24): ceph-common-17.2.7-907.g2be3efa9.el9.x8 11 MB/s | 22 MB 00:01 2024-04-27T07:19:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:(6/24): libradosstriper1-17.2.7-907.g2be3efa9.e 1.6 MB/s | 457 kB 00:00 2024-04-27T07:19:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:(7/24): python3-ceph-argparse-17.2.7-907.g2be3e 773 kB/s | 45 kB 00:00 2024-04-27T07:19:57.581 INFO:teuthology.orchestra.run.smithi082.stdout:(8/24): python3-ceph-common-17.2.7-907.g2be3efa 1.7 MB/s | 118 kB 00:00 2024-04-27T07:19:57.606 INFO:teuthology.orchestra.run.smithi082.stdout:(9/24): python3-cephfs-17.2.7-907.g2be3efa9.el9 2.6 MB/s | 156 kB 00:00 2024-04-27T07:19:57.673 INFO:teuthology.orchestra.run.smithi082.stdout:(10/24): librgw2-17.2.7-907.g2be3efa9.el9.x86_6 12 MB/s | 4.9 MB 00:00 2024-04-27T07:19:57.698 INFO:teuthology.orchestra.run.smithi082.stdout:(11/24): python3-rbd-17.2.7-907.g2be3efa9.el9.x 3.1 MB/s | 293 kB 00:00 2024-04-27T07:19:57.723 INFO:teuthology.orchestra.run.smithi082.stdout:(12/24): python3-rados-17.2.7-907.g2be3efa9.el9 2.2 MB/s | 320 kB 00:00 2024-04-27T07:19:57.740 INFO:teuthology.orchestra.run.smithi082.stdout:(13/24): python3-rgw-17.2.7-907.g2be3efa9.el9.x 1.4 MB/s | 99 kB 00:00 2024-04-27T07:19:57.791 INFO:teuthology.orchestra.run.smithi082.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-04-27T07:19:57.824 INFO:teuthology.orchestra.run.smithi082.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-04-27T07:19:57.858 INFO:teuthology.orchestra.run.smithi082.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-04-27T07:19:57.908 INFO:teuthology.orchestra.run.smithi082.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-27T07:19:57.933 INFO:teuthology.orchestra.run.smithi082.stdout:(18/24): python3-prettytable-0.7.2-27.el9.noarc 388 kB/s | 42 kB 00:00 2024-04-27T07:19:58.026 INFO:teuthology.orchestra.run.smithi082.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-04-27T07:19:58.059 INFO:teuthology.orchestra.run.smithi082.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-04-27T07:19:58.084 INFO:teuthology.orchestra.run.smithi082.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-04-27T07:19:58.218 INFO:teuthology.orchestra.run.smithi082.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-27T07:19:58.284 INFO:teuthology.orchestra.run.smithi082.stdout:(23/24): librbd1-17.2.7-907.g2be3efa9.el9.x86_6 15 MB/s | 2.9 MB 00:00 2024-04-27T07:19:58.552 INFO:teuthology.orchestra.run.smithi082.stdout:(24/24): librados2-17.2.7-907.g2be3efa9.el9.x86 6.2 MB/s | 3.1 MB 00:00 2024-04-27T07:19:58.553 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:19:58.554 INFO:teuthology.orchestra.run.smithi082.stdout:Total 16 MB/s | 58 MB 00:03 2024-04-27T07:19:58.611 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:19:58.643 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:19:58.643 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:19:59.079 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:19:59.079 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:00.326 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:00.723 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-27T07:20:00.790 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:00.881 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:00.961 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-27T07:20:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:01.077 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-27T07:20:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-27T07:20:01.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-27T07:20:01.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-27T07:20:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-27T07:20:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-27T07:20:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 10/26 2024-04-27T07:20:01.782 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-27T07:20:01.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-27T07:20:01.871 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:01.928 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:01.967 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-27T07:20:01.996 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-27T07:20:02.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-27T07:20:02.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-27T07:20:02.367 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-27T07:20:02.455 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-27T07:20:02.530 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 19/26 2024-04-27T07:20:02.569 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 20/26 2024-04-27T07:20:02.613 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-27T07:20:04.981 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:05.307 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:05.816 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:05.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-27T07:20:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-27T07:20:05.964 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-27T07:20:05.964 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-27T07:20:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:07.635 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-27T07:20:09.758 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:20:09.760 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 14 M 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.1 M 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 5.0 M 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 22 M 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-27T07:20:09.761 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 637 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 457 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 4.9 M 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 45 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 118 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 156 k 2024-04-27T07:20:09.762 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 320 k 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 293 k 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 99 k 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout:Install 22 Packages 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 2 Packages 2024-04-27T07:20:09.763 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:09.764 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 58 M 2024-04-27T07:20:09.764 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:20:10.595 INFO:teuthology.orchestra.run.smithi100.stdout:(1/24): ceph-base-17.2.7-907.g2be3efa9.el9.x86_ 7.2 MB/s | 5.0 MB 00:00 2024-04-27T07:20:10.661 INFO:teuthology.orchestra.run.smithi100.stdout:(2/24): ceph-selinux-17.2.7-907.g2be3efa9.el9.x 379 kB/s | 25 kB 00:00 2024-04-27T07:20:10.787 INFO:teuthology.orchestra.run.smithi100.stdout:(3/24): libcephfs2-17.2.7-907.g2be3efa9.el9.x86 5.0 MB/s | 637 kB 00:00 2024-04-27T07:20:10.879 INFO:teuthology.orchestra.run.smithi100.stdout:(4/24): libradosstriper1-17.2.7-907.g2be3efa9.e 4.9 MB/s | 457 kB 00:00 2024-04-27T07:20:11.504 INFO:teuthology.orchestra.run.smithi100.stdout:(5/24): librgw2-17.2.7-907.g2be3efa9.el9.x86_64 7.9 MB/s | 4.9 MB 00:00 2024-04-27T07:20:11.571 INFO:teuthology.orchestra.run.smithi100.stdout:(6/24): python3-ceph-argparse-17.2.7-907.g2be3e 679 kB/s | 45 kB 00:00 2024-04-27T07:20:11.638 INFO:teuthology.orchestra.run.smithi100.stdout:(7/24): python3-ceph-common-17.2.7-907.g2be3efa 1.7 MB/s | 118 kB 00:00 2024-04-27T07:20:11.713 INFO:teuthology.orchestra.run.smithi100.stdout:(8/24): python3-cephfs-17.2.7-907.g2be3efa9.el9 2.0 MB/s | 156 kB 00:00 2024-04-27T07:20:11.930 INFO:teuthology.orchestra.run.smithi100.stdout:(9/24): ceph-common-17.2.7-907.g2be3efa9.el9.x8 11 MB/s | 22 MB 00:02 2024-04-27T07:20:11.955 INFO:teuthology.orchestra.run.smithi100.stdout:(10/24): python3-rados-17.2.7-907.g2be3efa9.el9 1.3 MB/s | 320 kB 00:00 2024-04-27T07:20:11.989 INFO:teuthology.orchestra.run.smithi100.stdout:(11/24): python3-rbd-17.2.7-907.g2be3efa9.el9.x 4.9 MB/s | 293 kB 00:00 2024-04-27T07:20:12.014 INFO:teuthology.orchestra.run.smithi100.stdout:(12/24): python3-rgw-17.2.7-907.g2be3efa9.el9.x 1.7 MB/s | 99 kB 00:00 2024-04-27T07:20:12.181 INFO:teuthology.orchestra.run.smithi100.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-04-27T07:20:12.198 INFO:teuthology.orchestra.run.smithi100.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 767 kB/s | 160 kB 00:00 2024-04-27T07:20:12.340 INFO:teuthology.orchestra.run.smithi100.stdout:(15/24): ceph-radosgw-17.2.7-907.g2be3efa9.el9. 5.8 MB/s | 14 MB 00:02 2024-04-27T07:20:12.382 INFO:teuthology.orchestra.run.smithi100.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-04-27T07:20:12.415 INFO:teuthology.orchestra.run.smithi100.stdout:(17/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-04-27T07:20:12.441 INFO:teuthology.orchestra.run.smithi100.stdout:(18/24): python3-prettytable-0.7.2-27.el9.noarc 422 kB/s | 42 kB 00:00 2024-04-27T07:20:12.733 INFO:teuthology.orchestra.run.smithi100.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 153 kB/s | 49 kB 00:00 2024-04-27T07:20:12.791 INFO:teuthology.orchestra.run.smithi100.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 226 kB/s | 67 kB 00:00 2024-04-27T07:20:12.817 INFO:teuthology.orchestra.run.smithi100.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 711 kB/s | 309 kB 00:00 2024-04-27T07:20:13.067 INFO:teuthology.orchestra.run.smithi100.stdout:(22/24): librados2-17.2.7-907.g2be3efa9.el9.x86 11 MB/s | 3.1 MB 00:00 2024-04-27T07:20:13.109 INFO:teuthology.orchestra.run.smithi100.stdout:(23/24): thrift-0.15.0-2.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-04-27T07:20:13.159 INFO:teuthology.orchestra.run.smithi100.stdout:(24/24): librbd1-17.2.7-907.g2be3efa9.el9.x86_6 8.6 MB/s | 2.9 MB 00:00 2024-04-27T07:20:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:Total 17 MB/s | 58 MB 00:03 2024-04-27T07:20:13.225 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:20:13.259 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:20:13.259 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:20:13.697 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:20:13.698 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:20:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:20:15.218 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:15.218 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-27T07:20:15.218 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-27T07:20:15.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-27T07:20:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:15.566 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-27T07:20:15.589 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:15.676 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:15.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-27T07:20:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-27T07:20:16.195 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-27T07:20:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-27T07:20:16.287 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 8/26 2024-04-27T07:20:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-27T07:20:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 10/26 2024-04-27T07:20:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-27T07:20:16.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-27T07:20:16.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-27T07:20:16.496 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-27T07:20:16.537 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:16.539 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-27T07:20:16.561 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-27T07:20:16.603 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-27T07:20:16.603 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:16.629 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-27T07:20:16.662 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-27T07:20:16.957 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-27T07:20:17.000 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-27T07:20:17.080 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 18/26 2024-04-27T07:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 19/26 2024-04-27T07:20:17.194 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 20/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 1/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 5/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 6/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 7/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 8/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 9/26 2024-04-27T07:20:17.959 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 10/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-27T07:20:17.960 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:17.961 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-27T07:20:17.961 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 25/26 2024-04-27T07:20:18.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.689 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-27T07:20:18.690 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-27T07:20:18.691 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:18.691 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:18.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-test 2024-04-27T07:20:19.481 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:27 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:19.602 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 48 M 2024-04-27T07:20:19.603 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 162 k 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 48 M 2024-04-27T07:20:19.604 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 192 M 2024-04-27T07:20:19.605 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:19.644 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:19.675 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:19.894 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 305 kB 00:00 2024-04-27T07:20:19.953 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-27T07:20:20.003 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): libcephsqlite-17.2.7-907.g2be3efa9.el9.x 597 kB/s | 162 kB 00:00 2024-04-27T07:20:20.186 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 21/26 2024-04-27T07:20:20.228 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-27T07:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 22/26 2024-04-27T07:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-27T07:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-27T07:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:20.355 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:22.115 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): ceph-test-17.2.7-907.g2be3efa9.el9.x86_6 20 MB/s | 48 MB 00:02 2024-04-27T07:20:22.117 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:22.117 INFO:teuthology.orchestra.run.smithi082.stdout:Total 19 MB/s | 48 MB 00:02 2024-04-27T07:20:22.143 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:22.161 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:22.162 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:22.521 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:22.522 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:23.042 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:23.124 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-27T07:20:23.172 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-27T07:20:23.200 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-27T07:20:27.552 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-27T07:20:27.671 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-27T07:20:29.674 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-04-27T07:20:29.675 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-27T07:20:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 1/4 2024-04-27T07:20:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2/4 2024-04-27T07:20:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-27T07:20:30.044 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-27T07:20:30.044 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:30.045 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:30.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph 2024-04-27T07:20:30.808 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:38 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:30.933 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 6.5 k 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.1 M 2024-04-27T07:20:30.936 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 1.4 M 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 240 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.9 M 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 15 M 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-27T07:20:30.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-27T07:20:30.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout:Install 33 Packages 2024-04-27T07:20:30.939 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:30.940 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 27 M 2024-04-27T07:20:30.940 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 96 M 2024-04-27T07:20:30.940 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:30.973 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-27T07:20:31.034 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 24/26 2024-04-27T07:20:31.034 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:31.034 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-27T07:20:31.034 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-27T07:20:31.034 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-27T07:20:31.035 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:31.036 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-27T07:20:31.109 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-27T07:20:31.109 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:31.639 INFO:teuthology.orchestra.run.smithi082.stdout:(1/33): ceph-17.2.7-907.g2be3efa9.el9.x86_64.rp 39 kB/s | 6.5 kB 00:00 2024-04-27T07:20:31.898 INFO:teuthology.orchestra.run.smithi082.stdout:(2/33): ceph-mds-17.2.7-907.g2be3efa9.el9.x86_6 4.9 MB/s | 2.1 MB 00:00 2024-04-27T07:20:31.931 INFO:teuthology.orchestra.run.smithi082.stdout:(3/33): ceph-mgr-17.2.7-907.g2be3efa9.el9.x86_6 3.1 MB/s | 1.4 MB 00:00 2024-04-27T07:20:32.073 INFO:teuthology.orchestra.run.smithi082.stdout:(4/33): ceph-mgr-modules-core-17.2.7-907.g2be3e 1.7 MB/s | 240 kB 00:00 2024-04-27T07:20:32.248 INFO:teuthology.orchestra.run.smithi082.stdout:(5/33): ceph-mon-17.2.7-907.g2be3efa9.el9.x86_6 6.4 MB/s | 3.9 MB 00:00 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 1/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 3/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 4/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 5/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 6/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 7/26 2024-04-27T07:20:32.504 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x 8/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86 9/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 10/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 11/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 12/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 13/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-27T07:20:32.505 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-27T07:20:32.506 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-27T07:20:32.506 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-27T07:20:32.506 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 23/26 2024-04-27T07:20:32.506 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-27T07:20:32.506 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 25/26 2024-04-27T07:20:32.699 INFO:teuthology.orchestra.run.smithi082.stdout:(6/33): ceph-osd-17.2.7-907.g2be3efa9.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-27T07:20:32.724 INFO:teuthology.orchestra.run.smithi082.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 389 kB/s | 253 kB 00:00 2024-04-27T07:20:32.832 INFO:teuthology.orchestra.run.smithi082.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-04-27T07:20:32.949 INFO:teuthology.orchestra.run.smithi082.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-04-27T07:20:33.058 INFO:teuthology.orchestra.run.smithi082.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-04-27T07:20:33.091 INFO:teuthology.orchestra.run.smithi082.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 1.5 MB/s | 1.2 MB 00:00 2024-04-27T07:20:33.158 INFO:teuthology.orchestra.run.smithi082.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.194 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.195 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:33.196 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:20:33.200 INFO:teuthology.orchestra.run.smithi082.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-04-27T07:20:33.259 INFO:teuthology.orchestra.run.smithi082.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 858 kB/s | 172 kB 00:00 2024-04-27T07:20:33.284 INFO:teuthology.orchestra.run.smithi082.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-04-27T07:20:33.309 INFO:teuthology.orchestra.run.smithi082.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 338 kB/s | 51 kB 00:00 2024-04-27T07:20:33.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-test 2024-04-27T07:20:33.568 INFO:teuthology.orchestra.run.smithi082.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 141 kB/s | 43 kB 00:00 2024-04-27T07:20:33.693 INFO:teuthology.orchestra.run.smithi082.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2024-04-27T07:20:33.718 INFO:teuthology.orchestra.run.smithi082.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 396 kB/s | 172 kB 00:00 2024-04-27T07:20:33.769 INFO:teuthology.orchestra.run.smithi082.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 781 kB/s | 358 kB 00:00 2024-04-27T07:20:33.794 INFO:teuthology.orchestra.run.smithi082.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-04-27T07:20:33.819 INFO:teuthology.orchestra.run.smithi082.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 230 kB/s | 23 kB 00:00 2024-04-27T07:20:33.845 INFO:teuthology.orchestra.run.smithi082.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2024-04-27T07:20:33.878 INFO:teuthology.orchestra.run.smithi082.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-04-27T07:20:33.903 INFO:teuthology.orchestra.run.smithi082.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-04-27T07:20:33.945 INFO:teuthology.orchestra.run.smithi082.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 785 kB/s | 79 kB 00:00 2024-04-27T07:20:33.979 INFO:teuthology.orchestra.run.smithi082.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-04-27T07:20:33.987 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:26 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:20:34.029 INFO:teuthology.orchestra.run.smithi082.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-04-27T07:20:34.054 INFO:teuthology.orchestra.run.smithi082.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 477 kB/s | 36 kB 00:00 2024-04-27T07:20:34.109 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 48 M 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 162 k 2024-04-27T07:20:34.110 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-04-27T07:20:34.111 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:34.112 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 48 M 2024-04-27T07:20:34.112 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 192 M 2024-04-27T07:20:34.112 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:20:34.113 INFO:teuthology.orchestra.run.smithi082.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-04-27T07:20:34.139 INFO:teuthology.orchestra.run.smithi082.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-27T07:20:34.180 INFO:teuthology.orchestra.run.smithi082.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2024-04-27T07:20:34.230 INFO:teuthology.orchestra.run.smithi082.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.4 MB/s | 427 kB 00:00 2024-04-27T07:20:34.235 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:34.235 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.2 MB/s | 27 MB 00:03 2024-04-27T07:20:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:34.390 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:34.390 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:34.493 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-04-27T07:20:34.552 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-27T07:20:34.628 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): libcephsqlite-17.2.7-907.g2be3efa9.el9.x 443 kB/s | 162 kB 00:00 2024-04-27T07:20:34.656 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:34.657 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:35.826 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:35.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-27T07:20:35.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-27T07:20:35.956 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-27T07:20:36.047 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-27T07:20:36.134 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-27T07:20:36.175 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-27T07:20:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-27T07:20:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-27T07:20:36.283 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-27T07:20:36.317 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-27T07:20:36.349 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-27T07:20:36.384 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-27T07:20:36.418 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-27T07:20:36.456 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-27T07:20:36.529 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-27T07:20:36.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-27T07:20:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-27T07:20:36.772 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): ceph-test-17.2.7-907.g2be3efa9.el9.x86_6 19 MB/s | 48 MB 00:02 2024-04-27T07:20:36.774 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:36.774 INFO:teuthology.orchestra.run.smithi100.stdout:Total 18 MB/s | 48 MB 00:02 2024-04-27T07:20:36.800 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:20:36.808 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-27T07:20:36.820 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:20:36.821 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:20:36.847 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-27T07:20:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-27T07:20:36.960 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-27T07:20:37.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-27T07:20:37.183 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:20:37.183 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:20:37.201 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-27T07:20:37.271 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-27T07:20:37.361 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-27T07:20:37.401 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-27T07:20:37.517 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-27T07:20:37.673 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 28/33 2024-04-27T07:20:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-27T07:20:37.705 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-27T07:20:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:37.789 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-27T07:20:37.829 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-27T07:20:37.857 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-27T07:20:39.098 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-27T07:20:39.125 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-27T07:20:39.126 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:39.126 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-27T07:20:39.126 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-27T07:20:39.126 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-27T07:20:39.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:39.491 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-27T07:20:39.514 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:39.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-27T07:20:39.740 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-27T07:20:41.390 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 1/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 3/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 4/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 5/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 6/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-27T07:20:41.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-27T07:20:41.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-27T07:20:41.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-27T07:20:42.218 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 3/4 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-27T07:20:42.273 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-27T07:20:42.274 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:42.275 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:42.295 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-27T07:20:42.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-base 2024-04-27T07:20:43.136 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:51 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:43.214 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:20:43.254 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:43.255 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:20:43.255 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:43.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install cephadm 2024-04-27T07:20:43.808 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:51 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:43.926 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 82 k 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:20:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:43.928 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 82 k 2024-04-27T07:20:43.928 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 372 k 2024-04-27T07:20:43.928 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:44.148 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm-17.2.7-907.g2be3efa9.el9.noarch.rpm 374 kB/s | 82 kB 00:00 2024-04-27T07:20:44.149 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:44.149 INFO:teuthology.orchestra.run.smithi082.stdout:Total 370 kB/s | 82 kB 00:00 2024-04-27T07:20:44.149 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:44.154 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:44.154 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:44.156 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:44.156 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:44.482 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 4/4 2024-04-27T07:20:44.482 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 1/4 2024-04-27T07:20:44.482 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2/4 2024-04-27T07:20:44.482 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-27T07:20:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-27T07:20:44.770 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:44.771 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:20:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:20:45.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph 2024-04-27T07:20:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:20:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:20:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:45.316 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:45.317 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:45.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-immutable-object-cache 2024-04-27T07:20:45.572 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:38 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:20:45.695 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 6.5 k 2024-04-27T07:20:45.697 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.1 M 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 1.4 M 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 240 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 3.9 M 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 15 M 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-27T07:20:45.698 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-27T07:20:45.699 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout:Install 33 Packages 2024-04-27T07:20:45.700 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:45.701 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 27 M 2024-04-27T07:20:45.701 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 96 M 2024-04-27T07:20:45.701 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:20:46.050 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:54 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:46.171 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 137 k 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 137 k 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 379 k 2024-04-27T07:20:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:46.396 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-immutable-object-cache-17.2.7-907.g2be3efa 617 kB/s | 137 kB 00:00 2024-04-27T07:20:46.396 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:46.397 INFO:teuthology.orchestra.run.smithi082.stdout:Total 611 kB/s | 137 kB 00:00 2024-04-27T07:20:46.397 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:46.404 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:46.404 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:46.465 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:46.466 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:46.589 INFO:teuthology.orchestra.run.smithi100.stdout:(1/33): ceph-17.2.7-907.g2be3efa9.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2024-04-27T07:20:46.614 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:46.692 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:20:46.713 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:20:46.713 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:46.713 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-27T07:20:46.713 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:46.939 INFO:teuthology.orchestra.run.smithi100.stdout:(2/33): ceph-mgr-17.2.7-907.g2be3efa9.el9.x86_6 2.5 MB/s | 1.4 MB 00:00 2024-04-27T07:20:47.072 INFO:teuthology.orchestra.run.smithi100.stdout:(3/33): ceph-mds-17.2.7-907.g2be3efa9.el9.x86_6 2.9 MB/s | 2.1 MB 00:00 2024-04-27T07:20:47.173 INFO:teuthology.orchestra.run.smithi100.stdout:(4/33): ceph-mgr-modules-core-17.2.7-907.g2be3e 2.3 MB/s | 240 kB 00:00 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:47.600 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:(5/33): ceph-osd-17.2.7-907.g2be3efa9.el9.x86_6 20 MB/s | 15 MB 00:00 2024-04-27T07:20:47.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr 2024-04-27T07:20:48.073 INFO:teuthology.orchestra.run.smithi100.stdout:(6/33): ceph-mon-17.2.7-907.g2be3efa9.el9.x86_6 2.6 MB/s | 3.9 MB 00:01 2024-04-27T07:20:48.240 INFO:teuthology.orchestra.run.smithi100.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 237 kB/s | 253 kB 00:01 2024-04-27T07:20:48.302 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:56 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:48.384 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:20:48.425 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:48.427 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:20:48.427 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:48.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-dashboard 2024-04-27T07:20:48.849 INFO:teuthology.orchestra.run.smithi100.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 138 kB/s | 106 kB 00:00 2024-04-27T07:20:48.989 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:56 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:49.007 INFO:teuthology.orchestra.run.smithi100.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 176 kB/s | 135 kB 00:00 2024-04-27T07:20:49.111 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:49.112 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:49.112 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:20:49.112 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:49.112 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:49.112 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 3.4 M 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 24 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 15 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout:Install 7 Packages 2024-04-27T07:20:49.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:49.114 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 3.7 M 2024-04-27T07:20:49.114 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 80 M 2024-04-27T07:20:49.114 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:49.458 INFO:teuthology.orchestra.run.smithi082.stdout:(1/7): ceph-grafana-dashboards-17.2.7-907.g2be3 132 kB/s | 24 kB 00:00 2024-04-27T07:20:49.474 INFO:teuthology.orchestra.run.smithi082.stdout:(2/7): ceph-prometheus-alerts-17.2.7-907.g2be3e 72 kB/s | 15 kB 00:00 2024-04-27T07:20:49.566 INFO:teuthology.orchestra.run.smithi082.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 83 kB/s | 9.0 kB 00:00 2024-04-27T07:20:49.608 INFO:teuthology.orchestra.run.smithi082.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 306 kB/s | 41 kB 00:00 2024-04-27T07:20:49.624 INFO:teuthology.orchestra.run.smithi100.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 161 kB/s | 125 kB 00:00 2024-04-27T07:20:49.650 INFO:teuthology.orchestra.run.smithi082.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 367 kB/s | 31 kB 00:00 2024-04-27T07:20:49.709 INFO:teuthology.orchestra.run.smithi082.stdout:(6/7): ceph-mgr-dashboard-17.2.7-907.g2be3efa9. 7.7 MB/s | 3.4 MB 00:00 2024-04-27T07:20:49.767 INFO:teuthology.orchestra.run.smithi082.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.2 MB/s | 188 kB 00:00 2024-04-27T07:20:49.769 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:49.770 INFO:teuthology.orchestra.run.smithi082.stdout:Total 5.6 MB/s | 3.7 MB 00:00 2024-04-27T07:20:49.770 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:49.777 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:49.778 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:49.838 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:49.838 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:49.841 INFO:teuthology.orchestra.run.smithi100.stdout:(11/33): python3-mako-1.1.4-6.el9.noarch.rpm 796 kB/s | 172 kB 00:00 2024-04-27T07:20:49.883 INFO:teuthology.orchestra.run.smithi100.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 245 kB/s | 215 kB 00:00 2024-04-27T07:20:49.925 INFO:teuthology.orchestra.run.smithi100.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2024-04-27T07:20:50.017 INFO:teuthology.orchestra.run.smithi100.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 541 kB/s | 1.2 MB 00:02 2024-04-27T07:20:50.042 INFO:teuthology.orchestra.run.smithi100.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 459 kB/s | 42 kB 00:00 2024-04-27T07:20:50.067 INFO:teuthology.orchestra.run.smithi100.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 277 kB/s | 51 kB 00:00 2024-04-27T07:20:50.137 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-27T07:20:50.243 INFO:teuthology.orchestra.run.smithi100.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 193 kB/s | 43 kB 00:00 2024-04-27T07:20:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-27T07:20:50.276 INFO:teuthology.orchestra.run.smithi100.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 322 kB/s | 11 kB 00:00 2024-04-27T07:20:50.291 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-27T07:20:50.310 INFO:teuthology.orchestra.run.smithi100.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 524 kB/s | 18 kB 00:00 2024-04-27T07:20:50.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-27T07:20:50.335 INFO:teuthology.orchestra.run.smithi100.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 586 kB/s | 172 kB 00:00 2024-04-27T07:20:50.352 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 5/7 2024-04-27T07:20:50.352 INFO:teuthology.orchestra.run.smithi100.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2024-04-27T07:20:50.369 INFO:teuthology.orchestra.run.smithi100.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-04-27T07:20:50.386 INFO:teuthology.orchestra.run.smithi100.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 586 kB/s | 20 kB 00:00 2024-04-27T07:20:50.420 INFO:teuthology.orchestra.run.smithi100.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-04-27T07:20:50.439 INFO:teuthology.orchestra.run.smithi100.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 684 kB/s | 46 kB 00:00 2024-04-27T07:20:50.479 INFO:teuthology.orchestra.run.smithi100.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 854 kB/s | 79 kB 00:00 2024-04-27T07:20:50.504 INFO:teuthology.orchestra.run.smithi100.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 253 kB/s | 16 kB 00:00 2024-04-27T07:20:50.538 INFO:teuthology.orchestra.run.smithi100.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-04-27T07:20:50.563 INFO:teuthology.orchestra.run.smithi100.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 609 kB/s | 36 kB 00:00 2024-04-27T07:20:50.597 INFO:teuthology.orchestra.run.smithi100.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-27T07:20:50.647 INFO:teuthology.orchestra.run.smithi100.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-04-27T07:20:50.689 INFO:teuthology.orchestra.run.smithi100.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-27T07:20:50.789 INFO:teuthology.orchestra.run.smithi100.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.8 MB/s | 427 kB 00:00 2024-04-27T07:20:50.796 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:50.796 INFO:teuthology.orchestra.run.smithi100.stdout:Total 5.3 MB/s | 27 MB 00:05 2024-04-27T07:20:50.912 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:20:50.950 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:20:50.950 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:20:51.217 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:20:51.218 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:20:51.354 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 6/7 2024-04-27T07:20:51.388 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-27T07:20:52.359 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:20:52.425 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-27T07:20:52.457 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-27T07:20:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 1/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 3/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-27T07:20:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-27T07:20:52.490 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-27T07:20:52.582 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-27T07:20:52.659 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-27T07:20:52.700 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-27T07:20:52.724 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-27T07:20:52.725 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-27T07:20:52.725 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:52.725 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:20:52.736 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-27T07:20:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-27T07:20:52.800 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-27T07:20:52.834 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-27T07:20:52.875 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-27T07:20:52.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-27T07:20:52.909 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-27T07:20:52.944 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-27T07:20:52.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-27T07:20:53.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-27T07:20:53.202 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-27T07:20:53.290 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-27T07:20:53.343 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-27T07:20:53.382 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-27T07:20:53.408 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:01 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:20:53.431 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-27T07:20:53.486 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-27T07:20:53.528 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 7.4 M 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-27T07:20:53.529 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-04-27T07:20:53.530 INFO:teuthology.orchestra.run.smithi082.stdout:Install 12 Packages 2024-04-27T07:20:53.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:20:53.531 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 38 M 2024-04-27T07:20:53.531 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 209 M 2024-04-27T07:20:53.531 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:20:53.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-27T07:20:53.719 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-27T07:20:53.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-27T07:20:53.875 INFO:teuthology.orchestra.run.smithi082.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-27T07:20:53.886 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-27T07:20:53.927 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-27T07:20:53.950 INFO:teuthology.orchestra.run.smithi082.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-27T07:20:53.985 INFO:teuthology.orchestra.run.smithi082.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-04-27T07:20:54.034 INFO:teuthology.orchestra.run.smithi082.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-04-27T07:20:54.042 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-27T07:20:54.084 INFO:teuthology.orchestra.run.smithi082.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 706 kB/s | 35 kB 00:00 2024-04-27T07:20:54.198 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 28/33 2024-04-27T07:20:54.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-27T07:20:54.253 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 29/33 2024-04-27T07:20:54.253 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:54.253 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-27T07:20:54.254 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-27T07:20:54.254 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-27T07:20:54.254 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:54.635 INFO:teuthology.orchestra.run.smithi082.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.4 MB/s | 3.0 MB 00:00 2024-04-27T07:20:54.727 INFO:teuthology.orchestra.run.smithi082.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-27T07:20:55.035 INFO:teuthology.orchestra.run.smithi082.stdout:(8/12): ceph-mgr-diskprediction-local-17.2.7-90 5.6 MB/s | 7.4 MB 00:01 2024-04-27T07:20:55.111 INFO:teuthology.orchestra.run.smithi082.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.6 MB/s | 4.7 MB 00:01 2024-04-27T07:20:55.252 INFO:teuthology.orchestra.run.smithi082.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.1 MB/s | 250 kB 00:00 2024-04-27T07:20:55.606 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-27T07:20:55.634 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 30/33 2024-04-27T07:20:55.635 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:55.635 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-27T07:20:55.635 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-27T07:20:55.635 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-27T07:20:55.635 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.3 MB/s | 5.1 MB 00:00 2024-04-27T07:20:56.015 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-27T07:20:56.039 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 31/33 2024-04-27T07:20:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-27T07:20:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-27T07:20:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-27T07:20:56.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:56.240 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-27T07:20:56.263 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 32/33 2024-04-27T07:20:56.263 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:20:56.263 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-27T07:20:56.264 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-27T07:20:56.264 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-27T07:20:56.264 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:56.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-27T07:20:57.319 INFO:teuthology.orchestra.run.smithi082.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-04-27T07:20:57.320 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:20:57.320 INFO:teuthology.orchestra.run.smithi082.stdout:Total 10 MB/s | 38 MB 00:03 2024-04-27T07:20:57.668 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:20:57.693 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:20:57.694 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:20:57.925 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 33/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 1/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 3/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 4/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 5/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.n 6/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-27T07:20:57.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-27T07:20:57.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-27T07:20:57.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-27T07:20:57.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-27T07:20:57.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-27T07:20:57.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-27T07:20:57.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-27T07:20:58.100 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:20:58.100 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:20:58.705 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-27T07:20:58.705 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-27T07:20:58.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-27T07:20:58.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:20:58.708 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:20:58.867 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:20:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-27T07:20:58.975 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-27T07:20:59.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-base 2024-04-27T07:20:59.066 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-27T07:20:59.110 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-27T07:20:59.287 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-27T07:20:59.317 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-27T07:20:59.394 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-27T07:20:59.544 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:52 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:20:59.623 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-base-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:20:59.663 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:20:59.664 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:20:59.664 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:20:59.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install cephadm 2024-04-27T07:21:00.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-27T07:21:00.156 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-27T07:21:00.240 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:53 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:00.358 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 82 k 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:00.359 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:00.360 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 82 k 2024-04-27T07:21:00.360 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 372 k 2024-04-27T07:21:00.360 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:00.748 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm-17.2.7-907.g2be3efa9.el9.noarch.rpm 211 kB/s | 82 kB 00:00 2024-04-27T07:21:00.749 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:00.749 INFO:teuthology.orchestra.run.smithi100.stdout:Total 210 kB/s | 82 kB 00:00 2024-04-27T07:21:00.749 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:00.754 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:00.754 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:00.756 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:00.757 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:00.822 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:01.280 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:21:01.375 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:21:01.397 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-27T07:21:01.678 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:21:01.909 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/1 2024-04-27T07:21:01.910 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:01.910 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:01.910 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:01.910 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:01.910 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:02.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-immutable-object-cache 2024-04-27T07:21:02.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-27T07:21:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-27T07:21:02.617 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:55 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 137 k 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 137 k 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 379 k 2024-04-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:03.379 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-immutable-object-cache-17.2.7-907.g2be3efa 215 kB/s | 137 kB 00:00 2024-04-27T07:21:03.381 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:03.381 INFO:teuthology.orchestra.run.smithi100.stdout:Total 214 kB/s | 137 kB 00:00 2024-04-27T07:21:03.381 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:03.388 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:03.388 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:03.449 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:03.449 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:03.601 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:03.690 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:21:03.713 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:21:03.713 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:21:03.713 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-27T07:21:03.714 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:04.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.e 1/1 2024-04-27T07:21:04.536 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:04.536 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:04.536 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:04.536 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:04.536 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:04.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 1/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-27T07:21:04.993 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-27T07:21:04.994 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-27T07:21:04.994 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-27T07:21:04.994 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-27T07:21:04.994 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-27T07:21:05.302 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:58 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:05.383 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-mgr-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:05.389 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-27T07:21:05.389 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:05.389 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:21:05.389 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-27T07:21:05.390 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-27T07:21:05.391 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-27T07:21:05.391 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-27T07:21:05.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:05.391 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:21:05.425 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:05.426 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:05.426 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:05.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-dashboard 2024-04-27T07:21:05.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-rook 2024-04-27T07:21:06.017 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:59 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:06.141 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:06.141 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 3.4 M 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 24 k 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 15 k 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-04-27T07:21:06.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-27T07:21:06.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:06.143 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:06.143 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:06.143 INFO:teuthology.orchestra.run.smithi100.stdout:Install 7 Packages 2024-04-27T07:21:06.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:06.146 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.7 M 2024-04-27T07:21:06.146 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 80 M 2024-04-27T07:21:06.146 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:06.231 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:14 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:21:06.354 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 47 k 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-27T07:21:06.355 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:06.356 INFO:teuthology.orchestra.run.smithi082.stdout:Install 13 Packages 2024-04-27T07:21:06.357 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:06.357 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.2 M 2024-04-27T07:21:06.357 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 26 M 2024-04-27T07:21:06.357 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:21:06.792 INFO:teuthology.orchestra.run.smithi100.stdout:(1/7): ceph-prometheus-alerts-17.2.7-907.g2be3e 68 kB/s | 15 kB 00:00 2024-04-27T07:21:06.817 INFO:teuthology.orchestra.run.smithi100.stdout:(2/7): ceph-grafana-dashboards-17.2.7-907.g2be3 102 kB/s | 24 kB 00:00 2024-04-27T07:21:06.925 INFO:teuthology.orchestra.run.smithi082.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 188 kB/s | 19 kB 00:00 2024-04-27T07:21:06.950 INFO:teuthology.orchestra.run.smithi082.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 202 kB/s | 26 kB 00:00 2024-04-27T07:21:07.026 INFO:teuthology.orchestra.run.smithi100.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 39 kB/s | 9.0 kB 00:00 2024-04-27T07:21:07.067 INFO:teuthology.orchestra.run.smithi082.stdout:(3/13): ceph-mgr-rook-17.2.7-907.g2be3efa9.el9. 194 kB/s | 47 kB 00:00 2024-04-27T07:21:07.168 INFO:teuthology.orchestra.run.smithi082.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 928 kB/s | 222 kB 00:00 2024-04-27T07:21:07.193 INFO:teuthology.orchestra.run.smithi082.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 655 kB/s | 159 kB 00:00 2024-04-27T07:21:07.193 INFO:teuthology.orchestra.run.smithi100.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 184 kB/s | 31 kB 00:00 2024-04-27T07:21:07.260 INFO:teuthology.orchestra.run.smithi082.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 583 kB/s | 54 kB 00:00 2024-04-27T07:21:07.468 INFO:teuthology.orchestra.run.smithi100.stdout:(5/7): python3-routes-2.5.1-5.el9.noarch.rpm 685 kB/s | 188 kB 00:00 2024-04-27T07:21:07.527 INFO:teuthology.orchestra.run.smithi100.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 58 kB/s | 41 kB 00:00 2024-04-27T07:21:07.585 INFO:teuthology.orchestra.run.smithi082.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 46 kB/s | 15 kB 00:00 2024-04-27T07:21:07.602 INFO:teuthology.orchestra.run.smithi100.stdout:(7/7): ceph-mgr-dashboard-17.2.7-907.g2be3efa9. 3.3 MB/s | 3.4 MB 00:01 2024-04-27T07:21:07.605 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:07.606 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.5 MB/s | 3.7 MB 00:01 2024-04-27T07:21:07.606 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:07.610 INFO:teuthology.orchestra.run.smithi082.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 77 kB/s | 32 kB 00:00 2024-04-27T07:21:07.614 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:07.614 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:07.675 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:07.677 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:07.971 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:07.994 INFO:teuthology.orchestra.run.smithi082.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 301 kB/s | 279 kB 00:00 2024-04-27T07:21:08.028 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-27T07:21:08.052 INFO:teuthology.orchestra.run.smithi082.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 440 kB/s | 206 kB 00:00 2024-04-27T07:21:08.062 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-27T07:21:08.109 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-27T07:21:08.149 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-27T07:21:08.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 5/7 2024-04-27T07:21:08.311 INFO:teuthology.orchestra.run.smithi082.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 1.5 MB/s | 1.0 MB 00:00 2024-04-27T07:21:08.370 INFO:teuthology.orchestra.run.smithi082.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 283 kB/s | 90 kB 00:00 2024-04-27T07:21:08.462 INFO:teuthology.orchestra.run.smithi082.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 126 kB/s | 59 kB 00:00 2024-04-27T07:21:08.462 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:08.462 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-04-27T07:21:08.529 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:21:08.544 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:21:08.545 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:21:08.629 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:21:08.630 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:21:09.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 6/7 2024-04-27T07:21:09.215 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-27T07:21:09.216 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:21:09.378 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-27T07:21:09.430 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-27T07:21:09.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-27T07:21:09.531 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-27T07:21:09.572 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-27T07:21:09.667 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-27T07:21:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-27T07:21:09.823 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 7/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.n 1/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.no 3/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-27T07:21:10.317 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-27T07:21:10.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-27T07:21:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-27T07:21:10.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:10.575 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:10.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-27T07:21:10.630 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-27T07:21:10.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-27T07:21:10.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-27T07:21:10.791 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-27T07:21:11.302 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:04 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-27T07:21:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 1/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-27T07:21:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-27T07:21:11.423 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 7.4 M 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:21:11.424 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-04-27T07:21:11.425 INFO:teuthology.orchestra.run.smithi100.stdout:Install 12 Packages 2024-04-27T07:21:11.426 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:11.426 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 38 M 2024-04-27T07:21:11.426 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 209 M 2024-04-27T07:21:11.426 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-27T07:21:11.730 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:11.731 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:21:11.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-cephadm 2024-04-27T07:21:12.473 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:20 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:21:12.593 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:21:12.593 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 123 k 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:21:12.594 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:21:12.595 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2024-04-27T07:21:12.595 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:21:12.595 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 7.0 M 2024-04-27T07:21:12.595 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 33 M 2024-04-27T07:21:12.595 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:21:13.114 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): ceph-mgr-cephadm-17.2.7-907.g2be3efa9.el 387 kB/s | 123 kB 00:00 2024-04-27T07:21:13.372 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.1 MB/s | 548 kB 00:00 2024-04-27T07:21:13.423 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-04-27T07:21:13.465 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 370 kB/s | 248 kB 00:00 2024-04-27T07:21:13.490 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 762 kB/s | 51 kB 00:00 2024-04-27T07:21:13.977 INFO:teuthology.orchestra.run.smithi100.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-90 7.9 MB/s | 7.4 MB 00:00 2024-04-27T07:21:14.002 INFO:teuthology.orchestra.run.smithi100.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 203 kB/s | 195 kB 00:00 2024-04-27T07:21:14.069 INFO:teuthology.orchestra.run.smithi100.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-04-27T07:21:14.119 INFO:teuthology.orchestra.run.smithi100.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 366 kB/s | 18 kB 00:00 2024-04-27T07:21:14.169 INFO:teuthology.orchestra.run.smithi100.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-04-27T07:21:14.328 INFO:teuthology.orchestra.run.smithi100.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.2 MB/s | 3.0 MB 00:00 2024-04-27T07:21:14.378 INFO:teuthology.orchestra.run.smithi100.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-27T07:21:14.445 INFO:teuthology.orchestra.run.smithi100.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2024-04-27T07:21:14.504 INFO:teuthology.orchestra.run.smithi100.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-04-27T07:21:14.571 INFO:teuthology.orchestra.run.smithi100.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-04-27T07:21:14.721 INFO:teuthology.orchestra.run.smithi100.stdout:(11/12): libgfortran-11.4.1-3.el9.x86_64.rpm 477 kB/s | 803 kB 00:01 2024-04-27T07:21:14.938 INFO:teuthology.orchestra.run.smithi100.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-27T07:21:14.939 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:14.939 INFO:teuthology.orchestra.run.smithi100.stdout:Total 11 MB/s | 38 MB 00:03 2024-04-27T07:21:15.287 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:15.315 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:15.315 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:15.719 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:15.719 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:16.467 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:16.525 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-27T07:21:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-27T07:21:16.670 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-27T07:21:16.704 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-27T07:21:16.881 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-27T07:21:16.911 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-27T07:21:16.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-27T07:21:17.639 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-27T07:21:17.750 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-27T07:21:18.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-27T07:21:20.013 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-27T07:21:20.044 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 12/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3ef 1/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-27T07:21:22.682 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-27T07:21:22.683 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-27T07:21:23.090 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-27T07:21:23.090 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:23.090 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-27T07:21:23.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-27T07:21:23.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-27T07:21:23.092 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:23.092 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:23.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-rook 2024-04-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:16 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:24.079 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:24.080 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:24.080 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 47 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-27T07:21:24.081 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2024-04-27T07:21:24.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:24.083 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.2 M 2024-04-27T07:21:24.083 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 26 M 2024-04-27T07:21:24.083 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:24.420 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 191 kB/s | 26 kB 00:00 2024-04-27T07:21:24.445 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 120 kB/s | 19 kB 00:00 2024-04-27T07:21:24.470 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): ceph-mgr-rook-17.2.7-907.g2be3efa9.el9. 257 kB/s | 47 kB 00:00 2024-04-27T07:21:24.554 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-27T07:21:24.579 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-27T07:21:24.613 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-04-27T07:21:24.713 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-04-27T07:21:24.755 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 183 kB/s | 32 kB 00:00 2024-04-27T07:21:24.780 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 90 kB/s | 15 kB 00:00 2024-04-27T07:21:24.822 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.9 MB/s | 206 kB 00:00 2024-04-27T07:21:24.905 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-04-27T07:21:24.931 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2024-04-27T07:21:24.956 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 673 kB/s | 90 kB 00:00 2024-04-27T07:21:24.959 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:24.959 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-04-27T07:21:25.021 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:25.036 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:25.036 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:25.121 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:25.121 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:25.706 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:25.882 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-27T07:21:25.950 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-27T07:21:26.005 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-27T07:21:26.043 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-27T07:21:26.084 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-27T07:21:26.186 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-27T07:21:26.304 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-27T07:21:26.352 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-27T07:21:27.078 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-27T07:21:27.133 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-27T07:21:27.167 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-27T07:21:27.213 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-27T07:21:27.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 13/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 1/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-27T07:21:28.031 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-27T07:21:28.032 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-27T07:21:28.330 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:28.331 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:28.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-cephadm 2024-04-27T07:21:29.063 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:22 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:29.183 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:17.2.7-907.g2be3efa9.el9 ceph-noarch 123 k 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-27T07:21:29.184 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:29.185 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:29.185 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:29.185 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2024-04-27T07:21:29.185 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:29.186 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 7.0 M 2024-04-27T07:21:29.186 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 33 M 2024-04-27T07:21:29.186 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:29.826 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 876 kB/s | 248 kB 00:00 2024-04-27T07:21:29.976 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-04-27T07:21:29.993 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): ceph-mgr-cephadm-17.2.7-907.g2be3efa9.el 274 kB/s | 123 kB 00:00 2024-04-27T07:21:30.085 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 556 kB/s | 51 kB 00:00 2024-04-27T07:21:30.185 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.5 MB/s | 548 kB 00:00 2024-04-27T07:21:30.210 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 247 kB/s | 58 kB 00:00 2024-04-27T07:21:30.213 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:30.213 INFO:teuthology.orchestra.run.smithi100.stdout:Total 6.8 MB/s | 7.0 MB 00:01 2024-04-27T07:21:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:30.390 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:30.390 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:30.688 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:30.868 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-27T07:21:30.920 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-27T07:21:31.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-27T07:21:31.543 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-27T07:21:31.603 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-27T07:21:31.633 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-27T07:21:32.393 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-27T07:21:32.393 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/6 2024-04-27T07:21:32.393 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-27T07:21:32.393 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-27T07:21:32.394 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-27T07:21:32.394 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-27T07:21:32.629 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-27T07:21:32.629 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:32.629 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:32.629 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:32.630 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:32.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-fuse 2024-04-27T07:21:33.372 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:26 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:33.490 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 812 k 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:33.491 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout:Install 2 Packages 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 893 k 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 2.6 M 2024-04-27T07:21:33.492 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:33.896 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 644 kB/s | 80 kB 00:00 2024-04-27T07:21:34.213 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): ceph-fuse-17.2.7-907.g2be3efa9.el9.x86_6 1.8 MB/s | 812 kB 00:00 2024-04-27T07:21:34.213 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:34.213 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.2 MB/s | 893 kB 00:00 2024-04-27T07:21:34.225 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:34.246 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:34.247 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:34.323 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:34.323 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:34.642 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-27T07:21:34.702 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-27T07:21:35.307 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-27T07:21:35.307 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/2 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:35.539 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:35.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados-devel 2024-04-27T07:21:36.315 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:29 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:36.436 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 126 k 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:36.437 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:36.438 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 126 k 2024-04-27T07:21:36.438 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 448 k 2024-04-27T07:21:36.438 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:36.645 INFO:teuthology.orchestra.run.smithi100.stdout:librados-devel-17.2.7-907.g2be3efa9.el9.x86_64. 610 kB/s | 126 kB 00:00 2024-04-27T07:21:36.645 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:36.646 INFO:teuthology.orchestra.run.smithi100.stdout:Total 606 kB/s | 126 kB 00:00 2024-04-27T07:21:36.646 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:36.651 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:36.651 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:36.713 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:36.713 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:36.866 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:36.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:37.385 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:37.646 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:37.647 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:37.647 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:37.647 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:37.647 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:37.647 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:37.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs2 2024-04-27T07:21:38.384 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:31 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:38.462 INFO:teuthology.orchestra.run.smithi100.stdout:Package libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:38.503 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:38.504 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:38.505 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:38.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs-devel 2024-04-27T07:21:39.106 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:32 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:39.226 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:39.227 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:39.228 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:39.228 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 25 k 2024-04-27T07:21:39.228 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 110 k 2024-04-27T07:21:39.228 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:39.407 INFO:teuthology.orchestra.run.smithi100.stdout:libcephfs-devel-17.2.7-907.g2be3efa9.el9.x86_64 140 kB/s | 25 kB 00:00 2024-04-27T07:21:39.407 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:39.408 INFO:teuthology.orchestra.run.smithi100.stdout:Total 138 kB/s | 25 kB 00:00 2024-04-27T07:21:39.408 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:39.411 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:39.411 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:39.413 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:39.413 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:39.496 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:39.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:39.954 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:40.152 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:40.154 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:40.154 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:40.154 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:40.154 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:40.155 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:40.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados2 2024-04-27T07:21:40.822 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:33 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:40.900 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:40.941 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:40.942 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:40.942 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:41.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librbd1 2024-04-27T07:21:41.511 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:34 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:41.590 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:41.630 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:41.631 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:41.631 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:41.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rados 2024-04-27T07:21:42.196 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:35 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:42.273 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:42.315 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:42.316 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:42.378 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rgw 2024-04-27T07:21:42.884 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:35 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:42.962 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:43.004 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:43.005 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:43.005 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:43.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-cephfs 2024-04-27T07:21:43.576 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:36 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:43.655 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:43.695 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:43.696 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:43.696 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:43.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rbd 2024-04-27T07:21:44.261 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:37 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:44.339 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:21:44.381 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:44.382 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-04-27T07:21:44.382 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:44.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-fuse 2024-04-27T07:21:44.948 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:37 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-27T07:21:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:45.070 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 82 k 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 82 k 2024-04-27T07:21:45.071 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 222 k 2024-04-27T07:21:45.072 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:45.276 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-fuse-17.2.7-907.g2be3efa9.el9.x86_64.rpm 395 kB/s | 82 kB 00:00 2024-04-27T07:21:45.277 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:45.277 INFO:teuthology.orchestra.run.smithi100.stdout:Total 392 kB/s | 82 kB 00:00 2024-04-27T07:21:45.278 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:45.284 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:45.284 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:45.345 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:45.346 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:45.493 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:45.596 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:45.934 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:46.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:46.187 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:46.187 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:46.187 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:46.187 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:46.187 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:46.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-mirror 2024-04-27T07:21:46.935 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:39 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:47.058 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:47.058 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.9 M 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 12 M 2024-04-27T07:21:47.059 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:48.337 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-mirror-17.2.7-907.g2be3efa9.el9.x86_64.rpm 2.3 MB/s | 2.9 MB 00:01 2024-04-27T07:21:48.338 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:48.338 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.3 MB/s | 2.9 MB 00:01 2024-04-27T07:21:48.339 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:48.349 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:48.349 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:48.433 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:48.434 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:48.851 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:48.913 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:48.936 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:48.936 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:21:48.936 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-27T07:21:48.936 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-27T07:21:48.937 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-27T07:21:48.937 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:49.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:49.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:49.868 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:49.868 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:49.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:49.868 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:50.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-nbd 2024-04-27T07:21:50.613 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:43 ago on Sat 27 Apr 2024 07:20:07 AM UTC. 2024-04-27T07:21:50.736 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 165 k 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-04-27T07:21:50.737 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:50.738 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 165 k 2024-04-27T07:21:50.738 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 477 k 2024-04-27T07:21:50.738 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-27T07:21:51.274 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-nbd-17.2.7-907.g2be3efa9.el9.x86_64.rpm 308 kB/s | 165 kB 00:00 2024-04-27T07:21:51.275 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:21:51.275 INFO:teuthology.orchestra.run.smithi100.stdout:Total 307 kB/s | 165 kB 00:00 2024-04-27T07:21:51.275 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-27T07:21:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-27T07:21:51.283 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-27T07:21:51.346 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-27T07:21:51.346 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-27T07:21:51.512 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-27T07:21:51.619 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:52.007 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:52.226 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:21:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-27T07:21:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:21:52.227 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:21:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-27T07:21:52.463 DEBUG:teuthology.parallel:result is None 2024-04-27T07:22:13.087 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 101 kB/s | 6.0 MB 01:00 2024-04-27T07:22:13.087 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:13.088 INFO:teuthology.orchestra.run.smithi082.stdout:Total 118 kB/s | 7.0 MB 01:00 2024-04-27T07:22:13.159 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:13.172 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:13.172 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:13.267 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:13.267 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:13.566 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-27T07:22:13.796 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-27T07:22:14.321 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-27T07:22:14.415 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-27T07:22:14.470 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-27T07:22:14.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-27T07:22:15.216 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 6/6 2024-04-27T07:22:15.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 1/6 2024-04-27T07:22:15.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-27T07:22:15.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-27T07:22:15.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-27T07:22:15.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-27T07:22:15.481 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-27T07:22:15.481 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:15.481 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:15.481 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:17.2.7-907.g2be3efa9.el9.noarch 2024-04-27T07:22:15.481 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:15.482 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:15.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-fuse 2024-04-27T07:22:16.229 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:24 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:16.349 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:16.349 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:16.349 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-27T07:22:16.349 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 812 k 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout:Install 2 Packages 2024-04-27T07:22:16.350 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:16.351 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 893 k 2024-04-27T07:22:16.351 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 2.6 M 2024-04-27T07:22:16.351 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:16.881 INFO:teuthology.orchestra.run.smithi082.stdout:(1/2): ceph-fuse-17.2.7-907.g2be3efa9.el9.x86_6 1.7 MB/s | 812 kB 00:00 2024-04-27T07:22:17.106 INFO:teuthology.orchestra.run.smithi082.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 116 kB/s | 80 kB 00:00 2024-04-27T07:22:17.107 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:17.107 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.2 MB/s | 893 kB 00:00 2024-04-27T07:22:17.118 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:17.142 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:17.142 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:17.219 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:17.219 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:17.452 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:17.578 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-27T07:22:17.638 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-27T07:22:18.258 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2/2 2024-04-27T07:22:18.258 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/2 2024-04-27T07:22:18.521 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-27T07:22:18.522 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:18.522 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:18.522 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-27T07:22:18.522 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:18.522 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:18.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados-devel 2024-04-27T07:22:19.271 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:27 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:19.391 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:19.391 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 126 k 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 126 k 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 448 k 2024-04-27T07:22:19.392 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:19.736 INFO:teuthology.orchestra.run.smithi082.stdout:librados-devel-17.2.7-907.g2be3efa9.el9.x86_64. 368 kB/s | 126 kB 00:00 2024-04-27T07:22:19.736 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:19.737 INFO:teuthology.orchestra.run.smithi082.stdout:Total 366 kB/s | 126 kB 00:00 2024-04-27T07:22:19.737 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:19.743 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:19.743 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:19.808 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:19.808 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:19.960 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:20.081 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:20.433 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:20.694 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:20.695 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:20.695 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:20.695 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:22:20.695 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:20.695 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:20.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs2 2024-04-27T07:22:21.442 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:29 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:21.520 INFO:teuthology.orchestra.run.smithi082.stdout:Package libcephfs2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:21.561 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:21.562 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:21.562 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:21.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs-devel 2024-04-27T07:22:22.136 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:30 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:22.254 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:22.255 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:22.255 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 25 k 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 25 k 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 110 k 2024-04-27T07:22:22.256 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:22.430 INFO:teuthology.orchestra.run.smithi082.stdout:libcephfs-devel-17.2.7-907.g2be3efa9.el9.x86_64 143 kB/s | 25 kB 00:00 2024-04-27T07:22:22.431 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:22.431 INFO:teuthology.orchestra.run.smithi082.stdout:Total 142 kB/s | 25 kB 00:00 2024-04-27T07:22:22.431 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:22.435 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:22.435 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:22.436 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:22.436 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:22.523 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:22.960 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:23.168 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:23.168 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:23.168 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:23.169 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:22:23.169 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:23.169 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:23.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados2 2024-04-27T07:22:23.848 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:31 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:23.925 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:24.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librbd1 2024-04-27T07:22:24.523 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:32 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:24.600 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:24.640 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:24.641 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:24.642 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:24.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rados 2024-04-27T07:22:25.204 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:33 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:25.284 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rados-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:25.324 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:25.325 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:25.325 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:25.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rgw 2024-04-27T07:22:25.901 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:33 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:25.979 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rgw-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:26.020 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:26.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-cephfs 2024-04-27T07:22:26.592 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:34 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:26.670 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-cephfs-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:26.711 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:26.712 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:26.712 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:26.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rbd 2024-04-27T07:22:27.288 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:35 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:27.366 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rbd-2:17.2.7-907.g2be3efa9.el9.x86_64 is already installed. 2024-04-27T07:22:27.407 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:27.408 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-04-27T07:22:27.408 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:27.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-fuse 2024-04-27T07:22:27.974 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:35 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:28.091 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:28.092 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:28.092 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-04-27T07:22:28.092 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 82 k 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 82 k 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 222 k 2024-04-27T07:22:28.093 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:28.408 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-fuse-17.2.7-907.g2be3efa9.el9.x86_64.rpm 260 kB/s | 82 kB 00:00 2024-04-27T07:22:28.409 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:28.409 INFO:teuthology.orchestra.run.smithi082.stdout:Total 259 kB/s | 82 kB 00:00 2024-04-27T07:22:28.409 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:28.415 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:28.415 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:28.478 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:28.478 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:28.619 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:28.711 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:29.047 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:29.261 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:29.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:29.262 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:29.262 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:22:29.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:29.262 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:29.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-mirror 2024-04-27T07:22:30.013 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:38 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:30.134 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:30.135 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:30.135 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-04-27T07:22:30.135 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:30.135 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:30.135 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 2.9 M 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.9 M 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 12 M 2024-04-27T07:22:30.136 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:30.494 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-mirror-17.2.7-907.g2be3efa9.el9.x86_64.rpm 8.2 MB/s | 2.9 MB 00:00 2024-04-27T07:22:30.494 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:30.495 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.2 MB/s | 2.9 MB 00:00 2024-04-27T07:22:30.495 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:30.504 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:30.504 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:30.584 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:30.584 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:30.988 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:31.053 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:31.077 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:31.077 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-27T07:22:31.078 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-27T07:22:31.078 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-27T07:22:31.078 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-27T07:22:31.078 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:32.109 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:32.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:32.109 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:32.109 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:22:32.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:32.110 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:32.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-nbd 2024-04-27T07:22:32.894 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:40 ago on Sat 27 Apr 2024 07:19:52 AM UTC. 2024-04-27T07:22:33.019 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-27T07:22:33.020 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:33.020 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-04-27T07:22:33.020 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:33.020 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-27T07:22:33.020 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:17.2.7-907.g2be3efa9.el9 ceph 165 k 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 165 k 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 477 k 2024-04-27T07:22:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-27T07:22:33.372 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-nbd-17.2.7-907.g2be3efa9.el9.x86_64.rpm 471 kB/s | 165 kB 00:00 2024-04-27T07:22:33.373 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:22:33.373 INFO:teuthology.orchestra.run.smithi082.stdout:Total 469 kB/s | 165 kB 00:00 2024-04-27T07:22:33.373 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-27T07:22:33.381 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-27T07:22:33.381 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-27T07:22:33.442 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-27T07:22:33.443 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-27T07:22:33.595 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-27T07:22:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:34.094 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 1/1 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:17.2.7-907.g2be3efa9.el9.x86_64 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:22:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-27T07:22:34.609 DEBUG:teuthology.parallel:result is None 2024-04-27T07:22:34.610 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:22:34.611 INFO:teuthology.packaging:ref: None 2024-04-27T07:22:34.611 INFO:teuthology.packaging:tag: None 2024-04-27T07:22:34.611 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:22:34.611 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:22:34.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-27T07:22:34.851 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-27T07:22:34.872 INFO:teuthology.orchestra.run.smithi082.stdout:17.2.7-907.g2be3efa9.el9 2024-04-27T07:22:34.873 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-907.g2be3efa9.el9 2024-04-27T07:22:34.873 INFO:teuthology.task.install:The correct ceph version 17.2.7-907.g2be3efa9 is installed. 2024-04-27T07:22:34.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-27T07:22:34.875 INFO:teuthology.packaging:ref: None 2024-04-27T07:22:34.875 INFO:teuthology.packaging:tag: None 2024-04-27T07:22:34.875 INFO:teuthology.packaging:branch: quincy 2024-04-27T07:22:34.875 INFO:teuthology.packaging:sha1: c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:22:34.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-27T07:22:35.105 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-27T07:22:35.130 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.7-907.g2be3efa9.el9 2024-04-27T07:22:35.131 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-907.g2be3efa9.el9 2024-04-27T07:22:35.131 INFO:teuthology.task.install:The correct ceph version 17.2.7-907.g2be3efa9 is installed. 2024-04-27T07:22:35.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-27T07:22:35.133 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:22:35.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-27T07:22:35.158 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:22:35.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-27T07:22:35.198 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-27T07:22:35.199 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:22:35.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-27T07:22:35.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-27T07:22:35.303 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:22:35.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-04-27T07:22:35.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-27T07:22:35.395 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-27T07:22:35.396 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:22:35.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-27T07:22:35.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-27T07:22:35.485 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:22:35.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-27T07:22:35.511 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-27T07:22:35.576 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-27T07:22:35.577 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:22:35.577 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-27T07:22:35.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-27T07:22:35.666 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:22:35.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-04-27T07:22:35.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-27T07:22:35.752 INFO:teuthology.run_tasks:Running task print... 2024-04-27T07:22:35.761 INFO:teuthology.task.print:**** done install task... 2024-04-27T07:22:35.761 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-27T07:22:35.897 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f'} 2024-04-27T07:22:35.897 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-27T07:22:35.898 INFO:tasks.cephadm:Cluster fsid is ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:22:35.898 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-27T07:22:35.898 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-27T07:22:35.898 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi082': '172.21.15.82', 'mon.smithi100': '172.21.15.100'} 2024-04-27T07:22:35.898 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-27T07:22:35.899 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-04-27T07:22:35.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-04-27T07:22:35.949 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-27T07:22:35.949 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.173 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 27 07:22 /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.173 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.382 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 27 07:22 /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.383 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.399 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-27T07:22:36.423 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-27T07:22:36.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-27T07:22:36.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-27T07:22:37.955 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-27T07:22:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-27T07:23:09.997 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-27T07:23:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-27T07:23:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13", 2024-04-27T07:23:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-04-27T07:23:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9" 2024-04-27T07:23:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-04-27T07:23:09.998 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13", 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9" 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-27T07:23:15.964 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:23:15.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-04-27T07:23:16.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-04-27T07:23:16.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-04-27T07:23:16.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-04-27T07:23:16.143 INFO:tasks.cephadm:Writing seed config... 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-27T07:23:16.145 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-27T07:23:16.146 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-27T07:23:16.147 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-27T07:23:16.148 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:23:16.148 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-27T07:23:16.163 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ebadc0d6-0466-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-27T07:23:16.164 DEBUG:teuthology.orchestra.run.smithi082:mon.smithi082> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service 2024-04-27T07:23:16.206 INFO:tasks.cephadm:Bootstrapping... 2024-04-27T07:23:16.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:23:16.406 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-27T07:23:16.407 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'ebadc0d6-0466-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-04-27T07:23:16.432 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-27T07:23:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-27T07:23:16.433 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-04-27T07:23:16.456 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-27T07:23:16.456 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-04-27T07:23:16.456 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-04-27T07:23:16.463 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-27T07:23:16.464 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-27T07:23:16.470 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-27T07:23:16.470 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:23:16.476 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-04-27T07:23:16.483 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-04-27T07:23:16.483 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-04-27T07:23:16.483 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-04-27T07:23:16.506 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-27T07:23:16.507 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-27T07:23:16.507 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-04-27T07:23:16.507 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-04-27T07:23:16.513 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-27T07:23:16.513 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-27T07:23:16.519 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-27T07:23:16.519 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:23:16.526 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 140626291508560 on /run/cephadm/ebadc0d6-0466-11ef-bc93-c7b262605968.lock 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 140626291508560 acquired on /run/cephadm/ebadc0d6-0466-11ef-bc93-c7b262605968.lock 2024-04-27T07:23:16.533 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-04-27T07:23:16.534 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-04-27T07:23:16.534 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-04-27T07:23:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-04-27T07:23:16.537 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-04-27T07:23:16.540 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-27T07:23:16.540 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-27T07:23:16.540 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::1d72:cfdc:ebc9:3cad/64 scope link noprefixroute 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-04-27T07:23:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-27T07:23:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-27T07:23:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:4bba5d13506b552b86ba49891516dd450cd5841e76166fa879451331012cf28e 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 2024-04-27T07:23:18.215 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-27T07:23:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable) 2024-04-27T07:23:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable) 2024-04-27T07:23:19.180 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-04-27T07:23:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-04-27T07:23:20.172 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-04-27T07:23:21.178 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDopyxmJmFmGxAAc56hL0+UcRV0w5bwqxAJ/w== 2024-04-27T07:23:22.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDppyxm9W7XGhAAa557jIRiAlmsk1MkBYWqMQ== 2024-04-27T07:23:22.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDqpyxmNA3DFRAAHu1f2WF7T6j2PIkAfjGp/Q== 2024-04-27T07:23:22.971 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for smithi082 [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-27T07:23:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = octopus 2024-04-27T07:23:23.906 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:23.906 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-27T07:23:23.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:23:23.906 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-04-27T07:23:24.829 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.smithi082 on 2024-04-27T07:23:25.049 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-27T07:23:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-27T07:23:25.372 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target. 2024-04-27T07:23:25.372 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target. 2024-04-27T07:23:25.535 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082 2024-04-27T07:23:25.535 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service: Unit ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service not loaded. 2024-04-27T07:23:25.691 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target.wants/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service → /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@.service. 2024-04-27T07:23:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:25 smithi082 podman[26224]: 2024-04-27 07:23:25.830124492 +0000 UTC m=+0.018314399 image pull 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-27T07:23:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:26 smithi082 podman[26224]: 2024-04-27 07:23:26.906819413 +0000 UTC m=+1.095009292 container create 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=quincy-2be3efa, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-27T07:23:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:28 smithi082 podman[26224]: 2024-04-27 07:23:28.698903192 +0000 UTC m=+2.887093071 container init 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=quincy-2be3efa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-27T07:23:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:28 smithi082 podman[26224]: 2024-04-27 07:23:28.702725387 +0000 UTC m=+2.890915267 container start 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-27T07:23:29.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:28 smithi082 ceph-mon[26243]: mkfs ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:29.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:28 smithi082 ceph-mon[26243]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-04-27T07:23:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-27T07:23:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-27T07:23:29.739 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-27T07:23:29.739 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:23:29.739 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-27T07:23:29.739 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-04-27T07:23:29.740 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-04-27T07:23:29.740 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-04-27T07:23:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 bash[26224]: 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 2024-04-27T07:23:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 systemd[1]: Started Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:23:30.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 ceph-mon[26243]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-04-27T07:23:30.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 ceph-mon[26243]: monmap e1: 1 mons at {smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-27T07:23:30.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 ceph-mon[26243]: fsmap 2024-04-27T07:23:30.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 ceph-mon[26243]: osdmap e1: 0 total, 0 up, 0 in 2024-04-27T07:23:30.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:29 smithi082 ceph-mon[26243]: mgrmap e1: no daemons active 2024-04-27T07:23:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:32 smithi082 ceph-mon[26243]: from='client.? 172.21.15.82:0/3988305307' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-27T07:23:38.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi082 (age 3s) 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-27T07:23:38.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.360+0000 7fb7dbf54700 1 Processor -- start 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.360+0000 7fb7dbf54700 1 -- start start 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.360+0000 7fb7dbf54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.360+0000 7fb7dbf54700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4105a00 con 0x7fb7d4076c00 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d9cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d9cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52116/0 (socket says 172.21.15.82:52116) 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d9cf0700 1 -- 172.21.15.82:0/1624031955 learned_addr learned my addr 172.21.15.82:0/1624031955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d9cf0700 1 -- 172.21.15.82:0/1624031955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4105b40 con 0x7fb7d4076c00 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d9cf0700 1 --2- 172.21.15.82:0/1624031955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00098e0 tx=0x7fb7d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fa908d286843b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d8cee700 1 -- 172.21.15.82:0/1624031955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d000b860 con 0x7fb7d4076c00 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d8cee700 1 -- 172.21.15.82:0/1624031955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000b9c0 con 0x7fb7d4076c00 2024-04-27T07:23:38.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.361+0000 7fb7d8cee700 1 -- 172.21.15.82:0/1624031955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d000bc90 con 0x7fb7d4076c00 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 -- 172.21.15.82:0/1624031955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 msgr2=0x7fb7d41054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 --2- 172.21.15.82:0/1624031955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00098e0 tx=0x7fb7d0009250 comp rx=0 tx=0).stop 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 -- 172.21.15.82:0/1624031955 shutdown_connections 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 --2- 172.21.15.82:0/1624031955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d41054c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 -- 172.21.15.82:0/1624031955 >> 172.21.15.82:0/1624031955 conn(0x7fb7d40fcf50 msgr2=0x7fb7d40ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 -- 172.21.15.82:0/1624031955 shutdown_connections 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.362+0000 7fb7dbf54700 1 -- 172.21.15.82:0/1624031955 wait complete. 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 Processor -- start 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 -- start start 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4103350 con 0x7fb7d4076c00 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7d9cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7d9cf0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52124/0 (socket says 172.21.15.82:52124) 2024-04-27T07:23:38.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7d9cf0700 1 -- 172.21.15.82:0/3988305307 learned_addr learned my addr 172.21.15.82:0/3988305307 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7d9cf0700 1 -- 172.21.15.82:0/3988305307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00094f0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7d9cf0700 1 --2- 172.21.15.82:0/3988305307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009290 tx=0x7fb7d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d001c5c0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d001c740 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d41013c0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d001ca50 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.363+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d41018b0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.364+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb7d001cbb0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.364+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb7d001ac30 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.364+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d404bed0 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.367+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fb7d002e440 con 0x7fb7d4076c00 2024-04-27T07:23:38.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.436+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb7d410a6a0 con 0x7fb7d4076c00 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.437+0000 7fb7ca7fc700 1 -- 172.21.15.82:0/3988305307 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+318 (secure 0 0 0) 0x7fb7d002e5e0 con 0x7fb7d4076c00 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 msgr2=0x7fb7d4102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 --2- 172.21.15.82:0/3988305307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009290 tx=0x7fb7d0016000 comp rx=0 tx=0).stop 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 shutdown_connections 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 --2- 172.21.15.82:0/3988305307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d4076c00 0x7fb7d4102e10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 >> 172.21.15.82:0/3988305307 conn(0x7fb7d40fcf50 msgr2=0x7fb7d40ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 shutdown_connections 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:32.438+0000 7fb7dbf54700 1 -- 172.21.15.82:0/3988305307 wait complete. 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-04-27T07:23:38.475 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-04-27T07:23:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:39 smithi082 ceph-mon[26243]: from='client.? 172.21.15.82:0/4229838779' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-27T07:23:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:39 smithi082 ceph-mon[26243]: from='client.? 172.21.15.82:0/4229838779' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-27T07:23:39.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-27T07:23:39.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963cc4b700 1 Processor -- start 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963cc4b700 1 -- start start 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963cc4b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963cc4b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96381031d0 con 0x7f9638102880 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59812/0 (socket says 172.21.15.82:59812) 2024-04-27T07:23:39.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963659c700 1 -- 172.21.15.82:0/1439470162 learned_addr learned my addr 172.21.15.82:0/1439470162 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.872+0000 7f963659c700 1 -- 172.21.15.82:0/1439470162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638103310 con 0x7f9638102880 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963659c700 1 --2- 172.21.15.82:0/1439470162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f96280098e0 tx=0x7f9628009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9873adb4c3563d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963559a700 1 -- 172.21.15.82:0/1439470162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962800b860 con 0x7f9638102880 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963559a700 1 -- 172.21.15.82:0/1439470162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800b9c0 con 0x7f9638102880 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963559a700 1 -- 172.21.15.82:0/1439470162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962800bc90 con 0x7f9638102880 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 -- 172.21.15.82:0/1439470162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 msgr2=0x7f9638102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 --2- 172.21.15.82:0/1439470162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f96280098e0 tx=0x7f9628009250 comp rx=0 tx=0).stop 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 -- 172.21.15.82:0/1439470162 shutdown_connections 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 --2- 172.21.15.82:0/1439470162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638102c90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 -- 172.21.15.82:0/1439470162 >> 172.21.15.82:0/1439470162 conn(0x7f96380fe060 msgr2=0x7f9638100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 -- 172.21.15.82:0/1439470162 shutdown_connections 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.873+0000 7f963cc4b700 1 -- 172.21.15.82:0/1439470162 wait complete. 2024-04-27T07:23:39.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963cc4b700 1 Processor -- start 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963cc4b700 1 -- start start 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963cc4b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963cc4b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638079160 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59816/0 (socket says 172.21.15.82:59816) 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963659c700 1 -- 172.21.15.82:0/4229838779 learned_addr learned my addr 172.21.15.82:0/4229838779 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.874+0000 7f963659c700 1 -- 172.21.15.82:0/4229838779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96280094f0 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f963659c700 1 --2- 172.21.15.82:0/4229838779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9628003080 tx=0x7f9628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962801c5c0 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962801c720 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f962801ca30 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96380771d0 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96380776c0 con 0x7f9638102880 2024-04-27T07:23:39.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f962801cc60 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.875+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f962801ac80 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.876+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963804bed0 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.878+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f962801a450 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.945+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9638103b50 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.948+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f962802e8d0 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.948+0000 7f9626ffd700 1 -- 172.21.15.82:0/4229838779 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f9628024520 con 0x7f9638102880 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 msgr2=0x7f9638078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 --2- 172.21.15.82:0/4229838779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9628003080 tx=0x7f9628016000 comp rx=0 tx=0).stop 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 shutdown_connections 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 --2- 172.21.15.82:0/4229838779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9638102880 0x7f9638078c20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 >> 172.21.15.82:0/4229838779 conn(0x7f96380fe060 msgr2=0x7f9638105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 shutdown_connections 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:38.949+0000 7f963cc4b700 1 -- 172.21.15.82:0/4229838779 wait complete. 2024-04-27T07:23:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-04-27T07:23:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:40 smithi082 ceph-mon[26243]: from='client.? 172.21.15.82:0/2656478054' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:23:40.539 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.899+0000 7f4e8e94d700 1 Processor -- start 2024-04-27T07:23:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.899+0000 7f4e8e94d700 1 -- start start 2024-04-27T07:23:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e8e94d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e8e94d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88102080 con 0x7f4e88101730 2024-04-27T07:23:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:40.540 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59828/0 (socket says 172.21.15.82:59828) 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e87fff700 1 -- 172.21.15.82:0/2480789789 learned_addr learned my addr 172.21.15.82:0/2480789789 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e87fff700 1 -- 172.21.15.82:0/2480789789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e881021c0 con 0x7f4e88101730 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e87fff700 1 --2- 172.21.15.82:0/2480789789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0098e0 tx=0x7f4e7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d170908fa4869f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e86ffd700 1 -- 172.21.15.82:0/2480789789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e7c00b860 con 0x7f4e88101730 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e86ffd700 1 -- 172.21.15.82:0/2480789789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e7c00be50 con 0x7f4e88101730 2024-04-27T07:23:40.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.900+0000 7f4e86ffd700 1 -- 172.21.15.82:0/2480789789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e7c010380 con 0x7f4e88101730 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2480789789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 msgr2=0x7f4e88101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 --2- 172.21.15.82:0/2480789789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0098e0 tx=0x7f4e7c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2480789789 shutdown_connections 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 --2- 172.21.15.82:0/2480789789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e88101b40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2480789789 >> 172.21.15.82:0/2480789789 conn(0x7f4e880fcef0 msgr2=0x7f4e880ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:40.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2480789789 shutdown_connections 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.901+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2480789789 wait complete. 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e8e94d700 1 Processor -- start 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e8e94d700 1 -- start start 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e8e94d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e8e94d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8810f910 con 0x7f4e88101730 2024-04-27T07:23:40.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59836/0 (socket says 172.21.15.82:59836) 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e87fff700 1 -- 172.21.15.82:0/2656478054 learned_addr learned my addr 172.21.15.82:0/2656478054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e87fff700 1 -- 172.21.15.82:0/2656478054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0094f0 con 0x7f4e88101730 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e87fff700 1 --2- 172.21.15.82:0/2656478054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c000c00 tx=0x7f4e7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.902+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e7c0107c0 con 0x7f4e88101730 2024-04-27T07:23:40.544 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4e7c010db0 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e7c01ad00 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8810fb10 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e88110680 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4e7c024440 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.903+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4e7c019710 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.904+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8805f5c0 con 0x7f4e88101730 2024-04-27T07:23:40.545 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.906+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f4e7c01a530 con 0x7f4e88101730 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.971+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4e88103550 con 0x7f4e88101730 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.971+0000 7f4e84ff9700 1 -- 172.21.15.82:0/2656478054 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f4e7c031030 con 0x7f4e88101730 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 msgr2=0x7f4e8810f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 --2- 172.21.15.82:0/2656478054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c000c00 tx=0x7f4e7c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 shutdown_connections 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 --2- 172.21.15.82:0/2656478054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e88101730 0x7f4e8810f3d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 >> 172.21.15.82:0/2656478054 conn(0x7f4e880fcef0 msgr2=0x7f4e88105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 shutdown_connections 2024-04-27T07:23:40.547 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:39.972+0000 7f4e8e94d700 1 -- 172.21.15.82:0/2656478054 wait complete. 2024-04-27T07:23:40.547 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-04-27T07:23:40.782 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:40 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:23:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:40 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[26239]: 2024-04-27T07:23:40.779+0000 7f964ecc5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:23:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:40 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[26239]: 2024-04-27T07:23:40.779+0000 7f964ecc5700 -1 mon.smithi082@0(leader) e1 *** Got Signal Terminated *** 2024-04-27T07:23:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:40 smithi082 podman[26485]: 2024-04-27 07:23:40.974454927 +0000 UTC m=+0.279048299 container died 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-27T07:23:41.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 podman[26485]: 2024-04-27 07:23:41.32966404 +0000 UTC m=+0.634257421 container cleanup 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-04-27T07:23:41.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 bash[26485]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082 2024-04-27T07:23:41.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 podman[26500]: 2024-04-27 07:23:41.614306292 +0000 UTC m=+0.634866176 container remove 29383857ac916239e7f1b5987a78df062d5adac83aae5a8b28d88e6e152d2635 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-04-27T07:23:41.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service: Deactivated successfully. 2024-04-27T07:23:41.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 systemd[1]: Stopped Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:23:41.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 systemd[1]: Starting Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:23:42.181 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 podman[26594]: 2024-04-27 07:23:41.86050634 +0000 UTC m=+0.017763186 image pull 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:41 smithi082 podman[26594]: 2024-04-27 07:23:41.965054998 +0000 UTC m=+0.122311844 container create bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 podman[26594]: 2024-04-27 07:23:42.117274434 +0000 UTC m=+0.274531290 container init bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 podman[26594]: 2024-04-27 07:23:42.121465119 +0000 UTC m=+0.278721968 container start bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: set uid:gid to 167:167 (ceph:ceph) 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable), process ceph-mon, pid 2 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: pidfile_write: ignore empty --pid-file 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: load: jerasure load: lrc 2024-04-27T07:23:42.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: RocksDB version: 6.15.5 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Compile date Apr 26 2024 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: DB SUMMARY 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: DB Session ID: VKXPTWOBJWNGPDZ18D09 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: CURRENT file: CURRENT 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: IDENTITY file: IDENTITY 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 1, files: 000008.sst 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000010.log size: 98466 ; 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.error_if_exists: 0 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.create_if_missing: 0 2024-04-27T07:23:42.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.paranoid_checks: 1 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.env: 0x55e80b34cb00 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.fs: Posix File System 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.info_log: 0x55e80bcd9620 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_file_opening_threads: 16 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.statistics: (nil) 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.use_fsync: 0 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_log_file_size: 0 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-27T07:23:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.keep_log_file_num: 1000 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.recycle_log_file_num: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_fallocate: 1 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_mmap_reads: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_mmap_writes: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.use_direct_reads: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.create_missing_column_families: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.db_log_dir: 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi082/store.db 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-27T07:23:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.advise_random_on_open: 1 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.db_write_buffer_size: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.write_buffer_manager: 0x55e80c9cca20 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.rate_limiter: (nil) 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.wal_recovery_mode: 2 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.enable_thread_tracking: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.enable_pipelined_write: 0 2024-04-27T07:23:42.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.unordered_write: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.row_cache: None 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.wal_filter: None 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_ingest_behind: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.preserve_deletes: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.two_write_queues: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.manual_wal_flush: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.atomic_flush: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-27T07:23:42.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.log_readahead_size: 0 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.best_efforts_recovery: 0 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-27T07:23:42.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.allow_data_in_errors: 0 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.db_host_id: __hostname__ 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_background_jobs: 2 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_background_compactions: -1 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_subcompactions: 1 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_total_wal_size: 0 2024-04-27T07:23:42.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_open_files: -1 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bytes_per_sync: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_readahead_size: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_background_flushes: -1 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Compression algorithms supported: 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kZSTD supported: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kXpressCompression supported: 0 2024-04-27T07:23:42.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kLZ4HCCompression supported: 1 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kZlibCompression supported: 1 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kSnappyCompression supported: 1 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kLZ4Compression supported: 1 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: kBZip2Compression supported: 0 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000009 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.merge_operator: 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_filter: None 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_filter_factory: None 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.sst_partitioner_factory: None 2024-04-27T07:23:42.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e80bcacf58) 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: hash_index_allow_collision: 1 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 1 2024-04-27T07:23:42.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x55e80bcdf090 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-04-27T07:23:42.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 4 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.write_buffer_size: 33554432 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_write_buffer_number: 2 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression: NoCompression 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression: Disabled 2024-04-27T07:23:42.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.prefix_extractor: nullptr 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.num_levels: 7 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.level: 32767 2024-04-27T07:23:42.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.strategy: 0 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compression_opts.enabled: false 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.target_file_size_base: 67108864 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-27T07:23:42.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.arena_block_size: 4194304 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.disable_auto_compactions: 0 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-27T07:23:42.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.table_properties_collectors: 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.inplace_update_support: 0 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-27T07:23:42.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.bloom_locality: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.max_successive_merges: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.paranoid_file_checks: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.force_consistency_checks: 1 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.report_bg_io_stats: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.ttl: 2592000 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.enable_blob_files: false 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.min_blob_size: 0 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.blob_file_size: 268435456 2024-04-27T07:23:42.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202622147106, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202622147969, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93517, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91629, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13606, "raw_average_key_size": 49, "raw_value_size": 84167, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714202622, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "55ffc632-11e8-48a1-9a05-73bc5ee38638", "db_session_id": "VKXPTWOBJWNGPDZ18D09"}} 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202622148307, "job": 1, "event": "recovery_finished"} 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-27T07:23:42.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55e80bc73180 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: DB pointer 0x55e80bd48000 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:23:42.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 2/0 93.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 93.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:23:42.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 29.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 29.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 2/0 93.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 93.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:23:42.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.1 0.00 0.00 1 0.001 0 0 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 29.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:23:42.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: starting mon.smithi082 rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???) e1 preinit fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).mds e1 new map 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).mds e1 print_map 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e1 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: -1 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: No filesystems configured 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-27T07:23:42.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 bash[26594]: bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 systemd[1]: Started Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: monmap e1: 1 mons at {smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: fsmap 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: osdmap e1: 0 total, 0 up, 0 in 2024-04-27T07:23:42.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:42 smithi082 ceph-mon[26613]: mgrmap e1: no daemons active 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb6618c4700 1 Processor -- start 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb6618c4700 1 -- start start 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb6618c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb6618c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1031d0 con 0x7fb65c102880 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb65affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb65affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59842/0 (socket says 172.21.15.82:59842) 2024-04-27T07:23:43.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.653+0000 7fb65affd700 1 -- 172.21.15.82:0/3615139398 learned_addr learned my addr 172.21.15.82:0/3615139398 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb65affd700 1 -- 172.21.15.82:0/3615139398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c103310 con 0x7fb65c102880 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb65affd700 1 --2- 172.21.15.82:0/3615139398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0098e0 tx=0x7fb64c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab743f360c198b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb659ffb700 1 -- 172.21.15.82:0/3615139398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb64c00b860 con 0x7fb65c102880 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb659ffb700 1 -- 172.21.15.82:0/3615139398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb64c00be50 con 0x7fb65c102880 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb659ffb700 1 -- 172.21.15.82:0/3615139398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb64c010380 con 0x7fb65c102880 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb6618c4700 1 -- 172.21.15.82:0/3615139398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 msgr2=0x7fb65c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.654+0000 7fb6618c4700 1 --2- 172.21.15.82:0/3615139398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb64c0098e0 tx=0x7fb64c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- 172.21.15.82:0/3615139398 shutdown_connections 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 --2- 172.21.15.82:0/3615139398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c102c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- 172.21.15.82:0/3615139398 >> 172.21.15.82:0/3615139398 conn(0x7fb65c0fe060 msgr2=0x7fb65c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- 172.21.15.82:0/3615139398 shutdown_connections 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- 172.21.15.82:0/3615139398 wait complete. 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 Processor -- start 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- start start 2024-04-27T07:23:43.376 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb6618c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c111b30 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb65affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.655+0000 7fb65affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59856/0 (socket says 172.21.15.82:59856) 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb65affd700 1 -- 172.21.15.82:0/3400169223 learned_addr learned my addr 172.21.15.82:0/3400169223 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb65affd700 1 -- 172.21.15.82:0/3400169223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0094f0 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb65affd700 1 --2- 172.21.15.82:0/3400169223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00b440 tx=0x7fb64c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb64c010760 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb64c010d50 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c111d30 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb64c01ae20 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c1128a0 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb64c02e440 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.656+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb64c024740 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.657+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c05f5c0 con 0x7fb65c102880 2024-04-27T07:23:43.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.659+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fb64c029070 con 0x7fb65c102880 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.725+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb65c104650 con 0x7fb65c102880 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.728+0000 7fb6437fe700 1 -- 172.21.15.82:0/3400169223 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb64c01a6a0 con 0x7fb65c102880 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 msgr2=0x7fb65c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 --2- 172.21.15.82:0/3400169223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00b440 tx=0x7fb64c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 shutdown_connections 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 --2- 172.21.15.82:0/3400169223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb65c102880 0x7fb65c1115f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 >> 172.21.15.82:0/3400169223 conn(0x7fb65c0fe060 msgr2=0x7fb65c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 shutdown_connections 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:42.729+0000 7fb6618c4700 1 -- 172.21.15.82:0/3400169223 wait complete. 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-04-27T07:23:43.378 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 9283 ... 2024-04-27T07:23:43.550 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mgr.smithi082.hhlhmf 2024-04-27T07:23:43.550 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mgr.smithi082.hhlhmf.service: Unit ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mgr.smithi082.hhlhmf.service not loaded. 2024-04-27T07:23:43.697 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968.target.wants/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mgr.smithi082.hhlhmf.service → /etc/systemd/system/ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@.service. 2024-04-27T07:23:44.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:43 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3400169223' entity='client.admin' 2024-04-27T07:23:45.052 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-27T07:23:45.053 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-27T07:23:45.061 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-27T07:23:45.061 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:23:45.061 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-27T07:23:45.061 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-04-27T07:23:45.071 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-27T07:23:45.072 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-04-27T07:23:45.081 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-04-27T07:23:45.796 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:45 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2696548785' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-27T07:23:46.185 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:46.185 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "ebadc0d6-0466-11ef-bc93-c7b262605968", 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-27T07:23:46.186 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-27T07:23:46.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-27T07:23:46.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-27T07:23:46.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-27T07:23:46.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:46.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-27T07:23:46.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-27T07:23:46.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-27T07:23:46.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:46.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-27T07:23:28.745333+0000", 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:46.195 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.542+0000 7f3054d69700 1 Processor -- start 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.542+0000 7f3054d69700 1 -- start start 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.542+0000 7f3054d69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.542+0000 7f3054d69700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050105900 con 0x7f3050076ca0 2024-04-27T07:23:46.196 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.542+0000 7f304e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55430/0 (socket says 172.21.15.82:55430) 2024-04-27T07:23:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304e59c700 1 -- 172.21.15.82:0/726206486 learned_addr learned my addr 172.21.15.82:0/726206486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304e59c700 1 -- 172.21.15.82:0/726206486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050105a40 con 0x7f3050076ca0 2024-04-27T07:23:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304e59c700 1 --2- 172.21.15.82:0/726206486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30400098e0 tx=0x7f3040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef1cb148cd39630 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304d59a700 1 -- 172.21.15.82:0/726206486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304000b860 con 0x7f3050076ca0 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304d59a700 1 -- 172.21.15.82:0/726206486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f304000be50 con 0x7f3050076ca0 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.543+0000 7f304d59a700 1 -- 172.21.15.82:0/726206486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3040010380 con 0x7f3050076ca0 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 -- 172.21.15.82:0/726206486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 msgr2=0x7f30501053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 --2- 172.21.15.82:0/726206486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30400098e0 tx=0x7f3040009250 comp rx=0 tx=0).stop 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 -- 172.21.15.82:0/726206486 shutdown_connections 2024-04-27T07:23:46.198 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 --2- 172.21.15.82:0/726206486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f30501053c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 -- 172.21.15.82:0/726206486 >> 172.21.15.82:0/726206486 conn(0x7f30500fced0 msgr2=0x7f30500ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 -- 172.21.15.82:0/726206486 shutdown_connections 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.544+0000 7f3054d69700 1 -- 172.21.15.82:0/726206486 wait complete. 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f3054d69700 1 Processor -- start 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f3054d69700 1 -- start start 2024-04-27T07:23:46.199 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f3054d69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:46.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f3054d69700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050103250 con 0x7f3050076ca0 2024-04-27T07:23:46.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f304e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:46.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f304e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55438/0 (socket says 172.21.15.82:55438) 2024-04-27T07:23:46.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f304e59c700 1 -- 172.21.15.82:0/2696548785 learned_addr learned my addr 172.21.15.82:0/2696548785 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:46.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.545+0000 7f304e59c700 1 -- 172.21.15.82:0/2696548785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094f0 con 0x7f3050076ca0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f304e59c700 1 --2- 172.21.15.82:0/2696548785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3040006b00 tx=0x7f3040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30400107c0 con 0x7f3050076ca0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3040010db0 con 0x7f3050076ca0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30501012c0 con 0x7f3050076ca0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304001acf0 con 0x7f3050076ca0 2024-04-27T07:23:46.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30501017b0 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3040024440 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.546+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3040019710 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.547+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305004bed0 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.551+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f304001a530 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.622+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f30501019f0 con 0x7f3050076ca0 2024-04-27T07:23:46.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.622+0000 7f303effd700 1 -- 172.21.15.82:0/2696548785 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f3040010920 con 0x7f3050076ca0 2024-04-27T07:23:46.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 msgr2=0x7f3050102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:46.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 --2- 172.21.15.82:0/2696548785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3040006b00 tx=0x7f3040009250 comp rx=0 tx=0).stop 2024-04-27T07:23:46.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 shutdown_connections 2024-04-27T07:23:46.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 --2- 172.21.15.82:0/2696548785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3050076ca0 0x7f3050102d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:46.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 >> 172.21.15.82:0/2696548785 conn(0x7f30500fced0 msgr2=0x7f30500fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:46.204 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.623+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 shutdown_connections 2024-04-27T07:23:46.204 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:45.624+0000 7f3054d69700 1 -- 172.21.15.82:0/2696548785 wait complete. 2024-04-27T07:23:46.204 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-04-27T07:23:48.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:48 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3451271353' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-27T07:23:49.254 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:49.254 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:23:49.254 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "ebadc0d6-0466-11ef-bc93-c7b262605968", 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-27T07:23:49.255 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-27T07:23:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-27T07:23:49.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-27T07:23:49.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:49.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-27T07:23:28.745333+0000", 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.569+0000 7fc339c3b700 1 Processor -- start 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.569+0000 7fc339c3b700 1 -- start start 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.569+0000 7fc339c3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.569+0000 7fc339c3b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33406fe20 con 0x7fc33406f980 2024-04-27T07:23:49.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.570+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.570+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55446/0 (socket says 172.21.15.82:55446) 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.570+0000 7fc3337fe700 1 -- 172.21.15.82:0/1226425017 learned_addr learned my addr 172.21.15.82:0/1226425017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.570+0000 7fc3337fe700 1 -- 172.21.15.82:0/1226425017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33406ff60 con 0x7fc33406f980 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.571+0000 7fc3337fe700 1 --2- 172.21.15.82:0/1226425017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc3240098e0 tx=0x7fc324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6dc9cd7a01e55c server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.571+0000 7fc3327fc700 1 -- 172.21.15.82:0/1226425017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc32400b860 con 0x7fc33406f980 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.571+0000 7fc3327fc700 1 -- 172.21.15.82:0/1226425017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc32400be50 con 0x7fc33406f980 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.571+0000 7fc3327fc700 1 -- 172.21.15.82:0/1226425017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc324010380 con 0x7fc33406f980 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 -- 172.21.15.82:0/1226425017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 msgr2=0x7fc33406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 --2- 172.21.15.82:0/1226425017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc3240098e0 tx=0x7fc324009250 comp rx=0 tx=0).stop 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 -- 172.21.15.82:0/1226425017 shutdown_connections 2024-04-27T07:23:49.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 --2- 172.21.15.82:0/1226425017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc33406e2f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 -- 172.21.15.82:0/1226425017 >> 172.21.15.82:0/1226425017 conn(0x7fc334069ce0 msgr2=0x7fc33406c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 -- 172.21.15.82:0/1226425017 shutdown_connections 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.572+0000 7fc339c3b700 1 -- 172.21.15.82:0/1226425017 wait complete. 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc339c3b700 1 Processor -- start 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc339c3b700 1 -- start start 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc339c3b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc339c3b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3341180a0 con 0x7fc33406f980 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55462/0 (socket says 172.21.15.82:55462) 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc3337fe700 1 -- 172.21.15.82:0/3451271353 learned_addr learned my addr 172.21.15.82:0/3451271353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:49.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.573+0000 7fc3337fe700 1 -- 172.21.15.82:0/3451271353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240094f0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc3337fe700 1 --2- 172.21.15.82:0/3451271353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc324006b00 tx=0x7fc324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3240107c0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc324010db0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc32401acf0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3341182a0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.574+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc334118e10 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.575+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33405f5c0 con 0x7fc33406f980 2024-04-27T07:23:49.271 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.575+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc324010920 con 0x7fc33406f980 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.575+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc324024d60 con 0x7fc33406f980 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.578+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fc324010bd0 con 0x7fc33406f980 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.651+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc33410b080 con 0x7fc33406f980 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.651+0000 7fc31bfff700 1 -- 172.21.15.82:0/3451271353 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc33410b080 con 0x7fc33406f980 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.652+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 msgr2=0x7fc334117b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.652+0000 7fc339c3b700 1 --2- 172.21.15.82:0/3451271353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc324006b00 tx=0x7fc324009250 comp rx=0 tx=0).stop 2024-04-27T07:23:49.272 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.652+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 shutdown_connections 2024-04-27T07:23:49.273 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.652+0000 7fc339c3b700 1 --2- 172.21.15.82:0/3451271353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33406f980 0x7fc334117b60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:49.273 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.652+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 >> 172.21.15.82:0/3451271353 conn(0x7fc334069ce0 msgr2=0x7fc33410e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:49.273 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.653+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 shutdown_connections 2024-04-27T07:23:49.273 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:48.653+0000 7fc339c3b700 1 -- 172.21.15.82:0/3451271353 wait complete. 2024-04-27T07:23:49.273 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-04-27T07:23:51.498 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:23:51.498 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: mgrmap e2: smithi082.hhlhmf(active, starting, since 0.00286651s) 2024-04-27T07:23:51.498 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:23:51.498 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:23:51.499 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:51 smithi082 ceph-mon[26613]: from='mgr.14100 172.21.15.82:0/955008644' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "ebadc0d6-0466-11ef-bc93-c7b262605968", 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-27T07:23:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-27T07:23:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-27T07:23:52.354 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-27T07:23:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-27T07:23:28.745333+0000", 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:23:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.685+0000 7fc18f74c700 1 Processor -- start 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.685+0000 7fc18f74c700 1 -- start start 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.685+0000 7fc18f74c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.685+0000 7fc18f74c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881031d0 con 0x7fc188102880 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc18d4e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc18d4e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55534/0 (socket says 172.21.15.82:55534) 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc18d4e8700 1 -- 172.21.15.82:0/2942999122 learned_addr learned my addr 172.21.15.82:0/2942999122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc18d4e8700 1 -- 172.21.15.82:0/2942999122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188103310 con 0x7fc188102880 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc18d4e8700 1 --2- 172.21.15.82:0/2942999122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1840098e0 tx=0x7fc184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2ba3faed8a3b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc17ffff700 1 -- 172.21.15.82:0/2942999122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc18400b860 con 0x7fc188102880 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc17ffff700 1 -- 172.21.15.82:0/2942999122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc18400be50 con 0x7fc188102880 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.686+0000 7fc17ffff700 1 -- 172.21.15.82:0/2942999122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc184010380 con 0x7fc188102880 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- 172.21.15.82:0/2942999122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 msgr2=0x7fc188102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 --2- 172.21.15.82:0/2942999122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc1840098e0 tx=0x7fc184009250 comp rx=0 tx=0).stop 2024-04-27T07:23:52.357 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- 172.21.15.82:0/2942999122 shutdown_connections 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 --2- 172.21.15.82:0/2942999122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc188102c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- 172.21.15.82:0/2942999122 >> 172.21.15.82:0/2942999122 conn(0x7fc1880fe060 msgr2=0x7fc188100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- 172.21.15.82:0/2942999122 shutdown_connections 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- 172.21.15.82:0/2942999122 wait complete. 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 Processor -- start 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.687+0000 7fc18f74c700 1 -- start start 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18f74c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18f74c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188111b30 con 0x7fc188102880 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18d4e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18d4e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55536/0 (socket says 172.21.15.82:55536) 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18d4e8700 1 -- 172.21.15.82:0/4172283727 learned_addr learned my addr 172.21.15.82:0/4172283727 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18d4e8700 1 -- 172.21.15.82:0/4172283727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840094f0 con 0x7fc188102880 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18d4e8700 1 --2- 172.21.15.82:0/4172283727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc184000c00 tx=0x7fc184009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:52.358 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1840107c0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc184010db0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188111d30 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc18401ad00 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.688+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1881128a0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.689+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 2) v1 ==== 43132+0+0 (secure 0 0 0) 0x7fc18401a530 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.689+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18805f5c0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.690+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc18404a1f0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.692+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fc1840198e0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.762+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc18804bed0 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.762+0000 7fc17dffb700 1 -- 172.21.15.82:0/4172283727 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc184023810 con 0x7fc188102880 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 msgr2=0x7fc1881115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 --2- 172.21.15.82:0/4172283727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc184000c00 tx=0x7fc184009250 comp rx=0 tx=0).stop 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 shutdown_connections 2024-04-27T07:23:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 --2- 172.21.15.82:0/4172283727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc188102880 0x7fc1881115f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 >> 172.21.15.82:0/4172283727 conn(0x7fc1880fe060 msgr2=0x7fc1880feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 shutdown_connections 2024-04-27T07:23:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:51.763+0000 7fc18f74c700 1 -- 172.21.15.82:0/4172283727 wait complete. 2024-04-27T07:23:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-04-27T07:23:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:52 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4172283727' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-27T07:23:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:52 smithi082 ceph-mon[26613]: mgrmap e3: smithi082.hhlhmf(active, since 1.00627s) 2024-04-27T07:23:54.707 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:54 smithi082 ceph-mon[26613]: mgrmap e4: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "ebadc0d6-0466-11ef-bc93-c7b262605968", 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-27T07:23:55.658 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:55.659 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-27T07:23:55.660 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-27T07:23:55.661 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-04-27T07:23:28.745333+0000", 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-27T07:23:55.662 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.803+0000 7f1a20084700 1 Processor -- start 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.803+0000 7f1a20084700 1 -- start start 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a20084700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a20084700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18105940 con 0x7f1a18076c60 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1de20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1de20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55540/0 (socket says 172.21.15.82:55540) 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1de20700 1 -- 172.21.15.82:0/2255324956 learned_addr learned my addr 172.21.15.82:0/2255324956 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1de20700 1 -- 172.21.15.82:0/2255324956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18105a80 con 0x7f1a18076c60 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1de20700 1 --2- 172.21.15.82:0/2255324956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a080098e0 tx=0x7f1a08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867d420ff9059e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1ce1e700 1 -- 172.21.15.82:0/2255324956 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a0800b860 con 0x7f1a18076c60 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1ce1e700 1 -- 172.21.15.82:0/2255324956 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1a0800be50 con 0x7f1a18076c60 2024-04-27T07:23:55.663 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.804+0000 7f1a1ce1e700 1 -- 172.21.15.82:0/2255324956 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a08010380 con 0x7f1a18076c60 2024-04-27T07:23:55.664 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 -- 172.21.15.82:0/2255324956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 msgr2=0x7f1a18105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:55.664 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 --2- 172.21.15.82:0/2255324956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a080098e0 tx=0x7f1a08009250 comp rx=0 tx=0).stop 2024-04-27T07:23:55.664 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 -- 172.21.15.82:0/2255324956 shutdown_connections 2024-04-27T07:23:55.664 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 --2- 172.21.15.82:0/2255324956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18105400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:55.664 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 -- 172.21.15.82:0/2255324956 >> 172.21.15.82:0/2255324956 conn(0x7f1a180fced0 msgr2=0x7f1a180ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:55.665 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 -- 172.21.15.82:0/2255324956 shutdown_connections 2024-04-27T07:23:55.665 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.805+0000 7f1a20084700 1 -- 172.21.15.82:0/2255324956 wait complete. 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a20084700 1 Processor -- start 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a20084700 1 -- start start 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a20084700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a20084700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18103290 con 0x7f1a18076c60 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a1de20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:55.666 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a1de20700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55546/0 (socket says 172.21.15.82:55546) 2024-04-27T07:23:55.667 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a1de20700 1 -- 172.21.15.82:0/975826512 learned_addr learned my addr 172.21.15.82:0/975826512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:55.667 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a1de20700 1 -- 172.21.15.82:0/975826512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080094f0 con 0x7f1a18076c60 2024-04-27T07:23:55.667 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a1de20700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1a08003080 tx=0x7f1a08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:55.667 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.806+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a08010760 con 0x7f1a18076c60 2024-04-27T07:23:55.668 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1a08010d50 con 0x7f1a18076c60 2024-04-27T07:23:55.669 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a18101300 con 0x7f1a18076c60 2024-04-27T07:23:55.669 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a0801ace0 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a181017f0 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f1a0802e440 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.807+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1804bed0 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.808+0000 7f1a0e7fc700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 0x7f1a04038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.808+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1a0804a700 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.808+0000 7f1a1d61f700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 0x7f1a04038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.808+0000 7f1a1d61f700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 0x7f1a04038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009990 tx=0x7f1a14006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:54.812+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1a08018350 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.073+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1a18106890 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.073+0000 7f1a0e7fc700 1 -- 172.21.15.82:0/975826512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f1a080334f0 con 0x7f1a18076c60 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 msgr2=0x7f1a04038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:55.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 0x7f1a04038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009990 tx=0x7f1a14006e40 comp rx=0 tx=0).stop 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 msgr2=0x7f1a18102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1a08003080 tx=0x7f1a08009250 comp rx=0 tx=0).stop 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 shutdown_connections 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f1a04036850 0x7f1a04038d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 --2- 172.21.15.82:0/975826512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a18076c60 0x7f1a18102d50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 >> 172.21.15.82:0/975826512 conn(0x7f1a180fced0 msgr2=0x7f1a180fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 shutdown_connections 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:55.076+0000 7f1a20084700 1 -- 172.21.15.82:0/975826512 wait complete. 2024-04-27T07:23:55.671 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-04-27T07:23:55.770 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:55 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/975826512' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-27T07:23:56.759 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1335664873' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-04-27T07:23:56.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.056+0000 7fdd01d45700 1 Processor -- start 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.056+0000 7fdd01d45700 1 -- start start 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdd01d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdd01d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc063cc0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37658/0 (socket says 172.21.15.82:37658) 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfb7fe700 1 -- 172.21.15.82:0/652895218 learned_addr learned my addr 172.21.15.82:0/652895218 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfb7fe700 1 -- 172.21.15.82:0/652895218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc104800 con 0x7fdcfc103eb0 2024-04-27T07:23:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfb7fe700 1 --2- 172.21.15.82:0/652895218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0098e0 tx=0x7fdcec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68eba52ae9dd1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfaffd700 1 -- 172.21.15.82:0/652895218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcec00b860 con 0x7fdcfc103eb0 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfaffd700 1 -- 172.21.15.82:0/652895218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdcec00be50 con 0x7fdcfc103eb0 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.057+0000 7fdcfaffd700 1 -- 172.21.15.82:0/652895218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcec010380 con 0x7fdcfc103eb0 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 -- 172.21.15.82:0/652895218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 msgr2=0x7fdcfc1042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 --2- 172.21.15.82:0/652895218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0098e0 tx=0x7fdcec009250 comp rx=0 tx=0).stop 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 -- 172.21.15.82:0/652895218 shutdown_connections 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 --2- 172.21.15.82:0/652895218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1042c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 -- 172.21.15.82:0/652895218 >> 172.21.15.82:0/652895218 conn(0x7fdcfc0fc6b0 msgr2=0x7fdcfc0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 -- 172.21.15.82:0/652895218 shutdown_connections 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 -- 172.21.15.82:0/652895218 wait complete. 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.058+0000 7fdd01d45700 1 Processor -- start 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdd01d45700 1 -- start start 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdd01d45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:56.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdd01d45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc111af0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcfb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37670/0 (socket says 172.21.15.82:37670) 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcfb7fe700 1 -- 172.21.15.82:0/1335664873 learned_addr learned my addr 172.21.15.82:0/1335664873 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcfb7fe700 1 -- 172.21.15.82:0/1335664873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0094f0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcfb7fe700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000c00 tx=0x7fdcec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcec0107c0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fdcec010db0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcec01ad00 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc111cf0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.059+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc112860 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.060+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7fdcec0193c0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.060+0000 7fdcf8ff9700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 0x7fdce8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.060+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdcec04a5f0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.060+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc05f5c0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.061+0000 7fdcf2ffd700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 0x7fdce8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.061+0000 7fdcf2ffd700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 0x7fdce8038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009990 tx=0x7fdce4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.065+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdcec019670 con 0x7fdcfc103eb0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.247+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdcfc04bed0 con 0x7fdcfc103eb0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.247+0000 7fdcf8ff9700 1 -- 172.21.15.82:0/1335664873 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fdcec022340 con 0x7fdcfc103eb0 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.249+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 msgr2=0x7fdce8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.249+0000 7fdd01d45700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 0x7fdce8038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009990 tx=0x7fdce4006e40 comp rx=0 tx=0).stop 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.249+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 msgr2=0x7fdcfc1115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.249+0000 7fdd01d45700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000c00 tx=0x7fdcec009250 comp rx=0 tx=0).stop 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 shutdown_connections 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fdce8036850 0x7fdce8038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 --2- 172.21.15.82:0/1335664873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcfc103eb0 0x7fdcfc1115b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 >> 172.21.15.82:0/1335664873 conn(0x7fdcfc0fc6b0 msgr2=0x7fdcfc0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:56.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 shutdown_connections 2024-04-27T07:23:56.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:56.250+0000 7fdd01d45700 1 -- 172.21.15.82:0/1335664873 wait complete. 2024-04-27T07:23:56.774 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-04-27T07:23:57.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:57 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3158506759' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80d0358700 1 Processor -- start 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80d0358700 1 -- start start 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80d0358700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80d0358700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80790b0 con 0x7f80c8078ca0 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80ce0f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80ce0f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37678/0 (socket says 172.21.15.82:37678) 2024-04-27T07:23:58.041 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80ce0f4700 1 -- 172.21.15.82:0/759363304 learned_addr learned my addr 172.21.15.82:0/759363304 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:58.042 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.139+0000 7f80ce0f4700 1 -- 172.21.15.82:0/759363304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8077790 con 0x7f80c8078ca0 2024-04-27T07:23:58.042 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80ce0f4700 1 --2- 172.21.15.82:0/759363304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80c40098e0 tx=0x7f80c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c594ed8152990572 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:58.043 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80cd0f2700 1 -- 172.21.15.82:0/759363304 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c400b860 con 0x7f80c8078ca0 2024-04-27T07:23:58.043 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80cd0f2700 1 -- 172.21.15.82:0/759363304 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f80c400be50 con 0x7f80c8078ca0 2024-04-27T07:23:58.043 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80cd0f2700 1 -- 172.21.15.82:0/759363304 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c4010380 con 0x7f80c8078ca0 2024-04-27T07:23:58.043 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 -- 172.21.15.82:0/759363304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 msgr2=0x7f80c8077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:58.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 --2- 172.21.15.82:0/759363304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f80c40098e0 tx=0x7f80c4009250 comp rx=0 tx=0).stop 2024-04-27T07:23:58.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 -- 172.21.15.82:0/759363304 shutdown_connections 2024-04-27T07:23:58.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 --2- 172.21.15.82:0/759363304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8077250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:58.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 -- 172.21.15.82:0/759363304 >> 172.21.15.82:0/759363304 conn(0x7f80c80fe060 msgr2=0x7f80c8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:58.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 -- 172.21.15.82:0/759363304 shutdown_connections 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.140+0000 7f80d0358700 1 -- 172.21.15.82:0/759363304 wait complete. 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80d0358700 1 Processor -- start 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80d0358700 1 -- start start 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80d0358700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80d0358700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8113da0 con 0x7f80c8078ca0 2024-04-27T07:23:58.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80ce0f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:58.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80ce0f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37686/0 (socket says 172.21.15.82:37686) 2024-04-27T07:23:58.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80ce0f4700 1 -- 172.21.15.82:0/3158506759 learned_addr learned my addr 172.21.15.82:0/3158506759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:58.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80ce0f4700 1 -- 172.21.15.82:0/3158506759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40094f0 con 0x7f80c8078ca0 2024-04-27T07:23:58.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.141+0000 7f80ce0f4700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80c400b440 tx=0x7f80c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:58.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c4010760 con 0x7f80c8078ca0 2024-04-27T07:23:58.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f80c4010d50 con 0x7f80c8078ca0 2024-04-27T07:23:58.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80c401adc0 con 0x7f80c8078ca0 2024-04-27T07:23:58.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c8113fa0 con 0x7f80c8078ca0 2024-04-27T07:23:58.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8114b10 con 0x7f80c8078ca0 2024-04-27T07:23:58.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.142+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f80c40193c0 con 0x7f80c8078ca0 2024-04-27T07:23:58.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.143+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c805f5c0 con 0x7f80c8078ca0 2024-04-27T07:23:58.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.143+0000 7f80beffd700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 0x7f80b4038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:58.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.143+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f80c4049f60 con 0x7f80c8078ca0 2024-04-27T07:23:58.049 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.143+0000 7f80cd8f3700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 0x7f80b4038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:58.049 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.143+0000 7f80cd8f3700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 0x7f80b4038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009990 tx=0x7f80b8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:58.049 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.147+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f80c40224e0 con 0x7f80c8078ca0 2024-04-27T07:23:58.049 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.385+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f80c804bed0 con 0x7f80c8078ca0 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.457+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f80c4019670 con 0x7f80c8078ca0 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.459+0000 7f80beffd700 1 -- 172.21.15.82:0/3158506759 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f80c402aa90 con 0x7f80c8078ca0 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 msgr2=0x7f80b4038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 0x7f80b4038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009990 tx=0x7f80b8006e40 comp rx=0 tx=0).stop 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 msgr2=0x7f80c8113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:58.050 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f80c400b440 tx=0x7f80c4009250 comp rx=0 tx=0).stop 2024-04-27T07:23:58.051 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 shutdown_connections 2024-04-27T07:23:58.051 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7f80b4036850 0x7f80b4038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:58.051 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 --2- 172.21.15.82:0/3158506759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80c8078ca0 0x7f80c8113860 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:58.051 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 >> 172.21.15.82:0/3158506759 conn(0x7f80c80fe060 msgr2=0x7f80c80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:58.052 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 shutdown_connections 2024-04-27T07:23:58.052 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:57.461+0000 7f80d0358700 1 -- 172.21.15.82:0/3158506759 wait complete. 2024-04-27T07:23:58.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:58 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3158506759' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-27T07:23:58.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:58 smithi082 ceph-mon[26613]: mgrmap e5: smithi082.hhlhmf(active, since 6s) 2024-04-27T07:23:59.323 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:23:59.323 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-27T07:23:59.323 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-27T07:23:59.323 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "smithi082.hhlhmf", 2024-04-27T07:23:59.323 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.497+0000 7fe721cec700 1 Processor -- start 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe721cec700 1 -- start start 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe721cec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe721cec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c102090 con 0x7fe71c101740 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37718/0 (socket says 172.21.15.82:37718) 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71b7fe700 1 -- 172.21.15.82:0/3287936640 learned_addr learned my addr 172.21.15.82:0/3287936640 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71b7fe700 1 -- 172.21.15.82:0/3287936640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c1021d0 con 0x7fe71c101740 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71b7fe700 1 --2- 172.21.15.82:0/3287936640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0098e0 tx=0x7fe70c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f325a5aa0cabacaf server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.498+0000 7fe71a7fc700 1 -- 172.21.15.82:0/3287936640 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe70c00b860 con 0x7fe71c101740 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe71a7fc700 1 -- 172.21.15.82:0/3287936640 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe70c00be50 con 0x7fe71c101740 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe71a7fc700 1 -- 172.21.15.82:0/3287936640 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe70c010380 con 0x7fe71c101740 2024-04-27T07:23:59.324 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 -- 172.21.15.82:0/3287936640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 msgr2=0x7fe71c101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 --2- 172.21.15.82:0/3287936640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0098e0 tx=0x7fe70c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 -- 172.21.15.82:0/3287936640 shutdown_connections 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 --2- 172.21.15.82:0/3287936640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c101b50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 -- 172.21.15.82:0/3287936640 >> 172.21.15.82:0/3287936640 conn(0x7fe71c0fcec0 msgr2=0x7fe71c0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 -- 172.21.15.82:0/3287936640 shutdown_connections 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.499+0000 7fe721cec700 1 -- 172.21.15.82:0/3287936640 wait complete. 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe721cec700 1 Processor -- start 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe721cec700 1 -- start start 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe721cec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe721cec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c1109d0 con 0x7fe71c101740 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe71b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe71b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37734/0 (socket says 172.21.15.82:37734) 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe71b7fe700 1 -- 172.21.15.82:0/2328042656 learned_addr learned my addr 172.21.15.82:0/2328042656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:23:59.325 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.500+0000 7fe71b7fe700 1 -- 172.21.15.82:0/2328042656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0094f0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe71b7fe700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe70c000c00 tx=0x7fe70c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe70c0107c0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe70c010db0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c110bd0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe70c01ad00 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.501+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c111740 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe70c0193c0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c05f5c0 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe703fff700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 0x7fe704038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe70c04a650 con 0x7fe71c101740 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe71affd700 1 -- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 msgr2=0x7fe704038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.502+0000 7fe71affd700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 0x7fe704038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:23:59.326 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.507+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe70c022930 con 0x7fe71c101740 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.703+0000 7fe71affd700 1 -- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 msgr2=0x7fe704038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.703+0000 7fe71affd700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 0x7fe704038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.786+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe71c111a80 con 0x7fe71c101740 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.787+0000 7fe703fff700 1 -- 172.21.15.82:0/2328042656 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe70c022340 con 0x7fe71c101740 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 msgr2=0x7fe704038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 0x7fe704038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 msgr2=0x7fe71c110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe70c000c00 tx=0x7fe70c009250 comp rx=0 tx=0).stop 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 shutdown_connections 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7fe704036850 0x7fe704038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 --2- 172.21.15.82:0/2328042656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe71c101740 0x7fe71c110490 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 >> 172.21.15.82:0/2328042656 conn(0x7fe71c0fcec0 msgr2=0x7fe71c0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 shutdown_connections 2024-04-27T07:23:59.327 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:58.789+0000 7fe721cec700 1 -- 172.21.15.82:0/2328042656 wait complete. 2024-04-27T07:23:59.328 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-04-27T07:23:59.328 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-04-27T07:23:59.742 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:23:59 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2328042656' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: Active manager daemon smithi082.hhlhmf restarted 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: osdmap e2: 0 total, 0 up, 0 in 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: mgrmap e6: smithi082.hhlhmf(active, starting, since 0.00322231s) 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:24:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:24:04.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:03 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:24:05.270 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:04 smithi082 ceph-mon[26613]: Found migration_current of "None". Setting to last migration. 2024-04-27T07:24:05.270 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:04 smithi082 ceph-mon[26613]: mgrmap e7: smithi082.hhlhmf(active, since 1.0052s) 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.920+0000 7efc95d36700 1 Processor -- start 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.920+0000 7efc95d36700 1 -- start start 2024-04-27T07:24:05.548 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc95d36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc95d36700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90105980 con 0x7efc90076c00 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37748/0 (socket says 172.21.15.82:37748) 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8f7fe700 1 -- 172.21.15.82:0/3118394377 learned_addr learned my addr 172.21.15.82:0/3118394377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8f7fe700 1 -- 172.21.15.82:0/3118394377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90105ac0 con 0x7efc90076c00 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8f7fe700 1 --2- 172.21.15.82:0/3118394377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc840098e0 tx=0x7efc84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84519137fd1fa86 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.921+0000 7efc8e7fc700 1 -- 172.21.15.82:0/3118394377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8400b860 con 0x7efc90076c00 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc8e7fc700 1 -- 172.21.15.82:0/3118394377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efc8400be50 con 0x7efc90076c00 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc8e7fc700 1 -- 172.21.15.82:0/3118394377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc84010380 con 0x7efc90076c00 2024-04-27T07:24:05.549 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 -- 172.21.15.82:0/3118394377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 msgr2=0x7efc90105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 --2- 172.21.15.82:0/3118394377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc840098e0 tx=0x7efc84009250 comp rx=0 tx=0).stop 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 -- 172.21.15.82:0/3118394377 shutdown_connections 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 --2- 172.21.15.82:0/3118394377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90105440 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 -- 172.21.15.82:0/3118394377 >> 172.21.15.82:0/3118394377 conn(0x7efc900fcef0 msgr2=0x7efc900ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 -- 172.21.15.82:0/3118394377 shutdown_connections 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.922+0000 7efc95d36700 1 -- 172.21.15.82:0/3118394377 wait complete. 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc95d36700 1 Processor -- start 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc95d36700 1 -- start start 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc95d36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc95d36700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc901032d0 con 0x7efc90076c00 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37754/0 (socket says 172.21.15.82:37754) 2024-04-27T07:24:05.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc8f7fe700 1 -- 172.21.15.82:0/1449610862 learned_addr learned my addr 172.21.15.82:0/1449610862 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.923+0000 7efc8f7fe700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840094f0 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc8f7fe700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc84003050 tx=0x7efc84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc84010760 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efc84010d50 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc8401ae20 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90101340 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.924+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc90101830 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7efc8402e440 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc77fff700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc780393f0 con 0x7efc78036830 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efc8404a4f0 con 0x7efc90076c00 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc8effd700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:23:59.925+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:24:05.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:00.126+0000 7efc8effd700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:00.126+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:00.527+0000 7efc8effd700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:00.527+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:01.328+0000 7efc8effd700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:01.328+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:02.929+0000 7efc8effd700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3242457432 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:02.929+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:03.908+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7efc8402e880 con 0x7efc90076c00 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:03.908+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 msgr2=0x7efc78038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:03.908+0000 7efc77fff700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.909+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7efc8400f980 con 0x7efc90076c00 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.909+0000 7efc77fff700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 0x7efc7803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.909+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc780393f0 con 0x7efc78039fc0 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.910+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 0x7efc7803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:05.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.911+0000 7efc8effd700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 0x7efc7803c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc800039d0 tx=0x7efc80009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.911+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7efc780393f0 con 0x7efc78039fc0 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.917+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7efc9004bed0 con 0x7efc78039fc0 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.917+0000 7efc77fff700 1 -- 172.21.15.82:0/1449610862 <== mgr.14120 v2:172.21.15.82:6800/3417466421 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7efc9004bed0 con 0x7efc78039fc0 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 msgr2=0x7efc7803c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 0x7efc7803c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc800039d0 tx=0x7efc80009350 comp rx=0 tx=0).stop 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 msgr2=0x7efc90102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc84003050 tx=0x7efc84009250 comp rx=0 tx=0).stop 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 shutdown_connections 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7efc78039fc0 0x7efc7803c3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc90076c00 0x7efc90102d90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 --2- 172.21.15.82:0/1449610862 >> [v2:172.21.15.82:6800/3242457432,v1:172.21.15.82:6801/3242457432] conn(0x7efc78036830 0x7efc78038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 >> 172.21.15.82:0/1449610862 conn(0x7efc900fcef0 msgr2=0x7efc900fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 shutdown_connections 2024-04-27T07:24:05.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:04.918+0000 7efc95d36700 1 -- 172.21.15.82:0/1449610862 wait complete. 2024-04-27T07:24:05.554 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-04-27T07:24:05.554 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:04] ENGINE Bus STARTING 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:05] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:05] ENGINE Bus STARTED 2024-04-27T07:24:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:06 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:06.802 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.996+0000 7fb01bc33700 1 Processor -- start 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.996+0000 7fb01bc33700 1 -- start start 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb01bc33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb01bc33700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014102080 con 0x7fb014101730 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0199cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0199cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47082/0 (socket says 172.21.15.82:47082) 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0199cf700 1 -- 172.21.15.82:0/3630503572 learned_addr learned my addr 172.21.15.82:0/3630503572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0199cf700 1 -- 172.21.15.82:0/3630503572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0141021c0 con 0x7fb014101730 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0199cf700 1 --2- 172.21.15.82:0/3630503572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb00400bb80 tx=0x7fb00400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2aa6954392b2253 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0189cd700 1 -- 172.21.15.82:0/3630503572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb00400dd00 con 0x7fb014101730 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0189cd700 1 -- 172.21.15.82:0/3630503572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb00400de60 con 0x7fb014101730 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.997+0000 7fb0189cd700 1 -- 172.21.15.82:0/3630503572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0040188a0 con 0x7fb014101730 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 -- 172.21.15.82:0/3630503572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 msgr2=0x7fb014101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:06.803 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 --2- 172.21.15.82:0/3630503572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb00400bb80 tx=0x7fb00400b4f0 comp rx=0 tx=0).stop 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 -- 172.21.15.82:0/3630503572 shutdown_connections 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 --2- 172.21.15.82:0/3630503572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb014101b40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 -- 172.21.15.82:0/3630503572 >> 172.21.15.82:0/3630503572 conn(0x7fb0140fcef0 msgr2=0x7fb0140ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 -- 172.21.15.82:0/3630503572 shutdown_connections 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.998+0000 7fb01bc33700 1 -- 172.21.15.82:0/3630503572 wait complete. 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb01bc33700 1 Processor -- start 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb01bc33700 1 -- start start 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb01bc33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb01bc33700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014113ce0 con 0x7fb014101730 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb0199cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:06.804 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb0199cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47086/0 (socket says 172.21.15.82:47086) 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb0199cf700 1 -- 172.21.15.82:0/2065968943 learned_addr learned my addr 172.21.15.82:0/2065968943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb0199cf700 1 -- 172.21.15.82:0/2065968943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00400b790 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:05.999+0000 7fb0199cf700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb004010fa0 tx=0x7fb00400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.000+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb004018e10 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.000+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb004010b80 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.000+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014113ee0 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.000+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb014114a50 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.000+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb004021550 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fb0040217d0 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb00a7fc700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 0x7fb000038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff80052e0 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb004014070 con 0x7fb014101730 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb0191ce700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 0x7fb000038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:06.805 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.001+0000 7fb0191ce700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 0x7fb000038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb010009990 tx=0x7fb010006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.006+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb00400edc0 con 0x7fb014101730 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.041+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fb004022a10 con 0x7fb014101730 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.207+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7faff8000bf0 con 0x7fb000036720 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.216+0000 7fb00a7fc700 1 -- 172.21.15.82:0/2065968943 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faff8000bf0 con 0x7fb000036720 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.217+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 msgr2=0x7fb000038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.217+0000 7fb01bc33700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 0x7fb000038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb010009990 tx=0x7fb010006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 msgr2=0x7fb0141137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb004010fa0 tx=0x7fb00400b4f0 comp rx=0 tx=0).stop 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 shutdown_connections 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb000036720 0x7fb000038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 --2- 172.21.15.82:0/2065968943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb014101730 0x7fb0141137a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 >> 172.21.15.82:0/2065968943 conn(0x7fb0140fcef0 msgr2=0x7fb014105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:06.807 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 shutdown_connections 2024-04-27T07:24:06.807 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:06.218+0000 7fb01bc33700 1 -- 172.21.15.82:0/2065968943 wait complete. 2024-04-27T07:24:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:07 smithi082 ceph-mon[26613]: mgrmap e8: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:24:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:07 smithi082 ceph-mon[26613]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:07 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:07.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:07 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f912f700 1 Processor -- start 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f912f700 1 -- start start 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f912f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f912f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4105960 con 0x7fe0f4076c50 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47098/0 (socket says 172.21.15.82:47098) 2024-04-27T07:24:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f2d9d700 1 -- 172.21.15.82:0/2840023964 learned_addr learned my addr 172.21.15.82:0/2840023964 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.223+0000 7fe0f2d9d700 1 -- 172.21.15.82:0/2840023964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4105aa0 con 0x7fe0f4076c50 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f2d9d700 1 --2- 172.21.15.82:0/2840023964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098e0 tx=0x7fe0e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e021ad4605ea14 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f1d9b700 1 -- 172.21.15.82:0/2840023964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e400b860 con 0x7fe0f4076c50 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f1d9b700 1 -- 172.21.15.82:0/2840023964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe0e400be50 con 0x7fe0f4076c50 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f1d9b700 1 -- 172.21.15.82:0/2840023964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e4010380 con 0x7fe0f4076c50 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 -- 172.21.15.82:0/2840023964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 msgr2=0x7fe0f4105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 --2- 172.21.15.82:0/2840023964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40098e0 tx=0x7fe0e4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 -- 172.21.15.82:0/2840023964 shutdown_connections 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 --2- 172.21.15.82:0/2840023964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4105420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 -- 172.21.15.82:0/2840023964 >> 172.21.15.82:0/2840023964 conn(0x7fe0f40fcef0 msgr2=0x7fe0f40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 -- 172.21.15.82:0/2840023964 shutdown_connections 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.224+0000 7fe0f912f700 1 -- 172.21.15.82:0/2840023964 wait complete. 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f912f700 1 Processor -- start 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f912f700 1 -- start start 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f912f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f912f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4111b40 con 0x7fe0f4076c50 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47106/0 (socket says 172.21.15.82:47106) 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.225+0000 7fe0f2d9d700 1 -- 172.21.15.82:0/3921742194 learned_addr learned my addr 172.21.15.82:0/3921742194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0f2d9d700 1 -- 172.21.15.82:0/3921742194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40094f0 con 0x7fe0f4076c50 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0f2d9d700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006b00 tx=0x7fe0e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e40107c0 con 0x7fe0f4076c50 2024-04-27T07:24:08.011 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe0e4010db0 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4111d40 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e401acf0 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.226+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f41128b0 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe0e40193c0 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f405f5c0 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0db7fe700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 0x7fe0dc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe0e404a650 con 0x7fe0f4076c50 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0f259c700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 0x7fe0dc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.227+0000 7fe0f259c700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 0x7fe0dc038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009990 tx=0x7fe0e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:08.012 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.232+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe0e4022930 con 0x7fe0f4076c50 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.415+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f40fe100 con 0x7fe0dc036850 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.416+0000 7fe0db7fe700 1 -- 172.21.15.82:0/3921742194 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe0f40fe100 con 0x7fe0dc036850 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 msgr2=0x7fe0dc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 0x7fe0dc038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009990 tx=0x7fe0e8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 msgr2=0x7fe0f4111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006b00 tx=0x7fe0e4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 shutdown_connections 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fe0dc036850 0x7fe0dc038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 --2- 172.21.15.82:0/3921742194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0f4076c50 0x7fe0f4111600 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 >> 172.21.15.82:0/3921742194 conn(0x7fe0f40fcef0 msgr2=0x7fe0f40fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 shutdown_connections 2024-04-27T07:24:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:07.418+0000 7fe0f912f700 1 -- 172.21.15.82:0/3921742194 wait complete. 2024-04-27T07:24:08.014 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-04-27T07:24:08.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:08 smithi082 ceph-mon[26613]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:09.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f5444273700 1 Processor -- start 2024-04-27T07:24:09.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f5444273700 1 -- start start 2024-04-27T07:24:09.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f5444273700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:09.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f5444273700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c1031d0 con 0x7f543c102880 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f544200f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f544200f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47120/0 (socket says 172.21.15.82:47120) 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.438+0000 7f544200f700 1 -- 172.21.15.82:0/2491743993 learned_addr learned my addr 172.21.15.82:0/2491743993 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.439+0000 7f544200f700 1 -- 172.21.15.82:0/2491743993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c103310 con 0x7f543c102880 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.439+0000 7f544200f700 1 --2- 172.21.15.82:0/2491743993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54380098e0 tx=0x7f5438009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df30648bc77429e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.439+0000 7f544100d700 1 -- 172.21.15.82:0/2491743993 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543800b860 con 0x7f543c102880 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.439+0000 7f544100d700 1 -- 172.21.15.82:0/2491743993 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f543800be50 con 0x7f543c102880 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.439+0000 7f544100d700 1 -- 172.21.15.82:0/2491743993 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5438010380 con 0x7f543c102880 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- 172.21.15.82:0/2491743993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 msgr2=0x7f543c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:09.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 --2- 172.21.15.82:0/2491743993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54380098e0 tx=0x7f5438009250 comp rx=0 tx=0).stop 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- 172.21.15.82:0/2491743993 shutdown_connections 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 --2- 172.21.15.82:0/2491743993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c102c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- 172.21.15.82:0/2491743993 >> 172.21.15.82:0/2491743993 conn(0x7f543c0fe060 msgr2=0x7f543c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- 172.21.15.82:0/2491743993 shutdown_connections 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- 172.21.15.82:0/2491743993 wait complete. 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 Processor -- start 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- start start 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:09.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.440+0000 7f5444273700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c079160 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f544200f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f544200f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47130/0 (socket says 172.21.15.82:47130) 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f544200f700 1 -- 172.21.15.82:0/2843748930 learned_addr learned my addr 172.21.15.82:0/2843748930 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f544200f700 1 -- 172.21.15.82:0/2843748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380094f0 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f544200f700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f543800b440 tx=0x7f5438009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5438010760 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5438010d50 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c0771d0 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543801ae20 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.441+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c0776c0 con 0x7f543c102880 2024-04-27T07:24:09.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.442+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f543802e440 con 0x7f543c102880 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.442+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c04bed0 con 0x7f543c102880 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.442+0000 7f5432ffd700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 0x7f5428038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.442+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f543804a580 con 0x7f543c102880 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.442+0000 7f544180e700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 0x7f5428038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.443+0000 7f544180e700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 0x7f5428038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f542c009990 tx=0x7f542c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.447+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5438018530 con 0x7f543c102880 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.633+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f543c077dd0 con 0x7f54280368a0 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.887+0000 7f5432ffd700 1 -- 172.21.15.82:0/2843748930 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f543c077dd0 con 0x7f54280368a0 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 msgr2=0x7f5428038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:09.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 0x7f5428038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f542c009990 tx=0x7f542c006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 msgr2=0x7f543c078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f543800b440 tx=0x7f5438009250 comp rx=0 tx=0).stop 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 shutdown_connections 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f54280368a0 0x7f5428038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 --2- 172.21.15.82:0/2843748930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102880 0x7f543c078c20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 >> 172.21.15.82:0/2843748930 conn(0x7f543c0fe060 msgr2=0x7f543c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 shutdown_connections 2024-04-27T07:24:09.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:08.889+0000 7f5444273700 1 -- 172.21.15.82:0/2843748930 wait complete. 2024-04-27T07:24:10.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:09 smithi082 ceph-mon[26613]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:10.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:09 smithi082 ceph-mon[26613]: Generating ssh key... 2024-04-27T07:24:10.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:09 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:10.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:09 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKAsyyPbJ6BVxFg8vkgbQKEk9cTbbPaVmy0lG1Xqpj58Vy+XgL2Qx/NdkgFv10cUFFMrVzj8UuHV3shRYp/OVW+bfycPEA/f3obwX8RJCiv8Gz6CwB+SRAtLxsk5yvuAjocOlvBCsTa/aoPTtYYDiIVNP/oLI7ahSHzUWI7F1SyKNMVzrfH5SBGrF2Bn+rzVnuSeddZk55PVrMficdtZMWyyHckeHsBk+j+KlGMIf1lGy1elH0RrrN4T4QGrOE+0QZ7JNxGA6ypm+dwAd/TXytfTAfN6qFS6+wkv8M1A6xsvC3WQs+2+sk0Jwz33HBWMcCfEShlNgQz8fMS3D6m6r0IsolA38ix+VBClyv1IThvJ0HsAjLHca0rULdm7/AxGo/gAQ88IVH+LVFHLc3W4VDFmz6Xrfq8JmRUe6HhPZUeL9EbuspqV8h/Ag8es0WGzbg594tKGjAE7xf1lxjby6x7UqYIeNV45bIhUasYB3d+PtkLR3JC8AIBsrpKW7sqDU= ceph-ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.863+0000 7f6489c58700 1 Processor -- start 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.863+0000 7f6489c58700 1 -- start start 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f6489c58700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f6489c58700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484102610 con 0x7f6484101cc0 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f64837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f64837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47142/0 (socket says 172.21.15.82:47142) 2024-04-27T07:24:10.630 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f64837fe700 1 -- 172.21.15.82:0/903802895 learned_addr learned my addr 172.21.15.82:0/903802895 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f64837fe700 1 -- 172.21.15.82:0/903802895 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484102750 con 0x7f6484101cc0 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f64837fe700 1 --2- 172.21.15.82:0/903802895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f647400bb80 tx=0x7f647400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff2b150ece62406 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f6482ffd700 1 -- 172.21.15.82:0/903802895 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f647400dd00 con 0x7f6484101cc0 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f6482ffd700 1 -- 172.21.15.82:0/903802895 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f647400de60 con 0x7f6484101cc0 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.864+0000 7f6482ffd700 1 -- 172.21.15.82:0/903802895 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64740188a0 con 0x7f6484101cc0 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 -- 172.21.15.82:0/903802895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 msgr2=0x7f64841020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 --2- 172.21.15.82:0/903802895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f647400bb80 tx=0x7f647400b4f0 comp rx=0 tx=0).stop 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 -- 172.21.15.82:0/903802895 shutdown_connections 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 --2- 172.21.15.82:0/903802895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f64841020d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:10.631 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 -- 172.21.15.82:0/903802895 >> 172.21.15.82:0/903802895 conn(0x7f64840fc6f0 msgr2=0x7f64840feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 -- 172.21.15.82:0/903802895 shutdown_connections 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 -- 172.21.15.82:0/903802895 wait complete. 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.865+0000 7f6489c58700 1 Processor -- start 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f6489c58700 1 -- start start 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f6489c58700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f6489c58700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648410f8b0 con 0x7f6484101cc0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f64837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f64837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47144/0 (socket says 172.21.15.82:47144) 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f64837fe700 1 -- 172.21.15.82:0/1882980003 learned_addr learned my addr 172.21.15.82:0/1882980003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f64837fe700 1 -- 172.21.15.82:0/1882980003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647400b790 con 0x7f6484101cc0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f64837fe700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6474018600 tx=0x7f647400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.866+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6474010bd0 con 0x7f6484101cc0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f647401d050 con 0x7f6484101cc0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6474022590 con 0x7f6484101cc0 2024-04-27T07:24:10.632 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648410fab0 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6484110620 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f64740227d0 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.867+0000 7f6480ff9700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 0x7f6470038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.868+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648405f5c0 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.868+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6474014070 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.868+0000 7f647affd700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 0x7f6470038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.868+0000 7f647affd700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 0x7f6470038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f646c009990 tx=0x7f646c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:09.872+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f647400e360 con 0x7f6484101cc0 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.059+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f64841111a0 con 0x7f6470036850 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.060+0000 7f6480ff9700 1 -- 172.21.15.82:0/1882980003 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f64841111a0 con 0x7f6470036850 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 msgr2=0x7f6470038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 0x7f6470038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f646c009990 tx=0x7f646c006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 msgr2=0x7f648410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:10.633 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6474018600 tx=0x7f647400b4f0 comp rx=0 tx=0).stop 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 shutdown_connections 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f6470036850 0x7f6470038d00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 --2- 172.21.15.82:0/1882980003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484101cc0 0x7f648410f370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 >> 172.21.15.82:0/1882980003 conn(0x7f64840fc6f0 msgr2=0x7f6484105cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 shutdown_connections 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:10.062+0000 7f6489c58700 1 -- 172.21.15.82:0/1882980003 wait complete. 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-04-27T07:24:10.634 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-04-27T07:24:11.265 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:10 smithi082 ceph-mon[26613]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:12.136 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:11 smithi082 ceph-mon[26613]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:13.149 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:12 smithi082 ceph-mon[26613]: Deploying cephadm binary to smithi082 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.062+0000 7fceba4d4700 1 Processor -- start 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.062+0000 7fceba4d4700 1 -- start start 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.062+0000 7fceba4d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.062+0000 7fceba4d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4103220 con 0x7fceb41028d0 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47146/0 (socket says 172.21.15.82:47146) 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb3fff700 1 -- 172.21.15.82:0/3918581303 learned_addr learned my addr 172.21.15.82:0/3918581303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:13.765 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb3fff700 1 -- 172.21.15.82:0/3918581303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4103360 con 0x7fceb41028d0 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb3fff700 1 --2- 172.21.15.82:0/3918581303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcea40098e0 tx=0x7fcea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b372268f48bd593d server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb2ffd700 1 -- 172.21.15.82:0/3918581303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcea400b860 con 0x7fceb41028d0 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb2ffd700 1 -- 172.21.15.82:0/3918581303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcea400be50 con 0x7fceb41028d0 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.063+0000 7fceb2ffd700 1 -- 172.21.15.82:0/3918581303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcea4010380 con 0x7fceb41028d0 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 -- 172.21.15.82:0/3918581303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 msgr2=0x7fceb4102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3918581303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcea40098e0 tx=0x7fcea4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 -- 172.21.15.82:0/3918581303 shutdown_connections 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3918581303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb4102ce0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 -- 172.21.15.82:0/3918581303 >> 172.21.15.82:0/3918581303 conn(0x7fceb40fe090 msgr2=0x7fceb41004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:13.766 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 -- 172.21.15.82:0/3918581303 shutdown_connections 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 -- 172.21.15.82:0/3918581303 wait complete. 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.064+0000 7fceba4d4700 1 Processor -- start 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceba4d4700 1 -- start start 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceba4d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceba4d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4111b10 con 0x7fceb41028d0 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47156/0 (socket says 172.21.15.82:47156) 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb3fff700 1 -- 172.21.15.82:0/3150608030 learned_addr learned my addr 172.21.15.82:0/3150608030 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb3fff700 1 -- 172.21.15.82:0/3150608030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea40094f0 con 0x7fceb41028d0 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb3fff700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b440 tx=0x7fcea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcea4010760 con 0x7fceb41028d0 2024-04-27T07:24:13.767 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb4111d10 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fcea4010d50 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcea401ae20 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.065+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb4112880 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.066+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fcea402e440 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.066+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb405f5c0 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.066+0000 7fceb0ff9700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 0x7fce9c038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.066+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcea404a7d0 con 0x7fceb41028d0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.067+0000 7fceb37fe700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 0x7fce9c038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.067+0000 7fceb37fe700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 0x7fce9c038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009990 tx=0x7fcea8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:13.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.071+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcea4018940 con 0x7fceb41028d0 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:11.262+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) v1 -- 0x7fceb40ff230 con 0x7fce9c036830 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.146+0000 7fceb0ff9700 1 -- 172.21.15.82:0/3150608030 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fceb40ff230 con 0x7fce9c036830 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 msgr2=0x7fce9c038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 0x7fce9c038ce0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009990 tx=0x7fcea8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 msgr2=0x7fceb41115d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcea400b440 tx=0x7fcea4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 shutdown_connections 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fce9c036830 0x7fce9c038ce0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 --2- 172.21.15.82:0/3150608030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb41028d0 0x7fceb41115d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 >> 172.21.15.82:0/3150608030 conn(0x7fceb40fe090 msgr2=0x7fceb40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 shutdown_connections 2024-04-27T07:24:13.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:13.149+0000 7fceba4d4700 1 -- 172.21.15.82:0/3150608030 wait complete. 2024-04-27T07:24:13.770 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying mon service with default placement... 2024-04-27T07:24:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:14 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:14 smithi082 ceph-mon[26613]: Added host smithi082 2024-04-27T07:24:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:14 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:15.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-27T07:24:15.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.180+0000 7f60a7db1700 1 Processor -- start 2024-04-27T07:24:15.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.180+0000 7f60a7db1700 1 -- start start 2024-04-27T07:24:15.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.180+0000 7f60a7db1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:15.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.180+0000 7f60a7db1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01020b0 con 0x7f60a0101760 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a5b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a5b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47162/0 (socket says 172.21.15.82:47162) 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a5b4d700 1 -- 172.21.15.82:0/1049402310 learned_addr learned my addr 172.21.15.82:0/1049402310 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a5b4d700 1 -- 172.21.15.82:0/1049402310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a01021f0 con 0x7f60a0101760 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a5b4d700 1 --2- 172.21.15.82:0/1049402310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60900098e0 tx=0x7f6090009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cdb01a86931d22 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a4b4b700 1 -- 172.21.15.82:0/1049402310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f609000b860 con 0x7f60a0101760 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a4b4b700 1 -- 172.21.15.82:0/1049402310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f609000be50 con 0x7f60a0101760 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.181+0000 7f60a4b4b700 1 -- 172.21.15.82:0/1049402310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6090010380 con 0x7f60a0101760 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 -- 172.21.15.82:0/1049402310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 msgr2=0x7f60a0101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 --2- 172.21.15.82:0/1049402310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60900098e0 tx=0x7f6090009250 comp rx=0 tx=0).stop 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 -- 172.21.15.82:0/1049402310 shutdown_connections 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 --2- 172.21.15.82:0/1049402310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0101b70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 -- 172.21.15.82:0/1049402310 >> 172.21.15.82:0/1049402310 conn(0x7f60a00fcea0 msgr2=0x7f60a00ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 -- 172.21.15.82:0/1049402310 shutdown_connections 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.182+0000 7f60a7db1700 1 -- 172.21.15.82:0/1049402310 wait complete. 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 Processor -- start 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 -- start start 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0107ea0 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a5b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a5b4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47174/0 (socket says 172.21.15.82:47174) 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a5b4d700 1 -- 172.21.15.82:0/2632132712 learned_addr learned my addr 172.21.15.82:0/2632132712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a5b4d700 1 -- 172.21.15.82:0/2632132712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900094f0 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a5b4d700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6090000c00 tx=0x7f6090009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60900107c0 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6090010db0 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a0105f60 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f609001ad00 con 0x7f60a0101760 2024-04-27T07:24:15.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.183+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a0106450 con 0x7f60a0101760 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.184+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f60900193c0 con 0x7f60a0101760 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.184+0000 7f60967fc700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 0x7f608c038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.184+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a004bed0 con 0x7f60a0101760 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.184+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f609004a7e0 con 0x7f60a0101760 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.184+0000 7f60a534c700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 0x7f608c038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.185+0000 7f60a534c700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 0x7f608c038d00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f609c009990 tx=0x7f609c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.189+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f60900196c0 con 0x7f60a0101760 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.408+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f60a010b640 con 0x7f608c036850 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.415+0000 7f60967fc700 1 -- 172.21.15.82:0/2632132712 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f60a010b640 con 0x7f608c036850 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 msgr2=0x7f608c038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 0x7f608c038d00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f609c009990 tx=0x7f609c006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 msgr2=0x7f60a0107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6090000c00 tx=0x7f6090009250 comp rx=0 tx=0).stop 2024-04-27T07:24:15.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 shutdown_connections 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f608c036850 0x7f608c038d00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 --2- 172.21.15.82:0/2632132712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60a0101760 0x7f60a0107960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 >> 172.21.15.82:0/2632132712 conn(0x7f60a00fcea0 msgr2=0x7f60a00fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 shutdown_connections 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:14.417+0000 7f60a7db1700 1 -- 172.21.15.82:0/2632132712 wait complete. 2024-04-27T07:24:15.238 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying mgr service with default placement... 2024-04-27T07:24:15.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:15 smithi082 ceph-mon[26613]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:15.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:15 smithi082 ceph-mon[26613]: Saving service mon spec with placement count:5 2024-04-27T07:24:15.534 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:15 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:16 smithi082 ceph-mon[26613]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:16 smithi082 ceph-mon[26613]: Saving service mgr spec with placement count:2 2024-04-27T07:24:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:16 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.632+0000 7f9233a88700 1 Processor -- start 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.632+0000 7f9233a88700 1 -- start start 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.632+0000 7f9233a88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.632+0000 7f9233a88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c079110 con 0x7f922c078d00 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9231824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9231824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35484/0 (socket says 172.21.15.82:35484) 2024-04-27T07:24:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9231824700 1 -- 172.21.15.82:0/2100220364 learned_addr learned my addr 172.21.15.82:0/2100220364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9231824700 1 -- 172.21.15.82:0/2100220364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c077750 con 0x7f922c078d00 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9231824700 1 --2- 172.21.15.82:0/2100220364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f92280098e0 tx=0x7f9228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53960f64f3427e88 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9230822700 1 -- 172.21.15.82:0/2100220364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f922800b860 con 0x7f922c078d00 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9230822700 1 -- 172.21.15.82:0/2100220364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f922800be50 con 0x7f922c078d00 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.633+0000 7f9230822700 1 -- 172.21.15.82:0/2100220364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9228010380 con 0x7f922c078d00 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- 172.21.15.82:0/2100220364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 msgr2=0x7f922c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 --2- 172.21.15.82:0/2100220364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f92280098e0 tx=0x7f9228009250 comp rx=0 tx=0).stop 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- 172.21.15.82:0/2100220364 shutdown_connections 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 --2- 172.21.15.82:0/2100220364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c077210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- 172.21.15.82:0/2100220364 >> 172.21.15.82:0/2100220364 conn(0x7f922c0fdfd0 msgr2=0x7f922c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- 172.21.15.82:0/2100220364 shutdown_connections 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- 172.21.15.82:0/2100220364 wait complete. 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 Processor -- start 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.634+0000 7f9233a88700 1 -- start start 2024-04-27T07:24:17.237 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9233a88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9233a88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c113e00 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9231824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9231824700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35500/0 (socket says 172.21.15.82:35500) 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9231824700 1 -- 172.21.15.82:0/2716001485 learned_addr learned my addr 172.21.15.82:0/2716001485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9231824700 1 -- 172.21.15.82:0/2716001485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92280094f0 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9231824700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9228006fd0 tx=0x7f9228009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9228010760 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9228010d50 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c114000 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f922801adc0 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.635+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c114b70 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.636+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f92280108c0 con 0x7f922c078d00 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.636+0000 7f92227fc700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 0x7f9218038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:17.238 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.636+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c05f5c0 con 0x7f922c078d00 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.636+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9228049eb0 con 0x7f922c078d00 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.636+0000 7f9231023700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 0x7f9218038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.637+0000 7f9231023700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 0x7f9218038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f921c009990 tx=0x7f921c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.641+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9228022950 con 0x7f922c078d00 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.850+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f922c0ff260 con 0x7f9218036850 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.857+0000 7f92227fc700 1 -- 172.21.15.82:0/2716001485 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f922c0ff260 con 0x7f9218036850 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 msgr2=0x7f9218038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 0x7f9218038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f921c009990 tx=0x7f921c006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 msgr2=0x7f922c1138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9228006fd0 tx=0x7f9228009250 comp rx=0 tx=0).stop 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 shutdown_connections 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9218036850 0x7f9218038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 --2- 172.21.15.82:0/2716001485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f922c078d00 0x7f922c1138c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 >> 172.21.15.82:0/2716001485 conn(0x7f922c0fdfd0 msgr2=0x7f922c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:17.239 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 shutdown_connections 2024-04-27T07:24:17.240 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:15.860+0000 7f9233a88700 1 -- 172.21.15.82:0/2716001485 wait complete. 2024-04-27T07:24:17.240 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying crash service with default placement... 2024-04-27T07:24:18.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-27T07:24:18.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.660+0000 7fd9bbcab700 1 Processor -- start 2024-04-27T07:24:18.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9bbcab700 1 -- start start 2024-04-27T07:24:18.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9bbcab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9bbcab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b41031e0 con 0x7fd9b4102890 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b9a47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b9a47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35514/0 (socket says 172.21.15.82:35514) 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b9a47700 1 -- 172.21.15.82:0/2666361710 learned_addr learned my addr 172.21.15.82:0/2666361710 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b9a47700 1 -- 172.21.15.82:0/2666361710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4103320 con 0x7fd9b4102890 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b9a47700 1 --2- 172.21.15.82:0/2666361710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098e0 tx=0x7fd9b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef4a7830473d9a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.661+0000 7fd9b8a45700 1 -- 172.21.15.82:0/2666361710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9b000b860 con 0x7fd9b4102890 2024-04-27T07:24:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9b8a45700 1 -- 172.21.15.82:0/2666361710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b000be90 con 0x7fd9b4102890 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9b8a45700 1 -- 172.21.15.82:0/2666361710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9b00103c0 con 0x7fd9b4102890 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9bbcab700 1 -- 172.21.15.82:0/2666361710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 msgr2=0x7fd9b4102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/2666361710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098e0 tx=0x7fd9b0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9bbcab700 1 -- 172.21.15.82:0/2666361710 shutdown_connections 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/2666361710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4102ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.662+0000 7fd9bbcab700 1 -- 172.21.15.82:0/2666361710 >> 172.21.15.82:0/2666361710 conn(0x7fd9b40fe010 msgr2=0x7fd9b4100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.663+0000 7fd9bbcab700 1 -- 172.21.15.82:0/2666361710 shutdown_connections 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.663+0000 7fd9bbcab700 1 -- 172.21.15.82:0/2666361710 wait complete. 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.663+0000 7fd9bbcab700 1 Processor -- start 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.663+0000 7fd9bbcab700 1 -- start start 2024-04-27T07:24:18.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9bbcab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9bbcab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b4079160 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9b9a47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9b9a47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35518/0 (socket says 172.21.15.82:35518) 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9b9a47700 1 -- 172.21.15.82:0/1516625501 learned_addr learned my addr 172.21.15.82:0/1516625501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9b9a47700 1 -- 172.21.15.82:0/1516625501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00094f0 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9b9a47700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00090b0 tx=0x7fd9b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9b0010840 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b0010e70 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40771d0 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9b0024e90 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.664+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b40776c0 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.665+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b404bed0 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.665+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd9b00109a0 con 0x7fd9b4102890 2024-04-27T07:24:18.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.666+0000 7fd9aa7fc700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 0x7fd9a0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.666+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd9b004a750 con 0x7fd9b4102890 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.666+0000 7fd9b9246700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 0x7fd9a0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.666+0000 7fd9b9246700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 0x7fd9a0038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009990 tx=0x7fd9a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.675+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd9b002c520 con 0x7fd9b4102890 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.891+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9b4077dd0 con 0x7fd9a0036850 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.896+0000 7fd9aa7fc700 1 -- 172.21.15.82:0/1516625501 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd9b4077dd0 con 0x7fd9a0036850 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 msgr2=0x7fd9a0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 0x7fd9a0038d00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009990 tx=0x7fd9a4006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 msgr2=0x7fd9b4078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00090b0 tx=0x7fd9b0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:18.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 shutdown_connections 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd9a0036850 0x7fd9a0038d00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 --2- 172.21.15.82:0/1516625501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b4102890 0x7fd9b4078c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 >> 172.21.15.82:0/1516625501 conn(0x7fd9b40fe010 msgr2=0x7fd9b40feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 shutdown_connections 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:17.899+0000 7fd9bbcab700 1 -- 172.21.15.82:0/1516625501 wait complete. 2024-04-27T07:24:18.447 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying prometheus service with default placement... 2024-04-27T07:24:18.447 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:18 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:18.448 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:18 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:18.448 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:18 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:19 smithi082 ceph-mon[26613]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:19 smithi082 ceph-mon[26613]: Saving service crash spec with placement * 2024-04-27T07:24:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:19 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-27T07:24:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.858+0000 7f9bff417700 1 Processor -- start 2024-04-27T07:24:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bff417700 1 -- start start 2024-04-27T07:24:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bff417700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bff417700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80790d0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bfd1b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bfd1b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35520/0 (socket says 172.21.15.82:35520) 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bfd1b3700 1 -- 172.21.15.82:0/1927009680 learned_addr learned my addr 172.21.15.82:0/1927009680 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.859+0000 7f9bfd1b3700 1 -- 172.21.15.82:0/1927009680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf80777b0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9bfd1b3700 1 --2- 172.21.15.82:0/1927009680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40098e0 tx=0x7f9bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51b78cf48c695fa server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9beffff700 1 -- 172.21.15.82:0/1927009680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf400b860 con 0x7f9bf8078cc0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9beffff700 1 -- 172.21.15.82:0/1927009680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bf400be90 con 0x7f9bf8078cc0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9beffff700 1 -- 172.21.15.82:0/1927009680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf40103c0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9bff417700 1 -- 172.21.15.82:0/1927009680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 msgr2=0x7f9bf8077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.860+0000 7f9bff417700 1 --2- 172.21.15.82:0/1927009680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40098e0 tx=0x7f9bf4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- 172.21.15.82:0/1927009680 shutdown_connections 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 --2- 172.21.15.82:0/1927009680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8077270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- 172.21.15.82:0/1927009680 >> 172.21.15.82:0/1927009680 conn(0x7f9bf80fe010 msgr2=0x7f9bf8100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- 172.21.15.82:0/1927009680 shutdown_connections 2024-04-27T07:24:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- 172.21.15.82:0/1927009680 wait complete. 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 Processor -- start 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- start start 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bff417700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf81181f0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bfd1b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bfd1b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35528/0 (socket says 172.21.15.82:35528) 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.861+0000 7f9bfd1b3700 1 -- 172.21.15.82:0/2499885067 learned_addr learned my addr 172.21.15.82:0/2499885067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bfd1b3700 1 -- 172.21.15.82:0/2499885067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40094f0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bfd1b3700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006fd0 tx=0x7f9bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf4010630 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bf4010c60 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf401ad40 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf81183f0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.862+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf8118f10 con 0x7f9bf8078cc0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.863+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f9bf40193c0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.863+0000 7f9bedffb700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 0x7f9be4038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.863+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf805f5c0 con 0x7f9bf8078cc0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.863+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9bf404a100 con 0x7f9bf8078cc0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.863+0000 7f9bfc9b2700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 0x7f9be4038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.864+0000 7f9bfc9b2700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 0x7f9be4038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009990 tx=0x7f9be8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:18.868+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9bf402c300 con 0x7f9bf8078cc0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.071+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bf8119a90 con 0x7f9be40368a0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.076+0000 7f9bedffb700 1 -- 172.21.15.82:0/2499885067 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9bf8119a90 con 0x7f9be40368a0 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 msgr2=0x7f9be4038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 0x7f9be4038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009990 tx=0x7f9be8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 msgr2=0x7f9bf8117cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006fd0 tx=0x7f9bf4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 shutdown_connections 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9be40368a0 0x7f9be4038d50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 --2- 172.21.15.82:0/2499885067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf8078cc0 0x7f9bf8117cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 >> 172.21.15.82:0/2499885067 conn(0x7f9bf80fe010 msgr2=0x7f9bf810efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 shutdown_connections 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:19.078+0000 7f9bff417700 1 -- 172.21.15.82:0/2499885067 wait complete. 2024-04-27T07:24:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying grafana service with default placement... 2024-04-27T07:24:20.416 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:20 smithi082 ceph-mon[26613]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:20.416 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:20 smithi082 ceph-mon[26613]: Saving service prometheus spec with placement count:1 2024-04-27T07:24:21.469 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-27T07:24:21.469 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.631+0000 7ffac339d700 1 Processor -- start 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.631+0000 7ffac339d700 1 -- start start 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac339d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac339d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc101520 con 0x7ffabc100bd0 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac1139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac1139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35544/0 (socket says 172.21.15.82:35544) 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac1139700 1 -- 172.21.15.82:0/378424671 learned_addr learned my addr 172.21.15.82:0/378424671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac1139700 1 -- 172.21.15.82:0/378424671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc101660 con 0x7ffabc100bd0 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffac1139700 1 --2- 172.21.15.82:0/378424671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098e0 tx=0x7ffaac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff77b93a1c8404a server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.632+0000 7ffab3fff700 1 -- 172.21.15.82:0/378424671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaac00b860 con 0x7ffabc100bd0 2024-04-27T07:24:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffab3fff700 1 -- 172.21.15.82:0/378424671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaac00be90 con 0x7ffabc100bd0 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffab3fff700 1 -- 172.21.15.82:0/378424671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaac0103c0 con 0x7ffabc100bd0 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 -- 172.21.15.82:0/378424671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 msgr2=0x7ffabc100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 --2- 172.21.15.82:0/378424671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098e0 tx=0x7ffaac009250 comp rx=0 tx=0).stop 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 -- 172.21.15.82:0/378424671 shutdown_connections 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 --2- 172.21.15.82:0/378424671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc100fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 -- 172.21.15.82:0/378424671 >> 172.21.15.82:0/378424671 conn(0x7ffabc0fc690 msgr2=0x7ffabc0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 -- 172.21.15.82:0/378424671 shutdown_connections 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.633+0000 7ffac339d700 1 -- 172.21.15.82:0/378424671 wait complete. 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac339d700 1 Processor -- start 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac339d700 1 -- start start 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac339d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac339d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc103b40 con 0x7ffabc100bd0 2024-04-27T07:24:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac1139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac1139700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35550/0 (socket says 172.21.15.82:35550) 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac1139700 1 -- 172.21.15.82:0/1887702419 learned_addr learned my addr 172.21.15.82:0/1887702419 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac1139700 1 -- 172.21.15.82:0/1887702419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0094f0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.634+0000 7ffac1139700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffaac011680 tx=0x7ffaac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.635+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaac010890 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.635+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaac010ec0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.635+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc101bb0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.635+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaac0243f0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.635+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc1020a0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ffaac02d3f0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc04bed0 con 0x7ffabc100bd0 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffab1ffb700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 0x7ffaa8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffaac04a250 con 0x7ffabc100bd0 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffac0938700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 0x7ffaa8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.636+0000 7ffac0938700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 0x7ffaa8038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009990 tx=0x7ffab8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.641+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffaac02b8e0 con 0x7ffabc100bd0 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.851+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7ffabc0fd850 con 0x7ffaa8036850 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.862+0000 7ffab1ffb700 1 -- 172.21.15.82:0/1887702419 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ffabc0fd850 con 0x7ffaa8036850 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 msgr2=0x7ffaa8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 0x7ffaa8038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009990 tx=0x7ffab8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 msgr2=0x7ffabc103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffaac011680 tx=0x7ffaac009250 comp rx=0 tx=0).stop 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 shutdown_connections 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ffaa8036850 0x7ffaa8038d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 --2- 172.21.15.82:0/1887702419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffabc100bd0 0x7ffabc103600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 >> 172.21.15.82:0/1887702419 conn(0x7ffabc0fc690 msgr2=0x7ffabc0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 shutdown_connections 2024-04-27T07:24:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:20.864+0000 7ffac339d700 1 -- 172.21.15.82:0/1887702419 wait complete. 2024-04-27T07:24:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying node-exporter service with default placement... 2024-04-27T07:24:21.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:21 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:21.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:21 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:22.692 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1ba71a700 1 Processor -- start 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1ba71a700 1 -- start start 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1ba71a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1ba71a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41059c0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35556/0 (socket says 172.21.15.82:35556) 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.903+0000 7fd1b3fff700 1 -- 172.21.15.82:0/1286068107 learned_addr learned my addr 172.21.15.82:0/1286068107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1b3fff700 1 -- 172.21.15.82:0/1286068107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4105b00 con 0x7fd1b4076bf0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1b3fff700 1 --2- 172.21.15.82:0/1286068107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098e0 tx=0x7fd1a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9047d922f8e40ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1b2ffd700 1 -- 172.21.15.82:0/1286068107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1a400b860 con 0x7fd1b4076bf0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1b2ffd700 1 -- 172.21.15.82:0/1286068107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1a400be90 con 0x7fd1b4076bf0 2024-04-27T07:24:22.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1b2ffd700 1 -- 172.21.15.82:0/1286068107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1a40103c0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1286068107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 msgr2=0x7fd1b4105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1286068107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098e0 tx=0x7fd1a4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1286068107 shutdown_connections 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1286068107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4105480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1286068107 >> 172.21.15.82:0/1286068107 conn(0x7fd1b40fcef0 msgr2=0x7fd1b40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.904+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1286068107 shutdown_connections 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1286068107 wait complete. 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1ba71a700 1 Processor -- start 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1ba71a700 1 -- start start 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1ba71a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1ba71a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4103310 con 0x7fd1b4076bf0 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:22.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1b3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35560/0 (socket says 172.21.15.82:35560) 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.905+0000 7fd1b3fff700 1 -- 172.21.15.82:0/1352589224 learned_addr learned my addr 172.21.15.82:0/1352589224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1b3fff700 1 -- 172.21.15.82:0/1352589224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40094f0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1b3fff700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006d40 tx=0x7fd1a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1a4010840 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1a4010e70 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1a4024ea0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4101380 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.906+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b4101870 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.907+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd1a4024780 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.907+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b404bed0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.907+0000 7fd1b0ff9700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 0x7fd19c038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.907+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd1a404a6b0 con 0x7fd1b4076bf0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.907+0000 7fd1b37fe700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 0x7fd19c038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:22.695 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.908+0000 7fd1b37fe700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 0x7fd19c038cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009990 tx=0x7fd1a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:21.912+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd1a402c930 con 0x7fd1b4076bf0 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.123+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1b4101f80 con 0x7fd19c036800 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.128+0000 7fd1b0ff9700 1 -- 172.21.15.82:0/1352589224 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd1b4101f80 con 0x7fd19c036800 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 msgr2=0x7fd19c038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 0x7fd19c038cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009990 tx=0x7fd1a8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 msgr2=0x7fd1b4102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006d40 tx=0x7fd1a4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 shutdown_connections 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fd19c036800 0x7fd19c038cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 --2- 172.21.15.82:0/1352589224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b4076bf0 0x7fd1b4102dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.130+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 >> 172.21.15.82:0/1352589224 conn(0x7fd1b40fcef0 msgr2=0x7fd1b40fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.131+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 shutdown_connections 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:22.131+0000 7fd1ba71a700 1 -- 172.21.15.82:0/1352589224 wait complete. 2024-04-27T07:24:22.696 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying alertmanager service with default placement... 2024-04-27T07:24:22.812 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:22 smithi082 ceph-mon[26613]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:22.813 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:22 smithi082 ceph-mon[26613]: Saving service grafana spec with placement count:1 2024-04-27T07:24:22.813 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:22 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:22.813 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:22 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:23.708 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:23 smithi082 ceph-mon[26613]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:23 smithi082 ceph-mon[26613]: Saving service node-exporter spec with placement * 2024-04-27T07:24:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:23 smithi082 ceph-mon[26613]: from='mgr.14120 172.21.15.82:0/2655742192' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb70a749700 1 Processor -- start 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb70a749700 1 -- start start 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb70a749700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb70a749700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704103670 con 0x7fb704102c90 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb703fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb703fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35566/0 (socket says 172.21.15.82:35566) 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.096+0000 7fb703fff700 1 -- 172.21.15.82:0/3655185758 learned_addr learned my addr 172.21.15.82:0/3655185758 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb703fff700 1 -- 172.21.15.82:0/3655185758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7041037b0 con 0x7fb704102c90 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb703fff700 1 --2- 172.21.15.82:0/3655185758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098e0 tx=0x7fb6f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e258352710b60c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:23.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb702ffd700 1 -- 172.21.15.82:0/3655185758 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6f400b860 con 0x7fb704102c90 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb702ffd700 1 -- 172.21.15.82:0/3655185758 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6f400be90 con 0x7fb704102c90 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb702ffd700 1 -- 172.21.15.82:0/3655185758 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6f40103c0 con 0x7fb704102c90 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 -- 172.21.15.82:0/3655185758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 msgr2=0x7fb7041030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 --2- 172.21.15.82:0/3655185758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098e0 tx=0x7fb6f4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 -- 172.21.15.82:0/3655185758 shutdown_connections 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 --2- 172.21.15.82:0/3655185758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb7041030a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 -- 172.21.15.82:0/3655185758 >> 172.21.15.82:0/3655185758 conn(0x7fb7040fc6f0 msgr2=0x7fb7040feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.097+0000 7fb70a749700 1 -- 172.21.15.82:0/3655185758 shutdown_connections 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb70a749700 1 -- 172.21.15.82:0/3655185758 wait complete. 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb70a749700 1 Processor -- start 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb70a749700 1 -- start start 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb70a749700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb70a749700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704113d50 con 0x7fb704102c90 2024-04-27T07:24:23.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.098+0000 7fb703fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb703fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35568/0 (socket says 172.21.15.82:35568) 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb703fff700 1 -- 172.21.15.82:0/143987700 learned_addr learned my addr 172.21.15.82:0/143987700 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb703fff700 1 -- 172.21.15.82:0/143987700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40094f0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb703fff700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4011680 tx=0x7fb6f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6f4010890 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb704113f50 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6f4010ec0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb6f40243f0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.099+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb704114ac0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fb6f402d3f0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70405f5c0 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb700ff9700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 0x7fb6ec038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb6f404a270 con 0x7fb704102c90 2024-04-27T07:24:23.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb7037fe700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 0x7fb6ec038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.100+0000 7fb7037fe700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 0x7fb6ec038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009990 tx=0x7fb6f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.105+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb6f402b8e0 con 0x7fb704102c90 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.305+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7040fd8b0 con 0x7fb6ec036850 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.310+0000 7fb700ff9700 1 -- 172.21.15.82:0/143987700 <== mgr.14120 v2:172.21.15.82:6800/3417466421 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fb7040fd8b0 con 0x7fb6ec036850 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 msgr2=0x7fb6ec038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 0x7fb6ec038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009990 tx=0x7fb6f8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 msgr2=0x7fb704113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4011680 tx=0x7fb6f4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 shutdown_connections 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fb6ec036850 0x7fb6ec038d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 --2- 172.21.15.82:0/143987700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb704102c90 0x7fb704113810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 >> 172.21.15.82:0/143987700 conn(0x7fb7040fc6f0 msgr2=0x7fb7040fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 shutdown_connections 2024-04-27T07:24:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:23.312+0000 7fb70a749700 1 -- 172.21.15.82:0/143987700 wait complete. 2024-04-27T07:24:24.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:24 smithi082 ceph-mon[26613]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:24.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:24 smithi082 ceph-mon[26613]: Saving service alertmanager spec with placement count:1 2024-04-27T07:24:25.752 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:25 smithi082 ceph-mon[26613]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:24:25.753 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:25 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/713244089' entity='client.admin' 2024-04-27T07:24:26.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fd5520700 1 Processor -- start 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fd5520700 1 -- start start 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fd5520700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fd5520700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0079090 con 0x7f2fd0078c80 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35572/0 (socket says 172.21.15.82:35572) 2024-04-27T07:24:26.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.198+0000 7f2fceffd700 1 -- 172.21.15.82:0/3578031855 learned_addr learned my addr 172.21.15.82:0/3578031855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fceffd700 1 -- 172.21.15.82:0/3578031855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0077770 con 0x7f2fd0078c80 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fceffd700 1 --2- 172.21.15.82:0/3578031855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00098e0 tx=0x7f2fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe97d22cc89e30f server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fce7fc700 1 -- 172.21.15.82:0/3578031855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fc000b860 con 0x7f2fd0078c80 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fce7fc700 1 -- 172.21.15.82:0/3578031855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fc000be90 con 0x7f2fd0078c80 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fce7fc700 1 -- 172.21.15.82:0/3578031855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fc00103c0 con 0x7f2fd0078c80 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fd5520700 1 -- 172.21.15.82:0/3578031855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 msgr2=0x7f2fd0077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.199+0000 7f2fd5520700 1 --2- 172.21.15.82:0/3578031855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00098e0 tx=0x7f2fc0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 -- 172.21.15.82:0/3578031855 shutdown_connections 2024-04-27T07:24:26.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 --2- 172.21.15.82:0/3578031855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0077230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 -- 172.21.15.82:0/3578031855 >> 172.21.15.82:0/3578031855 conn(0x7f2fd00fe060 msgr2=0x7f2fd0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 -- 172.21.15.82:0/3578031855 shutdown_connections 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 -- 172.21.15.82:0/3578031855 wait complete. 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 Processor -- start 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.200+0000 7f2fd5520700 1 -- start start 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fd5520700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fd5520700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0113d90 con 0x7f2fd0078c80 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fceffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35584/0 (socket says 172.21.15.82:35584) 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fceffd700 1 -- 172.21.15.82:0/713244089 learned_addr learned my addr 172.21.15.82:0/713244089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fceffd700 1 -- 172.21.15.82:0/713244089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00094f0 con 0x7f2fd0078c80 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fceffd700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00094c0 tx=0x7f2fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:26.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fc0010890 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fc0010ec0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd0113f90 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fc00243f0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.201+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0114b00 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.202+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f2fc002d3f0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.202+0000 7f2fc7fff700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 0x7f2fbc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.202+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd005f5c0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.202+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2fc004a400 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.202+0000 7f2fc67fc700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 0x7f2fbc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.203+0000 7f2fc67fc700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 0x7f2fbc038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009990 tx=0x7f2fb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.207+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2fc002b8e0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.395+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f2fd004bed0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.398+0000 7f2fc7fff700 1 -- 172.21.15.82:0/713244089 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f2fc002b2f0 con 0x7f2fd0078c80 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.400+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 msgr2=0x7f2fbc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:26.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.400+0000 7f2fd5520700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 0x7f2fbc038d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009990 tx=0x7f2fb8006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.400+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 msgr2=0x7f2fd0113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00094c0 tx=0x7f2fc0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 shutdown_connections 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f2fbc036850 0x7f2fbc038d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 --2- 172.21.15.82:0/713244089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fd0078c80 0x7f2fd0113850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 >> 172.21.15.82:0/713244089 conn(0x7f2fd00fe060 msgr2=0x7f2fd00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 shutdown_connections 2024-04-27T07:24:26.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:25.401+0000 7f2fd5520700 1 -- 172.21.15.82:0/713244089 wait complete. 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96af681700 1 Processor -- start 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96af681700 1 -- start start 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96af681700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96af681700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a81031d0 con 0x7f96a8102880 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96ad41d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:27.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.394+0000 7f96ad41d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55254/0 (socket says 172.21.15.82:55254) 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f96ad41d700 1 -- 172.21.15.82:0/1945437151 learned_addr learned my addr 172.21.15.82:0/1945437151 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f96ad41d700 1 -- 172.21.15.82:0/1945437151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a8103310 con 0x7f96a8102880 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f96ad41d700 1 --2- 172.21.15.82:0/1945437151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96a40098e0 tx=0x7f96a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f62b3a1948e1b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f969ffff700 1 -- 172.21.15.82:0/1945437151 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96a400b860 con 0x7f96a8102880 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f969ffff700 1 -- 172.21.15.82:0/1945437151 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a400be90 con 0x7f96a8102880 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.395+0000 7f969ffff700 1 -- 172.21.15.82:0/1945437151 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96a40103c0 con 0x7f96a8102880 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- 172.21.15.82:0/1945437151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 msgr2=0x7f96a8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 --2- 172.21.15.82:0/1945437151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96a40098e0 tx=0x7f96a4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- 172.21.15.82:0/1945437151 shutdown_connections 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 --2- 172.21.15.82:0/1945437151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8102c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- 172.21.15.82:0/1945437151 >> 172.21.15.82:0/1945437151 conn(0x7f96a80fe060 msgr2=0x7f96a8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- 172.21.15.82:0/1945437151 shutdown_connections 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- 172.21.15.82:0/1945437151 wait complete. 2024-04-27T07:24:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 Processor -- start 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- start start 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.396+0000 7f96af681700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a8111b60 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96ad41d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96ad41d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55258/0 (socket says 172.21.15.82:55258) 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96ad41d700 1 -- 172.21.15.82:0/2200583500 learned_addr learned my addr 172.21.15.82:0/2200583500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96ad41d700 1 -- 172.21.15.82:0/2200583500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40094f0 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96ad41d700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96a40090b0 tx=0x7f96a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96a4010840 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96a4010e70 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96a4024e40 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a8111d60 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.397+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a81128d0 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.398+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f96a4024430 con 0x7f96a8102880 2024-04-27T07:24:27.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.398+0000 7f969dffb700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 0x7f9694038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.398+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a805f5c0 con 0x7f96a8102880 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.398+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f96a404a7a0 con 0x7f96a8102880 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.398+0000 7f96acc1c700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 0x7f9694038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.399+0000 7f96acc1c700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 0x7f9694038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9698009990 tx=0x7f9698006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.403+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f96a402c520 con 0x7f96a8102880 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.587+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f96a804bed0 con 0x7f96a8102880 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.591+0000 7f969dffb700 1 -- 172.21.15.82:0/2200583500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f96a402c340 con 0x7f96a8102880 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 msgr2=0x7f9694038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 0x7f9694038cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9698009990 tx=0x7f9698006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 msgr2=0x7f96a8111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96a40090b0 tx=0x7f96a4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 shutdown_connections 2024-04-27T07:24:27.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f9694036800 0x7f9694038cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:27.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 --2- 172.21.15.82:0/2200583500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96a8102880 0x7f96a8111620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:27.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.593+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 >> 172.21.15.82:0/2200583500 conn(0x7f96a80fe060 msgr2=0x7f96a80feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:27.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.594+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 shutdown_connections 2024-04-27T07:24:27.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:26.594+0000 7f96af681700 1 -- 172.21.15.82:0/2200583500 wait complete. 2024-04-27T07:24:27.159 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-04-27T07:24:27.575 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:27 smithi082 ceph-mon[26613]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:24:27.575 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:27 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2200583500' entity='client.admin' 2024-04-27T07:24:28.835 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:28 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1618121191' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-27T07:24:29.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75d4808700 1 Processor -- start 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75d4808700 1 -- start start 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75d4808700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75d4808700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0079090 con 0x7f75d0078c80 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75ce59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75ce59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55268/0 (socket says 172.21.15.82:55268) 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.573+0000 7f75ce59c700 1 -- 172.21.15.82:0/3126645120 learned_addr learned my addr 172.21.15.82:0/3126645120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75ce59c700 1 -- 172.21.15.82:0/3126645120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0077770 con 0x7f75d0078c80 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75ce59c700 1 --2- 172.21.15.82:0/3126645120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75c00098e0 tx=0x7f75c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c276e43d8d2cca3d server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75cd59a700 1 -- 172.21.15.82:0/3126645120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75c000b860 con 0x7f75d0078c80 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75cd59a700 1 -- 172.21.15.82:0/3126645120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75c000be90 con 0x7f75d0078c80 2024-04-27T07:24:29.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75cd59a700 1 -- 172.21.15.82:0/3126645120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75c00103c0 con 0x7f75d0078c80 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75d4808700 1 -- 172.21.15.82:0/3126645120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 msgr2=0x7f75d0077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.574+0000 7f75d4808700 1 --2- 172.21.15.82:0/3126645120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75c00098e0 tx=0x7f75c0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- 172.21.15.82:0/3126645120 shutdown_connections 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 --2- 172.21.15.82:0/3126645120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0077230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- 172.21.15.82:0/3126645120 >> 172.21.15.82:0/3126645120 conn(0x7f75d00fe060 msgr2=0x7f75d0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- 172.21.15.82:0/3126645120 shutdown_connections 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- 172.21.15.82:0/3126645120 wait complete. 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 Processor -- start 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- start start 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75d4808700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0113d90 con 0x7f75d0078c80 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75ce59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75ce59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55284/0 (socket says 172.21.15.82:55284) 2024-04-27T07:24:29.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.575+0000 7f75ce59c700 1 -- 172.21.15.82:0/1618121191 learned_addr learned my addr 172.21.15.82:0/1618121191 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75ce59c700 1 -- 172.21.15.82:0/1618121191 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00094f0 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75ce59c700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75c00094c0 tx=0x7f75c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75c0010890 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0113f90 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75c0010ec0 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75c00243f0 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.576+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0114b00 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.577+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d005f5c0 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.577+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f75c001a7e0 con 0x7f75d0078c80 2024-04-27T07:24:29.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.577+0000 7f75beffd700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 0x7f75b8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.577+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f75c004a260 con 0x7f75d0078c80 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.577+0000 7f75cdd9b700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 0x7f75b8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.578+0000 7f75cdd9b700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 0x7f75b8038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009990 tx=0x7f75c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.582+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f75c002b4d0 con 0x7f75d0078c80 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:27.822+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f75d004bed0 con 0x7f75d0078c80 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.502+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f75c002d3f0 con 0x7f75d0078c80 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.503+0000 7f75beffd700 1 -- 172.21.15.82:0/1618121191 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f75c000fcf0 con 0x7f75d0078c80 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 msgr2=0x7f75b8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 0x7f75b8038d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009990 tx=0x7f75c4006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 msgr2=0x7f75d0113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75c00094c0 tx=0x7f75c0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 shutdown_connections 2024-04-27T07:24:29.144 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7f75b8036850 0x7f75b8038d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:29.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 --2- 172.21.15.82:0/1618121191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75d0078c80 0x7f75d0113850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:29.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 >> 172.21.15.82:0/1618121191 conn(0x7f75d00fe060 msgr2=0x7f75d00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:29.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 shutdown_connections 2024-04-27T07:24:29.145 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:28.506+0000 7f75d4808700 1 -- 172.21.15.82:0/1618121191 wait complete. 2024-04-27T07:24:29.780 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:29 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1618121191' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-27T07:24:29.780 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:29 smithi082 ceph-mon[26613]: mgrmap e9: smithi082.hhlhmf(active, since 24s) 2024-04-27T07:24:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:30 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/636315223' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "smithi082.hhlhmf", 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.572+0000 7ff0e6a7f700 1 Processor -- start 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.572+0000 7ff0e6a7f700 1 -- start start 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.572+0000 7ff0e6a7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.572+0000 7ff0e6a7f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0105990 con 0x7ff0e00712d0 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0e481b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:30.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0e481b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55312/0 (socket says 172.21.15.82:55312) 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0e481b700 1 -- 172.21.15.82:0/2064249103 learned_addr learned my addr 172.21.15.82:0/2064249103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0e481b700 1 -- 172.21.15.82:0/2064249103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0105ad0 con 0x7ff0e00712d0 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0e481b700 1 --2- 172.21.15.82:0/2064249103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40098e0 tx=0x7ff0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53b19bec145475d server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0df7fe700 1 -- 172.21.15.82:0/2064249103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0d400b860 con 0x7ff0e00712d0 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0df7fe700 1 -- 172.21.15.82:0/2064249103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0d400be90 con 0x7ff0e00712d0 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.573+0000 7ff0df7fe700 1 -- 172.21.15.82:0/2064249103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0d40103c0 con 0x7ff0e00712d0 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/2064249103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 msgr2=0x7ff0e0105450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/2064249103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40098e0 tx=0x7ff0d4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/2064249103 shutdown_connections 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/2064249103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0105450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/2064249103 >> 172.21.15.82:0/2064249103 conn(0x7ff0e00fcec0 msgr2=0x7ff0e00ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/2064249103 shutdown_connections 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/2064249103 wait complete. 2024-04-27T07:24:30.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 Processor -- start 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.574+0000 7ff0e6a7f700 1 -- start start 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e6a7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e6a7f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0111b70 con 0x7ff0e00712d0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e481b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e481b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55326/0 (socket says 172.21.15.82:55326) 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e481b700 1 -- 172.21.15.82:0/636315223 learned_addr learned my addr 172.21.15.82:0/636315223 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e481b700 1 -- 172.21.15.82:0/636315223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40094f0 con 0x7ff0e00712d0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e481b700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40105b0 tx=0x7ff0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0d4010840 con 0x7ff0e00712d0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0111d70 con 0x7ff0e00712d0 2024-04-27T07:24:30.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01128e0 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0d4010e70 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.575+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0d40243f0 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7ff0d4024550 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0dd7fa700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 0x7ff0d0038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0dffff700 1 -- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 msgr2=0x7ff0d0038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff0d404b650 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0dffff700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 0x7ff0d0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.576+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c40052e0 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.585+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff0d4018940 con 0x7ff0e00712d0 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.778+0000 7ff0dffff700 1 -- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 msgr2=0x7ff0d0038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.778+0000 7ff0dffff700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 0x7ff0d0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:24:30.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.867+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff0c4005da0 con 0x7ff0e00712d0 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.867+0000 7ff0dd7fa700 1 -- 172.21.15.82:0/636315223 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff0d4018350 con 0x7ff0e00712d0 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.869+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 msgr2=0x7ff0d0038da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.869+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 0x7ff0d0038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.869+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 msgr2=0x7ff0e0111630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.869+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40105b0 tx=0x7ff0d4009250 comp rx=0 tx=0).stop 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 shutdown_connections 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7ff0d00368f0 0x7ff0d0038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 --2- 172.21.15.82:0/636315223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e00712d0 0x7ff0e0111630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 >> 172.21.15.82:0/636315223 conn(0x7ff0e00fcec0 msgr2=0x7ff0e00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 shutdown_connections 2024-04-27T07:24:30.644 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:29.870+0000 7ff0e6a7f700 1 -- 172.21.15.82:0/636315223 wait complete. 2024-04-27T07:24:30.645 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-04-27T07:24:30.645 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-04-27T07:24:35.086 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: Active manager daemon smithi082.hhlhmf restarted 2024-04-27T07:24:35.086 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: osdmap e3: 0 total, 0 up, 0 in 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: mgrmap e10: smithi082.hhlhmf(active, starting, since 0.0036629s) 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:24:35.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:35 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:24:36.688 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:36 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:35] ENGINE Bus STARTING 2024-04-27T07:24:36.689 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:36 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:35] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:24:36.689 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:36 smithi082 ceph-mon[26613]: [27/Apr/2024:07:24:35] ENGINE Bus STARTED 2024-04-27T07:24:36.689 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:36 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:36.689 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:36 smithi082 ceph-mon[26613]: mgrmap e11: smithi082.hhlhmf(active, since 1.00608s) 2024-04-27T07:24:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-04-27T07:24:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc112127700 1 Processor -- start 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc112127700 1 -- start start 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc112127700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc112127700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c1031e0 con 0x7fc10c102890 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55342/0 (socket says 172.21.15.82:55342) 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.045+0000 7fc10b7fe700 1 -- 172.21.15.82:0/3608405463 learned_addr learned my addr 172.21.15.82:0/3608405463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.046+0000 7fc10b7fe700 1 -- 172.21.15.82:0/3608405463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c103320 con 0x7fc10c102890 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.046+0000 7fc10b7fe700 1 --2- 172.21.15.82:0/3608405463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098e0 tx=0x7fc0fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cf415248566f52 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.046+0000 7fc10a7fc700 1 -- 172.21.15.82:0/3608405463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc0fc00b860 con 0x7fc10c102890 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.046+0000 7fc10a7fc700 1 -- 172.21.15.82:0/3608405463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0fc00be90 con 0x7fc10c102890 2024-04-27T07:24:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.046+0000 7fc10a7fc700 1 -- 172.21.15.82:0/3608405463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc0fc0103c0 con 0x7fc10c102890 2024-04-27T07:24:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 -- 172.21.15.82:0/3608405463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 msgr2=0x7fc10c102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 --2- 172.21.15.82:0/3608405463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098e0 tx=0x7fc0fc009250 comp rx=0 tx=0).stop 2024-04-27T07:24:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 -- 172.21.15.82:0/3608405463 shutdown_connections 2024-04-27T07:24:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 --2- 172.21.15.82:0/3608405463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c102ca0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 -- 172.21.15.82:0/3608405463 >> 172.21.15.82:0/3608405463 conn(0x7fc10c0fe050 msgr2=0x7fc10c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 -- 172.21.15.82:0/3608405463 shutdown_connections 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 -- 172.21.15.82:0/3608405463 wait complete. 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.047+0000 7fc112127700 1 Processor -- start 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc112127700 1 -- start start 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc112127700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc112127700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c079160 con 0x7fc10c102890 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55348/0 (socket says 172.21.15.82:55348) 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc10b7fe700 1 -- 172.21.15.82:0/2986608369 learned_addr learned my addr 172.21.15.82:0/2986608369 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc10b7fe700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0094f0 con 0x7fc10c102890 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc10b7fe700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc011680 tx=0x7fc0fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.048+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc0fc010890 con 0x7fc10c102890 2024-04-27T07:24:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.049+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c0771d0 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.049+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0fc010ec0 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.049+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc0fc0243f0 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.049+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c0776c0 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.049+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fc0fc02d3f0 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.050+0000 7fc103fff700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.050+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f8039460 con 0x7fc0f80368a0 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.050+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc0fc04b370 con 0x7fc10c102890 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.050+0000 7fc10affd700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.050+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.251+0000 7fc10affd700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.251+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.652+0000 7fc10affd700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:31.652+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:32.453+0000 7fc10affd700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:32.453+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:34.054+0000 7fc10affd700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3417466421 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:34.054+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:34.995+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fc0fc02d740 con 0x7fc10c102890 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:34.995+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 msgr2=0x7fc0f8038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:34.996+0000 7fc103fff700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.997+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fc0fc01a8c0 con 0x7fc10c102890 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.997+0000 7fc103fff700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 0x7fc0f803c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.997+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f8039460 con 0x7fc0f803a090 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.997+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 0x7fc0f803c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.998+0000 7fc10affd700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 0x7fc0f803c470 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40039d0 tx=0x7fc0f40092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:35.999+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fc0f8039460 con 0x7fc0f803a090 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.004+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc10c04bed0 con 0x7fc0f803a090 2024-04-27T07:24:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.004+0000 7fc103fff700 1 -- 172.21.15.82:0/2986608369 <== mgr.14162 v2:172.21.15.82:6800/1415088792 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc10c04bed0 con 0x7fc0f803a090 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 msgr2=0x7fc0f803c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 0x7fc0f803c470 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40039d0 tx=0x7fc0f40092f0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 msgr2=0x7fc10c078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc011680 tx=0x7fc0fc009250 comp rx=0 tx=0).stop 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 shutdown_connections 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc0f803a090 0x7fc0f803c470 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc10c102890 0x7fc10c078c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 --2- 172.21.15.82:0/2986608369 >> [v2:172.21.15.82:6800/3417466421,v1:172.21.15.82:6801/3417466421] conn(0x7fc0f80368a0 0x7fc0f8038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 >> 172.21.15.82:0/2986608369 conn(0x7fc10c0fe050 msgr2=0x7fc10c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 shutdown_connections 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:36.005+0000 7fc112127700 1 -- 172.21.15.82:0/2986608369 wait complete. 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-04-27T07:24:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-04-27T07:24:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:37 smithi082 ceph-mon[26613]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-27T07:24:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:37 smithi082 ceph-mon[26613]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-27T07:24:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:37 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:37 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:37 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-27T07:24:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cff03b700 1 Processor -- start 2024-04-27T07:24:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cff03b700 1 -- start start 2024-04-27T07:24:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cff03b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cff03b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81031d0 con 0x7f9cf8102880 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cfcdd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cfcdd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51238/0 (socket says 172.21.15.82:51238) 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cfcdd7700 1 -- 172.21.15.82:0/3010420945 learned_addr learned my addr 172.21.15.82:0/3010420945 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.135+0000 7f9cfcdd7700 1 -- 172.21.15.82:0/3010420945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8103310 con 0x7f9cf8102880 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cfcdd7700 1 --2- 172.21.15.82:0/3010420945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0098e0 tx=0x7f9cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02993b3329c0ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cf77fe700 1 -- 172.21.15.82:0/3010420945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cec00b860 con 0x7f9cf8102880 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cf77fe700 1 -- 172.21.15.82:0/3010420945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cec00be90 con 0x7f9cf8102880 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cf77fe700 1 -- 172.21.15.82:0/3010420945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cec0103c0 con 0x7f9cf8102880 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 -- 172.21.15.82:0/3010420945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 msgr2=0x7f9cf8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 --2- 172.21.15.82:0/3010420945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0098e0 tx=0x7f9cec009250 comp rx=0 tx=0).stop 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 -- 172.21.15.82:0/3010420945 shutdown_connections 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 --2- 172.21.15.82:0/3010420945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8102c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 -- 172.21.15.82:0/3010420945 >> 172.21.15.82:0/3010420945 conn(0x7f9cf80fe060 msgr2=0x7f9cf8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:38.045 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 -- 172.21.15.82:0/3010420945 shutdown_connections 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.136+0000 7f9cff03b700 1 -- 172.21.15.82:0/3010420945 wait complete. 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cff03b700 1 Processor -- start 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cff03b700 1 -- start start 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cff03b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cff03b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8111b60 con 0x7f9cf8102880 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cfcdd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cfcdd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51250/0 (socket says 172.21.15.82:51250) 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.137+0000 7f9cfcdd7700 1 -- 172.21.15.82:0/1718339426 learned_addr learned my addr 172.21.15.82:0/1718339426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cfcdd7700 1 -- 172.21.15.82:0/1718339426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0094f0 con 0x7f9cf8102880 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cfcdd7700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9cec011680 tx=0x7f9cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cec010890 con 0x7f9cf8102880 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf8111d60 con 0x7f9cf8102880 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cec010ec0 con 0x7f9cf8102880 2024-04-27T07:24:38.046 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cec0243f0 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.138+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf81128d0 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f9cec02d3f0 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cf57fa700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 0x7f9ce8038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9cec04b230 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cf7fff700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 0x7f9ce8038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf805f5c0 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.139+0000 7f9cf7fff700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 0x7f9ce8038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009990 tx=0x7f9ce4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.144+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9cec02b8e0 con 0x7f9cf8102880 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.341+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cf80ff250 con 0x7f9ce80367d0 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.418+0000 7f9cf57fa700 1 -- 172.21.15.82:0/1718339426 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f9cf80ff250 con 0x7f9ce80367d0 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 msgr2=0x7f9ce8038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 0x7f9ce8038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009990 tx=0x7f9ce4006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 msgr2=0x7f9cf8111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:38.047 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9cec011680 tx=0x7f9cec009250 comp rx=0 tx=0).stop 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 shutdown_connections 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9ce80367d0 0x7f9ce8038c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 --2- 172.21.15.82:0/1718339426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cf8102880 0x7f9cf8111620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 >> 172.21.15.82:0/1718339426 conn(0x7f9cf80fe060 msgr2=0x7f9cf80feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 shutdown_connections 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:37.420+0000 7f9cff03b700 1 -- 172.21.15.82:0/1718339426 wait complete. 2024-04-27T07:24:38.048 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-04-27T07:24:38.674 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:38 smithi082 ceph-mon[26613]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:38.674 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:38 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:38.674 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:38 smithi082 ceph-mon[26613]: mgrmap e12: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:24:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:39 smithi082 ceph-mon[26613]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:39 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:40.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$biP0TpzHSBdp4ZZ5mFjzhOKsfqz31gEGei5gXuFjh4lQYVA1BLO6a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714202678, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.444+0000 7faf426b4700 1 Processor -- start 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.444+0000 7faf426b4700 1 -- start start 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.444+0000 7faf426b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.444+0000 7faf426b4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0790d0 con 0x7faf3c078cc0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.444+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51264/0 (socket says 172.21.15.82:51264) 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3bfff700 1 -- 172.21.15.82:0/2284526680 learned_addr learned my addr 172.21.15.82:0/2284526680 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3bfff700 1 -- 172.21.15.82:0/2284526680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0777b0 con 0x7faf3c078cc0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3bfff700 1 --2- 172.21.15.82:0/2284526680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0098e0 tx=0x7faf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c993bd5e5e9f7813 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3affd700 1 -- 172.21.15.82:0/2284526680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf2c00b860 con 0x7faf3c078cc0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3affd700 1 -- 172.21.15.82:0/2284526680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf2c00be90 con 0x7faf3c078cc0 2024-04-27T07:24:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.445+0000 7faf3affd700 1 -- 172.21.15.82:0/2284526680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf2c0103c0 con 0x7faf3c078cc0 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- 172.21.15.82:0/2284526680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 msgr2=0x7faf3c077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 --2- 172.21.15.82:0/2284526680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0098e0 tx=0x7faf2c009250 comp rx=0 tx=0).stop 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- 172.21.15.82:0/2284526680 shutdown_connections 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 --2- 172.21.15.82:0/2284526680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c077270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- 172.21.15.82:0/2284526680 >> 172.21.15.82:0/2284526680 conn(0x7faf3c0fe060 msgr2=0x7faf3c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- 172.21.15.82:0/2284526680 shutdown_connections 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- 172.21.15.82:0/2284526680 wait complete. 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 Processor -- start 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.446+0000 7faf426b4700 1 -- start start 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf426b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf426b4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c113d80 con 0x7faf3c078cc0 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51270/0 (socket says 172.21.15.82:51270) 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf3bfff700 1 -- 172.21.15.82:0/3325370597 learned_addr learned my addr 172.21.15.82:0/3325370597 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:40.268 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf3bfff700 1 -- 172.21.15.82:0/3325370597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094f0 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf3bfff700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006d40 tx=0x7faf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf2c010840 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c113f80 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf2c010e70 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf2c024ea0 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.447+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c114af0 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.448+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7faf2c01a510 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.448+0000 7faf38ff9700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 0x7faf24038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.448+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faf2c04a820 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.448+0000 7faf3b7fe700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 0x7faf24038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.449+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c05f5c0 con 0x7faf3c078cc0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.449+0000 7faf3b7fe700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 0x7faf24038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf30009990 tx=0x7faf30006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:40.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.453+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faf2c018940 con 0x7faf3c078cc0 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.671+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7faf3c04bed0 con 0x7faf24036850 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.895+0000 7faf38ff9700 1 -- 172.21.15.82:0/3325370597 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7faf3c04bed0 con 0x7faf24036850 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 msgr2=0x7faf24038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 0x7faf24038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf30009990 tx=0x7faf30006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 msgr2=0x7faf3c113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006d40 tx=0x7faf2c009250 comp rx=0 tx=0).stop 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 shutdown_connections 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faf24036850 0x7faf24038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 --2- 172.21.15.82:0/3325370597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf3c078cc0 0x7faf3c113840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.897+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 >> 172.21.15.82:0/3325370597 conn(0x7faf3c0fe060 msgr2=0x7faf3c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.898+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 shutdown_connections 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:38.898+0000 7faf426b4700 1 -- 172.21.15.82:0/3325370597 wait complete. 2024-04-27T07:24:40.270 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-04-27T07:24:41.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:40 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/42749182' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.721+0000 7efe242a1700 1 Processor -- start 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.721+0000 7efe242a1700 1 -- start start 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe242a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe242a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c1059b0 con 0x7efe1c0712b0 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2203d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2203d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51284/0 (socket says 172.21.15.82:51284) 2024-04-27T07:24:41.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2203d700 1 -- 172.21.15.82:0/3471847808 learned_addr learned my addr 172.21.15.82:0/3471847808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2203d700 1 -- 172.21.15.82:0/3471847808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c105af0 con 0x7efe1c0712b0 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2203d700 1 --2- 172.21.15.82:0/3471847808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098e0 tx=0x7efe0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cc5635a72fed3e server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2103b700 1 -- 172.21.15.82:0/3471847808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c00b860 con 0x7efe1c0712b0 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2103b700 1 -- 172.21.15.82:0/3471847808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c00be90 con 0x7efe1c0712b0 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.722+0000 7efe2103b700 1 -- 172.21.15.82:0/3471847808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c0103c0 con 0x7efe1c0712b0 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 -- 172.21.15.82:0/3471847808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 msgr2=0x7efe1c105470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 --2- 172.21.15.82:0/3471847808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098e0 tx=0x7efe0c009250 comp rx=0 tx=0).stop 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 -- 172.21.15.82:0/3471847808 shutdown_connections 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 --2- 172.21.15.82:0/3471847808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c105470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 -- 172.21.15.82:0/3471847808 >> 172.21.15.82:0/3471847808 conn(0x7efe1c0fcec0 msgr2=0x7efe1c0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 -- 172.21.15.82:0/3471847808 shutdown_connections 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 -- 172.21.15.82:0/3471847808 wait complete. 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.723+0000 7efe242a1700 1 Processor -- start 2024-04-27T07:24:41.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe242a1700 1 -- start start 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe242a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe242a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c111b40 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe2203d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe2203d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51292/0 (socket says 172.21.15.82:51292) 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe2203d700 1 -- 172.21.15.82:0/42749182 learned_addr learned my addr 172.21.15.82:0/42749182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe2203d700 1 -- 172.21.15.82:0/42749182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0094f0 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe2203d700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006d40 tx=0x7efe0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c010840 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c010e70 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c111d40 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c024ea0 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.724+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c1128b0 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.725+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7efe0c01a510 con 0x7efe1c0712b0 2024-04-27T07:24:41.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.725+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c05f5c0 con 0x7efe1c0712b0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.725+0000 7efe12ffd700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 0x7efe08038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.725+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efe0c04a820 con 0x7efe1c0712b0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.726+0000 7efe2183c700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 0x7efe08038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.726+0000 7efe2183c700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 0x7efe08038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efe18009990 tx=0x7efe18006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.730+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efe0c018940 con 0x7efe1c0712b0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.917+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7efe1c04bed0 con 0x7efe1c0712b0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.918+0000 7efe12ffd700 1 -- 172.21.15.82:0/42749182 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7efe0c018350 con 0x7efe1c0712b0 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 msgr2=0x7efe08038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 0x7efe08038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efe18009990 tx=0x7efe18006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 msgr2=0x7efe1c111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006d40 tx=0x7efe0c009250 comp rx=0 tx=0).stop 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 shutdown_connections 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7efe08036850 0x7efe08038d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 --2- 172.21.15.82:0/42749182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe1c0712b0 0x7efe1c111600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:41.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 >> 172.21.15.82:0/42749182 conn(0x7efe1c0fcec0 msgr2=0x7efe1c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:41.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 shutdown_connections 2024-04-27T07:24:41.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:40.920+0000 7efe242a1700 1 -- 172.21.15.82:0/42749182 wait complete. 2024-04-27T07:24:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-27T07:24:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-04-27T07:24:41.494 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-27T07:24:41.494 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-04-27T07:24:41.494 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-04-27T07:24:41.494 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082:8443/ 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: Password: bwwhw3f50k 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config directory 2024-04-27T07:24:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-04-27T07:24:42.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ed5e17700 1 Processor -- start 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ed5e17700 1 -- start start 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ed5e17700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ed5e17700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0103650 con 0x7f1ed0102c70 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51296/0 (socket says 172.21.15.82:51296) 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.930+0000 7f1ecf7fe700 1 -- 172.21.15.82:0/3987501195 learned_addr learned my addr 172.21.15.82:0/3987501195 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.931+0000 7f1ecf7fe700 1 -- 172.21.15.82:0/3987501195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0103790 con 0x7f1ed0102c70 2024-04-27T07:24:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.931+0000 7f1ecf7fe700 1 --2- 172.21.15.82:0/3987501195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00098e0 tx=0x7f1ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5355905edfd38ec server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.931+0000 7f1ece7fc700 1 -- 172.21.15.82:0/3987501195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec000b860 con 0x7f1ed0102c70 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.931+0000 7f1ece7fc700 1 -- 172.21.15.82:0/3987501195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ec000be90 con 0x7f1ed0102c70 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.931+0000 7f1ece7fc700 1 -- 172.21.15.82:0/3987501195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec00103c0 con 0x7f1ed0102c70 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- 172.21.15.82:0/3987501195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 msgr2=0x7f1ed0103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/3987501195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00098e0 tx=0x7f1ec0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- 172.21.15.82:0/3987501195 shutdown_connections 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/3987501195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0103080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- 172.21.15.82:0/3987501195 >> 172.21.15.82:0/3987501195 conn(0x7f1ed00fc6f0 msgr2=0x7f1ed00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- 172.21.15.82:0/3987501195 shutdown_connections 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- 172.21.15.82:0/3987501195 wait complete. 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 Processor -- start 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- start start 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:42.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.932+0000 7f1ed5e17700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0113da0 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ecf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51302/0 (socket says 172.21.15.82:51302) 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ecf7fe700 1 -- 172.21.15.82:0/1861815032 learned_addr learned my addr 172.21.15.82:0/1861815032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ecf7fe700 1 -- 172.21.15.82:0/1861815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094f0 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ecf7fe700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00090b0 tx=0x7f1ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec0010840 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ec0010e70 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec0024e40 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed0113fa0 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.933+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0114ac0 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.934+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f1ec001a510 con 0x7f1ed0102c70 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.934+0000 7f1eb7fff700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 0x7f1eb8038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:42.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.934+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed005f5c0 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.934+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1ec004a930 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.934+0000 7f1eceffd700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 0x7f1eb8038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.935+0000 7f1eceffd700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 0x7f1eb8038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009990 tx=0x7f1ec4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.939+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1ec0018530 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:41.971+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f1ec0024430 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.128+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f1ed004bed0 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.129+0000 7f1eb7fff700 1 -- 172.21.15.82:0/1861815032 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1ec0018530 con 0x7f1ed0102c70 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.130+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 msgr2=0x7f1eb8038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 0x7f1eb8038d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009990 tx=0x7f1ec4006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 msgr2=0x7f1ed0113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:42.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00090b0 tx=0x7f1ec0009250 comp rx=0 tx=0).stop 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 shutdown_connections 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1eb8036850 0x7f1eb8038d00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 --2- 172.21.15.82:0/1861815032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ed0102c70 0x7f1ed0113860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 >> 172.21.15.82:0/1861815032 conn(0x7f1ed00fc6f0 msgr2=0x7f1ed00fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 shutdown_connections 2024-04-27T07:24:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:42.131+0000 7f1ed5e17700 1 -- 172.21.15.82:0/1861815032 wait complete. 2024-04-27T07:24:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:42 smithi082 ceph-mon[26613]: mgrmap e13: smithi082.hhlhmf(active, since 6s) 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc654595700 1 Processor -- start 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc654595700 1 -- start start 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc654595700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc654595700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c103180 con 0x7fc64c102830 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc652331700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc652331700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51310/0 (socket says 172.21.15.82:51310) 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.125+0000 7fc652331700 1 -- 172.21.15.82:0/3744799581 learned_addr learned my addr 172.21.15.82:0/3744799581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc652331700 1 -- 172.21.15.82:0/3744799581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c1032c0 con 0x7fc64c102830 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc652331700 1 --2- 172.21.15.82:0/3744799581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6480098e0 tx=0x7fc648009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5632506d29b4a72b server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:44.002 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc65132f700 1 -- 172.21.15.82:0/3744799581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc64800b860 con 0x7fc64c102830 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc65132f700 1 -- 172.21.15.82:0/3744799581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc64800be90 con 0x7fc64c102830 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc65132f700 1 -- 172.21.15.82:0/3744799581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6480103c0 con 0x7fc64c102830 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc654595700 1 -- 172.21.15.82:0/3744799581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 msgr2=0x7fc64c102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc654595700 1 --2- 172.21.15.82:0/3744799581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6480098e0 tx=0x7fc648009250 comp rx=0 tx=0).stop 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc654595700 1 -- 172.21.15.82:0/3744799581 shutdown_connections 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc654595700 1 --2- 172.21.15.82:0/3744799581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c102c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.126+0000 7fc654595700 1 -- 172.21.15.82:0/3744799581 >> 172.21.15.82:0/3744799581 conn(0x7fc64c0fdf90 msgr2=0x7fc64c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 -- 172.21.15.82:0/3744799581 shutdown_connections 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 -- 172.21.15.82:0/3744799581 wait complete. 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 Processor -- start 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 -- start start 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc654595700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c111b50 con 0x7fc64c102830 2024-04-27T07:24:44.003 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc652331700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc652331700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51322/0 (socket says 172.21.15.82:51322) 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc652331700 1 -- 172.21.15.82:0/3009219891 learned_addr learned my addr 172.21.15.82:0/3009219891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.127+0000 7fc652331700 1 -- 172.21.15.82:0/3009219891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480094f0 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc652331700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc6480090b0 tx=0x7fc648009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc648010840 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c111d50 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc648010e70 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc648024e40 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.128+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c1128c0 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fc64801a530 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc642ffd700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 0x7fc638038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc648024430 con 0x7fc64c102830 2024-04-27T07:24:44.004 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc651b30700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 0x7fc638038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c05f5c0 con 0x7fc64c102830 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.129+0000 7fc651b30700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 0x7fc638038da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009990 tx=0x7fc63c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.134+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc648018940 con 0x7fc64c102830 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.426+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fc64c04bed0 con 0x7fc64c102830 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.429+0000 7fc642ffd700 1 -- 172.21.15.82:0/3009219891 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fc648018350 con 0x7fc64c102830 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 msgr2=0x7fc638038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 0x7fc638038da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009990 tx=0x7fc63c006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 msgr2=0x7fc64c111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc6480090b0 tx=0x7fc648009250 comp rx=0 tx=0).stop 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 shutdown_connections 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fc6380368f0 0x7fc638038da0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 --2- 172.21.15.82:0/3009219891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc64c102830 0x7fc64c111610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 >> 172.21.15.82:0/3009219891 conn(0x7fc64c0fdf90 msgr2=0x7fc64c0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 shutdown_connections 2024-04-27T07:24:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-04-27T07:24:43.431+0000 7fc654595700 1 -- 172.21.15.82:0/3009219891 wait complete. 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.006 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-04-27T07:24:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-27T07:24:44.007 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:24:44.007 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-04-27T07:24:44.033 INFO:tasks.cephadm:Fetching config... 2024-04-27T07:24:44.034 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:24:44.034 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-27T07:24:44.090 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-27T07:24:44.090 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:24:44.090 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-27T07:24:44.145 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-27T07:24:44.145 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:24:44.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/keyring of=/dev/stdout 2024-04-27T07:24:44.209 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-27T07:24:44.210 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:24:44.210 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-27T07:24:44.264 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-27T07:24:44.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKAsyyPbJ6BVxFg8vkgbQKEk9cTbbPaVmy0lG1Xqpj58Vy+XgL2Qx/NdkgFv10cUFFMrVzj8UuHV3shRYp/OVW+bfycPEA/f3obwX8RJCiv8Gz6CwB+SRAtLxsk5yvuAjocOlvBCsTa/aoPTtYYDiIVNP/oLI7ahSHzUWI7F1SyKNMVzrfH5SBGrF2Bn+rzVnuSeddZk55PVrMficdtZMWyyHckeHsBk+j+KlGMIf1lGy1elH0RrrN4T4QGrOE+0QZ7JNxGA6ypm+dwAd/TXytfTAfN6qFS6+wkv8M1A6xsvC3WQs+2+sk0Jwz33HBWMcCfEShlNgQz8fMS3D6m6r0IsolA38ix+VBClyv1IThvJ0HsAjLHca0rULdm7/AxGo/gAQ88IVH+LVFHLc3W4VDFmz6Xrfq8JmRUe6HhPZUeL9EbuspqV8h/Ag8es0WGzbg594tKGjAE7xf1lxjby6x7UqYIeNV45bIhUasYB3d+PtkLR3JC8AIBsrpKW7sqDU= ceph-ebadc0d6-0466-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-27T07:24:44.341 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKAsyyPbJ6BVxFg8vkgbQKEk9cTbbPaVmy0lG1Xqpj58Vy+XgL2Qx/NdkgFv10cUFFMrVzj8UuHV3shRYp/OVW+bfycPEA/f3obwX8RJCiv8Gz6CwB+SRAtLxsk5yvuAjocOlvBCsTa/aoPTtYYDiIVNP/oLI7ahSHzUWI7F1SyKNMVzrfH5SBGrF2Bn+rzVnuSeddZk55PVrMficdtZMWyyHckeHsBk+j+KlGMIf1lGy1elH0RrrN4T4QGrOE+0QZ7JNxGA6ypm+dwAd/TXytfTAfN6qFS6+wkv8M1A6xsvC3WQs+2+sk0Jwz33HBWMcCfEShlNgQz8fMS3D6m6r0IsolA38ix+VBClyv1IThvJ0HsAjLHca0rULdm7/AxGo/gAQ88IVH+LVFHLc3W4VDFmz6Xrfq8JmRUe6HhPZUeL9EbuspqV8h/Ag8es0WGzbg594tKGjAE7xf1lxjby6x7UqYIeNV45bIhUasYB3d+PtkLR3JC8AIBsrpKW7sqDU= ceph-ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:24:44.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKAsyyPbJ6BVxFg8vkgbQKEk9cTbbPaVmy0lG1Xqpj58Vy+XgL2Qx/NdkgFv10cUFFMrVzj8UuHV3shRYp/OVW+bfycPEA/f3obwX8RJCiv8Gz6CwB+SRAtLxsk5yvuAjocOlvBCsTa/aoPTtYYDiIVNP/oLI7ahSHzUWI7F1SyKNMVzrfH5SBGrF2Bn+rzVnuSeddZk55PVrMficdtZMWyyHckeHsBk+j+KlGMIf1lGy1elH0RrrN4T4QGrOE+0QZ7JNxGA6ypm+dwAd/TXytfTAfN6qFS6+wkv8M1A6xsvC3WQs+2+sk0Jwz33HBWMcCfEShlNgQz8fMS3D6m6r0IsolA38ix+VBClyv1IThvJ0HsAjLHca0rULdm7/AxGo/gAQ88IVH+LVFHLc3W4VDFmz6Xrfq8JmRUe6HhPZUeL9EbuspqV8h/Ag8es0WGzbg594tKGjAE7xf1lxjby6x7UqYIeNV45bIhUasYB3d+PtkLR3JC8AIBsrpKW7sqDU= ceph-ebadc0d6-0466-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-27T07:24:44.392 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKAsyyPbJ6BVxFg8vkgbQKEk9cTbbPaVmy0lG1Xqpj58Vy+XgL2Qx/NdkgFv10cUFFMrVzj8UuHV3shRYp/OVW+bfycPEA/f3obwX8RJCiv8Gz6CwB+SRAtLxsk5yvuAjocOlvBCsTa/aoPTtYYDiIVNP/oLI7ahSHzUWI7F1SyKNMVzrfH5SBGrF2Bn+rzVnuSeddZk55PVrMficdtZMWyyHckeHsBk+j+KlGMIf1lGy1elH0RrrN4T4QGrOE+0QZ7JNxGA6ypm+dwAd/TXytfTAfN6qFS6+wkv8M1A6xsvC3WQs+2+sk0Jwz33HBWMcCfEShlNgQz8fMS3D6m6r0IsolA38ix+VBClyv1IThvJ0HsAjLHca0rULdm7/AxGo/gAQ88IVH+LVFHLc3W4VDFmz6Xrfq8JmRUe6HhPZUeL9EbuspqV8h/Ag8es0WGzbg594tKGjAE7xf1lxjby6x7UqYIeNV45bIhUasYB3d+PtkLR3JC8AIBsrpKW7sqDU= ceph-ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:24:44.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-27T07:24:44.438 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:44 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3009219891' entity='client.admin' 2024-04-27T07:24:44.655 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:24:47.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.136+0000 7fe788b9f700 1 -- 172.21.15.82:0/2127470633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 msgr2=0x7fe7840fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.136+0000 7fe788b9f700 1 --2- 172.21.15.82:0/2127470633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840fbd40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7740048c0 tx=0x7fe774009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- 172.21.15.82:0/2127470633 shutdown_connections 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 --2- 172.21.15.82:0/2127470633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840fbd40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- 172.21.15.82:0/2127470633 >> 172.21.15.82:0/2127470633 conn(0x7fe7840f7070 msgr2=0x7fe7840f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- 172.21.15.82:0/2127470633 shutdown_connections 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- 172.21.15.82:0/2127470633 wait complete. 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 Processor -- start 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- start start 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.137+0000 7fe788b9f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840f9560 con 0x7fe7840fb930 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe78259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe78259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40230/0 (socket says 172.21.15.82:40230) 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe78259c700 1 -- 172.21.15.82:0/3333717261 learned_addr learned my addr 172.21.15.82:0/3333717261 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe78259c700 1 -- 172.21.15.82:0/3333717261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774005040 con 0x7fe7840fb930 2024-04-27T07:24:47.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe78259c700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe774009680 tx=0x7fe774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe77400b5c0 con 0x7fe7840fb930 2024-04-27T07:24:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7840f7630 con 0x7fe7840fb930 2024-04-27T07:24:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe77400be70 con 0x7fe7840fb930 2024-04-27T07:24:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7740135a0 con 0x7fe7840fb930 2024-04-27T07:24:47.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.138+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7840f7b20 con 0x7fe7840fb930 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.139+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fe774013860 con 0x7fe7840fb930 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.139+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78405f5c0 con 0x7fe7840fb930 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.139+0000 7fe772ffd700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 0x7fe76c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.139+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe7740493c0 con 0x7fe7840fb930 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.139+0000 7fe781d9b700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 0x7fe76c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:47.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.140+0000 7fe781d9b700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 0x7fe76c038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe778009990 tx=0x7fe778006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:47.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.144+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe774011960 con 0x7fe7840fb930 2024-04-27T07:24:47.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.338+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fe78404bed0 con 0x7fe7840fb930 2024-04-27T07:24:47.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.341+0000 7fe772ffd700 1 -- 172.21.15.82:0/3333717261 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe774021070 con 0x7fe7840fb930 2024-04-27T07:24:47.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 msgr2=0x7fe76c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 0x7fe76c038d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe778009990 tx=0x7fe778006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 msgr2=0x7fe7840f9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe774009680 tx=0x7fe774009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 shutdown_connections 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fe76c036880 0x7fe76c038d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 --2- 172.21.15.82:0/3333717261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7840fb930 0x7fe7840f9020 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 >> 172.21.15.82:0/3333717261 conn(0x7fe7840f7070 msgr2=0x7fe784065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 shutdown_connections 2024-04-27T07:24:47.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:47.343+0000 7fe788b9f700 1 -- 172.21.15.82:0/3333717261 wait complete. 2024-04-27T07:24:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3333717261' entity='client.admin' 2024-04-27T07:24:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:24:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:48.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:24:48.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-27T07:24:48.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:48 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:24:48.626 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-27T07:24:48.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-27T07:24:49.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:49 smithi082 ceph-mon[26613]: Deploying daemon crash.smithi082 on smithi082 2024-04-27T07:24:49.795 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:24:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 -- 172.21.15.82:0/2571007275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 msgr2=0x7fa0700fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 --2- 172.21.15.82:0/2571007275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa0700fbd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa0600048c0 tx=0x7fa060009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 -- 172.21.15.82:0/2571007275 shutdown_connections 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 --2- 172.21.15.82:0/2571007275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa0700fbd50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 -- 172.21.15.82:0/2571007275 >> 172.21.15.82:0/2571007275 conn(0x7fa0700f70a0 msgr2=0x7fa0700f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 -- 172.21.15.82:0/2571007275 shutdown_connections 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.224+0000 7fa07584f700 1 -- 172.21.15.82:0/2571007275 wait complete. 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa07584f700 1 Processor -- start 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa07584f700 1 -- start start 2024-04-27T07:24:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa07584f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa07584f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07010dba0 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa06effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa06effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40254/0 (socket says 172.21.15.82:40254) 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa06effd700 1 -- 172.21.15.82:0/1747353520 learned_addr learned my addr 172.21.15.82:0/1747353520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.225+0000 7fa06effd700 1 -- 172.21.15.82:0/1747353520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060005040 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa06effd700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa060009680 tx=0x7fa060009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa06000b5c0 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa06000be70 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0701121b0 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0600135a0 con 0x7fa0700fb940 2024-04-27T07:24:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.226+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0701125e0 con 0x7fa0700fb940 2024-04-27T07:24:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fa060013810 con 0x7fa0700fb940 2024-04-27T07:24:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa070105900 con 0x7fa0700fb940 2024-04-27T07:24:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa0577fe700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 0x7fa058038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa060049340 con 0x7fa0700fb940 2024-04-27T07:24:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa06e7fc700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 0x7fa058038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.227+0000 7fa06e7fc700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 0x7fa058038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa064009990 tx=0x7fa064006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.232+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa060011960 con 0x7fa0700fb940 2024-04-27T07:24:51.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.436+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fa07002b310 con 0x7fa0580368d0 2024-04-27T07:24:51.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.440+0000 7fa0577fe700 1 -- 172.21.15.82:0/1747353520 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa07002b310 con 0x7fa0580368d0 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 msgr2=0x7fa058038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 0x7fa058038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa064009990 tx=0x7fa064006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 msgr2=0x7fa070065bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa060009680 tx=0x7fa060009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 shutdown_connections 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fa0580368d0 0x7fa058038d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 --2- 172.21.15.82:0/1747353520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0700fb940 0x7fa070065bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 >> 172.21.15.82:0/1747353520 conn(0x7fa0700f70a0 msgr2=0x7fa070102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:51.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 shutdown_connections 2024-04-27T07:24:51.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:51.442+0000 7fa07584f700 1 -- 172.21.15.82:0/1747353520 wait complete. 2024-04-27T07:24:52.391 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2024-04-27T07:24:52.391 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:24:52.391 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2024-04-27T07:24:52.410 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:24:52.410 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:24:52.468 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2024-04-27T07:24:52.468 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch host add smithi100 2024-04-27T07:24:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:52.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:52.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:52 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:52.852 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:24:53.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:53 smithi082 ceph-mon[26613]: Deploying daemon node-exporter.smithi082 on smithi082 2024-04-27T07:24:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/3683918753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 msgr2=0x7f4a780fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/3683918753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a780fbd50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a740048c0 tx=0x7f4a74009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/3683918753 shutdown_connections 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/3683918753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a780fbd50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/3683918753 >> 172.21.15.82:0/3683918753 conn(0x7f4a780f70a0 msgr2=0x7f4a780f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/3683918753 shutdown_connections 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/3683918753 wait complete. 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 Processor -- start 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.380+0000 7f4a7fd4a700 1 -- start start 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7fd4a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7fd4a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7810d5a0 con 0x7f4a780fb940 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7dae6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7dae6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40274/0 (socket says 172.21.15.82:40274) 2024-04-27T07:24:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7dae6700 1 -- 172.21.15.82:0/598007067 learned_addr learned my addr 172.21.15.82:0/598007067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:24:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7dae6700 1 -- 172.21.15.82:0/598007067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74005040 con 0x7f4a780fb940 2024-04-27T07:24:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7dae6700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a740096b0 tx=0x7f4a74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a7400bed0 con 0x7f4a780fb940 2024-04-27T07:24:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a7400b5c0 con 0x7f4a780fb940 2024-04-27T07:24:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7810d7a0 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a7401c5b0 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.381+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7810e310 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.382+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f4a74013420 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.382+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78101e50 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.382+0000 7f4a6e7fc700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 0x7f4a64038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.382+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4a74049a50 con 0x7f4a780fb940 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.382+0000 7f4a7d2e5700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 0x7f4a64038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:24:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.383+0000 7f4a7d2e5700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 0x7f4a64038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009990 tx=0x7f4a68006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:24:54.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.387+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4a74025400 con 0x7f4a780fb940 2024-04-27T07:24:54.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:54.582+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a780663f0 con 0x7f4a64036880 2024-04-27T07:24:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:56 smithi082 ceph-mon[26613]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:24:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:56 smithi082 ceph-mon[26613]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:24:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:56 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:56 smithi082 ceph-mon[26613]: Deploying cephadm binary to smithi100 2024-04-27T07:24:56.416 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi100' with addr '172.21.15.100' 2024-04-27T07:24:56.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.414+0000 7f4a6e7fc700 1 -- 172.21.15.82:0/598007067 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4a780663f0 con 0x7f4a64036880 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 msgr2=0x7f4a64038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 0x7f4a64038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009990 tx=0x7f4a68006e40 comp rx=0 tx=0).stop 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 msgr2=0x7f4a7810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a740096b0 tx=0x7f4a74009e30 comp rx=0 tx=0).stop 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 shutdown_connections 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f4a64036880 0x7f4a64038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:56.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 --2- 172.21.15.82:0/598007067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a780fb940 0x7f4a7810d060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:24:56.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 >> 172.21.15.82:0/598007067 conn(0x7f4a780f70a0 msgr2=0x7f4a78065ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:24:56.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 shutdown_connections 2024-04-27T07:24:56.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:24:56.416+0000 7f4a7fd4a700 1 -- 172.21.15.82:0/598007067 wait complete. 2024-04-27T07:24:57.413 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-27T07:24:57.681 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: Added host smithi100 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:57.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:57 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:24:58.739 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:58 smithi082 ceph-mon[26613]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:24:58.740 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:24:58 smithi082 ceph-mon[26613]: Deploying daemon alertmanager.smithi082 on smithi082 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 -- 172.21.15.82:0/3671332377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 msgr2=0x7f39d00fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 --2- 172.21.15.82:0/3671332377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d00fbd50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39c40048c0 tx=0x7f39c4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 -- 172.21.15.82:0/3671332377 shutdown_connections 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 --2- 172.21.15.82:0/3671332377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d00fbd50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 -- 172.21.15.82:0/3671332377 >> 172.21.15.82:0/3671332377 conn(0x7f39d00f70a0 msgr2=0x7f39d00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 -- 172.21.15.82:0/3671332377 shutdown_connections 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 -- 172.21.15.82:0/3671332377 wait complete. 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.113+0000 7f39d7113700 1 Processor -- start 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d7113700 1 -- start start 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d7113700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d7113700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d010d5c0 con 0x7f39d00fb940 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d4eaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d4eaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45120/0 (socket says 172.21.15.82:45120) 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d4eaf700 1 -- 172.21.15.82:0/732992504 learned_addr learned my addr 172.21.15.82:0/732992504 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d4eaf700 1 -- 172.21.15.82:0/732992504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4005040 con 0x7f39d00fb940 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d4eaf700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009680 tx=0x7f39c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39c400b5c0 con 0x7f39d00fb940 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39c400be70 con 0x7f39d00fb940 2024-04-27T07:25:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d010d7c0 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.114+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39c40135a0 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.115+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d010e330 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.115+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f39c4013860 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.116+0000 7f39cd7fa700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 0x7f39c0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.116+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d0101e50 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.116+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f39c40495e0 con 0x7f39d00fb940 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.116+0000 7f39cffff700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 0x7f39c0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.116+0000 7f39cffff700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 0x7f39c0038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009990 tx=0x7f39bc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.120+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f39c4011960 con 0x7f39d00fb940 2024-04-27T07:25:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.340+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39d0065760 con 0x7f39c0036880 2024-04-27T07:25:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.341+0000 7f39cd7fa700 1 -- 172.21.15.82:0/732992504 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f39d0065760 con 0x7f39c0036880 2024-04-27T07:25:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:25:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2024-04-27T07:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 msgr2=0x7f39c0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 0x7f39c0038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009990 tx=0x7f39bc006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 msgr2=0x7f39d010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009680 tx=0x7f39c4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 shutdown_connections 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f39c0036880 0x7f39c0038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 --2- 172.21.15.82:0/732992504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39d00fb940 0x7f39d010d080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 >> 172.21.15.82:0/732992504 conn(0x7f39d00f70a0 msgr2=0x7f39d0065050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 shutdown_connections 2024-04-27T07:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:00.343+0000 7f39d7113700 1 -- 172.21.15.82:0/732992504 wait complete. 2024-04-27T07:25:00.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:00 smithi082 ceph-mon[26613]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:00.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:00 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:01.489 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-27T07:25:01.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-27T07:25:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:01 smithi082 ceph-mon[26613]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-27T07:25:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:25:02.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:02 smithi082 ceph-mon[26613]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:04.797 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:04 smithi082 ceph-mon[26613]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:05.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 -- 172.21.15.82:0/4060623114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 msgr2=0x7f9aa80fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 --2- 172.21.15.82:0/4060623114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa80fce50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40048c0 tx=0x7f9aa4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 -- 172.21.15.82:0/4060623114 shutdown_connections 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 --2- 172.21.15.82:0/4060623114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa80fce50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 -- 172.21.15.82:0/4060623114 >> 172.21.15.82:0/4060623114 conn(0x7f9aa80f81a0 msgr2=0x7f9aa80fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 -- 172.21.15.82:0/4060623114 shutdown_connections 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.292+0000 7f9aaf275700 1 -- 172.21.15.82:0/4060623114 wait complete. 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aaf275700 1 Processor -- start 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aaf275700 1 -- start start 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aaf275700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aaf275700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa810d5d0 con 0x7f9aa80fca40 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aad011700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aad011700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45134/0 (socket says 172.21.15.82:45134) 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aad011700 1 -- 172.21.15.82:0/1344907422 learned_addr learned my addr 172.21.15.82:0/1344907422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aad011700 1 -- 172.21.15.82:0/1344907422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa4005040 con 0x7f9aa80fca40 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aad011700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40096b0 tx=0x7f9aa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aa400bed0 con 0x7f9aa80fca40 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa810d7d0 con 0x7f9aa80fca40 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aa400b5c0 con 0x7f9aa80fca40 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.293+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aa401c5b0 con 0x7f9aa80fca40 2024-04-27T07:25:05.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.294+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa810e340 con 0x7f9aa80fca40 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.294+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f9aa4013420 con 0x7f9aa80fca40 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.295+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa8102f50 con 0x7f9aa80fca40 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.295+0000 7f9a9dffb700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 0x7f9a94038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.295+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9aa40499f0 con 0x7f9aa80fca40 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.295+0000 7f9aac810700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 0x7f9a94038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:05.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.295+0000 7f9aac810700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 0x7f9a94038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009990 tx=0x7f9a98006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.299+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9aa4025730 con 0x7f9aa80fca40 2024-04-27T07:25:05.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:05.503+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9aa810ee10 con 0x7f9aa80fca40 2024-04-27T07:25:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.430+0000 7f9a9dffb700 1 -- 172.21.15.82:0/1344907422 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9aa4011370 con 0x7f9aa80fca40 2024-04-27T07:25:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 msgr2=0x7f9a94038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 0x7f9a94038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009990 tx=0x7f9a98006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 msgr2=0x7f9aa810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40096b0 tx=0x7f9aa4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 shutdown_connections 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f9a94036880 0x7f9a94038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 --2- 172.21.15.82:0/1344907422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80fca40 0x7f9aa810d090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 >> 172.21.15.82:0/1344907422 conn(0x7f9aa80f81a0 msgr2=0x7f9aa8103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 shutdown_connections 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:25:06.433+0000 7f9aaf275700 1 -- 172.21.15.82:0/1344907422 wait complete. 2024-04-27T07:25:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-04-27T07:25:06.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:06 smithi082 ceph-mon[26613]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:06.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:06 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1344907422' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-27T07:25:07.018 INFO:tasks.cephadm:Adding mon.smithi082 on smithi082 2024-04-27T07:25:07.018 INFO:tasks.cephadm:Adding mon.smithi100 on smithi100 2024-04-27T07:25:07.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi082:172.21.15.82=smithi082;smithi100:172.21.15.100=smithi100' 2024-04-27T07:25:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:07.326 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:07.547 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:07 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1344907422' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-27T07:25:07.547 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:07 smithi082 ceph-mon[26613]: osdmap e4: 0 total, 0 up, 0 in 2024-04-27T07:25:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-27T07:25:08.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:08 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 -- 172.21.15.100:0/774283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 msgr2=0x7fdacc0fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 --2- 172.21.15.100:0/774283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc0fce70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0048c0 tx=0x7fdabc009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 -- 172.21.15.100:0/774283058 shutdown_connections 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 --2- 172.21.15.100:0/774283058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc0fce70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 -- 172.21.15.100:0/774283058 >> 172.21.15.100:0/774283058 conn(0x7fdacc0f81c0 msgr2=0x7fdacc0fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 -- 172.21.15.100:0/774283058 shutdown_connections 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 -- 172.21.15.100:0/774283058 wait complete. 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.887+0000 7fdad253d700 1 Processor -- start 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdad253d700 1 -- start start 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdad253d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdad253d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc072240 con 0x7fdacc0fca60 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdacbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdacbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:35650/0 (socket says 172.21.15.100:35650) 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdacbfff700 1 -- 172.21.15.100:0/983620566 learned_addr learned my addr 172.21.15.100:0/983620566 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdacbfff700 1 -- 172.21.15.100:0/983620566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc005040 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.888+0000 7fdacbfff700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0096b0 tx=0x7fdabc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.889+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdabc00bed0 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.889+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc070310 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.889+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdabc00b5c0 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.889+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdabc01c5b0 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.889+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc070800 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fdabc013420 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc05f5c0 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdac8ff9700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 0x7fdab4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdabc049b10 con 0x7fdacc0fca60 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdacb7fe700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 0x7fdab4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.890+0000 7fdacb7fe700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 0x7fdab4038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009990 tx=0x7fdac0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:08.895+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdabc025400 con 0x7fdacc0fca60 2024-04-27T07:25:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.086+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 --> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi082:172.21.15.82=smithi082;smithi100:172.21.15.100=smithi100", "target": ["mon-mgr", ""]}) v1 -- 0x7fdacc106560 con 0x7fdab4036880 2024-04-27T07:25:09.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.092+0000 7fdac8ff9700 1 -- 172.21.15.100:0/983620566 <== mgr.14162 v2:172.21.15.82:6800/1415088792 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdacc106560 con 0x7fdab4036880 2024-04-27T07:25:09.094 INFO:teuthology.orchestra.run.smithi100.stdout:Scheduled mon update... 2024-04-27T07:25:09.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 msgr2=0x7fdab4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 0x7fdab4038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009990 tx=0x7fdac0006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 msgr2=0x7fdacc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0096b0 tx=0x7fdabc009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 shutdown_connections 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fdab4036880 0x7fdab4038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 --2- 172.21.15.100:0/983620566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdacc0fca60 0x7fdacc071d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.093+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 >> 172.21.15.100:0/983620566 conn(0x7fdacc0f81c0 msgr2=0x7fdacc103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.094+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 shutdown_connections 2024-04-27T07:25:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:09.094+0000 7fdad253d700 1 -- 172.21.15.100:0/983620566 wait complete. 2024-04-27T07:25:09.600 DEBUG:teuthology.orchestra.run.smithi100:mon.smithi100> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi100.service 2024-04-27T07:25:09.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:09.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:09 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-27T07:25:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:09 smithi082 ceph-mon[26613]: Deploying daemon grafana.smithi082 on smithi082 2024-04-27T07:25:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:09 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:09.879 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:09.926 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:10.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:10 smithi082 ceph-mon[26613]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:10.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:10 smithi082 ceph-mon[26613]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi082:172.21.15.82=smithi082;smithi100:172.21.15.100=smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:25:10.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:10 smithi082 ceph-mon[26613]: Saving service mon spec with placement smithi082:172.21.15.82=smithi082;smithi100:172.21.15.100=smithi100;count:2 2024-04-27T07:25:10.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:10 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- 172.21.15.100:0/296560218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 msgr2=0x7f1f0c0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 --2- 172.21.15.100:0/296560218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c0fbd50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0048c0 tx=0x7f1efc009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- 172.21.15.100:0/296560218 shutdown_connections 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 --2- 172.21.15.100:0/296560218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c0fbd50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- 172.21.15.100:0/296560218 >> 172.21.15.100:0/296560218 conn(0x7f1f0c0f70a0 msgr2=0x7f1f0c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- 172.21.15.100:0/296560218 shutdown_connections 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- 172.21.15.100:0/296560218 wait complete. 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 Processor -- start 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.369+0000 7f1f10b85700 1 -- start start 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f10b85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f10b85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c10fdb0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f0a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:11.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f0a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:41058/0 (socket says 172.21.15.100:41058) 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f0a59c700 1 -- 172.21.15.100:0/1172966550 learned_addr learned my addr 172.21.15.100:0/1172966550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f0a59c700 1 -- 172.21.15.100:0/1172966550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc005040 con 0x7f1f0c0fb940 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f0a59c700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009680 tx=0x7f1efc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1efc00b5c0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1efc00be70 con 0x7f1f0c0fb940 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c10fef0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1efc0135a0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.370+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c1103e0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.371+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f1efc01c430 con 0x7f1f0c0fb940 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.371+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c105900 con 0x7f1f0c0fb940 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.372+0000 7f1efaffd700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 0x7f1ef4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.372+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1efc0493b0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.372+0000 7f1f09d9b700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 0x7f1ef4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.372+0000 7f1f09d9b700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 0x7f1ef4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009990 tx=0x7f1f00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:11.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.377+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1efc01c7d0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.638+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1f0c05f5c0 con 0x7f1f0c0fb940 2024-04-27T07:25:11.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.638+0000 7f1efaffd700 1 -- 172.21.15.100:0/1172966550 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1efc021020 con 0x7f1f0c0fb940 2024-04-27T07:25:11.640 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:11.640 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 msgr2=0x7f1ef4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 0x7f1ef4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009990 tx=0x7f1f00006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 msgr2=0x7f1f0c066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009680 tx=0x7f1efc009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 shutdown_connections 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f1ef4036880 0x7f1ef4038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 --2- 172.21.15.100:0/1172966550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f0c0fb940 0x7f1f0c066820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:11.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 >> 172.21.15.100:0/1172966550 conn(0x7f1f0c0f70a0 msgr2=0x7f1f0c102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 shutdown_connections 2024-04-27T07:25:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:11.640+0000 7f1f10b85700 1 -- 172.21.15.100:0/1172966550 wait complete. 2024-04-27T07:25:11.643 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:12 smithi082 ceph-mon[26613]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:12 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1172966550' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:13.222 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:13.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:13.474 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:13.521 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:14.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:14 smithi082 ceph-mon[26613]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 -- 172.21.15.100:0/1901892064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 msgr2=0x7f3b7c0fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 --2- 172.21.15.100:0/1901892064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c0fb4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0048c0 tx=0x7f3b6c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 -- 172.21.15.100:0/1901892064 shutdown_connections 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 --2- 172.21.15.100:0/1901892064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c0fb4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 -- 172.21.15.100:0/1901892064 >> 172.21.15.100:0/1901892064 conn(0x7f3b7c0f6820 msgr2=0x7f3b7c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 -- 172.21.15.100:0/1901892064 shutdown_connections 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.927+0000 7f3b82451700 1 -- 172.21.15.100:0/1901892064 wait complete. 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b82451700 1 Processor -- start 2024-04-27T07:25:14.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b82451700 1 -- start start 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b82451700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b82451700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c10fd90 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:41074/0 (socket says 172.21.15.100:41074) 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b7bfff700 1 -- 172.21.15.100:0/569651872 learned_addr learned my addr 172.21.15.100:0/569651872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.928+0000 7f3b7bfff700 1 -- 172.21.15.100:0/569651872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c005040 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b7bfff700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0096b0 tx=0x7f3b6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b6c00bed0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c10fed0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6c00b5c0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b6c01c5b0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.929+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c1103c0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f3b6c01c820 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c106060 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b78ff9700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 0x7f3b64038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:14.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3b6c049af0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:14.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b7b7fe700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 0x7f3b64038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:14.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.930+0000 7f3b7b7fe700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 0x7f3b64038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009990 tx=0x7f3b70006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:14.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:14.934+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3b6c023300 con 0x7f3b7c0fb0c0 2024-04-27T07:25:15.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.196+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b7c05f5c0 con 0x7f3b7c0fb0c0 2024-04-27T07:25:15.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.196+0000 7f3b78ff9700 1 -- 172.21.15.100:0/569651872 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3b6c011b60 con 0x7f3b7c0fb0c0 2024-04-27T07:25:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:15.199 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 msgr2=0x7f3b64038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 0x7f3b64038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009990 tx=0x7f3b70006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 msgr2=0x7f3b7c102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0096b0 tx=0x7f3b6c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 shutdown_connections 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f3b64036880 0x7f3b64038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 --2- 172.21.15.100:0/569651872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b7c0fb0c0 0x7f3b7c102340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 >> 172.21.15.100:0/569651872 conn(0x7f3b7c0f6820 msgr2=0x7f3b7c0f7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 shutdown_connections 2024-04-27T07:25:15.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:15.199+0000 7f3b82451700 1 -- 172.21.15.100:0/569651872 wait complete. 2024-04-27T07:25:15.202 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:15 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/569651872' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:16.795 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:16.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:16.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:16 smithi082 ceph-mon[26613]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:17.168 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:18.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 -- 172.21.15.100:0/1985300979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 msgr2=0x7f10bc0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:18.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 --2- 172.21.15.100:0/1985300979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc0fce40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0048c0 tx=0x7f10ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:18.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 -- 172.21.15.100:0/1985300979 shutdown_connections 2024-04-27T07:25:18.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 --2- 172.21.15.100:0/1985300979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc0fce40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 -- 172.21.15.100:0/1985300979 >> 172.21.15.100:0/1985300979 conn(0x7f10bc0f8170 msgr2=0x7f10bc0fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 -- 172.21.15.100:0/1985300979 shutdown_connections 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.628+0000 7f10c10f9700 1 -- 172.21.15.100:0/1985300979 wait complete. 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10c10f9700 1 Processor -- start 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10c10f9700 1 -- start start 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10c10f9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10c10f9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc072240 con 0x7f10bc0fca30 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10bad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10bad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:41092/0 (socket says 172.21.15.100:41092) 2024-04-27T07:25:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.629+0000 7f10bad9d700 1 -- 172.21.15.100:0/2867656621 learned_addr learned my addr 172.21.15.100:0/2867656621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10bad9d700 1 -- 172.21.15.100:0/2867656621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac005040 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10bad9d700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0096b0 tx=0x7f10ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10ac00bed0 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc070310 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10ac00b5c0 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10ac01c5b0 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.630+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc070800 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.631+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc05f5c0 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.631+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f10ac013a80 con 0x7f10bc0fca30 2024-04-27T07:25:18.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.631+0000 7f10a37fe700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 0x7f10a4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.631+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f10ac0499e0 con 0x7f10bc0fca30 2024-04-27T07:25:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.631+0000 7f10ba59c700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 0x7f10a4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.632+0000 7f10ba59c700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 0x7f10a4038d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009990 tx=0x7f10b0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:18.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.636+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f10ac011940 con 0x7f10bc0fca30 2024-04-27T07:25:18.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:18 smithi082 ceph-mon[26613]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:18.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.895+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f10bc106410 con 0x7f10bc0fca30 2024-04-27T07:25:18.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.896+0000 7f10a37fe700 1 -- 172.21.15.100:0/2867656621 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f10ac011370 con 0x7f10bc0fca30 2024-04-27T07:25:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:18.898 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.897+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 msgr2=0x7f10a4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 0x7f10a4038d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009990 tx=0x7f10b0006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 msgr2=0x7f10bc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0096b0 tx=0x7f10ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 shutdown_connections 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f10a40368d0 0x7f10a4038d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 --2- 172.21.15.100:0/2867656621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10bc0fca30 0x7f10bc071d00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 >> 172.21.15.100:0/2867656621 conn(0x7f10bc0f8170 msgr2=0x7f10bc103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 shutdown_connections 2024-04-27T07:25:18.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:18.898+0000 7f10c10f9700 1 -- 172.21.15.100:0/2867656621 wait complete. 2024-04-27T07:25:18.901 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:19.827 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:19 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/2867656621' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:20.434 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:20.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:20.566 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:20 smithi082 ceph-mon[26613]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:20.678 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:20.730 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:22.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: Deploying daemon prometheus.smithi082 on smithi082 2024-04-27T07:25:22.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:21 smithi082 ceph-mon[26613]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 -- 172.21.15.100:0/2707320499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 msgr2=0x7faed00ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 --2- 172.21.15.100:0/2707320499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed00ff6d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faec0009c60 tx=0x7faec0004d10 comp rx=0 tx=0).stop 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 -- 172.21.15.100:0/2707320499 shutdown_connections 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 --2- 172.21.15.100:0/2707320499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed00ff6d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 -- 172.21.15.100:0/2707320499 >> 172.21.15.100:0/2707320499 conn(0x7faed00f70a0 msgr2=0x7faed00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:22.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 -- 172.21.15.100:0/2707320499 shutdown_connections 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.152+0000 7faed6f0e700 1 -- 172.21.15.100:0/2707320499 wait complete. 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed6f0e700 1 Processor -- start 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed6f0e700 1 -- start start 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed6f0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed6f0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed010d5e0 con 0x7faed0065c90 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed4caa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed4caa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:58120/0 (socket says 172.21.15.100:58120) 2024-04-27T07:25:22.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed4caa700 1 -- 172.21.15.100:0/1953548371 learned_addr learned my addr 172.21.15.100:0/1953548371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.153+0000 7faed4caa700 1 -- 172.21.15.100:0/1953548371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009940 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faed4caa700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faec00095a0 tx=0x7faec0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faec001d440 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed010d7e0 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faec001da70 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faec0012a50 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.154+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed010e350 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.155+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7faec0019040 con 0x7faed0065c90 2024-04-27T07:25:22.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.155+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0102f50 con 0x7faed0065c90 2024-04-27T07:25:22.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.155+0000 7faecd7fa700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 0x7faebc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:22.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.155+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faec004a340 con 0x7faed0065c90 2024-04-27T07:25:22.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.155+0000 7faecffff700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 0x7faebc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:22.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.156+0000 7faecffff700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 0x7faebc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009990 tx=0x7faeb8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.164+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faec002eb40 con 0x7faed0065c90 2024-04-27T07:25:22.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.424+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faed005f5c0 con 0x7faed0065c90 2024-04-27T07:25:22.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.424+0000 7faecd7fa700 1 -- 172.21.15.100:0/1953548371 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7faec0017070 con 0x7faed0065c90 2024-04-27T07:25:22.427 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:22.427 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 msgr2=0x7faebc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 0x7faebc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009990 tx=0x7faeb8006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 msgr2=0x7faed010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faec00095a0 tx=0x7faec0004d10 comp rx=0 tx=0).stop 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 shutdown_connections 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7faebc036880 0x7faebc038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 --2- 172.21.15.100:0/1953548371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faed0065c90 0x7faed010d0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.426+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 >> 172.21.15.100:0/1953548371 conn(0x7faed00f70a0 msgr2=0x7faed0103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.427+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 shutdown_connections 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:22.427+0000 7faed6f0e700 1 -- 172.21.15.100:0/1953548371 wait complete. 2024-04-27T07:25:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:23.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:22 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1953548371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:24.038 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:24.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:24.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:23 smithi082 ceph-mon[26613]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:24.283 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:24.329 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- 172.21.15.100:0/1810150495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 msgr2=0x7fd4c40fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 --2- 172.21.15.100:0/1810150495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c40fbd40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40048c0 tx=0x7fd4b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- 172.21.15.100:0/1810150495 shutdown_connections 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 --2- 172.21.15.100:0/1810150495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c40fbd40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- 172.21.15.100:0/1810150495 >> 172.21.15.100:0/1810150495 conn(0x7fd4c40f7070 msgr2=0x7fd4c40f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- 172.21.15.100:0/1810150495 shutdown_connections 2024-04-27T07:25:25.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- 172.21.15.100:0/1810150495 wait complete. 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 Processor -- start 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- start start 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.641+0000 7fd4c997d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c410fdd0 con 0x7fd4c40fb930 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:25.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:58136/0 (socket says 172.21.15.100:58136) 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c2ffd700 1 -- 172.21.15.100:0/3707663799 learned_addr learned my addr 172.21.15.100:0/3707663799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c2ffd700 1 -- 172.21.15.100:0/3707663799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4005040 con 0x7fd4c40fb930 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c2ffd700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40096b0 tx=0x7fd4b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b400bed0 con 0x7fd4c40fb930 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4b400b5c0 con 0x7fd4c40fb930 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c410ff10 con 0x7fd4c40fb930 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b401c5b0 con 0x7fd4c40fb930 2024-04-27T07:25:25.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.642+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4110400 con 0x7fd4c40fb930 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.643+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fd4b4013420 con 0x7fd4c40fb930 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.643+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c41058f0 con 0x7fd4c40fb930 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.643+0000 7fd4ab7fe700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 0x7fd4ac038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.643+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd4b4049ae0 con 0x7fd4c40fb930 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.643+0000 7fd4c27fc700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 0x7fd4ac038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:25.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.644+0000 7fd4c27fc700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 0x7fd4ac038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009990 tx=0x7fd4b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:25.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.648+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd4b4004d30 con 0x7fd4c40fb930 2024-04-27T07:25:25.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.908+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd4c405f5c0 con 0x7fd4c40fb930 2024-04-27T07:25:25.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.909+0000 7fd4ab7fe700 1 -- 172.21.15.100:0/3707663799 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd4b4011370 con 0x7fd4c40fb930 2024-04-27T07:25:25.911 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:25.911 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 msgr2=0x7fd4ac038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 0x7fd4ac038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009990 tx=0x7fd4b8006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 msgr2=0x7fd4c4066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40096b0 tx=0x7fd4b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 shutdown_connections 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fd4ac036880 0x7fd4ac038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:25.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 --2- 172.21.15.100:0/3707663799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4c40fb930 0x7fd4c4066820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 >> 172.21.15.100:0/3707663799 conn(0x7fd4c40f7070 msgr2=0x7fd4c4102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 shutdown_connections 2024-04-27T07:25:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:25.911+0000 7fd4c997d700 1 -- 172.21.15.100:0/3707663799 wait complete. 2024-04-27T07:25:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:26 smithi082 ceph-mon[26613]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:26 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:26 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/3707663799' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:27.439 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:27.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:27.684 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:27.732 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:28.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:28 smithi082 ceph-mon[26613]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:29.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 -- 172.21.15.100:0/4005033817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 msgr2=0x7fbb840fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/4005033817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb840fbd40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb740048c0 tx=0x7fbb74009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 -- 172.21.15.100:0/4005033817 shutdown_connections 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/4005033817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb840fbd40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 -- 172.21.15.100:0/4005033817 >> 172.21.15.100:0/4005033817 conn(0x7fbb840f7070 msgr2=0x7fbb840f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 -- 172.21.15.100:0/4005033817 shutdown_connections 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.244+0000 7fbb8a29d700 1 -- 172.21.15.100:0/4005033817 wait complete. 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb8a29d700 1 Processor -- start 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb8a29d700 1 -- start start 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb8a29d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb8a29d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8410fdd0 con 0x7fbb840fb930 2024-04-27T07:25:29.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb83fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb83fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:58154/0 (socket says 172.21.15.100:58154) 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.245+0000 7fbb83fff700 1 -- 172.21.15.100:0/1398969993 learned_addr learned my addr 172.21.15.100:0/1398969993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb83fff700 1 -- 172.21.15.100:0/1398969993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74005040 con 0x7fbb840fb930 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb83fff700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb740096b0 tx=0x7fbb74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb7400bed0 con 0x7fbb840fb930 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb7400b5c0 con 0x7fbb840fb930 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8410ff10 con 0x7fbb840fb930 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb7401c5b0 con 0x7fbb840fb930 2024-04-27T07:25:29.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.246+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb84110400 con 0x7fbb840fb930 2024-04-27T07:25:29.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.247+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbb74013420 con 0x7fbb840fb930 2024-04-27T07:25:29.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.247+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb841058f0 con 0x7fbb840fb930 2024-04-27T07:25:29.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.247+0000 7fbb80ff9700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 0x7fbb6c038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:29.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.247+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbb74049ac0 con 0x7fbb840fb930 2024-04-27T07:25:29.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.247+0000 7fbb837fe700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 0x7fbb6c038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:29.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.248+0000 7fbb837fe700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 0x7fbb6c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009990 tx=0x7fbb78006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:29.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.252+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbb74013a80 con 0x7fbb840fb930 2024-04-27T07:25:29.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.513+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbb8405f5c0 con 0x7fbb840fb930 2024-04-27T07:25:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.514+0000 7fbb80ff9700 1 -- 172.21.15.100:0/1398969993 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbb74011370 con 0x7fbb840fb930 2024-04-27T07:25:29.516 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:29.516 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:29.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 msgr2=0x7fbb6c038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 0x7fbb6c038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009990 tx=0x7fbb78006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 msgr2=0x7fbb84066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb740096b0 tx=0x7fbb74009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 shutdown_connections 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fbb6c036880 0x7fbb6c038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 --2- 172.21.15.100:0/1398969993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb840fb930 0x7fbb84066820 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 >> 172.21.15.100:0/1398969993 conn(0x7fbb840f7070 msgr2=0x7fbb84102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 shutdown_connections 2024-04-27T07:25:29.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:29.516+0000 7fbb8a29d700 1 -- 172.21.15.100:0/1398969993 wait complete. 2024-04-27T07:25:29.519 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:30 smithi082 ceph-mon[26613]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:30 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1398969993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:31.078 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:31.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:32.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:31 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:32.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:31 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:32.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:31 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:32.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:31 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-27T07:25:32.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:31 smithi082 ceph-mon[26613]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:32.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 -- 172.21.15.100:0/681835392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 msgr2=0x7fb1980fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 --2- 172.21.15.100:0/681835392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb1980fbd50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb190009c60 tx=0x7fb190004d10 comp rx=0 tx=0).stop 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 -- 172.21.15.100:0/681835392 shutdown_connections 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 --2- 172.21.15.100:0/681835392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb1980fbd50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 -- 172.21.15.100:0/681835392 >> 172.21.15.100:0/681835392 conn(0x7fb1980f70a0 msgr2=0x7fb1980f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 -- 172.21.15.100:0/681835392 shutdown_connections 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.799+0000 7fb19f15b700 1 -- 172.21.15.100:0/681835392 wait complete. 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19f15b700 1 Processor -- start 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19f15b700 1 -- start start 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19f15b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19f15b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19810c4d0 con 0x7fb1980fb940 2024-04-27T07:25:32.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19cef7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:32.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19cef7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:55704/0 (socket says 172.21.15.100:55704) 2024-04-27T07:25:32.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19cef7700 1 -- 172.21.15.100:0/1073921274 learned_addr learned my addr 172.21.15.100:0/1073921274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:32.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.800+0000 7fb19cef7700 1 -- 172.21.15.100:0/1073921274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190009940 con 0x7fb1980fb940 2024-04-27T07:25:32.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb19cef7700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb190009500 tx=0x7fb190004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:32.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb190007c80 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19810c6d0 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb19001d910 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1900129d0 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.801+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19810d240 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7fb190019040 con 0x7fb1980fb940 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb1957fa700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 0x7fb180038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:32.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb19004a500 con 0x7fb1980fb940 2024-04-27T07:25:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb197fff700 1 -- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 msgr2=0x7fb180038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1415088792 2024-04-27T07:25:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb197fff700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 0x7fb180038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:25:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.802+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198101e50 con 0x7fb1980fb940 2024-04-27T07:25:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:32.807+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb190017070 con 0x7fb1980fb940 2024-04-27T07:25:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.003+0000 7fb197fff700 1 -- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 msgr2=0x7fb180038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1415088792 2024-04-27T07:25:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.003+0000 7fb197fff700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 0x7fb180038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:25:33.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.067+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb19805f5c0 con 0x7fb1980fb940 2024-04-27T07:25:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.068+0000 7fb1957fa700 1 -- 172.21.15.100:0/1073921274 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb19805f5c0 con 0x7fb1980fb940 2024-04-27T07:25:33.070 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:33.070 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 msgr2=0x7fb180038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 0x7fb180038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 msgr2=0x7fb19810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb190009500 tx=0x7fb190004d10 comp rx=0 tx=0).stop 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 shutdown_connections 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7fb1800368d0 0x7fb180038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 --2- 172.21.15.100:0/1073921274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980fb940 0x7fb19810bf90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 >> 172.21.15.100:0/1073921274 conn(0x7fb1980f70a0 msgr2=0x7fb198102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 shutdown_connections 2024-04-27T07:25:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:33.070+0000 7fb19f15b700 1 -- 172.21.15.100:0/1073921274 wait complete. 2024-04-27T07:25:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:32 smithi082 ceph-mon[26613]: from='mgr.14162 172.21.15.82:0/687962898' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-27T07:25:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:32 smithi082 ceph-mon[26613]: mgrmap e14: smithi082.hhlhmf(active, since 56s) 2024-04-27T07:25:34.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:33 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1073921274' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:34.667 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:34.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:36.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/2563634520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 msgr2=0x7f6d040fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:36.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/2563634520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d040fbd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d000048c0 tx=0x7f6d00009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:36.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/2563634520 shutdown_connections 2024-04-27T07:25:36.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/2563634520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d040fbd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:36.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/2563634520 >> 172.21.15.100:0/2563634520 conn(0x7f6d040f70a0 msgr2=0x7f6d040f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/2563634520 shutdown_connections 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/2563634520 wait complete. 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 Processor -- start 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- start start 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.327+0000 7f6d0b7b1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0410fde0 con 0x7f6d040fb940 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0954d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0954d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:55726/0 (socket says 172.21.15.100:55726) 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0954d700 1 -- 172.21.15.100:0/863157680 learned_addr learned my addr 172.21.15.100:0/863157680 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0954d700 1 -- 172.21.15.100:0/863157680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00005040 con 0x7f6d040fb940 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0954d700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d000096b0 tx=0x7f6d00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0000bed0 con 0x7f6d040fb940 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d0000b5c0 con 0x7f6d040fb940 2024-04-27T07:25:36.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0410ff20 con 0x7f6d040fb940 2024-04-27T07:25:36.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0001c5b0 con 0x7f6d040fb940 2024-04-27T07:25:36.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.328+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d04110410 con 0x7f6d040fb940 2024-04-27T07:25:36.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f6d00013420 con 0x7f6d040fb940 2024-04-27T07:25:36.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04105900 con 0x7f6d040fb940 2024-04-27T07:25:36.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6cf5ffb700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 0x7f6cf0038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:36.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6d00049b00 con 0x7f6d040fb940 2024-04-27T07:25:36.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6d08d4c700 1 -- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 msgr2=0x7f6cf0038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1415088792 2024-04-27T07:25:36.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.329+0000 7f6d08d4c700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 0x7f6cf0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:25:36.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.334+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6d00025400 con 0x7f6d040fb940 2024-04-27T07:25:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.530+0000 7f6d08d4c700 1 -- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 msgr2=0x7f6cf0038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1415088792 2024-04-27T07:25:36.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.530+0000 7f6d08d4c700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 0x7f6cf0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:25:36.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.597+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6d0405f5c0 con 0x7f6d040fb940 2024-04-27T07:25:36.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.598+0000 7f6cf5ffb700 1 -- 172.21.15.100:0/863157680 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6d00004d30 con 0x7f6d040fb940 2024-04-27T07:25:36.600 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:36.600 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 msgr2=0x7f6cf0038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 0x7f6cf0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 msgr2=0x7f6d04066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d000096b0 tx=0x7f6d00009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 shutdown_connections 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:6800/1415088792,v1:172.21.15.82:6801/1415088792] conn(0x7f6cf0036920 0x7f6cf0038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:36.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 --2- 172.21.15.100:0/863157680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d040fb940 0x7f6d04066840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 >> 172.21.15.100:0/863157680 conn(0x7f6d040f70a0 msgr2=0x7f6d04102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 shutdown_connections 2024-04-27T07:25:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:36.600+0000 7f6d0b7b1700 1 -- 172.21.15.100:0/863157680 wait complete. 2024-04-27T07:25:36.603 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:36.720 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:36 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/863157680' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:38.243 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:38.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:38.458 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: Active manager daemon smithi082.hhlhmf restarted 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: osdmap e5: 0 total, 0 up, 0 in 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: mgrmap e15: smithi082.hhlhmf(active, starting, since 0.0032751s) 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:38.459 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:25:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:38.538 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: [27/Apr/2024:07:25:38] ENGINE Bus STARTING 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: [27/Apr/2024:07:25:38] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: [27/Apr/2024:07:25:38] ENGINE Bus STARTED 2024-04-27T07:25:39.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:39.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:39.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:39 smithi082 ceph-mon[26613]: mgrmap e16: smithi082.hhlhmf(active, since 1.00549s) 2024-04-27T07:25:40.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 -- 172.21.15.100:0/1752377686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 msgr2=0x7fbaac0fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 --2- 172.21.15.100:0/1752377686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac0fd430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0048c0 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 -- 172.21.15.100:0/1752377686 shutdown_connections 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 --2- 172.21.15.100:0/1752377686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac0fd430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 -- 172.21.15.100:0/1752377686 >> 172.21.15.100:0/1752377686 conn(0x7fbaac0f70a0 msgr2=0x7fbaac0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 -- 172.21.15.100:0/1752377686 shutdown_connections 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.079+0000 7fbab137b700 1 -- 172.21.15.100:0/1752377686 wait complete. 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbab137b700 1 Processor -- start 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbab137b700 1 -- start start 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbab137b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbab137b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac10dbc0 con 0x7fbaac0fd020 2024-04-27T07:25:40.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbaaaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:40.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbaaaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:37800/0 (socket says 172.21.15.100:37800) 2024-04-27T07:25:40.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.080+0000 7fbaaaffd700 1 -- 172.21.15.100:0/1510404571 learned_addr learned my addr 172.21.15.100:0/1510404571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbaaaffd700 1 -- 172.21.15.100:0/1510404571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c005040 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbaaaffd700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0096b0 tx=0x7fba9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba9c00bed0 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba9c00b5c0 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac1121d0 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba9c01c5b0 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.081+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac112600 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.082+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 43297+0+0 (secure 0 0 0) 0x7fba9c01c820 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.082+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 0x7fba98038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.082+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fba9c049970 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.082+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac1058f0 con 0x7fbaac0fd020 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.082+0000 7fbaa3fff700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 0x7fba98038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:40.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.083+0000 7fbaa3fff700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 0x7fba98038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba94009990 tx=0x7fba94006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:40.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.087+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fba9c023300 con 0x7fbaac0fd020 2024-04-27T07:25:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.361+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbaac101e40 con 0x7fbaac0fd020 2024-04-27T07:25:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.362+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1510404571 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fbaac101e40 con 0x7fbaac0fd020 2024-04-27T07:25:40.364 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:40.364 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 msgr2=0x7fba98038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 0x7fba98038bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba94009990 tx=0x7fba94006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 msgr2=0x7fbaac066440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0096b0 tx=0x7fba9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 shutdown_connections 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fba98036710 0x7fba98038bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 --2- 172.21.15.100:0/1510404571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac0fd020 0x7fbaac066440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 >> 172.21.15.100:0/1510404571 conn(0x7fbaac0f70a0 msgr2=0x7fbaac102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 shutdown_connections 2024-04-27T07:25:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:40.365+0000 7fbab137b700 1 -- 172.21.15.100:0/1510404571 wait complete. 2024-04-27T07:25:40.368 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:41.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:40 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:41.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:40 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1510404571' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:41.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:40 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:41.912 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:41.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:41 smithi082 ceph-mon[26613]: mgrmap e17: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:25:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:42.345 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:44.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 -- 172.21.15.100:0/3800087852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 msgr2=0x7fc8800fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 --2- 172.21.15.100:0/3800087852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc8800fbd50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8700048c0 tx=0x7fc870009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 -- 172.21.15.100:0/3800087852 shutdown_connections 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 --2- 172.21.15.100:0/3800087852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc8800fbd50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 -- 172.21.15.100:0/3800087852 >> 172.21.15.100:0/3800087852 conn(0x7fc8800f70a0 msgr2=0x7fc8800f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.508+0000 7fc884ba3700 1 -- 172.21.15.100:0/3800087852 shutdown_connections 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.509+0000 7fc884ba3700 1 -- 172.21.15.100:0/3800087852 wait complete. 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.509+0000 7fc884ba3700 1 Processor -- start 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.509+0000 7fc884ba3700 1 -- start start 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.509+0000 7fc884ba3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.509+0000 7fc884ba3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88010fd50 con 0x7fc8800fb940 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc87e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc87e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:37814/0 (socket says 172.21.15.100:37814) 2024-04-27T07:25:44.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc87e59c700 1 -- 172.21.15.100:0/4237295692 learned_addr learned my addr 172.21.15.100:0/4237295692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc87e59c700 1 -- 172.21.15.100:0/4237295692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870005040 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc87e59c700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8700096b0 tx=0x7fc870009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc87000bed0 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88010fef0 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc87000b5c0 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc87001c5b0 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.510+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc880110380 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.511+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fc870013420 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.511+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc880105900 con 0x7fc8800fb940 2024-04-27T07:25:44.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.512+0000 7fc86effd700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 0x7fc868038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.512+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc870049cc0 con 0x7fc8800fb940 2024-04-27T07:25:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.512+0000 7fc87dd9b700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 0x7fc868038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.512+0000 7fc87dd9b700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 0x7fc868038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc874009990 tx=0x7fc874006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.517+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc8700119c0 con 0x7fc8800fb940 2024-04-27T07:25:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.789+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc88005f5c0 con 0x7fc8800fb940 2024-04-27T07:25:44.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.790+0000 7fc86effd700 1 -- 172.21.15.100:0/4237295692 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fc870004d30 con 0x7fc8800fb940 2024-04-27T07:25:44.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:44.792 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 msgr2=0x7fc868038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 0x7fc868038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc874009990 tx=0x7fc874006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 msgr2=0x7fc880065c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc8700096b0 tx=0x7fc870009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 shutdown_connections 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc868036970 0x7fc868038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:44.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 --2- 172.21.15.100:0/4237295692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8800fb940 0x7fc880065c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:44.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 >> 172.21.15.100:0/4237295692 conn(0x7fc8800f70a0 msgr2=0x7fc880102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:44.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 shutdown_connections 2024-04-27T07:25:44.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:44.792+0000 7fc884ba3700 1 -- 172.21.15.100:0/4237295692 wait complete. 2024-04-27T07:25:44.795 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:25:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:45 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/4237295692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:46.304 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:46.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:46.548 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:46.595 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-27T07:25:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 -- 172.21.15.100:0/3672682667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 msgr2=0x7f2e500fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 --2- 172.21.15.100:0/3672682667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e500fbd30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0048c0 tx=0x7f2e4c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:47.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 -- 172.21.15.100:0/3672682667 shutdown_connections 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 --2- 172.21.15.100:0/3672682667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e500fbd30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 -- 172.21.15.100:0/3672682667 >> 172.21.15.100:0/3672682667 conn(0x7f2e500f70a0 msgr2=0x7f2e500f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 -- 172.21.15.100:0/3672682667 shutdown_connections 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.916+0000 7f2e5754b700 1 -- 172.21.15.100:0/3672682667 wait complete. 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e5754b700 1 Processor -- start 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e5754b700 1 -- start start 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e5754b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:47.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e5754b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5010fda0 con 0x7f2e500fb920 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e552e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e552e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:37836/0 (socket says 172.21.15.100:37836) 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e552e7700 1 -- 172.21.15.100:0/4023968501 learned_addr learned my addr 172.21.15.100:0/4023968501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e552e7700 1 -- 172.21.15.100:0/4023968501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c005040 con 0x7f2e500fb920 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.917+0000 7f2e552e7700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009680 tx=0x7f2e4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.918+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e4c00b5c0 con 0x7f2e500fb920 2024-04-27T07:25:47.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.918+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e4c00be70 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.918+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5010fee0 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.918+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e4c0135a0 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.918+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e501103d0 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f2e4c01c430 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e501058e0 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e45ffb700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 0x7f2e3c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2e4c0495a0 con 0x7f2e500fb920 2024-04-27T07:25:47.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e54ae6700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 0x7f2e3c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.919+0000 7f2e54ae6700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 0x7f2e3c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009990 tx=0x7f2e40006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:47.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:47.923+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2e4c004d30 con 0x7f2e500fb920 2024-04-27T07:25:48.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.178+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e5005f5c0 con 0x7f2e500fb920 2024-04-27T07:25:48.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.178+0000 7f2e45ffb700 1 -- 172.21.15.100:0/4023968501 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2e4c021070 con 0x7f2e500fb920 2024-04-27T07:25:48.181 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:48.181 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 msgr2=0x7f2e3c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 0x7f2e3c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009990 tx=0x7f2e40006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 msgr2=0x7f2e50066860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009680 tx=0x7f2e4c009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 shutdown_connections 2024-04-27T07:25:48.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2e3c036970 0x7f2e3c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:48.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 --2- 172.21.15.100:0/4023968501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e500fb920 0x7f2e50066860 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:48.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 >> 172.21.15.100:0/4023968501 conn(0x7f2e500f70a0 msgr2=0x7f2e50102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:48.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 shutdown_connections 2024-04-27T07:25:48.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:48.181+0000 7f2e5754b700 1 -- 172.21.15.100:0/4023968501 wait complete. 2024-04-27T07:25:48.184 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:48.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:48 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/4023968501' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:49.759 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:49.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:25:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:25:50.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:25:50.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:25:51.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:25:51.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:51.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:25:51.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-27T07:25:51.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:25:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:51 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:25:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:51 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:25:52.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:51 smithi082 ceph-mon[26613]: Deploying daemon crash.smithi100 on smithi100 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 -- 172.21.15.100:0/1510971908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 msgr2=0x7fcec8101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 --2- 172.21.15.100:0/1510971908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8101da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fceb00048c0 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 -- 172.21.15.100:0/1510971908 shutdown_connections 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 --2- 172.21.15.100:0/1510971908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8101da0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 -- 172.21.15.100:0/1510971908 >> 172.21.15.100:0/1510971908 conn(0x7fcec8071800 msgr2=0x7fcec8071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 -- 172.21.15.100:0/1510971908 shutdown_connections 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.126+0000 7fcece99c700 1 -- 172.21.15.100:0/1510971908 wait complete. 2024-04-27T07:25:52.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcece99c700 1 Processor -- start 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcece99c700 1 -- start start 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcece99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcece99c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81136c0 con 0x7fcec81019d0 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcec7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcec7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:41018/0 (socket says 172.21.15.100:41018) 2024-04-27T07:25:52.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.127+0000 7fcec7fff700 1 -- 172.21.15.100:0/2373330511 learned_addr learned my addr 172.21.15.100:0/2373330511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcec7fff700 1 -- 172.21.15.100:0/2373330511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0005040 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcec7fff700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b7f0 tx=0x7fceb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceb0009370 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fceb0013420 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec81138c0 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceb001c590 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.128+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec8113db0 con 0x7fcec81019d0 2024-04-27T07:25:52.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.129+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fceb00094d0 con 0x7fcec81019d0 2024-04-27T07:25:52.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.129+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80fd0d0 con 0x7fcec81019d0 2024-04-27T07:25:52.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.129+0000 7fcec4ff9700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 0x7fceb4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:52.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.129+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fceb00493e0 con 0x7fcec81019d0 2024-04-27T07:25:52.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.130+0000 7fcec77fe700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 0x7fceb4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:52.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.130+0000 7fcec77fe700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 0x7fceb4038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009990 tx=0x7fceb8006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:52.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.134+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fceb0013590 con 0x7fcec81019d0 2024-04-27T07:25:52.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.399+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcec805f5c0 con 0x7fcec81019d0 2024-04-27T07:25:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.400+0000 7fcec4ff9700 1 -- 172.21.15.100:0/2373330511 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fceb0021030 con 0x7fcec81019d0 2024-04-27T07:25:52.446 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:52.446 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 msgr2=0x7fceb4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 0x7fceb4038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009990 tx=0x7fceb8006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 msgr2=0x7fcec8113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fceb000b7f0 tx=0x7fceb0009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 shutdown_connections 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fceb4036970 0x7fceb4038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 --2- 172.21.15.100:0/2373330511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcec81019d0 0x7fcec8113180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 >> 172.21.15.100:0/2373330511 conn(0x7fcec8071800 msgr2=0x7fcec80650b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:52.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 shutdown_connections 2024-04-27T07:25:52.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:52.402+0000 7fcece99c700 1 -- 172.21.15.100:0/2373330511 wait complete. 2024-04-27T07:25:52.448 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:53.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:52 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/2373330511' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:25:54.205 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:54.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:25:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:55 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:55 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:55.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:55 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:55.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:55 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:55.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:55 smithi082 ceph-mon[26613]: Deploying daemon node-exporter.smithi100 on smithi100 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 -- 172.21.15.100:0/17006540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 msgr2=0x7f2fb4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/17006540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4102e80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40048c0 tx=0x7f2fa4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 -- 172.21.15.100:0/17006540 shutdown_connections 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/17006540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4102e80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 -- 172.21.15.100:0/17006540 >> 172.21.15.100:0/17006540 conn(0x7f2fb40f85b0 msgr2=0x7f2fb40fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 -- 172.21.15.100:0/17006540 shutdown_connections 2024-04-27T07:25:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.927+0000 7f2fb8c21700 1 -- 172.21.15.100:0/17006540 wait complete. 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb8c21700 1 Processor -- start 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb8c21700 1 -- start start 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb8c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb8c21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4113670 con 0x7f2fb4102ab0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:41040/0 (socket says 172.21.15.100:41040) 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.928+0000 7f2fb259c700 1 -- 172.21.15.100:0/672706850 learned_addr learned my addr 172.21.15.100:0/672706850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fb259c700 1 -- 172.21.15.100:0/672706850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4005040 con 0x7f2fb4102ab0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fb259c700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b820 tx=0x7f2fa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa40093c0 con 0x7f2fb4102ab0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb4113870 con 0x7f2fb4102ab0 2024-04-27T07:25:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fa4013420 con 0x7f2fb4102ab0 2024-04-27T07:25:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa401c5b0 con 0x7f2fb4102ab0 2024-04-27T07:25:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.929+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb4113d60 con 0x7f2fb4102ab0 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.930+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb40fe1b0 con 0x7f2fb4102ab0 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.930+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f2fa4013a90 con 0x7f2fb4102ab0 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.930+0000 7f2fab7fe700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 0x7f2fa0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.930+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2fa4049a70 con 0x7f2fb4102ab0 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.930+0000 7f2fa9d9b700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 0x7f2fa0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:25:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.931+0000 7f2fa9d9b700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 0x7f2fa0038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009990 tx=0x7f2f9c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:25:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:55.935+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2fa40098a0 con 0x7f2fb4102ab0 2024-04-27T07:25:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.212+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2fb405f5c0 con 0x7f2fb4102ab0 2024-04-27T07:25:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.213+0000 7f2fab7fe700 1 -- 172.21.15.100:0/672706850 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2fa4011370 con 0x7f2fb4102ab0 2024-04-27T07:25:56.218 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:25:56.218 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 msgr2=0x7f2fa0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 0x7f2fa0038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009990 tx=0x7f2f9c006e40 comp rx=0 tx=0).stop 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 msgr2=0x7f2fb4113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b820 tx=0x7f2fa4009e30 comp rx=0 tx=0).stop 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 shutdown_connections 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2fa0036970 0x7f2fa0038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 --2- 172.21.15.100:0/672706850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fb4102ab0 0x7f2fb4113130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:25:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 >> 172.21.15.100:0/672706850 conn(0x7f2fb40f85b0 msgr2=0x7f2fb40f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:25:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 shutdown_connections 2024-04-27T07:25:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:25:56.215+0000 7f2fb8c21700 1 -- 172.21.15.100:0/672706850 wait complete. 2024-04-27T07:25:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:25:56.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/672706850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:25:57.728 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:25:57.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:25:57.978 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:25:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:25:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:59.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:25:59.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:25:59.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-27T07:25:59.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:25:59.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:25:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 -- 172.21.15.100:0/2402036723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 msgr2=0x7f4184101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 --2- 172.21.15.100:0/2402036723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184101d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f417c009c60 tx=0x7f417c004d10 comp rx=0 tx=0).stop 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 -- 172.21.15.100:0/2402036723 shutdown_connections 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 --2- 172.21.15.100:0/2402036723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184101d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 -- 172.21.15.100:0/2402036723 >> 172.21.15.100:0/2402036723 conn(0x7f41840f74c0 msgr2=0x7f41840f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 -- 172.21.15.100:0/2402036723 shutdown_connections 2024-04-27T07:26:00.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 -- 172.21.15.100:0/2402036723 wait complete. 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.204+0000 7f4189053700 1 Processor -- start 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4189053700 1 -- start start 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4189053700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4189053700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184112560 con 0x7f41841019a0 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4182d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4182d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:48968/0 (socket says 172.21.15.100:48968) 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4182d9d700 1 -- 172.21.15.100:0/3211574985 learned_addr learned my addr 172.21.15.100:0/3211574985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4182d9d700 1 -- 172.21.15.100:0/3211574985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009940 con 0x7f41841019a0 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.205+0000 7f4182d9d700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b740 tx=0x7f417c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:00.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417c007b30 con 0x7f41841019a0 2024-04-27T07:26:00.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4184112760 con 0x7f41841019a0 2024-04-27T07:26:00.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f417c01d910 con 0x7f41841019a0 2024-04-27T07:26:00.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417c0128b0 con 0x7f41841019a0 2024-04-27T07:26:00.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4184112c50 con 0x7f41841019a0 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840fd0a0 con 0x7f41841019a0 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.206+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f417c019040 con 0x7f41841019a0 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.207+0000 7f417b7fe700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 0x7f4170038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.207+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f417c04a490 con 0x7f41841019a0 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.207+0000 7f418259c700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 0x7f4170038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.207+0000 7f418259c700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 0x7f4170038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f416c009990 tx=0x7f416c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:00.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.212+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f417c02ed20 con 0x7f41841019a0 2024-04-27T07:26:00.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.476+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f418405f5c0 con 0x7f41841019a0 2024-04-27T07:26:00.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.477+0000 7f417b7fe700 1 -- 172.21.15.100:0/3211574985 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f417c017020 con 0x7f41841019a0 2024-04-27T07:26:00.479 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:26:00.479 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 msgr2=0x7f4170038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 0x7f4170038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f416c009990 tx=0x7f416c006e40 comp rx=0 tx=0).stop 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 msgr2=0x7f4184112020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b740 tx=0x7f417c004d10 comp rx=0 tx=0).stop 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 shutdown_connections 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4170036970 0x7f4170038e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 --2- 172.21.15.100:0/3211574985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41841019a0 0x7f4184112020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 >> 172.21.15.100:0/3211574985 conn(0x7f41840f74c0 msgr2=0x7f41840f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 shutdown_connections 2024-04-27T07:26:00.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:00.479+0000 7f4189053700 1 -- 172.21.15.100:0/3211574985 wait complete. 2024-04-27T07:26:00.482 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:26:00.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:00 smithi082 ceph-mon[26613]: Deploying daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:26:01.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:01 smithi082 ceph-mon[26613]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:01.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:01 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/3211574985' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:26:02.379 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:26:02.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:26:02.692 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:26:04.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:04.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:04.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:04.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:26:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: Deploying daemon mon.smithi100 on smithi100 2024-04-27T07:26:04.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 -- 172.21.15.100:0/2458496033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 msgr2=0x7f30540fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 --2- 172.21.15.100:0/2458496033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f30540fde40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f30440048c0 tx=0x7f3044009e30 comp rx=0 tx=0).stop 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 -- 172.21.15.100:0/2458496033 shutdown_connections 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 --2- 172.21.15.100:0/2458496033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f30540fde40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 -- 172.21.15.100:0/2458496033 >> 172.21.15.100:0/2458496033 conn(0x7f3054071800 msgr2=0x7f3054071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 -- 172.21.15.100:0/2458496033 shutdown_connections 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 -- 172.21.15.100:0/2458496033 wait complete. 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.167+0000 7f305a1e1700 1 Processor -- start 2024-04-27T07:26:04.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f305a1e1700 1 -- start start 2024-04-27T07:26:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f305a1e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:04.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f305a1e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30541136d0 con 0x7f30540fda70 2024-04-27T07:26:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f30537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f30537fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.100:49008/0 (socket says 172.21.15.100:49008) 2024-04-27T07:26:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.168+0000 7f30537fe700 1 -- 172.21.15.100:0/3207446768 learned_addr learned my addr 172.21.15.100:0/3207446768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:26:04.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f30537fe700 1 -- 172.21.15.100:0/3207446768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044005040 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f30537fe700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f304400b820 tx=0x7f3044009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30440093c0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30541138d0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3044013420 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f304401c5b0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.169+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054113d40 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.170+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30540658b0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.170+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f304401c7f0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.170+0000 7f3050ff9700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 0x7f3040038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.170+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3044049ae0 con 0x7f30540fda70 2024-04-27T07:26:04.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.171+0000 7f304affd700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 0x7f3040038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:04.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.171+0000 7f304affd700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 0x7f3040038e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f303c009990 tx=0x7f303c006e40 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:04.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.175+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3044023300 con 0x7f30540fda70 2024-04-27T07:26:04.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.449+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f305405f5c0 con 0x7f30540fda70 2024-04-27T07:26:04.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.449+0000 7f3050ff9700 1 -- 172.21.15.100:0/3207446768 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3044011b60 con 0x7f30540fda70 2024-04-27T07:26:04.451 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:26:04.452 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:23:23.367897Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-27T07:26:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 msgr2=0x7f3040038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 0x7f3040038e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f303c009990 tx=0x7f303c006e40 comp rx=0 tx=0).stop 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 msgr2=0x7f3054113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f304400b820 tx=0x7f3044009e30 comp rx=0 tx=0).stop 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 shutdown_connections 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3040036970 0x7f3040038e20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 --2- 172.21.15.100:0/3207446768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30540fda70 0x7f3054113190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.452+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 >> 172.21.15.100:0/3207446768 conn(0x7f3054071800 msgr2=0x7f3054103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.453+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 shutdown_connections 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:04.453+0000 7f305a1e1700 1 -- 172.21.15.100:0/3207446768 wait complete. 2024-04-27T07:26:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-04-27T07:26:05.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:04 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/3207446768' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:26:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:05 smithi082 ceph-mon[26613]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:06.774 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-27T07:26:06.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-27T07:26:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:26:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:07 smithi082 ceph-mon[26613]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:08.366 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 podman[34153]: 2024-04-27 07:26:08.244493659 +0000 UTC m=+0.019744703 image pull 1c583463371507dd553af71bf60c9ae8747aff79bb666e4e29ef4e17d0bc3a13 quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9 2024-04-27T07:26:08.651 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 podman[34153]: 2024-04-27 07:26:08.558381652 +0000 UTC m=+0.333632692 container create 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=quincy-2be3efa, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 podman[34153]: 2024-04-27 07:26:08.735635578 +0000 UTC m=+0.510886620 container init 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 podman[34153]: 2024-04-27 07:26:08.738666564 +0000 UTC m=+0.513917606 container start 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: set uid:gid to 167:167 (ceph:ceph) 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable), process ceph-mon, pid 2 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: pidfile_write: ignore empty --pid-file 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: load: jerasure load: lrc 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: RocksDB version: 6.15.5 2024-04-27T07:26:08.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Compile date Apr 26 2024 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: DB SUMMARY 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: DB Session ID: ULNEL40DY7S6Q93CSD10 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: CURRENT file: CURRENT 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: IDENTITY file: IDENTITY 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 0, files: 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000004.log size: 511 ; 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.error_if_exists: 0 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.create_if_missing: 0 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.paranoid_checks: 1 2024-04-27T07:26:08.920 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.env: 0x55b31223db00 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.fs: Posix File System 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.info_log: 0x55b3141f7620 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_file_opening_threads: 16 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.statistics: (nil) 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.use_fsync: 0 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_log_file_size: 0 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.keep_log_file_num: 1000 2024-04-27T07:26:08.921 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.recycle_log_file_num: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_fallocate: 1 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_mmap_reads: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_mmap_writes: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.use_direct_reads: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.create_missing_column_families: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.db_log_dir: 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi100/store.db 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-27T07:26:08.922 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.advise_random_on_open: 1 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.db_write_buffer_size: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.write_buffer_manager: 0x55b314eeaa20 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.rate_limiter: (nil) 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.wal_recovery_mode: 2 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.enable_thread_tracking: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.enable_pipelined_write: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.unordered_write: 0 2024-04-27T07:26:08.923 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.row_cache: None 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.wal_filter: None 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_ingest_behind: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.preserve_deletes: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.two_write_queues: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.manual_wal_flush: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.atomic_flush: 0 2024-04-27T07:26:08.924 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.log_readahead_size: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.best_efforts_recovery: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.allow_data_in_errors: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.db_host_id: __hostname__ 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_background_jobs: 2 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_background_compactions: -1 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_subcompactions: 1 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-27T07:26:08.925 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_total_wal_size: 0 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_open_files: -1 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bytes_per_sync: 0 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_readahead_size: 0 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_background_flushes: -1 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Compression algorithms supported: 2024-04-27T07:26:08.926 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kZSTD supported: 0 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kXpressCompression supported: 0 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kLZ4HCCompression supported: 1 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kZlibCompression supported: 1 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kSnappyCompression supported: 1 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kLZ4Compression supported: 1 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: kBZip2Compression supported: 0 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000003 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.merge_operator: 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_filter: None 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_filter_factory: None 2024-04-27T07:26:08.927 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.sst_partitioner_factory: None 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b3141caf58) 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: hash_index_allow_collision: 1 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 1 2024-04-27T07:26:08.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x55b3141fd090 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2024-04-27T07:26:08.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 4 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.write_buffer_size: 33554432 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_write_buffer_number: 2 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression: NoCompression 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression: Disabled 2024-04-27T07:26:08.930 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.prefix_extractor: nullptr 2024-04-27T07:26:08.931 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.num_levels: 7 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-27T07:26:08.932 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.level: 32767 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.strategy: 0 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compression_opts.enabled: false 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.target_file_size_base: 67108864 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-27T07:26:08.933 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.arena_block_size: 4194304 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.disable_auto_compactions: 0 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-27T07:26:08.934 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.table_properties_collectors: 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.inplace_update_support: 0 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-27T07:26:08.935 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.bloom_locality: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.max_successive_merges: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.paranoid_file_checks: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.force_consistency_checks: 1 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.report_bg_io_stats: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.ttl: 2592000 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.enable_blob_files: false 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.min_blob_size: 0 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.blob_file_size: 268435456 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-27T07:26:08.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202768764803, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202768765126, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714202768, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "cfde7b78-d42f-4d05-92ae-f47a83b27ae1", "db_session_id": "ULNEL40DY7S6Q93CSD10"}} 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714202768765446, "job": 1, "event": "recovery_finished"} 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-27T07:26:08.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55b314191180 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: DB pointer 0x55b314266000 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.938 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.939 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:26:08.940 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-27T07:26:08.941 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100 does not exist in monmap, will attempt to join an existing cluster 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: using public_addr v2:172.21.15.100:0/0 -> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: starting mon.smithi100 rank -1 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:26:08.942 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(???) e0 preinit fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).mds e1 new map 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).mds e1 print_map 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e1 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: -1 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: No filesystems configured 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-27T07:26:08.943 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 ceph-mon[34183]: mon.smithi100@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 bash[34153]: 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 2024-04-27T07:26:08.944 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:08 smithi100 systemd[1]: Started Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:26:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:14.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: mon.smithi082 calling monitor election 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: mon.smithi100 calling monitor election 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: monmap e2: 2 mons at {smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: fsmap 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: osdmap e5: 0 total, 0 up, 0 in 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: mgrmap e17: smithi082.hhlhmf(active, since 35s) 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: overall HEALTH_OK 2024-04-27T07:26:14.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:26:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: mon.smithi082 calling monitor election 2024-04-27T07:26:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: mon.smithi100 calling monitor election 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: monmap e2: 2 mons at {smithi082=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],smithi100=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: fsmap 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: osdmap e5: 0 total, 0 up, 0 in 2024-04-27T07:26:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: mgrmap e17: smithi082.hhlhmf(active, since 35s) 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: overall HEALTH_OK 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/2839902235' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:14.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:15.043 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:14 smithi100 ceph-mon[34183]: mgrmap e18: smithi082.hhlhmf(active, since 35s), standbys: smithi100.eparbe 2024-04-27T07:26:15.043 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:14 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:26:15.043 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:14 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:15.043 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:14 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:26:15.043 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:14 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 -- 172.21.15.100:0/2349187695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 msgr2=0x7fe89c008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 --2- 172.21.15.100:0/2349187695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe89c008650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40fcb60 tx=0x7fe8a8002040 comp rx=0 tx=0).stop 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 -- 172.21.15.100:0/2349187695 shutdown_connections 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 --2- 172.21.15.100:0/2349187695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe89c008650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 -- 172.21.15.100:0/2349187695 >> 172.21.15.100:0/2349187695 conn(0x7fe8b40f7620 msgr2=0x7fe8b40f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 -- 172.21.15.100:0/2349187695 shutdown_connections 2024-04-27T07:26:15.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.040+0000 7fe8b980d700 1 -- 172.21.15.100:0/2349187695 wait complete. 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 Processor -- start 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 -- start start 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe8b4113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b4113eb0 con 0x7fe89c0061f0 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.041+0000 7fe8b980d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b410d800 con 0x7fe8b41138a0 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48064/0 (socket says 172.21.15.100:48064) 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 -- 172.21.15.100:0/3577432470 learned_addr learned my addr 172.21.15.100:0/3577432470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 -- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 msgr2=0x7fe8b410d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 -- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 msgr2=0x7fe8b410d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b27fc700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:26:15.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b2ffd700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe8b4113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b2ffd700 1 -- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 msgr2=0x7fe8b410d2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b2ffd700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b2ffd700 1 -- 172.21.15.100:0/3577432470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8005040 con 0x7fe89c0061f0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.042+0000 7fe8b2ffd700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe8b4113360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40fcb60 tx=0x7fe8a8002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.043+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a8018e70 con 0x7fe89c0061f0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.043+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8a8004db0 con 0x7fe89c0061f0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.043+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a8022c50 con 0x7fe89c0061f0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.043+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b410da80 con 0x7fe89c0061f0 2024-04-27T07:26:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.043+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b410dfe0 con 0x7fe89c0061f0 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.044+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b40fd1e0 con 0x7fe89c0061f0 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.044+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fe8a8033440 con 0x7fe89c0061f0 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.045+0000 7fe89b7fe700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 0x7fe8a006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.045+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe8a8087fb0 con 0x7fe89c0061f0 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.045+0000 7fe8b27fc700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 0x7fe8a006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:15.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.045+0000 7fe8b27fc700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 0x7fe8a006b820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4006fd0 tx=0x7fe8a4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:15.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.049+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe8a8058e20 con 0x7fe89c0061f0 2024-04-27T07:26:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.332+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe8b404bed0 con 0x7fe89c0061f0 2024-04-27T07:26:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.333+0000 7fe89b7fe700 1 -- 172.21.15.100:0/3577432470 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7fe8a8022db0 con 0x7fe89c0061f0 2024-04-27T07:26:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-27T07:26:15.336 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","modified":"2024-04-27T07:26:08.789192Z","created":"2024-04-27T07:23:23.367897Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi100","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 msgr2=0x7fe8a006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 0x7fe8a006b820 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4006fd0 tx=0x7fe8a4008040 comp rx=0 tx=0).stop 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 msgr2=0x7fe8b4113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe8b4113360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40fcb60 tx=0x7fe8a8002040 comp rx=0 tx=0).stop 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 shutdown_connections 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe8a0069370 0x7fe8a006b820 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c0061f0 0x7fe8b4113360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 --2- 172.21.15.100:0/3577432470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8b41138a0 0x7fe8b410d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:15.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 >> 172.21.15.100:0/3577432470 conn(0x7fe8b40f7620 msgr2=0x7fe8b40f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 shutdown_connections 2024-04-27T07:26:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:26:15.335+0000 7fe8b980d700 1 -- 172.21.15.100:0/3577432470 wait complete. 2024-04-27T07:26:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 2 2024-04-27T07:26:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:14 smithi082 ceph-mon[26613]: mgrmap e18: smithi082.hhlhmf(active, since 35s), standbys: smithi100.eparbe 2024-04-27T07:26:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:14 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:26:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:14 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:14 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:26:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:14 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:26:15.968 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:15 smithi100 ceph-mon[34183]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:15.968 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:15 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/3577432470' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:26:15.970 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-27T07:26:15.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-27T07:26:16.230 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:26:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:15 smithi082 ceph-mon[26613]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:15 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/3577432470' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:26:17.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Reconfiguring mon.smithi082 (unknown last config time)... 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:17.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:17 smithi082 ceph-mon[26613]: Reconfiguring daemon mon.smithi082 on smithi082 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:26:17.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Reconfiguring mon.smithi082 (unknown last config time)... 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:17.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:17 smithi100 ceph-mon[34183]: Reconfiguring daemon mon.smithi082 on smithi082 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 -- 172.21.15.82:0/1855859124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 msgr2=0x7fe324101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 --2- 172.21.15.82:0/1855859124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe324101d60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009c60 tx=0x7fe31c004d10 comp rx=0 tx=0).stop 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 -- 172.21.15.82:0/1855859124 shutdown_connections 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 --2- 172.21.15.82:0/1855859124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe324101d60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 -- 172.21.15.82:0/1855859124 >> 172.21.15.82:0/1855859124 conn(0x7fe3240f74f0 msgr2=0x7fe3240f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 -- 172.21.15.82:0/1855859124 shutdown_connections 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.865+0000 7fe329db2700 1 -- 172.21.15.82:0/1855859124 wait complete. 2024-04-27T07:26:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 Processor -- start 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 -- start start 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe324112700 0x7fe32410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324112d10 con 0x7fe324101990 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe329db2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32410c660 con 0x7fe324112700 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50442/0 (socket says 172.21.15.82:50442) 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 -- 172.21.15.82:0/2301664724 learned_addr learned my addr 172.21.15.82:0/2301664724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 -- 172.21.15.82:0/2301664724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe324112700 msgr2=0x7fe32410c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe324112700 0x7fe32410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 -- 172.21.15.82:0/2301664724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c009940 con 0x7fe324101990 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.866+0000 7fe3237fe700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe31c004f80 tx=0x7fe31c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.867+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31c00e040 con 0x7fe324101990 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.867+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32410c8e0 con 0x7fe324101990 2024-04-27T07:26:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.867+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe31c008da0 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.867+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe31c01c750 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.867+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32410cea0 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.868+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324100c00 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.868+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fe31c012b00 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.868+0000 7fe31bfff700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 0x7fe31006b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.869+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe31c087ec0 con 0x7fe324101990 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.869+0000 7fe322ffd700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 0x7fe31006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.869+0000 7fe322ffd700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 0x7fe31006b810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009930 tx=0x7fe30c006de0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:17.873+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe31c058ce0 con 0x7fe324101990 2024-04-27T07:26:18.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.065+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe324105c80 con 0x7fe324101990 2024-04-27T07:26:18.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.066+0000 7fe31bfff700 1 -- 172.21.15.82:0/2301664724 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7fe31c087670 con 0x7fe324101990 2024-04-27T07:26:18.068 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:26:18.068 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-04-27T07:26:18.068 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:26:18.069 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2024-04-27T07:26:18.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.067+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 msgr2=0x7fe31006b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:18.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.067+0000 7fe329db2700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 0x7fe31006b810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009930 tx=0x7fe30c006de0 comp rx=0 tx=0).stop 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.067+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 msgr2=0x7fe3241121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.067+0000 7fe329db2700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe31c004f80 tx=0x7fe31c004d10 comp rx=0 tx=0).stop 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 shutdown_connections 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe310069360 0x7fe31006b810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe324101990 0x7fe3241121c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 --2- 172.21.15.82:0/2301664724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe324112700 0x7fe32410c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 >> 172.21.15.82:0/2301664724 conn(0x7fe3240f74f0 msgr2=0x7fe3240f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 shutdown_connections 2024-04-27T07:26:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:18.068+0000 7fe329db2700 1 -- 172.21.15.82:0/2301664724 wait complete. 2024-04-27T07:26:18.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:18 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2301664724' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:18.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:18 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2301664724' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:19.559 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-27T07:26:19.559 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:26:19.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-04-27T07:26:19.585 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:26:19.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:26:19.648 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:26:19.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-04-27T07:26:19.679 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:26:19.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:26:19.691 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:26:19.744 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:19.748 INFO:tasks.cephadm:Deploying OSDs... 2024-04-27T07:26:19.748 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:26:19.748 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-27T07:26:19.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-27T07:26:19.764 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-27T07:26:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-27T07:26:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-27 07:25:30.318431727 +0000 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-27 07:19:09.858425926 +0000 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-27 07:19:09.858425926 +0000 2024-04-27T07:26:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-27 07:19:09.858425926 +0000 2024-04-27T07:26:19.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-27T07:26:19.882 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-27T07:26:19.882 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-27T07:26:19.882 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000232642 s, 2.2 MB/s 2024-04-27T07:26:19.883 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-27T07:26:19.940 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-27 07:25:30.318431727 +0000 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-27 07:19:10.212418880 +0000 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-27 07:19:10.212418880 +0000 2024-04-27T07:26:19.995 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-27 07:19:10.212418880 +0000 2024-04-27T07:26:19.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-27T07:26:20.057 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-27T07:26:20.057 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-27T07:26:20.057 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000196928 s, 2.6 MB/s 2024-04-27T07:26:20.058 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-27T07:26:20.114 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-27T07:26:20.170 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-27T07:26:20.170 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:20.170 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-27 07:25:30.319431708 +0000 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-27 07:19:10.557412015 +0000 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-27 07:19:10.557412015 +0000 2024-04-27T07:26:20.171 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-27 07:19:10.557412015 +0000 2024-04-27T07:26:20.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-27T07:26:20.232 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-27T07:26:20.233 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-27T07:26:20.233 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000191579 s, 2.7 MB/s 2024-04-27T07:26:20.234 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-27T07:26:20.289 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-27T07:26:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-27T07:26:20.343 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-27 07:25:30.319431708 +0000 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-27 07:19:10.886405467 +0000 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-27 07:19:10.886405467 +0000 2024-04-27T07:26:20.344 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-27 07:19:10.886405467 +0000 2024-04-27T07:26:20.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-27T07:26:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-27T07:26:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-27T07:26:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00023226 s, 2.2 MB/s 2024-04-27T07:26:20.408 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-27T07:26:20.463 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:26:20.464 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-04-27T07:26:20.483 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-27T07:26:20.483 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:20.540 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-27 07:26:07.207319116 +0000 2024-04-27T07:26:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-27 07:19:09.870304794 +0000 2024-04-27T07:26:20.541 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-27 07:19:09.870304794 +0000 2024-04-27T07:26:20.541 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-27 07:19:09.870304794 +0000 2024-04-27T07:26:20.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-27T07:26:20.608 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-27T07:26:20.608 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-27T07:26:20.608 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000289834 s, 1.8 MB/s 2024-04-27T07:26:20.609 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-27T07:26:20.668 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-04-27T07:26:20.690 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:20 smithi082 ceph-mon[26613]: Reconfiguring mgr.smithi082.hhlhmf (unknown last config time)... 2024-04-27T07:26:20.690 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:20 smithi082 ceph-mon[26613]: Reconfiguring daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:26:20.725 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-27 07:26:07.207319116 +0000 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-27 07:19:10.216295735 +0000 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-27 07:19:10.216295735 +0000 2024-04-27T07:26:20.726 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-27 07:19:10.216295735 +0000 2024-04-27T07:26:20.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-27T07:26:20.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:20 smithi100 ceph-mon[34183]: Reconfiguring mgr.smithi082.hhlhmf (unknown last config time)... 2024-04-27T07:26:20.790 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:20 smithi100 ceph-mon[34183]: Reconfiguring daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:26:20.791 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-27T07:26:20.791 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-27T07:26:20.791 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000276365 s, 1.9 MB/s 2024-04-27T07:26:20.792 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-27T07:26:20.850 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-27 07:26:07.207319116 +0000 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-27 07:19:10.557286807 +0000 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-27 07:19:10.557286807 +0000 2024-04-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-27 07:19:10.557286807 +0000 2024-04-27T07:26:20.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-27T07:26:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-27T07:26:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-27T07:26:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000218531 s, 2.3 MB/s 2024-04-27T07:26:20.970 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-27T07:26:21.027 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-27 07:26:07.208319090 +0000 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-27 07:19:10.891278062 +0000 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-27 07:19:10.891278062 +0000 2024-04-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-27 07:19:10.891278062 +0000 2024-04-27T07:26:21.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-27T07:26:21.144 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-27T07:26:21.144 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-27T07:26:21.144 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00019246 s, 2.7 MB/s 2024-04-27T07:26:21.145 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-27T07:26:21.201 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-04-27T07:26:21.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-27T07:26:22.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: Reconfiguring crash.smithi082 (monmap changed)... 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:22.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:21 smithi082 ceph-mon[26613]: Reconfiguring daemon crash.smithi082 on smithi082 2024-04-27T07:26:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: Reconfiguring crash.smithi082 (monmap changed)... 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:21 smithi100 ceph-mon[34183]: Reconfiguring daemon crash.smithi082 on smithi082 2024-04-27T07:26:23.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:23.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:23.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:23 smithi082 ceph-mon[26613]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-04-27T07:26:23.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:23 smithi082 ceph-mon[26613]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-04-27T07:26:23.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:23 smithi082 ceph-mon[26613]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:23 smithi100 ceph-mon[34183]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-04-27T07:26:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:23 smithi100 ceph-mon[34183]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-04-27T07:26:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:23 smithi100 ceph-mon[34183]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:24.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:24.448 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:25.323 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:25 smithi082 ceph-mon[26613]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:25 smithi100 ceph-mon[34183]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114462 s, 916 MB/s 2024-04-27T07:26:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-27T07:26:26.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-04-27T07:26:27.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:27 smithi082 ceph-mon[26613]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:26:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:27 smithi100 ceph-mon[34183]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 -- 172.21.15.82:0/2414953973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 msgr2=0x7f39680fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 --2- 172.21.15.82:0/2414953973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f39680fc0f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f395c004940 tx=0x7f395c009e30 comp rx=0 tx=0).stop 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 -- 172.21.15.82:0/2414953973 shutdown_connections 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 --2- 172.21.15.82:0/2414953973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 0x7f39680fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 --2- 172.21.15.82:0/2414953973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f39680fc0f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 -- 172.21.15.82:0/2414953973 >> 172.21.15.82:0/2414953973 conn(0x7f39680f7420 msgr2=0x7f39680f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 -- 172.21.15.82:0/2414953973 shutdown_connections 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.482+0000 7f396e023700 1 -- 172.21.15.82:0/2414953973 wait complete. 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 Processor -- start 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 -- start start 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:29.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 0x7f39681126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968112c30 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.483+0000 7f396e023700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968112d70 con 0x7f39680fcf90 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47874/0 (socket says 172.21.15.82:47874) 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 -- 172.21.15.82:0/641640963 learned_addr learned my addr 172.21.15.82:0/641640963 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f3966ffd700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 0x7f39681126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 -- 172.21.15.82:0/641640963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 msgr2=0x7f39681126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 0x7f39681126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 -- 172.21.15.82:0/641640963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c005040 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f39677fe700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3b0 tx=0x7f395c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c00e040 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f395c004290 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968112fa0 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.484+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f395c01c3f0 con 0x7f39680fbce0 2024-04-27T07:26:29.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.485+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968113480 con 0x7f39680fbce0 2024-04-27T07:26:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.485+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396804c710 con 0x7f39680fbce0 2024-04-27T07:26:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.486+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f395c013420 con 0x7f39680fbce0 2024-04-27T07:26:29.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.486+0000 7f394ffff700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 0x7f395006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:26:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.487+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f395c087360 con 0x7f39680fbce0 2024-04-27T07:26:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.487+0000 7f3966ffd700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 0x7f395006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:26:29.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.487+0000 7f3966ffd700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 0x7f395006b6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39580041d0 tx=0x7f39580043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:26:29.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.491+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f395c0582a0 con 0x7f39680fbce0 2024-04-27T07:26:29.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:29.692+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3968101280 con 0x7f3950069210 2024-04-27T07:26:29.697 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:29 smithi082 ceph-mon[26613]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:29.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:29 smithi100 ceph-mon[34183]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:31.533 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:31 smithi082 ceph-mon[26613]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-04-27T07:26:31.533 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:31 smithi082 ceph-mon[26613]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-04-27T07:26:31.533 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:31 smithi082 ceph-mon[26613]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:31 smithi100 ceph-mon[34183]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-04-27T07:26:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:31 smithi100 ceph-mon[34183]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-04-27T07:26:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:31 smithi100 ceph-mon[34183]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:33.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:33 smithi082 ceph-mon[26613]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:33.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:33 smithi100 ceph-mon[34183]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:36 smithi082 ceph-mon[26613]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:36 smithi100 ceph-mon[34183]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2476933213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef"}]: dispatch 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2476933213' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef"}]': finished 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: osdmap e6: 1 total, 0 up, 1 in 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:37 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/645875741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2476933213' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef"}]: dispatch 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2476933213' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef"}]': finished 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: osdmap e6: 1 total, 0 up, 1 in 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:37 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/645875741' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:26:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:38 smithi082 ceph-mon[26613]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:38 smithi100 ceph-mon[34183]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:39 smithi082 ceph-mon[26613]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:39 smithi100 ceph-mon[34183]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:39 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:41 smithi082 ceph-mon[26613]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:41 smithi100 ceph-mon[34183]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:43.697 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:43 smithi082 ceph-mon[26613]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:43.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:43 smithi100 ceph-mon[34183]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:45.719 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:45 smithi100 ceph-mon[34183]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:45.813 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:45 smithi082 ceph-mon[26613]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:47.504 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:47.504 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:47.504 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: Reconfiguring crash.smithi100 (monmap changed)... 2024-04-27T07:26:47.505 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:26:47.505 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:47.505 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: Reconfiguring daemon crash.smithi100 on smithi100 2024-04-27T07:26:47.505 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:47 smithi082 ceph-mon[26613]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:47.568 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: Reconfiguring crash.smithi100 (monmap changed)... 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: Reconfiguring daemon crash.smithi100 on smithi100 2024-04-27T07:26:47.569 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:47 smithi100 ceph-mon[34183]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:48.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:26:48.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:48.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: Deploying daemon osd.0 on smithi082 2024-04-27T07:26:48.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: Reconfiguring mgr.smithi100.eparbe (monmap changed)... 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:48.275 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:48 smithi082 ceph-mon[26613]: Reconfiguring daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:26:48.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:26:48.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: Deploying daemon osd.0 on smithi082 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: Reconfiguring mgr.smithi100.eparbe (monmap changed)... 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:48.313 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:48 smithi100 ceph-mon[34183]: Reconfiguring daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:26:50.305 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: Reconfiguring mon.smithi100 (monmap changed)... 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:26:50.306 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:49 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: Reconfiguring mon.smithi100 (monmap changed)... 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:26:50.321 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:26:50.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:49 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:26:51.257 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: Reconfiguring daemon mon.smithi100 on smithi100 2024-04-27T07:26:51.257 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:26:51.258 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:26:51.259 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.259 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:26:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: Reconfiguring daemon mon.smithi100 on smithi100 2024-04-27T07:26:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:26:52.170 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:51 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:26:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:51 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:26:53.462 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:53.462 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:53.462 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:53 smithi082 ceph-mon[26613]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:53.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:53.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:53.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:53 smithi100 ceph-mon[34183]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:54.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:54.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:54.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:54.686 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:54.686 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:54.686 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:26:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:55 smithi082 ceph-mon[26613]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:55.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:55 smithi100 ceph-mon[34183]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:57.754 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:57 smithi082 ceph-mon[26613]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:57.754 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:57 smithi082 ceph-mon[26613]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-27T07:26:57.754 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:57 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:57.754 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:57 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:57.822 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-04-27T07:26:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.820+0000 7f394ffff700 1 -- 172.21.15.82:0/641640963 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3968101280 con 0x7f3950069210 2024-04-27T07:26:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 msgr2=0x7f395006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 0x7f395006b6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f39580041d0 tx=0x7f39580043c0 comp rx=0 tx=0).stop 2024-04-27T07:26:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 msgr2=0x7f3968066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:26:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b3b0 tx=0x7f395c009e30 comp rx=0 tx=0).stop 2024-04-27T07:26:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 shutdown_connections 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3950069210 0x7f395006b6c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39680fbce0 0x7f3968066c70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 --2- 172.21.15.82:0/641640963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39680fcf90 0x7f39681126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 >> 172.21.15.82:0/641640963 conn(0x7f39680f7420 msgr2=0x7f39680f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 shutdown_connections 2024-04-27T07:26:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:26:57.822+0000 7f396e023700 1 -- 172.21.15.82:0/641640963 wait complete. 2024-04-27T07:26:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:57 smithi100 ceph-mon[34183]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:57 smithi100 ceph-mon[34183]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-27T07:26:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:57 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:57 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:58.490 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.0.service 2024-04-27T07:26:58.493 INFO:tasks.cephadm:Deploying osd.1 on smithi082 with /dev/vg_nvme/lv_3... 2024-04-27T07:26:58.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-27T07:26:58.735 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-27T07:26:58.735 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: osdmap e7: 1 total, 0 up, 1 in 2024-04-27T07:26:58.735 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:58.736 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:26:58.736 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:58.736 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:58 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: osdmap e7: 1 total, 0 up, 1 in 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:58 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:26:59.640 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:59 smithi082 ceph-mon[26613]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:59.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:59 smithi082 ceph-mon[26613]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:26:59.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:59 smithi082 ceph-mon[26613]: osdmap e8: 1 total, 0 up, 1 in 2024-04-27T07:26:59.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:59.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:26:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:59.780 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:59 smithi100 ceph-mon[34183]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:26:59.781 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:59 smithi100 ceph-mon[34183]: from='osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:26:59.781 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:59 smithi100 ceph-mon[34183]: osdmap e8: 1 total, 0 up, 1 in 2024-04-27T07:26:59.781 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:59 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:26:59.781 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:26:59 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:27:00.099 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:27:00.472 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:00 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:27:00.473 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:00 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:27:00.473 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:00 smithi082 ceph-mon[26613]: osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] boot 2024-04-27T07:27:00.473 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:00 smithi082 ceph-mon[26613]: osdmap e9: 1 total, 1 up, 1 in 2024-04-27T07:27:00.473 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:27:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:00 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:27:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:00 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:27:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:00 smithi100 ceph-mon[34183]: osd.0 [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] boot 2024-04-27T07:27:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:00 smithi100 ceph-mon[34183]: osdmap e9: 1 total, 1 up, 1 in 2024-04-27T07:27:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: osdmap e10: 1 total, 1 up, 1 in 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:01.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:01.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: osdmap e10: 1 total, 1 up, 1 in 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:01.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:01.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129121 s, 812 MB/s 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 2024-04-27T07:27:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-27T07:27:02.765 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:02 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi082 2024-04-27T07:27:02.765 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:02 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi082 to 12864M 2024-04-27T07:27:02.765 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:02 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:02 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi082 2024-04-27T07:27:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:02 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi082 to 12864M 2024-04-27T07:27:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:02 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:03.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-04-27T07:27:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:03 smithi082 ceph-mon[26613]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:03 smithi100 ceph-mon[34183]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:05.017 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:27:05.792 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:05 smithi082 ceph-mon[26613]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:05 smithi100 ceph-mon[34183]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:07.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:07 smithi082 ceph-mon[26613]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:07.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 -- 172.21.15.82:0/279518493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fce60 msgr2=0x7f810c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 --2- 172.21.15.82:0/279518493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fce60 0x7f810c0fd270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80fc004940 tx=0x7f80fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 -- 172.21.15.82:0/279518493 shutdown_connections 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 --2- 172.21.15.82:0/279518493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fdfd0 0x7f810c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 --2- 172.21.15.82:0/279518493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fce60 0x7f810c0fd270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 -- 172.21.15.82:0/279518493 >> 172.21.15.82:0/279518493 conn(0x7f810c0f8540 msgr2=0x7f810c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 -- 172.21.15.82:0/279518493 shutdown_connections 2024-04-27T07:27:07.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.784+0000 7f81118e1700 1 -- 172.21.15.82:0/279518493 wait complete. 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 Processor -- start 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 -- start start 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fce60 0x7f810c10d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c10e460 con 0x7f810c0fdfd0 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f81118e1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c10e5d0 con 0x7f810c0fce60 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51796/0 (socket says 172.21.15.82:51796) 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 -- 172.21.15.82:0/969641484 learned_addr learned my addr 172.21.15.82:0/969641484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810affd700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fce60 0x7f810c10d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 -- 172.21.15.82:0/969641484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fce60 msgr2=0x7f810c10d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fce60 0x7f810c10d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:07.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.785+0000 7f810a7fc700 1 -- 172.21.15.82:0/969641484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc005040 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f810a7fc700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8100002a50 tx=0x7f81000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8100007cc0 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c113030 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f810000f040 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810000da30 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.786+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c1135c0 con 0x7f810c0fdfd0 2024-04-27T07:27:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.787+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c04c710 con 0x7f810c0fdfd0 2024-04-27T07:27:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.787+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f810000db90 con 0x7f810c0fdfd0 2024-04-27T07:27:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.788+0000 7f80f37fe700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 0x7f80f406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.788+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f8100086090 con 0x7f810c0fdfd0 2024-04-27T07:27:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.788+0000 7f810affd700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 0x7f80f406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.788+0000 7f810affd700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 0x7f80f406b6c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b970 tx=0x7f80fc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:07.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.792+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8100056c50 con 0x7f810c0fdfd0 2024-04-27T07:27:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:07 smithi100 ceph-mon[34183]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:07.986+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f810c1023b0 con 0x7f80f4069210 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:27:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:27:08.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:27:08.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:08.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:09.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:09 smithi100 ceph-mon[34183]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:09 smithi082 ceph-mon[26613]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:10 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2266657848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49804229-f1b4-4b6c-93c2-2e918a8c4acf"}]: dispatch 2024-04-27T07:27:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:10 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2266657848' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49804229-f1b4-4b6c-93c2-2e918a8c4acf"}]': finished 2024-04-27T07:27:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:10 smithi100 ceph-mon[34183]: osdmap e11: 2 total, 1 up, 2 in 2024-04-27T07:27:10.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:10 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:10 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2266657848' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49804229-f1b4-4b6c-93c2-2e918a8c4acf"}]: dispatch 2024-04-27T07:27:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:10 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2266657848' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49804229-f1b4-4b6c-93c2-2e918a8c4acf"}]': finished 2024-04-27T07:27:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:10 smithi082 ceph-mon[26613]: osdmap e11: 2 total, 1 up, 2 in 2024-04-27T07:27:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:10 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:11.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:11 smithi100 ceph-mon[34183]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:11.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:11 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1084112244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:27:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:11 smithi082 ceph-mon[26613]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:11 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1084112244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:27:13.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:13 smithi100 ceph-mon[34183]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:14.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:13 smithi082 ceph-mon[26613]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:15.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:15 smithi100 ceph-mon[34183]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:15.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:15 smithi082 ceph-mon[26613]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:17.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:17 smithi082 ceph-mon[26613]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:17.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:27:17.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:17.909 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:17 smithi100 ceph-mon[34183]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:17.909 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:27:17.909 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:18.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:18 smithi100 ceph-mon[34183]: Deploying daemon osd.1 on smithi082 2024-04-27T07:27:18.977 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:18 smithi082 ceph-mon[26613]: Deploying daemon osd.1 on smithi082 2024-04-27T07:27:19.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:19 smithi082 ceph-mon[26613]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:19.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:19 smithi100 ceph-mon[34183]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:21.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:21 smithi082 ceph-mon[26613]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:21.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:21 smithi100 ceph-mon[34183]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:23.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:23 smithi082 ceph-mon[26613]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:23.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:23.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:23.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:23.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:23.952 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:23 smithi100 ceph-mon[34183]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:23.952 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:23.952 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:23.952 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:23.952 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:25.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:25 smithi082 ceph-mon[26613]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:25.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:25 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:25.633 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:25 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:25.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:25 smithi100 ceph-mon[34183]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:25.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:25 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:25.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:25 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:26.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.238+0000 7f80f37fe700 1 -- 172.21.15.82:0/969641484 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f810c1023b0 con 0x7f80f4069210 2024-04-27T07:27:26.241 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 1 on host 'smithi082' 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 msgr2=0x7f80f406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 0x7f80f406b6c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b970 tx=0x7f80fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 msgr2=0x7f810c10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8100002a50 tx=0x7f81000046b0 comp rx=0 tx=0).stop 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 shutdown_connections 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f80f4069210 0x7f80f406b6c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810c0fce60 0x7f810c10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 --2- 172.21.15.82:0/969641484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f810c0fdfd0 0x7f810c10de60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 >> 172.21.15.82:0/969641484 conn(0x7f810c0f8540 msgr2=0x7f810c0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:27:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 shutdown_connections 2024-04-27T07:27:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:26.241+0000 7f81118e1700 1 -- 172.21.15.82:0/969641484 wait complete. 2024-04-27T07:27:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:27 smithi082 ceph-mon[26613]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:27 smithi082 ceph-mon[26613]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-27T07:27:27.490 DEBUG:teuthology.orchestra.run.smithi082:osd.1> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.1.service 2024-04-27T07:27:27.493 INFO:tasks.cephadm:Deploying osd.2 on smithi082 with /dev/vg_nvme/lv_2... 2024-04-27T07:27:27.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-27T07:27:27.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:27.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:27.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:27 smithi100 ceph-mon[34183]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:27.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:27 smithi100 ceph-mon[34183]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-27T07:27:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:27:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:28 smithi100 ceph-mon[34183]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-27T07:27:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:28 smithi100 ceph-mon[34183]: osdmap e12: 2 total, 1 up, 2 in 2024-04-27T07:27:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:28 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:28 smithi100 ceph-mon[34183]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:27:28.442 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-mon[26613]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-27T07:27:28.442 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-mon[26613]: osdmap e12: 2 total, 1 up, 2 in 2024-04-27T07:27:28.442 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:28.442 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-mon[26613]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:27:28.443 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[52173]: 2024-04-27T07:27:28.206+0000 7f309f0cb700 -1 osd.1 0 waiting for initial osdmap 2024-04-27T07:27:28.443 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:27:28 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[52173]: 2024-04-27T07:27:28.210+0000 7f30986c3700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:27:29.342 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:29 smithi082 ceph-mon[26613]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:27:29.342 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:29 smithi082 ceph-mon[26613]: osdmap e13: 2 total, 1 up, 2 in 2024-04-27T07:27:29.342 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:29 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:29 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:29 smithi082 ceph-mon[26613]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:29 smithi100 ceph-mon[34183]: from='osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:27:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:29 smithi100 ceph-mon[34183]: osdmap e13: 2 total, 1 up, 2 in 2024-04-27T07:27:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:29 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:29 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:29 smithi100 ceph-mon[34183]: pgmap v56: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] boot 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: osdmap e14: 2 total, 2 up, 2 in 2024-04-27T07:27:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:30 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012537 s, 836 MB/s 2024-04-27T07:27:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: osd.1 [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] boot 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: osdmap e14: 2 total, 2 up, 2 in 2024-04-27T07:27:30.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:30 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:27:31.572 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:31 smithi082 ceph-mon[26613]: osdmap e15: 2 total, 2 up, 2 in 2024-04-27T07:27:31.572 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:31 smithi082 ceph-mon[26613]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:31.573 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:31.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-04-27T07:27:31.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:31 smithi100 ceph-mon[34183]: osdmap e15: 2 total, 2 up, 2 in 2024-04-27T07:27:31.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:31 smithi100 ceph-mon[34183]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:31.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:32.375 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:27:32.479 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:32 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:32.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:32 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:33 smithi082 ceph-mon[26613]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:33 smithi100 ceph-mon[34183]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:35.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.026+0000 7f7754b35700 1 -- 172.21.15.82:0/3883506731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 msgr2=0x7f77500fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.026+0000 7f7754b35700 1 --2- 172.21.15.82:0/3883506731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f77500fe460 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7744004940 tx=0x7f7744009e30 comp rx=0 tx=0).stop 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 -- 172.21.15.82:0/3883506731 shutdown_connections 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 --2- 172.21.15.82:0/3883506731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f77500fe460 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 --2- 172.21.15.82:0/3883506731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 0x7f77500fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 -- 172.21.15.82:0/3883506731 >> 172.21.15.82:0/3883506731 conn(0x7f77500f84a0 msgr2=0x7f77500fa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 -- 172.21.15.82:0/3883506731 shutdown_connections 2024-04-27T07:27:35.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.027+0000 7f7754b35700 1 -- 172.21.15.82:0/3883506731 wait complete. 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 Processor -- start 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 -- start start 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 0x7f775010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775010e550 con 0x7f77500fdff0 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f7754b35700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775010ed40 con 0x7f77500fcd40 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f774dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f774dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44464/0 (socket says 172.21.15.82:44464) 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f774dd9b700 1 -- 172.21.15.82:0/981441410 learned_addr learned my addr 172.21.15.82:0/981441410 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:27:35.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.028+0000 7f774e59c700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 0x7f775010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f774dd9b700 1 -- 172.21.15.82:0/981441410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 msgr2=0x7f775010d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f774dd9b700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 0x7f775010d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f774dd9b700 1 -- 172.21.15.82:0/981441410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744005040 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f774dd9b700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f774400b3b0 tx=0x7f7744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774400e040 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f774400bbf0 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775010efc0 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f774401c630 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.029+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775010f580 con 0x7f77500fdff0 2024-04-27T07:27:35.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.030+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500fc140 con 0x7f77500fdff0 2024-04-27T07:27:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.030+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f774400bd60 con 0x7f77500fdff0 2024-04-27T07:27:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.031+0000 7f773effd700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 0x7f773806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.031+0000 7f774e59c700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 0x7f773806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.031+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f7744087090 con 0x7f77500fdff0 2024-04-27T07:27:35.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.031+0000 7f774e59c700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 0x7f773806b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7740009bf0 tx=0x7f77400091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:35.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.035+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7744057bc0 con 0x7f77500fdff0 2024-04-27T07:27:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:35.236+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f775010f8b0 con 0x7f7738069210 2024-04-27T07:27:35.481 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:35 smithi082 ceph-mon[26613]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:35.482 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:27:35.482 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:27:35.482 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:35 smithi100 ceph-mon[34183]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:27:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:27:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:36.663 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:27:36.663 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi082 2024-04-27T07:27:36.663 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi082 to 6432M 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.664 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi082 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:27:36.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi082 to 6432M 2024-04-27T07:27:36.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:36.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:36.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:36.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:37.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:37 smithi082 ceph-mon[26613]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:37 smithi100 ceph-mon[34183]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3030292702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f876dc76-f7f6-4cf0-9aa2-90143dcc191d"}]: dispatch 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3030292702' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f876dc76-f7f6-4cf0-9aa2-90143dcc191d"}]': finished 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: osdmap e16: 3 total, 2 up, 3 in 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:38 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4175475289' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3030292702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f876dc76-f7f6-4cf0-9aa2-90143dcc191d"}]: dispatch 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3030292702' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f876dc76-f7f6-4cf0-9aa2-90143dcc191d"}]': finished 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: osdmap e16: 3 total, 2 up, 3 in 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:38 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/4175475289' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:27:40.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:39 smithi082 ceph-mon[26613]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:39 smithi100 ceph-mon[34183]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:41 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:27:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:41 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:44.156 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:43 smithi082 ceph-mon[26613]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:44.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:43 smithi100 ceph-mon[34183]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:46.038 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:45 smithi082 ceph-mon[26613]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:46.038 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:45 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:27:46.038 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:45 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:45 smithi100 ceph-mon[34183]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:45 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:27:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:45 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:27:47.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:46 smithi100 ceph-mon[34183]: Deploying daemon osd.2 on smithi082 2024-04-27T07:27:47.196 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:46 smithi082 ceph-mon[26613]: Deploying daemon osd.2 on smithi082 2024-04-27T07:27:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:47 smithi082 ceph-mon[26613]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:48.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:47 smithi100 ceph-mon[34183]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:50.019 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:49 smithi082 ceph-mon[26613]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:50.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:49 smithi100 ceph-mon[34183]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:51.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:51.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:51.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:27:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:51 smithi100 ceph-mon[34183]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:52.187 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:51 smithi082 ceph-mon[26613]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:53.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.793+0000 7f773effd700 1 -- 172.21.15.82:0/981441410 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f775010f8b0 con 0x7f7738069210 2024-04-27T07:27:53.795 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 2 on host 'smithi082' 2024-04-27T07:27:53.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 msgr2=0x7f773806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 0x7f773806b6c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7740009bf0 tx=0x7f77400091a0 comp rx=0 tx=0).stop 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 msgr2=0x7f775010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f774400b3b0 tx=0x7f7744009e30 comp rx=0 tx=0).stop 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 shutdown_connections 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7738069210 0x7f773806b6c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77500fcd40 0x7f775010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 --2- 172.21.15.82:0/981441410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77500fdff0 0x7f775010dec0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 >> 172.21.15.82:0/981441410 conn(0x7f77500f84a0 msgr2=0x7f77500f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 shutdown_connections 2024-04-27T07:27:53.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:27:53.795+0000 7f7754b35700 1 -- 172.21.15.82:0/981441410 wait complete. 2024-04-27T07:27:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:53 smithi082 ceph-mon[26613]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:54.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:53 smithi100 ceph-mon[34183]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:27:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:54.714 DEBUG:teuthology.orchestra.run.smithi082:osd.2> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.2.service 2024-04-27T07:27:54.716 INFO:tasks.cephadm:Deploying osd.3 on smithi100 with /dev/vg_nvme/lv_4... 2024-04-27T07:27:54.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-27T07:27:54.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:54 smithi082 ceph-mon[26613]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-27T07:27:54.971 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:27:55.087 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:54 smithi100 ceph-mon[34183]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-27T07:27:55.974 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-mon[26613]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:55.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-mon[26613]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-27T07:27:55.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-mon[26613]: osdmap e17: 3 total, 2 up, 3 in 2024-04-27T07:27:55.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:55.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-mon[26613]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:27:55.975 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[59969]: 2024-04-27T07:27:55.894+0000 7f59cba71700 -1 osd.2 0 waiting for initial osdmap 2024-04-27T07:27:55.975 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:27:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[59969]: 2024-04-27T07:27:55.899+0000 7f59c586a700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:27:56.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:55 smithi100 ceph-mon[34183]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:56.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:55 smithi100 ceph-mon[34183]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-27T07:27:56.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:55 smithi100 ceph-mon[34183]: osdmap e17: 3 total, 2 up, 3 in 2024-04-27T07:27:56.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:55 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:56.151 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:55 smithi100 ceph-mon[34183]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011613 s, 903 MB/s 2024-04-27T07:27:56.786 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-27T07:27:57.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:56 smithi100 ceph-mon[34183]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:27:57.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:56 smithi100 ceph-mon[34183]: osdmap e18: 3 total, 2 up, 3 in 2024-04-27T07:27:57.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:56 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:56 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:56 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:56 smithi082 ceph-mon[26613]: from='osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-04-27T07:27:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:56 smithi082 ceph-mon[26613]: osdmap e18: 3 total, 2 up, 3 in 2024-04-27T07:27:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:56 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:56 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:56 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-04-27T07:27:57.704 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] boot 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: osdmap e19: 3 total, 3 up, 3 in 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:57.936 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:57.937 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:57 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:58.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: pgmap v75: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: osd.2 [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] boot 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: osdmap e19: 3 total, 3 up, 3 in 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:58.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:57 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:27:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.160+0000 7f43ab890700 1 -- 172.21.15.100:0/1933797246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 msgr2=0x7f43a40ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.160+0000 7f43ab890700 1 --2- 172.21.15.100:0/1933797246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40ffa30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f43a0004940 tx=0x7f43a0009e30 comp rx=0 tx=0).stop 2024-04-27T07:27:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- 172.21.15.100:0/1933797246 shutdown_connections 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 --2- 172.21.15.100:0/1933797246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 0x7f43a4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 --2- 172.21.15.100:0/1933797246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40ffa30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- 172.21.15.100:0/1933797246 >> 172.21.15.100:0/1933797246 conn(0x7f43a40f7440 msgr2=0x7f43a40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- 172.21.15.100:0/1933797246 shutdown_connections 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- 172.21.15.100:0/1933797246 wait complete. 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 Processor -- start 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- start start 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 0x7f43a40fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40fd830 con 0x7f43a40fff70 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43ab890700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40fbe70 con 0x7f43a4066eb0 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.161+0000 7f43a962c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51452/0 (socket says 172.21.15.100:51452) 2024-04-27T07:27:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 -- 172.21.15.100:0/3891324963 learned_addr learned my addr 172.21.15.100:0/3891324963 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a8e2b700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 0x7f43a40fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 -- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 msgr2=0x7f43a40fb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 0x7f43a40fb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 -- 172.21.15.100:0/3891324963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0005040 con 0x7f43a4066eb0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43a962c700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a000e030 con 0x7f43a4066eb0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a40fc0f0 con 0x7f43a4066eb0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43a0013de0 con 0x7f43a4066eb0 2024-04-27T07:27:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43a001ce50 con 0x7f43a4066eb0 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.162+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a40fc630 con 0x7f43a4066eb0 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.163+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a404c710 con 0x7f43a4066eb0 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.164+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f43a001c400 con 0x7f43a4066eb0 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.164+0000 7f4399ffb700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 0x7f439006b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.164+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f43a0088250 con 0x7f43a4066eb0 2024-04-27T07:27:59.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.164+0000 7f43a8e2b700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 0x7f439006b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:27:59.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.165+0000 7f43a8e2b700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 0x7f439006b650 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4394009b80 tx=0x7f439400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:27:59.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.169+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f43a0058930 con 0x7f43a4066eb0 2024-04-27T07:27:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:59 smithi082 ceph-mon[26613]: osdmap e20: 3 total, 3 up, 3 in 2024-04-27T07:27:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:59 smithi082 ceph-mon[26613]: pgmap v78: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:27:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:27:59 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-27T07:27:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:27:59.361+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f43a40f8f30 con 0x7f43900691a0 2024-04-27T07:27:59.363 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:59 smithi100 ceph-mon[34183]: osdmap e20: 3 total, 3 up, 3 in 2024-04-27T07:27:59.363 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:59 smithi100 ceph-mon[34183]: pgmap v78: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:27:59.363 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:27:59 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: osdmap e21: 3 total, 3 up, 3 in 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: osdmap e21: 3 total, 3 up, 3 in 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:00.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64499]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T07:28:00.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64499]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:00.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64499]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:00.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64499]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:01.123 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64590]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T07:28:01.123 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64590]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:01.123 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64590]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:01.124 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:28:00 smithi082 sudo[64590]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: osdmap e22: 3 total, 3 up, 3 in 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi082 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi082 to 4288M 2024-04-27T07:28:01.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:01.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:01 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:01.237+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f43a001c6e0 con 0x7f43a4066eb0 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: osdmap e22: 3 total, 3 up, 3 in 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi082 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi082 to 4288M 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.240 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:01.241 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:01.241 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.241 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:01.241 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:01.241 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:01 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:01.381 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64610]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T07:28:01.381 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64610]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:01.381 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64610]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:01.381 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64610]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:01.643 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64613]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T07:28:01.643 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64613]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:01.643 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64613]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:01.643 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64613]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:01.906 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T07:28:01.906 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:01.906 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64698]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:01.906 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64698]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:02.160 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T07:28:02.160 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:02.160 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64722]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:02.160 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:28:01 smithi082 sudo[64722]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:02.425 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64726]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T07:28:02.425 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:02.425 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64726]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:02.425 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64726]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64775]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64775]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64775]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 sudo[64775]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: osdmap e23: 3 total, 3 up, 3 in 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: mgrmap e19: smithi082.hhlhmf(active, since 2m), standbys: smithi100.eparbe 2024-04-27T07:28:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/2768360545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]: dispatch 2024-04-27T07:28:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]: dispatch 2024-04-27T07:28:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]': finished 2024-04-27T07:28:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: osdmap e24: 4 total, 3 up, 4 in 2024-04-27T07:28:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:02 smithi082 ceph-mon[26613]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T07:28:02.973 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37591]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T07:28:02.973 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37591]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:02.973 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37591]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:02.973 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37591]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37616]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37616]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37616]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 sudo[37616]: pam_unix(sudo:session): session closed for user root 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: osdmap e23: 3 total, 3 up, 3 in 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: mgrmap e19: smithi082.hhlhmf(active, since 2m), standbys: smithi100.eparbe 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/2768360545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]: dispatch 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]: dispatch 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94cf05fd-8fc6-4a90-95dc-8c0bfcb57371"}]': finished 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: osdmap e24: 4 total, 3 up, 4 in 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:02 smithi100 ceph-mon[34183]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T07:28:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1532087331' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: pgmap v84: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T07:28:03.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:03 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/1532087331' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: pgmap v84: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:28:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T07:28:03.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:28:03.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:28:03.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T07:28:03.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:03 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: pgmap v85: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: pgmap v85: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:07.870 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:07 smithi100 ceph-mon[34183]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:07 smithi082 ceph-mon[26613]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:09 smithi082 ceph-mon[26613]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:28:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:09 smithi082 ceph-mon[26613]: Deploying daemon osd.3 on smithi100 2024-04-27T07:28:10.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:09 smithi100 ceph-mon[34183]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:10.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:28:10.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:10.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:09 smithi100 ceph-mon[34183]: Deploying daemon osd.3 on smithi100 2024-04-27T07:28:11.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:11 smithi100 ceph-mon[34183]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:11 smithi082 ceph-mon[26613]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:14.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:13 smithi082 ceph-mon[26613]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:14.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:14.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:14.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:14.160 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:13 smithi100 ceph-mon[34183]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:14.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:14.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:14.161 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:15 smithi082 ceph-mon[26613]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:15 smithi100 ceph-mon[34183]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:17.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.525+0000 7f4399ffb700 1 -- 172.21.15.100:0/3891324963 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f43a40f8f30 con 0x7f43900691a0 2024-04-27T07:28:17.529 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 3 on host 'smithi100' 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 msgr2=0x7f439006b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 0x7f439006b650 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4394009b80 tx=0x7f439400b040 comp rx=0 tx=0).stop 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 msgr2=0x7f43a40fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f43a0000c00 tx=0x7f43a0009e30 comp rx=0 tx=0).stop 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 shutdown_connections 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f43900691a0 0x7f439006b650 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a4066eb0 0x7f43a40fd230 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 --2- 172.21.15.100:0/3891324963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43a40fff70 0x7f43a40fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 >> 172.21.15.100:0/3891324963 conn(0x7f43a40f7440 msgr2=0x7f43a40f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 shutdown_connections 2024-04-27T07:28:17.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:17.527+0000 7f43ab890700 1 -- 172.21.15.100:0/3891324963 wait complete. 2024-04-27T07:28:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:17 smithi082 ceph-mon[26613]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:17 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:17 smithi082 ceph-mon[26613]: from='osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:28:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:17 smithi082 ceph-mon[26613]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:28:18.110 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:17 smithi100 ceph-mon[34183]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:18.110 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:18.110 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:17 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:18.110 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:17 smithi100 ceph-mon[34183]: from='osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:28:18.110 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:17 smithi100 ceph-mon[34183]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:28:18.134 DEBUG:teuthology.orchestra.run.smithi100:osd.3> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.3.service 2024-04-27T07:28:18.136 INFO:tasks.cephadm:Deploying osd.4 on smithi100 with /dev/vg_nvme/lv_3... 2024-04-27T07:28:18.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-27T07:28:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:28:19.531 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: osdmap e25: 4 total, 3 up, 4 in 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:19.532 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-mon[34183]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: osdmap e25: 4 total, 3 up, 4 in 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:19.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:19 smithi082 ceph-mon[26613]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:19.862 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[39614]: 2024-04-27T07:28:19.528+0000 7f1ac7984700 -1 osd.3 0 waiting for initial osdmap 2024-04-27T07:28:19.862 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:28:19 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[39614]: 2024-04-27T07:28:19.534+0000 7f1ac1f7e700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:28:20.824 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:20 smithi100 ceph-mon[34183]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:28:20.824 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:20 smithi100 ceph-mon[34183]: osdmap e26: 4 total, 3 up, 4 in 2024-04-27T07:28:20.824 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:20 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:20.824 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:20 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:20 smithi082 ceph-mon[26613]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:28:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:20 smithi082 ceph-mon[26613]: osdmap e26: 4 total, 3 up, 4 in 2024-04-27T07:28:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:20 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:20 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:21.792 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:28:21.792 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:28:21.792 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:21.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] boot 2024-04-27T07:28:21.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: osdmap e27: 4 total, 4 up, 4 in 2024-04-27T07:28:21.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:21 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:21.867 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124878 s, 840 MB/s 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 2024-04-27T07:28:21.868 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-27T07:28:21.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:28:21.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:28:21.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-27T07:28:21.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: osd.3 [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] boot 2024-04-27T07:28:21.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: osdmap e27: 4 total, 4 up, 4 in 2024-04-27T07:28:21.869 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:21 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:28:22.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-04-27T07:28:22.829 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:22 smithi100 ceph-mon[34183]: osdmap e28: 4 total, 4 up, 4 in 2024-04-27T07:28:22.836 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:22 smithi100 ceph-mon[34183]: osdmap e29: 4 total, 4 up, 4 in 2024-04-27T07:28:22.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:22 smithi082 ceph-mon[26613]: osdmap e28: 4 total, 4 up, 4 in 2024-04-27T07:28:22.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:22 smithi082 ceph-mon[26613]: osdmap e29: 4 total, 4 up, 4 in 2024-04-27T07:28:22.928 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi100 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:24.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi100 to 15936M 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:24.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:23 smithi100 ceph-mon[34183]: osdmap e30: 4 total, 4 up, 4 in 2024-04-27T07:28:24.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.308+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/1333357916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 msgr2=0x7fa1c80fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:24.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/1333357916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c80fc0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8004940 tx=0x7fa1b8009e30 comp rx=0 tx=0).stop 2024-04-27T07:28:24.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/1333357916 shutdown_connections 2024-04-27T07:28:24.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/1333357916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c80fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/1333357916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c80fc0d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/1333357916 >> 172.21.15.100:0/1333357916 conn(0x7fa1c80f7420 msgr2=0x7fa1c80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/1333357916 shutdown_connections 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/1333357916 wait complete. 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 Processor -- start 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- start start 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c8112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8112c70 con 0x7fa1c80fcf70 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.309+0000 7fa1cd5fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8112de0 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46876/0 (socket says 172.21.15.100:46876) 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 -- 172.21.15.100:0/304950291 learned_addr learned my addr 172.21.15.100:0/304950291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:28:24.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c67fc700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c8112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 -- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 msgr2=0x7fa1c8112730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c8112730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 -- 172.21.15.100:0/304950291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8005040 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c67fc700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c8112730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1c6ffd700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b3b0 tx=0x7fa1b8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b800e040 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c8113060 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1b800bcc0 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b801c630 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.310+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c8113620 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.311+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c804c710 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.312+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa1b8013980 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.312+0000 7fa1af7fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 0x7fa1b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.312+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fa1b8087920 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.312+0000 7fa1c67fc700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 0x7fa1b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:24.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.313+0000 7fa1c67fc700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 0x7fa1b006b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006fd0 tx=0x7fa1bc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:28:24.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.317+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa1b8057d00 con 0x7fa1c80fbcc0 2024-04-27T07:28:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi100 2024-04-27T07:28:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi100 to 15936M 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:24.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:23 smithi082 ceph-mon[26613]: osdmap e30: 4 total, 4 up, 4 in 2024-04-27T07:28:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:24.509+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1c8101210 con 0x7fa1b00692a0 2024-04-27T07:28:25.214 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:25.215 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:25.215 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:25.215 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:24 smithi100 ceph-mon[34183]: osdmap e31: 4 total, 4 up, 4 in 2024-04-27T07:28:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:24 smithi082 ceph-mon[26613]: osdmap e31: 4 total, 4 up, 4 in 2024-04-27T07:28:26.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:25 smithi100 ceph-mon[34183]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:26.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:25 smithi100 ceph-mon[34183]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:25 smithi082 ceph-mon[26613]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:25 smithi082 ceph-mon[26613]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1252148426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]: dispatch 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]: dispatch 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]': finished 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: osdmap e32: 5 total, 4 up, 5 in 2024-04-27T07:28:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:28.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:27 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/541213370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/1252148426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]: dispatch 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]: dispatch 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4abec552-f6f7-4611-8a92-8521469ff82e"}]': finished 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: osdmap e32: 5 total, 4 up, 5 in 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:27 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/541213370' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:30.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:29 smithi100 ceph-mon[34183]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-04-27T07:28:30.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:29 smithi082 ceph-mon[26613]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-04-27T07:28:32.253 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:31 smithi100 ceph-mon[34183]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-27T07:28:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:31 smithi082 ceph-mon[26613]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-27T07:28:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:33 smithi100 ceph-mon[34183]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-27T07:28:34.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:33 smithi082 ceph-mon[26613]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-27T07:28:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:34 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:28:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:34 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:34 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:28:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:34 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:36.272 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:35 smithi100 ceph-mon[34183]: Deploying daemon osd.4 on smithi100 2024-04-27T07:28:36.273 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:35 smithi100 ceph-mon[34183]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-27T07:28:36.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:35 smithi082 ceph-mon[26613]: Deploying daemon osd.4 on smithi100 2024-04-27T07:28:36.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:35 smithi082 ceph-mon[26613]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-27T07:28:38.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:37 smithi082 ceph-mon[26613]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:38.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:37 smithi100 ceph-mon[34183]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:39.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:40.027 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:39 smithi100 ceph-mon[34183]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:40.028 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:39 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:40.028 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:39 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:40.028 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:39 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:39 smithi082 ceph-mon[26613]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:39 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:42.068 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:41 smithi100 ceph-mon[34183]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:42.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:41 smithi082 ceph-mon[26613]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.973+0000 7fa1af7fe700 1 -- 172.21.15.100:0/304950291 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa1c8101210 con 0x7fa1b00692a0 2024-04-27T07:28:42.976 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 4 on host 'smithi100' 2024-04-27T07:28:42.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 msgr2=0x7fa1b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:42.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 0x7fa1b006b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006fd0 tx=0x7fa1bc008040 comp rx=0 tx=0).stop 2024-04-27T07:28:42.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 msgr2=0x7fa1c8066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b3b0 tx=0x7fa1b8009e30 comp rx=0 tx=0).stop 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 shutdown_connections 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa1b00692a0 0x7fa1b006b750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1c80fbcc0 0x7fa1c8066cf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 --2- 172.21.15.100:0/304950291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c80fcf70 0x7fa1c8112730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.975+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 >> 172.21.15.100:0/304950291 conn(0x7fa1c80f7420 msgr2=0x7fa1c80f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.976+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 shutdown_connections 2024-04-27T07:28:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:42.976+0000 7fa1cd5fe700 1 -- 172.21.15.100:0/304950291 wait complete. 2024-04-27T07:28:43.555 DEBUG:teuthology.orchestra.run.smithi100:osd.4> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.4.service 2024-04-27T07:28:43.558 INFO:tasks.cephadm:Deploying osd.5 on smithi100 with /dev/vg_nvme/lv_2... 2024-04-27T07:28:43.558 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-27T07:28:43.861 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:28:44.221 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:44.221 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.221 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.221 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:28:44.221 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:28:44.222 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.222 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:43 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:43 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:45.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:44 smithi100 ceph-mon[34183]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-27T07:28:45.119 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:44 smithi100 ceph-mon[34183]: osdmap e33: 5 total, 4 up, 5 in 2024-04-27T07:28:45.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:44 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:45.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:44 smithi100 ceph-mon[34183]: from='osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:45.120 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:44 smithi100 ceph-mon[34183]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:45.120 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[46177]: 2024-04-27T07:28:44.999+0000 7fb675c99700 -1 osd.4 0 waiting for initial osdmap 2024-04-27T07:28:45.120 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[46177]: 2024-04-27T07:28:45.006+0000 7fb66f291700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:28:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:44 smithi082 ceph-mon[26613]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-27T07:28:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:44 smithi082 ceph-mon[26613]: osdmap e33: 5 total, 4 up, 5 in 2024-04-27T07:28:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:44 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:44 smithi082 ceph-mon[26613]: from='osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:44 smithi082 ceph-mon[26613]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:28:45.669 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-27T07:28:45.670 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-27T07:28:45.670 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-04-27T07:28:45.670 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-04-27T07:28:45.670 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128474 s, 816 MB/s 2024-04-27T07:28:45.670 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-04-27T07:28:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:28:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: osdmap e34: 5 total, 4 up, 5 in 2024-04-27T07:28:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] boot 2024-04-27T07:28:46.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: osdmap e35: 5 total, 5 up, 5 in 2024-04-27T07:28:46.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:45 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: osdmap e34: 5 total, 4 up, 5 in 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: osd.4 [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] boot 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: osdmap e35: 5 total, 5 up, 5 in 2024-04-27T07:28:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:45 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:28:46.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-04-27T07:28:47.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:47 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:28:47.121 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:47 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:28:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:47 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:28:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:47 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:28:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:28:48.004 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:48 smithi100 ceph-mon[34183]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:48 smithi082 ceph-mon[26613]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:48 smithi082 ceph-mon[26613]: osdmap e36: 5 total, 5 up, 5 in 2024-04-27T07:28:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:48 smithi100 ceph-mon[34183]: osdmap e36: 5 total, 5 up, 5 in 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1394091292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c0ffef0 msgr2=0x7fe49c102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1394091292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c0ffef0 0x7fe49c102310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe490004940 tx=0x7fe490009e30 comp rx=0 tx=0).stop 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1394091292 shutdown_connections 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1394091292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c0ffef0 0x7fe49c102310 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1394091292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c066f30 0x7fe49c0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1394091292 >> 172.21.15.100:0/1394091292 conn(0x7fe49c0f7440 msgr2=0x7fe49c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1394091292 shutdown_connections 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1394091292 wait complete. 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 Processor -- start 2024-04-27T07:28:49.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.677+0000 7fe4a1c10700 1 -- start start 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c0ffef0 0x7fe49c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c10e4a0 con 0x7fe49c0ffef0 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c10e610 con 0x7fe49c066f30 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56008/0 (socket says 172.21.15.100:56008) 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 -- 172.21.15.100:0/1227744101 learned_addr learned my addr 172.21.15.100:0/1227744101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49affd700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c0ffef0 0x7fe49c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 -- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c0ffef0 msgr2=0x7fe49c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c0ffef0 0x7fe49c10dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 -- 172.21.15.100:0/1227744101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe490005040 con 0x7fe49c066f30 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe49b7fe700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe48c002a50 tx=0x7fe48c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:28:49.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c007cc0 con 0x7fe49c066f30 2024-04-27T07:28:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe48c00f040 con 0x7fe49c066f30 2024-04-27T07:28:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c113070 con 0x7fe49c066f30 2024-04-27T07:28:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c00d9c0 con 0x7fe49c066f30 2024-04-27T07:28:49.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.678+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c113630 con 0x7fe49c066f30 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.679+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c04c710 con 0x7fe49c066f30 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.680+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe48c009730 con 0x7fe49c066f30 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.680+0000 7fe483fff700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 0x7fe48406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.680+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fe48c086a50 con 0x7fe49c066f30 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.680+0000 7fe49affd700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 0x7fe48406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:28:49.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.681+0000 7fe49affd700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 0x7fe48406b750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe49000b970 tx=0x7fe490009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:28:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.686+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe48c056c80 con 0x7fe49c066f30 2024-04-27T07:28:49.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:28:49.879+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49c0f8f30 con 0x7fe4840692a0 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.295 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:50.296 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:50 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-27T07:28:50.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:50 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:28:51.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:51 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi100 2024-04-27T07:28:51.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:51 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi100 to 7968M 2024-04-27T07:28:51.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:51 smithi100 ceph-mon[34183]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:51 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi100 2024-04-27T07:28:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:51 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi100 to 7968M 2024-04-27T07:28:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:51 smithi082 ceph-mon[26613]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:28:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:52 smithi082 ceph-mon[26613]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:52 smithi100 ceph-mon[34183]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1051473547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]: dispatch 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]: dispatch 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]': finished 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: osdmap e37: 6 total, 5 up, 6 in 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:28:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:53 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/1096626831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/1051473547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]: dispatch 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]: dispatch 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da729222-1a05-4b04-936c-f02b6f94e26f"}]': finished 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: osdmap e37: 6 total, 5 up, 6 in 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:28:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:53 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/1096626831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-27T07:28:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:54 smithi082 ceph-mon[26613]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:54 smithi100 ceph-mon[34183]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:28:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:56 smithi082 ceph-mon[26613]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:56 smithi100 ceph-mon[34183]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:58.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:28:58 smithi082 ceph-mon[26613]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:28:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:28:58 smithi100 ceph-mon[34183]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:00.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:00 smithi082 ceph-mon[26613]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:00.591 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:29:00.591 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:00 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:00.592 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:00 smithi100 ceph-mon[34183]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:00.592 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:29:00.592 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:00 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:01 smithi082 ceph-mon[26613]: Deploying daemon osd.5 on smithi100 2024-04-27T07:29:01.368 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:01 smithi100 ceph-mon[34183]: Deploying daemon osd.5 on smithi100 2024-04-27T07:29:02.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:02 smithi082 ceph-mon[26613]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:02.411 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:02 smithi100 ceph-mon[34183]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:03.330 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:03 smithi100 ceph-mon[34183]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:03.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:03 smithi082 ceph-mon[26613]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:05 smithi082 ceph-mon[26613]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:05 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:29:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:05 smithi100 ceph-mon[34183]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:05 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:29:08.012 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:07 smithi100 ceph-mon[34183]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:07 smithi082 ceph-mon[26613]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:08.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.989+0000 7fe483fff700 1 -- 172.21.15.100:0/1227744101 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe49c0f8f30 con 0x7fe4840692a0 2024-04-27T07:29:08.991 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 5 on host 'smithi100' 2024-04-27T07:29:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 msgr2=0x7fe48406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 0x7fe48406b750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe49000b970 tx=0x7fe490009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 msgr2=0x7fe49c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe48c002a50 tx=0x7fe48c004600 comp rx=0 tx=0).stop 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 shutdown_connections 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe4840692a0 0x7fe48406b750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe49c066f30 0x7fe49c10d960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 --2- 172.21.15.100:0/1227744101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe49c0ffef0 0x7fe49c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.991+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 >> 172.21.15.100:0/1227744101 conn(0x7fe49c0f7440 msgr2=0x7fe49c0f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.992+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 shutdown_connections 2024-04-27T07:29:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:08.992+0000 7fe4a1c10700 1 -- 172.21.15.100:0/1227744101 wait complete. 2024-04-27T07:29:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:29:09.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:09.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:09.620 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:09.621 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:29:09.645 DEBUG:teuthology.orchestra.run.smithi100:osd.5> sudo journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.5.service 2024-04-27T07:29:09.647 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-27T07:29:09.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-27T07:29:09.900 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:10.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:10 smithi082 ceph-mon[26613]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-27T07:29:10.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:10 smithi082 ceph-mon[26613]: osdmap e38: 6 total, 5 up, 6 in 2024-04-27T07:29:10.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:10 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:10.294 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:10 smithi082 ceph-mon[26613]: from='osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:29:10.294 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:10 smithi082 ceph-mon[26613]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:29:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-mon[34183]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-27T07:29:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-mon[34183]: osdmap e38: 6 total, 5 up, 6 in 2024-04-27T07:29:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-mon[34183]: from='osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:29:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-mon[34183]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:29:10.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[53116]: 2024-04-27T07:29:10.267+0000 7f7c72330700 -1 osd.5 0 waiting for initial osdmap 2024-04-27T07:29:10.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:29:10 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[53116]: 2024-04-27T07:29:10.275+0000 7f7c6d12b700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:29:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:11 smithi100 ceph-mon[34183]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:29:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:11 smithi100 ceph-mon[34183]: osdmap e39: 6 total, 5 up, 6 in 2024-04-27T07:29:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:11 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:11 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:11 smithi100 ceph-mon[34183]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- 172.21.15.82:0/3634976989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 msgr2=0x7f52b4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/3634976989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b4102320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52a8004940 tx=0x7f52a8009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- 172.21.15.82:0/3634976989 shutdown_connections 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/3634976989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b4102320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/3634976989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 0x7f52b40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- 172.21.15.82:0/3634976989 >> 172.21.15.82:0/3634976989 conn(0x7f52b40f7430 msgr2=0x7f52b40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- 172.21.15.82:0/3634976989 shutdown_connections 2024-04-27T07:29:11.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- 172.21.15.82:0/3634976989 wait complete. 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 Processor -- start 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.453+0000 7f52b9ca0700 1 -- start start 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 0x7f52b410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b410e520 con 0x7f52b40fff40 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b410ed70 con 0x7f52b4066260 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50602/0 (socket says 172.21.15.82:50602) 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 -- 172.21.15.82:0/1359825757 learned_addr learned my addr 172.21.15.82:0/1359825757 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b37fe700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 0x7f52b410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:11.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 -- 172.21.15.82:0/1359825757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 msgr2=0x7f52b410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 0x7f52b410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 -- 172.21.15.82:0/1359825757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8005040 con 0x7f52b40fff40 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b2ffd700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009150 tx=0x7f52a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a800e040 con 0x7f52b40fff40 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52a8004290 con 0x7f52b40fff40 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b410eff0 con 0x7f52b40fff40 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a801c630 con 0x7f52b40fff40 2024-04-27T07:29:11.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.454+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b410f530 con 0x7f52b40fff40 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.455+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b405f5c0 con 0x7f52b40fff40 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.456+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f52a800bbf0 con 0x7f52b40fff40 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.456+0000 7f529bfff700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 0x7f529c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.456+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f52a8087b20 con 0x7f52b40fff40 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.456+0000 7f52b37fe700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 0x7f529c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:11.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.457+0000 7f52b37fe700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 0x7f529c06fb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52b4065fa0 tx=0x7f52a4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:11.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.461+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f52a8057c20 con 0x7f52b40fff40 2024-04-27T07:29:11.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:11 smithi082 ceph-mon[26613]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-04-27T07:29:11.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:11 smithi082 ceph-mon[26613]: osdmap e39: 6 total, 5 up, 6 in 2024-04-27T07:29:11.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:11 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:11.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:11 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:11.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:11 smithi082 ceph-mon[26613]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-27T07:29:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.648+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f52b404bed0 con 0x7f52b40fff40 2024-04-27T07:29:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.648+0000 7f529bfff700 1 -- 172.21.15.82:0/1359825757 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f52a80577b0 con 0x7f52b40fff40 2024-04-27T07:29:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:29:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 msgr2=0x7f529c06fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 0x7f529c06fb60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52b4065fa0 tx=0x7f52a4009040 comp rx=0 tx=0).stop 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 msgr2=0x7f52b410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009150 tx=0x7f52a8009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 shutdown_connections 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f529c06d6b0 0x7f529c06fb60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52b4066260 0x7f52b410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 --2- 172.21.15.82:0/1359825757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b40fff40 0x7f52b410df20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 >> 172.21.15.82:0/1359825757 conn(0x7f52b40f7430 msgr2=0x7f52b40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.650+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 shutdown_connections 2024-04-27T07:29:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:11.651+0000 7f52b9ca0700 1 -- 172.21.15.82:0/1359825757 wait complete. 2024-04-27T07:29:12.269 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1714202951,"num_in_osds":6,"osd_in_since":1714202932,"num_remapped_pgs":0} 2024-04-27T07:29:12.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: purged_snaps scrub starts 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: purged_snaps scrub ok 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] boot 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: osdmap e40: 6 total, 6 up, 6 in 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:12 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1359825757' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-27T07:29:12.520 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: purged_snaps scrub starts 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: purged_snaps scrub ok 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: osd.5 [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] boot 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: osdmap e40: 6 total, 6 up, 6 in 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:29:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:12 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1359825757' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-27T07:29:13.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: osdmap e41: 6 total, 6 up, 6 in 2024-04-27T07:29:13.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:13.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: Detected new or changed devices on smithi100 2024-04-27T07:29:13.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi100 to 5312M 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:29:13.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:13 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: osdmap e41: 6 total, 6 up, 6 in 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: Detected new or changed devices on smithi100 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi100 to 5312M 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:29:13.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:13 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:29:14.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 -- 172.21.15.82:0/3231655360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 msgr2=0x7f5d9c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 --2- 172.21.15.82:0/3231655360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c1031f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009ce0 tx=0x7f5d94004d10 comp rx=0 tx=0).stop 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 -- 172.21.15.82:0/3231655360 shutdown_connections 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 --2- 172.21.15.82:0/3231655360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 0x7f5d9c0fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 --2- 172.21.15.82:0/3231655360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c1031f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 -- 172.21.15.82:0/3231655360 >> 172.21.15.82:0/3231655360 conn(0x7f5d9c072380 msgr2=0x7f5d9c072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 -- 172.21.15.82:0/3231655360 shutdown_connections 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 -- 172.21.15.82:0/3231655360 wait complete. 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.178+0000 7f5da1eed700 1 Processor -- start 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5da1eed700 1 -- start start 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5da1eed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5da1eed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 0x7f5d9c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5da1eed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1146a0 con 0x7f5d9c102e20 2024-04-27T07:29:14.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5da1eed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c10dc80 con 0x7f5d9c1037c0 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50620/0 (socket says 172.21.15.82:50620) 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 -- 172.21.15.82:0/487197130 learned_addr learned my addr 172.21.15.82:0/487197130 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9affd700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 0x7f5d9c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 -- 172.21.15.82:0/487197130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 msgr2=0x7f5d9c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 0x7f5d9c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 -- 172.21.15.82:0/487197130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d94009940 con 0x7f5d9c102e20 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d9b7fe700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400be40 tx=0x7f5d94004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.179+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9400e040 con 0x7f5d9c102e20 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.180+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c10df00 con 0x7f5d9c102e20 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.180+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d94004610 con 0x7f5d9c102e20 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.180+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d9401c640 con 0x7f5d9c102e20 2024-04-27T07:29:14.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.180+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c10e440 con 0x7f5d9c102e20 2024-04-27T07:29:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.180+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c100160 con 0x7f5d9c102e20 2024-04-27T07:29:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.181+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5d94012970 con 0x7f5d9c102e20 2024-04-27T07:29:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.181+0000 7f5d93fff700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 0x7f5d8806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.181+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5d94088810 con 0x7f5d9c102e20 2024-04-27T07:29:14.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.181+0000 7f5d9affd700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 0x7f5d8806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:14.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.182+0000 7f5d9affd700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 0x7f5d8806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c10f3b0 tx=0x7f5d8400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:14.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.186+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5d94058890 con 0x7f5d9c102e20 2024-04-27T07:29:14.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.376+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d9c0fe6e0 con 0x7f5d9c102e20 2024-04-27T07:29:14.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.377+0000 7f5d93fff700 1 -- 172.21.15.82:0/487197130 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7f5d94058420 con 0x7f5d9c102e20 2024-04-27T07:29:14.379 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:29:14.380 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:29:12.270803+0000","last_up_change":"2024-04-27T07:29:11.263707+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6803","nonce":2738777068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6805","nonce":2738777068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6809","nonce":2738777068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6807","nonce":2738777068}]},"public_addr":"172.21.15.82:6803/2738777068","cluster_addr":"172.21.15.82:6805/2738777068","heartbeat_back_addr":"172.21.15.82:6809/2738777068","heartbeat_front_addr":"172.21.15.82:6807/2738777068","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6811","nonce":3469545083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6813","nonce":3469545083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6817","nonce":3469545083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6815","nonce":3469545083}]},"public_addr":"172.21.15.82:6811/3469545083","cluster_addr":"172.21.15.82:6813/3469545083","heartbeat_back_addr":"172.21.15.82:6817/3469545083","heartbeat_front_addr":"172.21.15.82:6815/3469545083","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6819","nonce":3740754295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6821","nonce":3740754295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6825","nonce":3740754295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6823","nonce":3740754295}]},"public_addr":"172.21.15.82:6819/3740754295","cluster_addr":"172.21.15.82:6821/3740754295","heartbeat_back_addr":"172.21.15.82:6825/3740754295","heartbeat_front_addr":"172.21.15.82:6823/3740754295","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6801","nonce":4124992664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6803","nonce":4124992664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6807","nonce":4124992664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6805","nonce":4124992664}]},"public_addr":"172.21.15.100:6801/4124992664","cluster_addr":"172.21.15.100:6803/4124992664","heartbeat_back_addr":"172.21.15.100:6807/4124992664","heartbeat_front_addr":"172.21.15.100:6805/4124992664","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6809","nonce":371286847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6811","nonce":371286847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6815","nonce":371286847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6813","nonce":371286847}]},"public_addr":"172.21.15.100:6809/371286847","cluster_addr":"172.21.15.100:6811/371286847","heartbeat_back_addr":"172.21.15.100:6815/371286847","heartbeat_front_addr":"172.21.15.100:6813/371286847","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6817","nonce":1350134728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6819","nonce":1350134728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6823","nonce":1350134728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6821","nonce":1350134728}]},"public_addr":"172.21.15.100:6817/1350134728","cluster_addr":"172.21.15.100:6819/1350134728","heartbeat_back_addr":"172.21.15.100:6823/1350134728","heartbeat_front_addr":"172.21.15.100:6821/1350134728","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 msgr2=0x7f5d8806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 0x7f5d8806b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c10f3b0 tx=0x7f5d8400b040 comp rx=0 tx=0).stop 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 msgr2=0x7f5d9c113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400be40 tx=0x7f5d94004d10 comp rx=0 tx=0).stop 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 shutdown_connections 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f5d880692a0 0x7f5d8806b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d9c102e20 0x7f5d9c113b10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 --2- 172.21.15.82:0/487197130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d9c1037c0 0x7f5d9c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 >> 172.21.15.82:0/487197130 conn(0x7f5d9c072380 msgr2=0x7f5d9c0face0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:14.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 shutdown_connections 2024-04-27T07:29:14.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:14.379+0000 7f5da1eed700 1 -- 172.21.15.82:0/487197130 wait complete. 2024-04-27T07:29:14.693 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:14 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/487197130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:14 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/487197130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:15.047 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-27T07:27:58.687625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-27T07:29:15.047 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-27T07:29:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:15.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:15 smithi082 ceph-mon[26613]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:15.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:15 smithi100 ceph-mon[34183]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 -- 172.21.15.82:0/773359587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 msgr2=0x7f81ac1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 --2- 172.21.15.82:0/773359587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1031b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f819c004940 tx=0x7f819c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 -- 172.21.15.82:0/773359587 shutdown_connections 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 --2- 172.21.15.82:0/773359587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 0x7f81ac0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 --2- 172.21.15.82:0/773359587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1031b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 -- 172.21.15.82:0/773359587 >> 172.21.15.82:0/773359587 conn(0x7f81ac0f8990 msgr2=0x7f81ac0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 -- 172.21.15.82:0/773359587 shutdown_connections 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 -- 172.21.15.82:0/773359587 wait complete. 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.953+0000 7f81b29f2700 1 Processor -- start 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 -- start start 2024-04-27T07:29:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 0x7f81ac113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac114470 con 0x7f81ac102de0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac10da70 con 0x7f81ac103780 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57606/0 (socket says 172.21.15.82:57606) 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 -- 172.21.15.82:0/2854603467 learned_addr learned my addr 172.21.15.82:0/2854603467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81ab7fe700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 0x7f81ac113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 -- 172.21.15.82:0/2854603467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 msgr2=0x7f81ac113e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 0x7f81ac113e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 -- 172.21.15.82:0/2854603467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c005040 con 0x7f81ac102de0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81abfff700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f819c009b30 tx=0x7f819c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c021070 con 0x7f81ac102de0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac10dcf0 con 0x7f81ac102de0 2024-04-27T07:29:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f819c013c00 con 0x7f81ac102de0 2024-04-27T07:29:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.954+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819c00e070 con 0x7f81ac102de0 2024-04-27T07:29:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.955+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac10e1d0 con 0x7f81ac102de0 2024-04-27T07:29:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.955+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac1000f0 con 0x7f81ac102de0 2024-04-27T07:29:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.956+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f819c01cad0 con 0x7f81ac102de0 2024-04-27T07:29:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.956+0000 7f81a8ff9700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 0x7f819406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.956+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f819c0882f0 con 0x7f81ac102de0 2024-04-27T07:29:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.956+0000 7f81ab7fe700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 0x7f819406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.957+0000 7f81ab7fe700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 0x7f819406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ac10ec30 tx=0x7f81a000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:16.960+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f819c0583f0 con 0x7f81ac102de0 2024-04-27T07:29:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.146+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81ac10ef30 con 0x7f81ac102de0 2024-04-27T07:29:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.146+0000 7f81a8ff9700 1 -- 172.21.15.82:0/2854603467 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f819c004490 con 0x7f81ac102de0 2024-04-27T07:29:17.148 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-27T07:29:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 msgr2=0x7f819406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 0x7f819406b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ac10ec30 tx=0x7f81a000b040 comp rx=0 tx=0).stop 2024-04-27T07:29:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 msgr2=0x7f81ac1138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f819c009b30 tx=0x7f819c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 shutdown_connections 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f81940692a0 0x7f819406b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ac102de0 0x7f81ac1138e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 --2- 172.21.15.82:0/2854603467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81ac103780 0x7f81ac113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 >> 172.21.15.82:0/2854603467 conn(0x7f81ac0f8990 msgr2=0x7f81ac0fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 shutdown_connections 2024-04-27T07:29:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:17.148+0000 7f81b29f2700 1 -- 172.21.15.82:0/2854603467 wait complete. 2024-04-27T07:29:17.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:17 smithi082 ceph-mon[26613]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:17.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:17 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2854603467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:29:17.819 INFO:tasks.cephadm:Setting up client nodes... 2024-04-27T07:29:17.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-27T07:29:17.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:17 smithi100 ceph-mon[34183]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:17.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:17 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2854603467' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:29:18.073 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- 172.21.15.82:0/3148172234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fce80 msgr2=0x7f88240fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 --2- 172.21.15.82:0/3148172234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fce80 0x7f88240fd290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8814004940 tx=0x7f8814009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- 172.21.15.82:0/3148172234 shutdown_connections 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 --2- 172.21.15.82:0/3148172234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fdff0 0x7f88240fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 --2- 172.21.15.82:0/3148172234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fce80 0x7f88240fd290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- 172.21.15.82:0/3148172234 >> 172.21.15.82:0/3148172234 conn(0x7f88240f8580 msgr2=0x7f88240fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:19.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- 172.21.15.82:0/3148172234 shutdown_connections 2024-04-27T07:29:19.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- 172.21.15.82:0/3148172234 wait complete. 2024-04-27T07:29:19.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 Processor -- start 2024-04-27T07:29:19.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.602+0000 7f8829f4d700 1 -- start start 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fce80 0x7f882410d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882410e560 con 0x7f88240fdff0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8824112e40 con 0x7f88240fce80 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57616/0 (socket says 172.21.15.82:57616) 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 -- 172.21.15.82:0/1472780574 learned_addr learned my addr 172.21.15.82:0/1472780574 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 -- 172.21.15.82:0/1472780574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fce80 msgr2=0x7f882410d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f88237fe700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fce80 0x7f882410d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fce80 0x7f882410d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 -- 172.21.15.82:0/1472780574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814005040 con 0x7f88240fdff0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8822ffd700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f881800b790 tx=0x7f8818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f881800f770 con 0x7f88240fdff0 2024-04-27T07:29:19.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f881800fda0 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88241130a0 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f881800d310 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.603+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824113610 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.604+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882404c710 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.605+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8818010420 con 0x7f88240fdff0 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.605+0000 7f880bfff700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 0x7f880c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:19.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.605+0000 7f88237fe700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 0x7f880c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:19.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.605+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8818086e70 con 0x7f88240fdff0 2024-04-27T07:29:19.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.606+0000 7f88237fe700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 0x7f880c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:19.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.610+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8818056f70 con 0x7f88240fdff0 2024-04-27T07:29:19.779 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:19 smithi100 ceph-mon[34183]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:19.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:19 smithi082 ceph-mon[26613]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:19.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.875+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f8824105960 con 0x7f88240fdff0 2024-04-27T07:29:19.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.881+0000 7f880bfff700 1 -- 172.21.15.82:0/1472780574 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8818056b00 con 0x7f88240fdff0 2024-04-27T07:29:19.883 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-04-27T07:29:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBPqSxm2V9CNBAABnrUrmD1H+crRs3l52Z7Ug== 2024-04-27T07:29:19.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 msgr2=0x7f880c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 0x7f880c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 msgr2=0x7f882410ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f881800b790 tx=0x7f8818009250 comp rx=0 tx=0).stop 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 shutdown_connections 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f880c0692a0 0x7f880c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88240fce80 0x7f882410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 --2- 172.21.15.82:0/1472780574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88240fdff0 0x7f882410ded0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 >> 172.21.15.82:0/1472780574 conn(0x7f88240f8580 msgr2=0x7f88240f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 shutdown_connections 2024-04-27T07:29:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:19.883+0000 7f8829f4d700 1 -- 172.21.15.82:0/1472780574 wait complete. 2024-04-27T07:29:20.608 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:29:20.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-27T07:29:20.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-27T07:29:20.644 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-27T07:29:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:20 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1472780574' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:20 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1472780574' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-27T07:29:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi100/config 2024-04-27T07:29:20.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:20 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1472780574' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:20.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:20 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1472780574' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-27T07:29:21.916 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:21 smithi082 ceph-mon[26613]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:22.050 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:21 smithi100 ceph-mon[34183]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:22.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/2801108783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 msgr2=0x7f7d840fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/2801108783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840fe440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d74004940 tx=0x7f7d74009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/2801108783 shutdown_connections 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/2801108783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840fe440 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/2801108783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 0x7f7d840fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/2801108783 >> 172.21.15.100:0/2801108783 conn(0x7f7d840f8540 msgr2=0x7f7d840fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/2801108783 shutdown_connections 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.381+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/2801108783 wait complete. 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 Processor -- start 2024-04-27T07:29:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 -- start start 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 0x7f7d84071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84072200 con 0x7f7d840fce60 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8b4b3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840707f0 con 0x7f7d840fdfd0 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40280/0 (socket says 172.21.15.100:40280) 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 -- 172.21.15.100:0/365918053 learned_addr learned my addr 172.21.15.100:0/365918053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d8924f700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 0x7f7d84071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 -- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 msgr2=0x7f7d84071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 0x7f7d84071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 -- 172.21.15.100:0/365918053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74005040 con 0x7f7d840fdfd0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.382+0000 7f7d88a4e700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400b3b0 tx=0x7f7d74009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.383+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7400e040 con 0x7f7d840fdfd0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.383+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d7400bbf0 con 0x7f7d840fdfd0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.383+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d84070a40 con 0x7f7d840fdfd0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.383+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7401c630 con 0x7f7d840fdfd0 2024-04-27T07:29:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.383+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d84071000 con 0x7f7d840fdfd0 2024-04-27T07:29:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.384+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8404c710 con 0x7f7d840fdfd0 2024-04-27T07:29:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.384+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7d7400bd60 con 0x7f7d840fdfd0 2024-04-27T07:29:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.385+0000 7f7d79ffb700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 0x7f7d7006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.385+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7d74087b10 con 0x7f7d840fdfd0 2024-04-27T07:29:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.385+0000 7f7d8924f700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 0x7f7d7006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.386+0000 7f7d8924f700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 0x7f7d7006b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d80004f40 tx=0x7f7d8000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:22.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.390+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7d74057c10 con 0x7f7d840fdfd0 2024-04-27T07:29:22.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.648+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f7d841058c0 con 0x7f7d840fdfd0 2024-04-27T07:29:22.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.652+0000 7f7d79ffb700 1 -- 172.21.15.100:0/365918053 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f7d740577a0 con 0x7f7d840fdfd0 2024-04-27T07:29:22.654 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-04-27T07:29:22.654 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBSqSxmBfnEJhAAKAKWr1Bne+QSXECXIaChMA== 2024-04-27T07:29:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 msgr2=0x7f7d7006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 0x7f7d7006b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d80004f40 tx=0x7f7d8000b040 comp rx=0 tx=0).stop 2024-04-27T07:29:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 msgr2=0x7f7d840702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400b3b0 tx=0x7f7d74009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:22.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 shutdown_connections 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d700692a0 0x7f7d7006b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fce60 0x7f7d84071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 --2- 172.21.15.100:0/365918053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fdfd0 0x7f7d840702b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.654+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 >> 172.21.15.100:0/365918053 conn(0x7f7d840f8540 msgr2=0x7f7d840f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.655+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 shutdown_connections 2024-04-27T07:29:22.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:29:22.655+0000 7f7d8b4b3700 1 -- 172.21.15.100:0/365918053 wait complete. 2024-04-27T07:29:22.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:22 smithi100 ceph-mon[34183]: from='client.? 172.21.15.100:0/365918053' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:22.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:22 smithi100 ceph-mon[34183]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:22.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:22 smithi100 ceph-mon[34183]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-27T07:29:23.289 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:29:23.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-27T07:29:23.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-27T07:29:23.325 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-27T07:29:23.325 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-27T07:29:23.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-27T07:29:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:22 smithi082 ceph-mon[26613]: from='client.? 172.21.15.100:0/365918053' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:22 smithi082 ceph-mon[26613]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-27T07:29:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:22 smithi082 ceph-mon[26613]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-27T07:29:23.582 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:23.988 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:23 smithi082 ceph-mon[26613]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:23.988 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:24.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:23 smithi100 ceph-mon[34183]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:24.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- 172.21.15.82:0/1752816944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac101d10 msgr2=0x7ff6ac1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/1752816944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac101d10 0x7ff6ac1020e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004940 tx=0x7ff69c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- 172.21.15.82:0/1752816944 shutdown_connections 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/1752816944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/1752816944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac101d10 0x7ff6ac1020e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- 172.21.15.82:0/1752816944 >> 172.21.15.82:0/1752816944 conn(0x7ff6ac0f7860 msgr2=0x7ff6ac0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- 172.21.15.82:0/1752816944 shutdown_connections 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- 172.21.15.82:0/1752816944 wait complete. 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 Processor -- start 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.318+0000 7ff6b1d83700 1 -- start start 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac101d10 0x7ff6ac113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac114510 con 0x7ff6ac1026b0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac10db60 con 0x7ff6ac101d10 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57626/0 (socket says 172.21.15.82:57626) 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 -- 172.21.15.82:0/352145009 learned_addr learned my addr 172.21.15.82:0/352145009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6ab7fe700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac101d10 0x7ff6ac113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 -- 172.21.15.82:0/352145009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac101d10 msgr2=0x7ff6ac113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac101d10 0x7ff6ac113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 -- 172.21.15.82:0/352145009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c005040 con 0x7ff6ac1026b0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6aaffd700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0002a80 tx=0x7ff6a0004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a0007cc0 con 0x7ff6ac1026b0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac10de40 con 0x7ff6ac1026b0 2024-04-27T07:29:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6a000f040 con 0x7ff6ac1026b0 2024-04-27T07:29:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a000daf0 con 0x7ff6ac1026b0 2024-04-27T07:29:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.319+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac10e400 con 0x7ff6ac1026b0 2024-04-27T07:29:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.320+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac0ff020 con 0x7ff6ac1026b0 2024-04-27T07:29:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.321+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff6a000dc90 con 0x7ff6ac1026b0 2024-04-27T07:29:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.321+0000 7ff693fff700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 0x7ff69406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.321+0000 7ff6ab7fe700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 0x7ff69406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.321+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff6a0086580 con 0x7ff6ac1026b0 2024-04-27T07:29:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.322+0000 7ff6ab7fe700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 0x7ff69406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004f90 tx=0x7ff69c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.326+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff6a004d250 con 0x7ff6ac1026b0 2024-04-27T07:29:25.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.561+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff6ac04c740 con 0x7ff6ac1026b0 2024-04-27T07:29:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.564+0000 7ff693fff700 1 -- 172.21.15.82:0/352145009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167176 (secure 0 0 0) 0x7ff6a004ad20 con 0x7ff6ac1026b0 2024-04-27T07:29:25.568 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:29:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 msgr2=0x7ff69406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:25.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 0x7ff69406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004f90 tx=0x7ff69c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 msgr2=0x7ff6ac113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0002a80 tx=0x7ff6a0004630 comp rx=0 tx=0).stop 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 shutdown_connections 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff6940692a0 0x7ff69406b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac101d10 0x7ff6ac113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 --2- 172.21.15.82:0/352145009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ac1026b0 0x7ff6ac113ec0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 >> 172.21.15.82:0/352145009 conn(0x7ff6ac0f7860 msgr2=0x7ff6ac106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 shutdown_connections 2024-04-27T07:29:25.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:25.567+0000 7ff6b1d83700 1 -- 172.21.15.82:0/352145009 wait complete. 2024-04-27T07:29:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:25 smithi100 ceph-mon[34183]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:25 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/352145009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-27T07:29:26.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:25 smithi082 ceph-mon[26613]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:26.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:25 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/352145009' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-27T07:29:26.277 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi082.hhlhmf","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1079100432},{"type":"v1","addr":"172.21.15.82:6801","nonce":1079100432}]},"active_addr":"172.21.15.82:6801/1079100432","active_change":"2024-04-27T07:25:38.376767+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi100.eparbe","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/","prometheus":"http://172.21.15.82:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":812733995}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4080505049}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4140677880}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":92279690}]}]} 2024-04-27T07:29:26.281 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-27T07:29:26.281 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-27T07:29:26.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-27T07:29:26.572 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:27.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:27 smithi082 ceph-mon[26613]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:27 smithi100 ceph-mon[34183]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- 172.21.15.82:0/737817787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 msgr2=0x7fdd140fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 --2- 172.21.15.82:0/737817787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd140fb7e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd04004940 tx=0x7fdd04009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- 172.21.15.82:0/737817787 shutdown_connections 2024-04-27T07:29:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 --2- 172.21.15.82:0/737817787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd140fb7e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 --2- 172.21.15.82:0/737817787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- 172.21.15.82:0/737817787 >> 172.21.15.82:0/737817787 conn(0x7fdd14073350 msgr2=0x7fdd14073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- 172.21.15.82:0/737817787 shutdown_connections 2024-04-27T07:29:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- 172.21.15.82:0/737817787 wait complete. 2024-04-27T07:29:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 Processor -- start 2024-04-27T07:29:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.231+0000 7fdd1b631700 1 -- start start 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd1b631700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd1b631700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd1b631700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14114610 con 0x7fdd140fb390 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd1b631700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1410db80 con 0x7fdd14102f60 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36854/0 (socket says 172.21.15.82:36854) 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 -- 172.21.15.82:0/2386516145 learned_addr learned my addr 172.21.15.82:0/2386516145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd18bcc700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 -- 172.21.15.82:0/2386516145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 msgr2=0x7fdd14113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 -- 172.21.15.82:0/2386516145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04005040 con 0x7fdd140fb390 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd18bcc700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:29:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd193cd700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000b790 tx=0x7fdd10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd1000f770 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd1000fda0 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd1000d310 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.232+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1410de60 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.233+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1410e350 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd14105390 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdd10010420 con 0x7fdd140fb390 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd09ffb700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 0x7fdd0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd18bcc700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 0x7fdd0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd10086e80 con 0x7fdd140fb390 2024-04-27T07:29:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.234+0000 7fdd18bcc700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 0x7fdd0006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009fd0 tx=0x7fdd04009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.238+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdd10056f80 con 0x7fdd140fb390 2024-04-27T07:29:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.427+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd1410a0b0 con 0x7fdd140fb390 2024-04-27T07:29:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.428+0000 7fdd09ffb700 1 -- 172.21.15.82:0/2386516145 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7fdd10056b10 con 0x7fdd140fb390 2024-04-27T07:29:28.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:29:28.430 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:29:12.270803+0000","last_up_change":"2024-04-27T07:29:11.263707+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6803","nonce":2738777068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6805","nonce":2738777068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6809","nonce":2738777068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6807","nonce":2738777068}]},"public_addr":"172.21.15.82:6803/2738777068","cluster_addr":"172.21.15.82:6805/2738777068","heartbeat_back_addr":"172.21.15.82:6809/2738777068","heartbeat_front_addr":"172.21.15.82:6807/2738777068","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6811","nonce":3469545083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6813","nonce":3469545083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6817","nonce":3469545083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6815","nonce":3469545083}]},"public_addr":"172.21.15.82:6811/3469545083","cluster_addr":"172.21.15.82:6813/3469545083","heartbeat_back_addr":"172.21.15.82:6817/3469545083","heartbeat_front_addr":"172.21.15.82:6815/3469545083","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6819","nonce":3740754295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6821","nonce":3740754295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6825","nonce":3740754295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6823","nonce":3740754295}]},"public_addr":"172.21.15.82:6819/3740754295","cluster_addr":"172.21.15.82:6821/3740754295","heartbeat_back_addr":"172.21.15.82:6825/3740754295","heartbeat_front_addr":"172.21.15.82:6823/3740754295","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6801","nonce":4124992664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6803","nonce":4124992664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6807","nonce":4124992664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6805","nonce":4124992664}]},"public_addr":"172.21.15.100:6801/4124992664","cluster_addr":"172.21.15.100:6803/4124992664","heartbeat_back_addr":"172.21.15.100:6807/4124992664","heartbeat_front_addr":"172.21.15.100:6805/4124992664","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6809","nonce":371286847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6811","nonce":371286847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6815","nonce":371286847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6813","nonce":371286847}]},"public_addr":"172.21.15.100:6809/371286847","cluster_addr":"172.21.15.100:6811/371286847","heartbeat_back_addr":"172.21.15.100:6815/371286847","heartbeat_front_addr":"172.21.15.100:6813/371286847","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6817","nonce":1350134728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6819","nonce":1350134728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6823","nonce":1350134728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6821","nonce":1350134728}]},"public_addr":"172.21.15.100:6817/1350134728","cluster_addr":"172.21.15.100:6819/1350134728","heartbeat_back_addr":"172.21.15.100:6823/1350134728","heartbeat_front_addr":"172.21.15.100:6821/1350134728","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 msgr2=0x7fdd0006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 0x7fdd0006b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009fd0 tx=0x7fdd04009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 msgr2=0x7fdd141139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000b790 tx=0x7fdd10009250 comp rx=0 tx=0).stop 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 shutdown_connections 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fdd000692a0 0x7fdd0006b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd140fb390 0x7fdd141139f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 --2- 172.21.15.82:0/2386516145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd14102f60 0x7fdd14113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 >> 172.21.15.82:0/2386516145 conn(0x7fdd14073350 msgr2=0x7fdd140ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 shutdown_connections 2024-04-27T07:29:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:28.430+0000 7fdd1b631700 1 -- 172.21.15.82:0/2386516145 wait complete. 2024-04-27T07:29:29.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:28 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2386516145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:29.165 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-27T07:29:29.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-27T07:29:29.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:28 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2386516145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:30.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:29 smithi082 ceph-mon[26613]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:30.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:29 smithi100 ceph-mon[34183]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 -- 172.21.15.82:0/2992227436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fbf40 msgr2=0x7f7ba8101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 --2- 172.21.15.82:0/2992227436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8101a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b90004940 tx=0x7f7b90009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 -- 172.21.15.82:0/2992227436 shutdown_connections 2024-04-27T07:29:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 --2- 172.21.15.82:0/2992227436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8101a30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:30.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 --2- 172.21.15.82:0/2992227436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba80fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 -- 172.21.15.82:0/2992227436 >> 172.21.15.82:0/2992227436 conn(0x7f7ba8073350 msgr2=0x7f7ba8073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 -- 172.21.15.82:0/2992227436 shutdown_connections 2024-04-27T07:29:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 -- 172.21.15.82:0/2992227436 wait complete. 2024-04-27T07:29:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.969+0000 7f7bad63f700 1 Processor -- start 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7bad63f700 1 -- start start 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7bad63f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7bad63f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7bad63f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8114530 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7bad63f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba810db50 con 0x7f7ba80fbf40 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36876/0 (socket says 172.21.15.82:36876) 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 -- 172.21.15.82:0/651857803 learned_addr learned my addr 172.21.15.82:0/651857803 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7b9e7fc700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 -- 172.21.15.82:0/651857803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 msgr2=0x7f7ba8113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 -- 172.21.15.82:0/651857803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90005040 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7b9e7fc700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.970+0000 7f7ba6ffd700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b98002a50 tx=0x7f7b980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.971+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b98007cc0 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.971+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b9800f040 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.971+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b98009640 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.971+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba810de30 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.971+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba810e370 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.972+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba80fe670 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.972+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7b980097a0 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.972+0000 7f7b9ffff700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 0x7f7b9406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.972+0000 7f7b9e7fc700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 0x7f7b9406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.972+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b98086bb0 con 0x7f7ba80fb5a0 2024-04-27T07:29:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.973+0000 7f7b9e7fc700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 0x7f7b9406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b3b0 tx=0x7f7b90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:30.977+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7b9808d080 con 0x7f7ba80fb5a0 2024-04-27T07:29:31.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.163+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ba804c710 con 0x7f7ba80fb5a0 2024-04-27T07:29:31.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.164+0000 7f7b9ffff700 1 -- 172.21.15.82:0/651857803 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11081 (secure 0 0 0) 0x7f7b98053220 con 0x7f7ba80fb5a0 2024-04-27T07:29:31.166 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:29:31.166 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:29:12.270803+0000","last_up_change":"2024-04-27T07:29:11.263707+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6803","nonce":2738777068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6805","nonce":2738777068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6809","nonce":2738777068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6807","nonce":2738777068}]},"public_addr":"172.21.15.82:6803/2738777068","cluster_addr":"172.21.15.82:6805/2738777068","heartbeat_back_addr":"172.21.15.82:6809/2738777068","heartbeat_front_addr":"172.21.15.82:6807/2738777068","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6811","nonce":3469545083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6813","nonce":3469545083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6817","nonce":3469545083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6815","nonce":3469545083}]},"public_addr":"172.21.15.82:6811/3469545083","cluster_addr":"172.21.15.82:6813/3469545083","heartbeat_back_addr":"172.21.15.82:6817/3469545083","heartbeat_front_addr":"172.21.15.82:6815/3469545083","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6819","nonce":3740754295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6821","nonce":3740754295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6825","nonce":3740754295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6823","nonce":3740754295}]},"public_addr":"172.21.15.82:6819/3740754295","cluster_addr":"172.21.15.82:6821/3740754295","heartbeat_back_addr":"172.21.15.82:6825/3740754295","heartbeat_front_addr":"172.21.15.82:6823/3740754295","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6801","nonce":4124992664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6803","nonce":4124992664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6807","nonce":4124992664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6805","nonce":4124992664}]},"public_addr":"172.21.15.100:6801/4124992664","cluster_addr":"172.21.15.100:6803/4124992664","heartbeat_back_addr":"172.21.15.100:6807/4124992664","heartbeat_front_addr":"172.21.15.100:6805/4124992664","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6809","nonce":371286847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6811","nonce":371286847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6815","nonce":371286847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6813","nonce":371286847}]},"public_addr":"172.21.15.100:6809/371286847","cluster_addr":"172.21.15.100:6811/371286847","heartbeat_back_addr":"172.21.15.100:6815/371286847","heartbeat_front_addr":"172.21.15.100:6813/371286847","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6817","nonce":1350134728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6819","nonce":1350134728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6823","nonce":1350134728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6821","nonce":1350134728}]},"public_addr":"172.21.15.100:6817/1350134728","cluster_addr":"172.21.15.100:6819/1350134728","heartbeat_back_addr":"172.21.15.100:6823/1350134728","heartbeat_front_addr":"172.21.15.100:6821/1350134728","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:29:31.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 msgr2=0x7f7b9406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:31.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 0x7f7b9406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b3b0 tx=0x7f7b90009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:31.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 msgr2=0x7f7ba81139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:31.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b98002a50 tx=0x7f7b980046b0 comp rx=0 tx=0).stop 2024-04-27T07:29:31.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 shutdown_connections 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7b940692a0 0x7f7b9406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba80fb5a0 0x7f7ba81139a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 --2- 172.21.15.82:0/651857803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba80fbf40 0x7f7ba8113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 >> 172.21.15.82:0/651857803 conn(0x7f7ba8073350 msgr2=0x7f7ba8100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 shutdown_connections 2024-04-27T07:29:31.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:31.166+0000 7f7bad63f700 1 -- 172.21.15.82:0/651857803 wait complete. 2024-04-27T07:29:31.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-27T07:29:31.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-27T07:29:31.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-27T07:29:31.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-27T07:29:31.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-27T07:29:31.786 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-27T07:29:32.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:31 smithi082 ceph-mon[26613]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:31 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/651857803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:32.095 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:32.095 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:32.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:31 smithi100 ceph-mon[34183]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:31 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/651857803' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:29:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:33 smithi082 ceph-mon[26613]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:34.093 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:34.094 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:34.094 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:33 smithi100 ceph-mon[34183]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 -- 172.21.15.82:0/4211746922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109410 msgr2=0x7f1cc81097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/4211746922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109410 0x7f1cc81097e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004940 tx=0x7f1cb8009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 -- 172.21.15.82:0/4211746922 shutdown_connections 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/4211746922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109db0 0x7f1cc8103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/4211746922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109410 0x7f1cc81097e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 -- 172.21.15.82:0/4211746922 >> 172.21.15.82:0/4211746922 conn(0x7f1cc8072c20 msgr2=0x7f1cc8075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 -- 172.21.15.82:0/4211746922 shutdown_connections 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.759+0000 7f1ccdc42700 1 -- 172.21.15.82:0/4211746922 wait complete. 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 Processor -- start 2024-04-27T07:29:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 -- start start 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 0x7f1cc811a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc811ae10 con 0x7f1cc8109db0 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1ccdc42700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc8114150 con 0x7f1cc8109410 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1cc6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1cc6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36900/0 (socket says 172.21.15.82:36900) 2024-04-27T07:29:34.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.760+0000 7f1cc6ffd700 1 -- 172.21.15.82:0/3677592002 learned_addr learned my addr 172.21.15.82:0/3677592002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc77fe700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 0x7f1cc811a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc6ffd700 1 -- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 msgr2=0x7f1cc811a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc6ffd700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 0x7f1cc811a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc6ffd700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8005040 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc77fe700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 0x7f1cc811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1cc6ffd700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b790 tx=0x7f1cbc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc00f6f0 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cbc00fd20 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc81143d0 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc0103a0 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.761+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc8114910 con 0x7f1cc8109db0 2024-04-27T07:29:34.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.762+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cc8114e40 con 0x7f1cc8109db0 2024-04-27T07:29:34.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1cbc00f850 con 0x7f1cc8109db0 2024-04-27T07:29:34.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 0x7f1cb006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1cbc086c10 con 0x7f1cc8109db0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1cc77fe700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 0x7f1cb006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 0x7f1cb0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cb0071a30 con 0x7f1cb006ef70 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cbc08c070 con 0x7f1cc8109db0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.763+0000 7f1cc77fe700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 0x7f1cb006b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004f90 tx=0x7f1cb8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.764+0000 7f1cc7fff700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 0x7f1cb0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.764+0000 7f1cc7fff700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 0x7f1cb0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:34.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.765+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== osd.5 v2:172.21.15.100:6816/1350134728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1cb0071a30 con 0x7f1cb006ef70 2024-04-27T07:29:34.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.779+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 --> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1cc80754c0 con 0x7f1cb006ef70 2024-04-27T07:29:34.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.779+0000 7f1caffff700 1 -- 172.21.15.82:0/3677592002 <== osd.5 v2:172.21.15.100:6816/1350134728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1cc80754c0 con 0x7f1cb006ef70 2024-04-27T07:29:34.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 msgr2=0x7f1cb0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 0x7f1cb0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 msgr2=0x7f1cb006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 0x7f1cb006b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8004f90 tx=0x7f1cb8009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 msgr2=0x7f1cc811a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b790 tx=0x7f1cbc009220 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 shutdown_connections 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:6816/1350134728,v1:172.21.15.100:6817/1350134728] conn(0x7f1cb006ef70 0x7f1cb0071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cb00692a0 0x7f1cb006b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cc8109410 0x7f1cc811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 --2- 172.21.15.82:0/3677592002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cc8109db0 0x7f1cc811a730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 >> 172.21.15.82:0/3677592002 conn(0x7f1cc8072c20 msgr2=0x7f1cc8074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 shutdown_connections 2024-04-27T07:29:34.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:34.780+0000 7f1ccdc42700 1 -- 172.21.15.82:0/3677592002 wait complete. 2024-04-27T07:29:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:35 smithi100 ceph-mon[34183]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:36.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:35 smithi082 ceph-mon[26613]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:38.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:37 smithi082 ceph-mon[26613]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:38.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:37 smithi100 ceph-mon[34183]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.339+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/3254671379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18103780 msgr2=0x7f0a180fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.339+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/3254671379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18103780 0x7f0a180fcdf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004940 tx=0x7f0a08009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/3254671379 shutdown_connections 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/3254671379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18103780 0x7f0a180fcdf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/3254671379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18102de0 0x7f0a181031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/3254671379 >> 172.21.15.82:0/3254671379 conn(0x7f0a180f8990 msgr2=0x7f0a180fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/3254671379 shutdown_connections 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/3254671379 wait complete. 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 Processor -- start 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- start start 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18103780 0x7f0a18113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181144e0 con 0x7f0a18102de0 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1f7eb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1810dae0 con 0x7f0a18103780 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1d587700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1d587700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47954/0 (socket says 172.21.15.82:47954) 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1d587700 1 -- 172.21.15.82:0/4082332571 learned_addr learned my addr 172.21.15.82:0/4082332571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.340+0000 7f0a1cd86700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18103780 0x7f0a18113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1d587700 1 -- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18103780 msgr2=0x7f0a18113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1d587700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18103780 0x7f0a18113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1d587700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08005040 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1d587700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a14002a50 tx=0x7f0a140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a14007cc0 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1810ddc0 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a1400f040 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a1400da30 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.341+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1810e350 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.342+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a1810e800 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.342+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0a1400db90 con 0x7f0a18102de0 2024-04-27T07:29:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a0dffb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 0x7f0a0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0a14086c10 con 0x7f0a18102de0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a1cd86700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 0x7f0a0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a0dffb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 0x7f0a04071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a04071a30 con 0x7f0a0406ef70 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a1408c070 con 0x7f0a18102de0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a1cd86700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 0x7f0a0406b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004890 tx=0x7f0a08009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.343+0000 7f0a1dd88700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 0x7f0a04071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.344+0000 7f0a1dd88700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 0x7f0a04071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.344+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== osd.4 v2:172.21.15.100:6808/371286847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0a04071a30 con 0x7f0a0406ef70 2024-04-27T07:29:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.359+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 --> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a180fa360 con 0x7f0a0406ef70 2024-04-27T07:29:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a0dffb700 1 -- 172.21.15.82:0/4082332571 <== osd.4 v2:172.21.15.100:6808/371286847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a180fa360 con 0x7f0a0406ef70 2024-04-27T07:29:38.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 msgr2=0x7f0a04071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:38.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 0x7f0a04071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 msgr2=0x7f0a0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 0x7f0a0406b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004890 tx=0x7f0a08009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 msgr2=0x7f0a18113950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a14002a50 tx=0x7f0a140046b0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 shutdown_connections 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0a040692a0 0x7f0a0406b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a18102de0 0x7f0a18113950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:6808/371286847,v1:172.21.15.100:6809/371286847] conn(0x7f0a0406ef70 0x7f0a04071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 --2- 172.21.15.82:0/4082332571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a18103780 0x7f0a18113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 >> 172.21.15.82:0/4082332571 conn(0x7f0a180f8990 msgr2=0x7f0a180f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 shutdown_connections 2024-04-27T07:29:38.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:38.360+0000 7f0a1f7eb700 1 -- 172.21.15.82:0/4082332571 wait complete. 2024-04-27T07:29:39.024 INFO:teuthology.orchestra.run.smithi082.stdout:171798691848 2024-04-27T07:29:39.025 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-27T07:29:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:39.207 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:39.788 INFO:teuthology.orchestra.run.smithi082.stdout:150323855372 2024-04-27T07:29:39.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-27T07:29:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:39 smithi082 ceph-mon[26613]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:39 smithi100 ceph-mon[34183]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 -- 172.21.15.82:0/760508955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc101e20 msgr2=0x7f93bc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 --2- 172.21.15.82:0/760508955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc101e20 0x7f93bc1021f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93b4004940 tx=0x7f93b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 -- 172.21.15.82:0/760508955 shutdown_connections 2024-04-27T07:29:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 --2- 172.21.15.82:0/760508955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc0fc710 0x7f93bc0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 --2- 172.21.15.82:0/760508955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc101e20 0x7f93bc1021f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 -- 172.21.15.82:0/760508955 >> 172.21.15.82:0/760508955 conn(0x7f93bc071460 msgr2=0x7f93bc071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 -- 172.21.15.82:0/760508955 shutdown_connections 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.294+0000 7f93c1984700 1 -- 172.21.15.82:0/760508955 wait complete. 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 Processor -- start 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 -- start start 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 0x7f93bc112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1135d0 con 0x7f93bc0fc710 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93c1984700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc10c9c0 con 0x7f93bc101e20 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47976/0 (socket says 172.21.15.82:47976) 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 -- 172.21.15.82:0/851495563 learned_addr learned my addr 172.21.15.82:0/851495563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93ba7fc700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 0x7f93bc112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 -- 172.21.15.82:0/851495563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 msgr2=0x7f93bc112f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 0x7f93bc112f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4005040 con 0x7f93bc0fc710 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93ba7fc700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 0x7f93bc112f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.295+0000 7f93baffd700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93b400b3b0 tx=0x7f93b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.296+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b400e040 con 0x7f93bc0fc710 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.296+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc10cc40 con 0x7f93bc0fc710 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.296+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93b400bbc0 con 0x7f93bc0fc710 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.296+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b401c3f0 con 0x7f93bc0fc710 2024-04-27T07:29:41.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.296+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc10d200 con 0x7f93bc0fc710 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.297+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93bc10d7e0 con 0x7f93bc0fc710 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.297+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f93b400bd30 con 0x7f93bc0fc710 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.297+0000 7f93a37fe700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 0x7f93a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93ba7fc700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 0x7f93a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f93b4088bc0 con 0x7f93bc0fc710 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93a37fe700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 0x7f93a4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93a4071a30 con 0x7f93a406ef70 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93b4088fa0 con 0x7f93bc0fc710 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93bb7fe700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 0x7f93a4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:41.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93ba7fc700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 0x7f93a406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93bc10db80 tx=0x7f93b000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.298+0000 7f93bb7fe700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 0x7f93a4071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.299+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== osd.2 v2:172.21.15.82:6818/3740754295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f93a4071a30 con 0x7f93a406ef70 2024-04-27T07:29:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 --> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93bc05e660 con 0x7f93a406ef70 2024-04-27T07:29:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93a37fe700 1 -- 172.21.15.82:0/851495563 <== osd.2 v2:172.21.15.82:6818/3740754295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93bc05e660 con 0x7f93a406ef70 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 msgr2=0x7f93a4071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 0x7f93a4071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 msgr2=0x7f93a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 0x7f93a406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93bc10db80 tx=0x7f93b000b040 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 msgr2=0x7f93bc112a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93b400b3b0 tx=0x7f93b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 shutdown_connections 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6818/3740754295,v1:172.21.15.82:6819/3740754295] conn(0x7f93a406ef70 0x7f93a4071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f93a40692a0 0x7f93a406b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93bc0fc710 0x7f93bc112a40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 --2- 172.21.15.82:0/851495563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93bc101e20 0x7f93bc112f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 >> 172.21.15.82:0/851495563 conn(0x7f93bc071460 msgr2=0x7f93bc0f97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 shutdown_connections 2024-04-27T07:29:41.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:41.314+0000 7f93c1984700 1 -- 172.21.15.82:0/851495563 wait complete. 2024-04-27T07:29:42.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- 172.21.15.82:0/2470722378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 msgr2=0x7f352c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 --2- 172.21.15.82:0/2470722378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c0fc1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3518004940 tx=0x7f3518009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- 172.21.15.82:0/2470722378 shutdown_connections 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 --2- 172.21.15.82:0/2470722378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c0fc1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 --2- 172.21.15.82:0/2470722378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 0x7f352c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- 172.21.15.82:0/2470722378 >> 172.21.15.82:0/2470722378 conn(0x7f352c071d00 msgr2=0x7f352c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- 172.21.15.82:0/2470722378 shutdown_connections 2024-04-27T07:29:42.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- 172.21.15.82:0/2470722378 wait complete. 2024-04-27T07:29:42.105 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:41 smithi082 ceph-mon[26613]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:42.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 Processor -- start 2024-04-27T07:29:42.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.102+0000 7f3533205700 1 -- start start 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3533205700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3533205700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 0x7f352c1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3533205700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c1147b0 con 0x7f352c0fbd40 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3533205700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c10db10 con 0x7f352c101d90 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3530fa1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3530fa1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47988/0 (socket says 172.21.15.82:47988) 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3530fa1700 1 -- 172.21.15.82:0/303189453 learned_addr learned my addr 172.21.15.82:0/303189453 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f352bfff700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 0x7f352c1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3530fa1700 1 -- 172.21.15.82:0/303189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 msgr2=0x7f352c1140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.103+0000 7f3530fa1700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 0x7f352c1140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f3530fa1700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518005040 con 0x7f352c0fbd40 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f3530fa1700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f352000b790 tx=0x7f3520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352000f6f0 con 0x7f352c0fbd40 2024-04-27T07:29:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c10ddf0 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f352000fd20 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35200103a0 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.104+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c10e3b0 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.105+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f352c10e980 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.105+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3520010500 con 0x7f352c0fbd40 2024-04-27T07:29:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35297fa700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 0x7f351c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3520086ba0 con 0x7f352c0fbd40 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f352bfff700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 0x7f351c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35297fa700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 0x7f351c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f351c071a40 con 0x7f351c06ef80 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3520089210 con 0x7f352c0fbd40 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f352bfff700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 0x7f351c06b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f352c10ecd0 tx=0x7f3518009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.106+0000 7f35317a2700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 0x7f351c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.107+0000 7f35317a2700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 0x7f351c071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.107+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== osd.1 v2:172.21.15.82:6810/3469545083 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f351c071a40 con 0x7f351c06ef80 2024-04-27T07:29:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.130+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 --> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f352c0faae0 con 0x7f351c06ef80 2024-04-27T07:29:42.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.130+0000 7f35297fa700 1 -- 172.21.15.82:0/303189453 <== osd.1 v2:172.21.15.82:6810/3469545083 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f352c0faae0 con 0x7f351c06ef80 2024-04-27T07:29:42.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 msgr2=0x7f351c071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 0x7f351c071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 msgr2=0x7f351c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 0x7f351c06b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f352c10ecd0 tx=0x7f3518009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 msgr2=0x7f352c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f352000b790 tx=0x7f3520009250 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 shutdown_connections 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6810/3469545083,v1:172.21.15.82:6811/3469545083] conn(0x7f351c06ef80 0x7f351c071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f351c0692b0 0x7f351c06b760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f352c0fbd40 0x7f352c113b90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 --2- 172.21.15.82:0/303189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f352c101d90 0x7f352c1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 >> 172.21.15.82:0/303189453 conn(0x7f352c071d00 msgr2=0x7f352c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 shutdown_connections 2024-04-27T07:29:42.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.131+0000 7f3533205700 1 -- 172.21.15.82:0/303189453 wait complete. 2024-04-27T07:29:42.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- 172.21.15.82:0/4068591579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c102680 msgr2=0x7fbb9c0fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 --2- 172.21.15.82:0/4068591579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c102680 0x7fbb9c0fbcf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb90004940 tx=0x7fbb90009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- 172.21.15.82:0/4068591579 shutdown_connections 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 --2- 172.21.15.82:0/4068591579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c102680 0x7fbb9c0fbcf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 --2- 172.21.15.82:0/4068591579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- 172.21.15.82:0/4068591579 >> 172.21.15.82:0/4068591579 conn(0x7fbb9c0f7870 msgr2=0x7fbb9c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- 172.21.15.82:0/4068591579 shutdown_connections 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- 172.21.15.82:0/4068591579 wait complete. 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 Processor -- start 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.305+0000 7fbba41c4700 1 -- start start 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c102680 0x7fbb9c112d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c113370 con 0x7fbb9c101ce0 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10c970 con 0x7fbb9c102680 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48012/0 (socket says 172.21.15.82:48012) 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 -- 172.21.15.82:0/2811138984 learned_addr learned my addr 172.21.15.82:0/2811138984 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba175f700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c102680 0x7fbb9c112d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 -- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c102680 msgr2=0x7fbb9c112d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c102680 0x7fbb9c112d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90005040 con 0x7fbb9c101ce0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba1f60700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800eb40 tx=0x7fbb9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb98007cc0 con 0x7fbb9c101ce0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb9800f040 con 0x7fbb9c101ce0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c10cbf0 con 0x7fbb9c101ce0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9800ca10 con 0x7fbb9c101ce0 2024-04-27T07:29:42.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.306+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c10d100 con 0x7fbb9c101ce0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.307+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb9c10d5b0 con 0x7fbb9c101ce0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbb9800cc80 con 0x7fbb9c101ce0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 0x7fbb8806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbb98086c60 con 0x7fbb9c101ce0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbba175f700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 0x7fbb8806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 0x7fbb88071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb88071a30 con 0x7fbb8806ef70 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.308+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb98087040 con 0x7fbb9c101ce0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.309+0000 7fbba2761700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 0x7fbb88071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.309+0000 7fbba175f700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 0x7fbb8806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb90004890 tx=0x7fbb90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.309+0000 7fbba2761700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 0x7fbb88071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.310+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== osd.3 v2:172.21.15.100:6800/4124992664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbb88071a30 con 0x7fbb8806ef70 2024-04-27T07:29:42.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.325+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 --> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb9c0f9220 con 0x7fbb8806ef70 2024-04-27T07:29:42.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbb8e7fc700 1 -- 172.21.15.82:0/2811138984 <== osd.3 v2:172.21.15.100:6800/4124992664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbb9c0f9220 con 0x7fbb8806ef70 2024-04-27T07:29:42.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 msgr2=0x7fbb88071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 0x7fbb88071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 msgr2=0x7fbb8806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 0x7fbb8806b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb90004890 tx=0x7fbb90009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 msgr2=0x7fbb9c1127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800eb40 tx=0x7fbb9800b040 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 shutdown_connections 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:6800/4124992664,v1:172.21.15.100:6801/4124992664] conn(0x7fbb8806ef70 0x7fbb88071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbb880692a0 0x7fbb8806b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c101ce0 0x7fbb9c1127e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 --2- 172.21.15.82:0/2811138984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb9c102680 0x7fbb9c112d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 >> 172.21.15.82:0/2811138984 conn(0x7fbb9c0f7870 msgr2=0x7fbb9c0f8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 shutdown_connections 2024-04-27T07:29:42.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:42.326+0000 7fbba41c4700 1 -- 172.21.15.82:0/2811138984 wait complete. 2024-04-27T07:29:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:41 smithi100 ceph-mon[34183]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:81604378648 2024-04-27T07:29:43.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-27T07:29:44.061 INFO:teuthology.orchestra.run.smithi082.stdout:60129542174 2024-04-27T07:29:44.062 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-27T07:29:44.101 INFO:teuthology.orchestra.run.smithi082.stdout:115964117010 2024-04-27T07:29:44.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-27T07:29:44.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:43 smithi082 ceph-mon[26613]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:44.366 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:44.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:43 smithi100 ceph-mon[34183]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:44.563 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:44.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.566+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2900431794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c0fbd40 msgr2=0x7f3d3c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:44.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.566+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2900431794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c0fc1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3d30004940 tx=0x7f3d30009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:44.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2900431794 shutdown_connections 2024-04-27T07:29:44.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2900431794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c0fc1b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2900431794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c101d90 0x7f3d3c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2900431794 >> 172.21.15.82:0/2900431794 conn(0x7f3d3c071d00 msgr2=0x7f3d3c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:44.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2900431794 shutdown_connections 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.567+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2900431794 wait complete. 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 Processor -- start 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 -- start start 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c1113d0 con 0x7f3d3c101d90 2024-04-27T07:29:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d40b5c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c116620 con 0x7f3d3c0fbd40 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d39d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d39d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48030/0 (socket says 172.21.15.82:48030) 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d39d9b700 1 -- 172.21.15.82:0/2137172432 learned_addr learned my addr 172.21.15.82:0/2137172432 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.568+0000 7f3d3a59c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d39d9b700 1 -- 172.21.15.82:0/2137172432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c0fbd40 msgr2=0x7f3d3c110840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d39d9b700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c110840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d39d9b700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30005040 con 0x7f3d3c101d90 2024-04-27T07:29:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d39d9b700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b3b0 tx=0x7f3d30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3000e040 con 0x7f3d3c101d90 2024-04-27T07:29:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d30013420 con 0x7f3d3c101d90 2024-04-27T07:29:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3001c630 con 0x7f3d3c101d90 2024-04-27T07:29:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3c1168a0 con 0x7f3d3c101d90 2024-04-27T07:29:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.569+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c10bb80 con 0x7f3d3c101d90 2024-04-27T07:29:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.570+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d3c066030 con 0x7f3d3c101d90 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.571+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3d30013590 con 0x7f3d3c101d90 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d2affd700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 0x7f3d2406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d30087fb0 con 0x7f3d3c101d90 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d2affd700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 0x7f3d24071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d24071a30 con 0x7f3d2406ef70 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d3008a560 con 0x7f3d3c101d90 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d3a59c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 0x7f3d2406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.572+0000 7f3d3ad9d700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 0x7f3d24071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.573+0000 7f3d3a59c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 0x7f3d2406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009fd0 tx=0x7f3d2c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.573+0000 7f3d3ad9d700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 0x7f3d24071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:44.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.574+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== osd.0 v2:172.21.15.82:6802/2738777068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3d24071a30 con 0x7f3d2406ef70 2024-04-27T07:29:44.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.592+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 --> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d3c0fd430 con 0x7f3d2406ef70 2024-04-27T07:29:44.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.592+0000 7f3d2affd700 1 -- 172.21.15.82:0/2137172432 <== osd.0 v2:172.21.15.82:6802/2738777068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d3c0fd430 con 0x7f3d2406ef70 2024-04-27T07:29:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.592+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 msgr2=0x7f3d24071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.592+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 0x7f3d24071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 msgr2=0x7f3d2406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 0x7f3d2406b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009fd0 tx=0x7f3d2c00b040 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 msgr2=0x7f3d3c110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b3b0 tx=0x7f3d30009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 shutdown_connections 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6802/2738777068,v1:172.21.15.82:6803/2738777068] conn(0x7f3d2406ef70 0x7f3d24071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3d240692a0 0x7f3d2406b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3c0fbd40 0x7f3d3c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 --2- 172.21.15.82:0/2137172432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d3c101d90 0x7f3d3c110d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 >> 172.21.15.82:0/2137172432 conn(0x7f3d3c071d00 msgr2=0x7f3d3c065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 shutdown_connections 2024-04-27T07:29:44.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:44.593+0000 7f3d40b5c700 1 -- 172.21.15.82:0/2137172432 wait complete. 2024-04-27T07:29:45.771 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:46.219 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:45 smithi100 ceph-mon[34183]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:46.243 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:45 smithi082 ceph-mon[26613]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:46.659 INFO:teuthology.orchestra.run.smithi082.stdout:38654705700 2024-04-27T07:29:46.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-27T07:29:47.481 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:47.481 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:47 smithi082 ceph-mon[26613]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:47 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2873280579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-27T07:29:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:47 smithi100 ceph-mon[34183]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:47 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2873280579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 -- 172.21.15.82:0/2217224807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4065640 msgr2=0x7f33a4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 --2- 172.21.15.82:0/2217224807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4065640 0x7f33a4065ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f338c004940 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 -- 172.21.15.82:0/2217224807 shutdown_connections 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 --2- 172.21.15.82:0/2217224807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4065640 0x7f33a4065ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 --2- 172.21.15.82:0/2217224807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4102e50 0x7f33a4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 -- 172.21.15.82:0/2217224807 >> 172.21.15.82:0/2217224807 conn(0x7f33a4071d00 msgr2=0x7f33a4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:49.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 -- 172.21.15.82:0/2217224807 shutdown_connections 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.681+0000 7f33a950b700 1 -- 172.21.15.82:0/2217224807 wait complete. 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 Processor -- start 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 -- start start 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4065640 0x7f33a4113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4114700 con 0x7f33a4102e50 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a950b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a410daf0 con 0x7f33a4065640 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35550/0 (socket says 172.21.15.82:35550) 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 -- 172.21.15.82:0/2873280579 learned_addr learned my addr 172.21.15.82:0/2873280579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a2ffd700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4065640 0x7f33a4113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 -- 172.21.15.82:0/2873280579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4065640 msgr2=0x7f33a4113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4065640 0x7f33a4113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 -- 172.21.15.82:0/2873280579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c005040 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.682+0000 7f33a27fc700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.683+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c00e040 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.683+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f338c013420 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.683+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a410dd70 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.683+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c01c630 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.683+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a410e330 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.684+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a4100100 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.684+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f338c013590 con 0x7f33a4102e50 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.684+0000 7f339b7fe700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 0x7f339006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:49.010 INFO:teuthology.orchestra.run.smithi082.stdout:150323855374 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.684+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f338c088040 con 0x7f33a4102e50 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.685+0000 7f33a2ffd700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 0x7f339006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.685+0000 7f33a2ffd700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 0x7f339006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f339c007a40 tx=0x7f339c009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.689+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f338c058140 con 0x7f33a4102e50 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.879+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f33a410f1c0 con 0x7f33a4102e50 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.880+0000 7f339b7fe700 1 -- 172.21.15.82:0/2873280579 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f338c057cd0 con 0x7f33a4102e50 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 msgr2=0x7f339006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 0x7f339006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f339c007a40 tx=0x7f339c009da0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 msgr2=0x7f33a41140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b3b0 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:49.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 shutdown_connections 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f33900692a0 0x7f339006b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33a4065640 0x7f33a4113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 --2- 172.21.15.82:0/2873280579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33a4102e50 0x7f33a41140b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 >> 172.21.15.82:0/2873280579 conn(0x7f33a4071d00 msgr2=0x7f33a40fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 shutdown_connections 2024-04-27T07:29:49.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:47.882+0000 7f33a950b700 1 -- 172.21.15.82:0/2873280579 wait complete. 2024-04-27T07:29:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:49 smithi100 ceph-mon[34183]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:50.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:49 smithi082 ceph-mon[26613]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:50.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 -- 172.21.15.82:0/3844286757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30103780 msgr2=0x7f0c300fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 --2- 172.21.15.82:0/3844286757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30103780 0x7f0c300fcdf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004940 tx=0x7f0c1c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 -- 172.21.15.82:0/3844286757 shutdown_connections 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 --2- 172.21.15.82:0/3844286757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30103780 0x7f0c300fcdf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 --2- 172.21.15.82:0/3844286757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30102de0 0x7f0c301031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 -- 172.21.15.82:0/3844286757 >> 172.21.15.82:0/3844286757 conn(0x7f0c300f8990 msgr2=0x7f0c300fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 -- 172.21.15.82:0/3844286757 shutdown_connections 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.844+0000 7f0c36e59700 1 -- 172.21.15.82:0/3844286757 wait complete. 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 Processor -- start 2024-04-27T07:29:50.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 -- start start 2024-04-27T07:29:50.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:50.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30103780 0x7f0c30113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c30114590 con 0x7f0c30102de0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c36e59700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3010db20 con 0x7f0c30103780 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c34bf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c34bf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35570/0 (socket says 172.21.15.82:35570) 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c34bf5700 1 -- 172.21.15.82:0/2911061254 learned_addr learned my addr 172.21.15.82:0/2911061254 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.845+0000 7f0c2ffff700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30103780 0x7f0c30113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c34bf5700 1 -- 172.21.15.82:0/2911061254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30103780 msgr2=0x7f0c30113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c34bf5700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30103780 0x7f0c30113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c34bf5700 1 -- 172.21.15.82:0/2911061254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c005040 con 0x7f0c30102de0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c34bf5700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400b790 tx=0x7f0c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c2400f6f0 con 0x7f0c30102de0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3010de00 con 0x7f0c30102de0 2024-04-27T07:29:50.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c2400fd20 con 0x7f0c30102de0 2024-04-27T07:29:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c240103a0 con 0x7f0c30102de0 2024-04-27T07:29:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.846+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3010e390 con 0x7f0c30102de0 2024-04-27T07:29:50.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.847+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c301000f0 con 0x7f0c30102de0 2024-04-27T07:29:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.847+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0c2400f850 con 0x7f0c30102de0 2024-04-27T07:29:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.848+0000 7f0c2d7fa700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 0x7f0c2006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.848+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c24086c40 con 0x7f0c30102de0 2024-04-27T07:29:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.848+0000 7f0c2ffff700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 0x7f0c2006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:50.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.848+0000 7f0c2ffff700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 0x7f0c2006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004890 tx=0x7f0c1c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:50.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:50.852+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0c240532b0 con 0x7f0c30102de0 2024-04-27T07:29:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.045+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0c30109f30 con 0x7f0c30102de0 2024-04-27T07:29:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.046+0000 7f0c2d7fa700 1 -- 172.21.15.82:0/2911061254 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c240568d0 con 0x7f0c30102de0 2024-04-27T07:29:51.048 INFO:teuthology.orchestra.run.smithi082.stdout:171798691851 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 msgr2=0x7f0c2006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 0x7f0c2006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c004890 tx=0x7f0c1c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 msgr2=0x7f0c30113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400b790 tx=0x7f0c24009250 comp rx=0 tx=0).stop 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 shutdown_connections 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0c200692a0 0x7f0c2006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c30102de0 0x7f0c30113970 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 --2- 172.21.15.82:0/2911061254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c30103780 0x7f0c30113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 >> 172.21.15.82:0/2911061254 conn(0x7f0c300f8990 msgr2=0x7f0c300fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 shutdown_connections 2024-04-27T07:29:51.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:51.048+0000 7f0c36e59700 1 -- 172.21.15.82:0/2911061254 wait complete. 2024-04-27T07:29:51.288 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855372 got 150323855374 for osd.4 2024-04-27T07:29:51.289 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:52.279 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:51 smithi082 ceph-mon[26613]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:52.279 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:51 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2911061254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-27T07:29:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:51 smithi100 ceph-mon[34183]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:51 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2911061254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-27T07:29:53.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691848 got 171798691851 for osd.5 2024-04-27T07:29:53.101 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.022+0000 7f011c919700 1 -- 172.21.15.82:0/3121665827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fde10 msgr2=0x7f01180fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.022+0000 7f011c919700 1 --2- 172.21.15.82:0/3121665827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fde10 0x7f01180fe1e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0108004970 tx=0x7f0108009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- 172.21.15.82:0/3121665827 shutdown_connections 2024-04-27T07:29:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 --2- 172.21.15.82:0/3121665827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fe7b0 0x7f0118106e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 --2- 172.21.15.82:0/3121665827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fde10 0x7f01180fe1e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- 172.21.15.82:0/3121665827 >> 172.21.15.82:0/3121665827 conn(0x7f01180f7810 msgr2=0x7f01180f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- 172.21.15.82:0/3121665827 shutdown_connections 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- 172.21.15.82:0/3121665827 wait complete. 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 Processor -- start 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- start start 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fde10 0x7f01180fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180fdc20 con 0x7f01180fe7b0 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.023+0000 7f011c919700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180fc750 con 0x7f01180fde10 2024-04-27T07:29:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35602/0 (socket says 172.21.15.82:35602) 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 -- 172.21.15.82:0/4189133460 learned_addr learned my addr 172.21.15.82:0/4189133460 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f011659c700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fde10 0x7f01180fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 -- 172.21.15.82:0/4189133460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fde10 msgr2=0x7f01180fbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fde10 0x7f01180fbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 -- 172.21.15.82:0/4189133460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108005040 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0115d9b700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c8c0 tx=0x7f010c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f010c00a980 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f010c00ce60 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f010c0115e0 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180fca30 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.024+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011811a0f0 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.025+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118066a30 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.026+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f010c012400 con 0x7f01180fe7b0 2024-04-27T07:29:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.026+0000 7f0106ffd700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 0x7f010006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.026+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f010c086e60 con 0x7f01180fe7b0 2024-04-27T07:29:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.026+0000 7f011659c700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 0x7f010006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.026+0000 7f011659c700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 0x7f010006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0108004f50 tx=0x7f0108009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.030+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f010c053570 con 0x7f01180fe7b0 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- 172.21.15.82:0/276871815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 msgr2=0x7f76241031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 --2- 172.21.15.82:0/276871815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f76241031b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7620004940 tx=0x7f7620009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- 172.21.15.82:0/276871815 shutdown_connections 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 --2- 172.21.15.82:0/276871815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 0x7f76240fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 --2- 172.21.15.82:0/276871815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f76241031b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- 172.21.15.82:0/276871815 >> 172.21.15.82:0/276871815 conn(0x7f76240f8950 msgr2=0x7f76240fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- 172.21.15.82:0/276871815 shutdown_connections 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- 172.21.15.82:0/276871815 wait complete. 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 Processor -- start 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- start start 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 0x7f76240707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624070d30 con 0x7f7624102de0 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.957+0000 7f762c6a8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624070e70 con 0x7f7624103780 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35580/0 (socket says 172.21.15.82:35580) 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 -- 172.21.15.82:0/1429586721 learned_addr learned my addr 172.21.15.82:0/1429586721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f7629c43700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 0x7f76240707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 -- 172.21.15.82:0/1429586721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 msgr2=0x7f76240707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 0x7f76240707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 -- 172.21.15.82:0/1429586721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620005040 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762a444700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f762000b3b0 tx=0x7f7620009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762000e040 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7620013420 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76240710c0 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f762001c630 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.958+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762411a2e0 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.959+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76241000f0 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.960+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7620013590 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.960+0000 7f761affd700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.960+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7620088020 con 0x7f7624102de0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.960+0000 7f7629c43700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.960+0000 7f7629c43700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 0x7f761006b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7624071ba0 tx=0x7f761400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:54.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:53.964+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7620054690 con 0x7f7624102de0 2024-04-27T07:29:54.136 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:53 smithi082 ceph-mon[26613]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:54.136 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:54.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.165+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f76240fe530 con 0x7f7624102de0 2024-04-27T07:29:54.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.165+0000 7f761affd700 1 -- 172.21.15.82:0/1429586721 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7620057cb0 con 0x7f7624102de0 2024-04-27T07:29:54.168 INFO:teuthology.orchestra.run.smithi082.stdout:38654705702 2024-04-27T07:29:54.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 msgr2=0x7f761006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 0x7f761006b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7624071ba0 tx=0x7f761400b040 comp rx=0 tx=0).stop 2024-04-27T07:29:54.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 msgr2=0x7f7624070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f762000b3b0 tx=0x7f7620009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 shutdown_connections 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76100692a0 0x7f761006b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7624102de0 0x7f7624070260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 --2- 172.21.15.82:0/1429586721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7624103780 0x7f76240707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 >> 172.21.15.82:0/1429586721 conn(0x7f76240f8950 msgr2=0x7f76241073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 shutdown_connections 2024-04-27T07:29:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.167+0000 7f762c6a8700 1 -- 172.21.15.82:0/1429586721 wait complete. 2024-04-27T07:29:54.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.235+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f011804c710 con 0x7f01180fe7b0 2024-04-27T07:29:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.235+0000 7f0106ffd700 1 -- 172.21.15.82:0/4189133460 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f010c0126b0 con 0x7f01180fe7b0 2024-04-27T07:29:54.238 INFO:teuthology.orchestra.run.smithi082.stdout:115964117012 2024-04-27T07:29:54.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 msgr2=0x7f010006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 0x7f010006b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0108004f50 tx=0x7f0108009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 msgr2=0x7f01180fc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c8c0 tx=0x7f010c0044c0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 shutdown_connections 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f01000692a0 0x7f010006b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01180fde10 0x7f01180fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 --2- 172.21.15.82:0/4189133460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01180fe7b0 0x7f01180fc210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.237+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 >> 172.21.15.82:0/4189133460 conn(0x7f01180f7810 msgr2=0x7f01180ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.238+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 shutdown_connections 2024-04-27T07:29:54.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:54.238+0000 7f011c919700 1 -- 172.21.15.82:0/4189133460 wait complete. 2024-04-27T07:29:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:53 smithi100 ceph-mon[34183]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:29:55.260 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:54 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1429586721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-27T07:29:55.260 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:54 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4189133460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-27T07:29:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:54 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1429586721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-27T07:29:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:54 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/4189133460' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-27T07:29:55.610 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-04-27T07:29:55.610 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- 172.21.15.82:0/2800061995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 msgr2=0x7f6ce00fbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/2800061995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce00fbcf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0004940 tx=0x7f6cd0009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- 172.21.15.82:0/2800061995 shutdown_connections 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/2800061995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce00fbcf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/2800061995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- 172.21.15.82:0/2800061995 >> 172.21.15.82:0/2800061995 conn(0x7f6ce00f7870 msgr2=0x7f6ce00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- 172.21.15.82:0/2800061995 shutdown_connections 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- 172.21.15.82:0/2800061995 wait complete. 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 Processor -- start 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- start start 2024-04-27T07:29:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce0112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce0112db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0113400 con 0x7f6ce0102680 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.800+0000 7f6ce84a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce010ca00 con 0x7f6ce0101ce0 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce6240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce0112870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce5a3f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce0112db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce6240700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce0112870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:32798/0 (socket says 172.21.15.82:32798) 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce6240700 1 -- 172.21.15.82:0/3454883005 learned_addr learned my addr 172.21.15.82:0/3454883005 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce5a3f700 1 -- 172.21.15.82:0/3454883005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 msgr2=0x7f6ce0112870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce5a3f700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce0112870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce5a3f700 1 -- 172.21.15.82:0/3454883005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0005040 con 0x7f6ce0102680 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce5a3f700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce0112db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd000e040 con 0x7f6ce0102680 2024-04-27T07:29:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cd0013420 con 0x7f6ce0102680 2024-04-27T07:29:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce010cc80 con 0x7f6ce0102680 2024-04-27T07:29:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd001c630 con 0x7f6ce0102680 2024-04-27T07:29:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.801+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce010d210 con 0x7f6ce0102680 2024-04-27T07:29:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.802+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce00fd430 con 0x7f6ce0102680 2024-04-27T07:29:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.803+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6cd0013590 con 0x7f6ce0102680 2024-04-27T07:29:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.803+0000 7f6cd6ffd700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 0x7f6ccc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.803+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6cd0088080 con 0x7f6ce0102680 2024-04-27T07:29:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.803+0000 7f6ce6240700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 0x7f6ccc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.804+0000 7f6ce6240700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 0x7f6ccc06b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0041d0 tx=0x7f6cdc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:55.808+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6cd0058230 con 0x7f6ce0102680 2024-04-27T07:29:56.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.001+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ce0108dc0 con 0x7f6ce0102680 2024-04-27T07:29:56.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.001+0000 7f6cd6ffd700 1 -- 172.21.15.82:0/3454883005 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cd0013840 con 0x7f6ce0102680 2024-04-27T07:29:56.003 INFO:teuthology.orchestra.run.smithi082.stdout:81604378651 2024-04-27T07:29:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 msgr2=0x7f6ccc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 0x7f6ccc06b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0041d0 tx=0x7f6cdc00b040 comp rx=0 tx=0).stop 2024-04-27T07:29:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 msgr2=0x7f6ce0112db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce0112db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd0009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:56.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 shutdown_connections 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f6ccc0692a0 0x7f6ccc06b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ce0101ce0 0x7f6ce0112870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 --2- 172.21.15.82:0/3454883005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ce0102680 0x7f6ce0112db0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 >> 172.21.15.82:0/3454883005 conn(0x7f6ce00f7870 msgr2=0x7f6ce00f88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 shutdown_connections 2024-04-27T07:29:56.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:56.003+0000 7f6ce84a4700 1 -- 172.21.15.82:0/3454883005 wait complete. 2024-04-27T07:29:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:55 smithi082 ceph-mon[26613]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:55 smithi100 ceph-mon[34183]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:56.726 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117012 for osd.3 2024-04-27T07:29:56.726 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:57.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3454883005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-27T07:29:57.093 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-04-27T07:29:57.093 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:57.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:56 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3454883005' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 -- 172.21.15.82:0/4225007891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 msgr2=0x7f54300fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 --2- 172.21.15.82:0/4225007891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f54300fce00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f542c004940 tx=0x7f542c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 -- 172.21.15.82:0/4225007891 shutdown_connections 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 --2- 172.21.15.82:0/4225007891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f54300fce00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 --2- 172.21.15.82:0/4225007891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 0x7f54301031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 -- 172.21.15.82:0/4225007891 >> 172.21.15.82:0/4225007891 conn(0x7f54300f8980 msgr2=0x7f54300fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 -- 172.21.15.82:0/4225007891 shutdown_connections 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.319+0000 7f5437bdb700 1 -- 172.21.15.82:0/4225007891 wait complete. 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 Processor -- start 2024-04-27T07:29:57.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 -- start start 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 0x7f5430115e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5430116a40 con 0x7f5430103790 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5437bdb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543010fd80 con 0x7f5430102df0 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41482/0 (socket says 172.21.15.82:41482) 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 -- 172.21.15.82:0/3861559590 learned_addr learned my addr 172.21.15.82:0/3861559590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435977700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 0x7f5430115e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 -- 172.21.15.82:0/3861559590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 msgr2=0x7f5430115e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 0x7f5430115e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.320+0000 7f5435176700 1 -- 172.21.15.82:0/3861559590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c005040 con 0x7f5430103790 2024-04-27T07:29:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f5435176700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f542c009100 tx=0x7f542c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f542c00e040 con 0x7f5430103790 2024-04-27T07:29:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543010ffa0 con 0x7f5430103790 2024-04-27T07:29:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f542c009af0 con 0x7f5430103790 2024-04-27T07:29:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f542c01c3f0 con 0x7f5430103790 2024-04-27T07:29:57.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.321+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54301104e0 con 0x7f5430103790 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.322+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54301072f0 con 0x7f5430103790 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.322+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f542c00baf0 con 0x7f5430103790 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.323+0000 7f54227fc700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.323+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f542c0880e0 con 0x7f5430103790 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.323+0000 7f5435977700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:57.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.323+0000 7f5435977700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 0x7f541c06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5424009b60 tx=0x7f54240091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:57.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.327+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f542c0581e0 con 0x7f5430103790 2024-04-27T07:29:57.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.513+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54300fe540 con 0x7f5430103790 2024-04-27T07:29:57.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.514+0000 7f54227fc700 1 -- 172.21.15.82:0/3861559590 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f542c057d70 con 0x7f5430103790 2024-04-27T07:29:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:60129542177 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 msgr2=0x7f541c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 0x7f541c06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5424009b60 tx=0x7f54240091a0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 msgr2=0x7f5430116360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f542c009100 tx=0x7f542c009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 shutdown_connections 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f541c0692a0 0x7f541c06b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102df0 0x7f5430115e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 --2- 172.21.15.82:0/3861559590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5430103790 0x7f5430116360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 >> 172.21.15.82:0/3861559590 conn(0x7f54300f8980 msgr2=0x7f5430070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:57.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 shutdown_connections 2024-04-27T07:29:57.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:57.516+0000 7f5437bdb700 1 -- 172.21.15.82:0/3861559590 wait complete. 2024-04-27T07:29:58.065 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:57 smithi082 ceph-mon[26613]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:58.065 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:57 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3861559590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-27T07:29:58.089 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542177 for osd.1 2024-04-27T07:29:58.089 DEBUG:teuthology.parallel:result is None 2024-04-27T07:29:58.089 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-27T07:29:58.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-27T07:29:58.340 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:29:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:57 smithi100 ceph-mon[34183]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:29:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:57 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3861559590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/4263134149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc0101d00 msgr2=0x7f9fc01020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/4263134149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc0101d00 0x7f9fc01020d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4004940 tx=0x7f9fb4009e30 comp rx=0 tx=0).stop 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/4263134149 shutdown_connections 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/4263134149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc01026a0 0x7f9fc00fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/4263134149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc0101d00 0x7f9fc01020d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:59.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/4263134149 >> 172.21.15.82:0/4263134149 conn(0x7f9fc00f7870 msgr2=0x7f9fc00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:29:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/4263134149 shutdown_connections 2024-04-27T07:29:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.964+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/4263134149 wait complete. 2024-04-27T07:29:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.965+0000 7f9fc6a7e700 1 Processor -- start 2024-04-27T07:29:59.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.965+0000 7f9fc6a7e700 1 -- start start 2024-04-27T07:29:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.965+0000 7f9fc6a7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc0101d00 0x7f9fc0112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:59.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc6a7e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc6a7e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01134b0 con 0x7f9fc01026a0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc6a7e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc010ca20 con 0x7f9fc0101d00 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41498/0 (socket says 172.21.15.82:41498) 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 -- 172.21.15.82:0/270816243 learned_addr learned my addr 172.21.15.82:0/270816243 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc481a700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc0101d00 0x7f9fc0112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 -- 172.21.15.82:0/270816243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc0101d00 msgr2=0x7f9fc0112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc0101d00 0x7f9fc0112890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 -- 172.21.15.82:0/270816243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4005040 con 0x7f9fc01026a0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbffff700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00b790 tx=0x7f9fac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac00f6f0 con 0x7f9fc01026a0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fac00fd20 con 0x7f9fc01026a0 2024-04-27T07:29:59.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc010cd00 con 0x7f9fc01026a0 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fac0103a0 con 0x7f9fc01026a0 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.966+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc010d2c0 con 0x7f9fc01026a0 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.967+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc00fd450 con 0x7f9fc01026a0 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.968+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9fac011400 con 0x7f9fc01026a0 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.968+0000 7f9fbd7fa700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 0x7f9fb006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:29:59.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.968+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9fac086b20 con 0x7f9fc01026a0 2024-04-27T07:29:59.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.968+0000 7f9fc481a700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 0x7f9fb006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:29:59.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.968+0000 7f9fc481a700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 0x7f9fb006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4004f90 tx=0x7f9fb4009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:29:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:29:59.972+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9fac056cc0 con 0x7f9fc01026a0 2024-04-27T07:30:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:29:59 smithi082 ceph-mon[26613]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.163+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fc0108e70 con 0x7f9fb00692a0 2024-04-27T07:30:00.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.165+0000 7f9fbd7fa700 1 -- 172.21.15.82:0/270816243 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28171 (secure 0 0 0) 0x7f9fc0108e70 con 0x7f9fb00692a0 2024-04-27T07:30:00.167 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:29:59 smithi100 ceph-mon[34183]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 msgr2=0x7f9fb006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 0x7f9fb006b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4004f90 tx=0x7f9fb4009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 msgr2=0x7f9fc0112dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00b790 tx=0x7f9fac009220 comp rx=0 tx=0).stop 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 shutdown_connections 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9fb00692a0 0x7f9fb006b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fc0101d00 0x7f9fc0112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 --2- 172.21.15.82:0/270816243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc01026a0 0x7f9fc0112dd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:00.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 >> 172.21.15.82:0/270816243 conn(0x7f9fc00f7870 msgr2=0x7f9fc00f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 shutdown_connections 2024-04-27T07:30:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:00.167+0000 7f9fc6a7e700 1 -- 172.21.15.82:0/270816243 wait complete. 2024-04-27T07:30:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-27T07:30:00.870 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-27T07:29:58.424549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002396"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-27T07:29:11.266716+0000","last_change":"2024-04-27T07:28:45.994657+0000","last_active":"2024-04-27T07:29:11.266716+0000","last_peered":"2024-04-27T07:29:11.266716+0000","last_clean":"2024-04-27T07:29:11.266716+0000","last_became_active":"2024-04-27T07:28:45.994393+0000","last_became_peered":"2024-04-27T07:28:45.994393+0000","last_unstale":"2024-04-27T07:29:11.266716+0000","last_undegraded":"2024-04-27T07:29:11.266716+0000","last_fullsized":"2024-04-27T07:29:11.266716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T07:27:59.041769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T07:27:59.041769+0000","last_clean_scrub_stamp":"2024-04-27T07:27:59.041769+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:37:27.953560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":4,"up_from":35,"seq":150323855376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.505},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44600000000000001}]},{"osd":1,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.495}]},{"osd":2,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Apr 27 07:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Apr 27 07:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Apr 27 07:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Apr 27 07:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298312,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446840,"statfs":{"total":95995035648,"available":95689564160,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 27 07:29:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.312},{"interface":"front","average":{"1min":0.375,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Apr 27 07:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32700000000000001}]},{"osd":3,"last update":"Sat Apr 27 07:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.503}]},{"osd":4,"last update":"Sat Apr 27 07:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.443},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:33 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.246,"5min":0.221,"15min":0.221},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Apr 27 07:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26700000000000002}]},{"osd":3,"last update":"Sat Apr 27 07:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.505}]},{"osd":4,"last update":"Sat Apr 27 07:29:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T07:30:00.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-27T07:30:01.117 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:00 smithi082 ceph-mon[26613]: overall HEALTH_OK 2024-04-27T07:30:01.133 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:00 smithi100 ceph-mon[34183]: overall HEALTH_OK 2024-04-27T07:30:02.307 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:01 smithi082 ceph-mon[26613]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-27T07:30:02.307 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:01 smithi082 ceph-mon[26613]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:01 smithi100 ceph-mon[34183]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-27T07:30:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:01 smithi100 ceph-mon[34183]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 -- 172.21.15.82:0/464875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 msgr2=0x7f7a60102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 --2- 172.21.15.82:0/464875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a60102160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a50004940 tx=0x7f7a50009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 -- 172.21.15.82:0/464875 shutdown_connections 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 --2- 172.21.15.82:0/464875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 0x7f7a600fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 --2- 172.21.15.82:0/464875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a60102160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 -- 172.21.15.82:0/464875 >> 172.21.15.82:0/464875 conn(0x7f7a60071d00 msgr2=0x7f7a60072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 -- 172.21.15.82:0/464875 shutdown_connections 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 -- 172.21.15.82:0/464875 wait complete. 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.643+0000 7f7a66496700 1 Processor -- start 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 -- start start 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 0x7f7a6010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6010f6d0 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6010f810 con 0x7f7a600fbd40 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41520/0 (socket says 172.21.15.82:41520) 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 -- 172.21.15.82:0/3233371202 learned_addr learned my addr 172.21.15.82:0/3233371202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5ffff700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 0x7f7a6010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 -- 172.21.15.82:0/3233371202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 msgr2=0x7f7a6010eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 0x7f7a6010eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 -- 172.21.15.82:0/3233371202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50005040 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5f7fe700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a54002a50 tx=0x7f7a540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a54007cc0 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a5400f040 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a60117bb0 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a54009640 con 0x7f7a60101d90 2024-04-27T07:30:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.644+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a60118110 con 0x7f7a60101d90 2024-04-27T07:30:02.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.645+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600fd430 con 0x7f7a60101d90 2024-04-27T07:30:02.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.646+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7a540097a0 con 0x7f7a60101d90 2024-04-27T07:30:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.646+0000 7f7a5cff9700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 0x7f7a4806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.646+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7a54086c70 con 0x7f7a60101d90 2024-04-27T07:30:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.646+0000 7f7a5ffff700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 0x7f7a4806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:02.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.647+0000 7f7a5ffff700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 0x7f7a4806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000b3b0 tx=0x7f7a50009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.652+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7a54053260 con 0x7f7a60101d90 2024-04-27T07:30:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.834+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a6004bed0 con 0x7f7a480692a0 2024-04-27T07:30:03.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.836+0000 7f7a5cff9700 1 -- 172.21.15.82:0/3233371202 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28126 (secure 0 0 0) 0x7f7a6004bed0 con 0x7f7a480692a0 2024-04-27T07:30:03.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 msgr2=0x7f7a4806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 0x7f7a4806b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000b3b0 tx=0x7f7a50009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 msgr2=0x7f7a6010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a54002a50 tx=0x7f7a540046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 shutdown_connections 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a480692a0 0x7f7a4806b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a600fbd40 0x7f7a6010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 --2- 172.21.15.82:0/3233371202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a60101d90 0x7f7a6010f080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 >> 172.21.15.82:0/3233371202 conn(0x7f7a60071d00 msgr2=0x7f7a600fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:03.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 shutdown_connections 2024-04-27T07:30:03.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:02.838+0000 7f7a66496700 1 -- 172.21.15.82:0/3233371202 wait complete. 2024-04-27T07:30:03.394 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-04-27T07:30:03.643 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-27T07:30:02.425259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002150"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-27T07:29:11.266716+0000","last_change":"2024-04-27T07:28:45.994657+0000","last_active":"2024-04-27T07:29:11.266716+0000","last_peered":"2024-04-27T07:29:11.266716+0000","last_clean":"2024-04-27T07:29:11.266716+0000","last_became_active":"2024-04-27T07:28:45.994393+0000","last_became_peered":"2024-04-27T07:28:45.994393+0000","last_unstale":"2024-04-27T07:29:11.266716+0000","last_undegraded":"2024-04-27T07:29:11.266716+0000","last_fullsized":"2024-04-27T07:29:11.266716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-27T07:27:59.041769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-27T07:27:59.041769+0000","last_clean_scrub_stamp":"2024-04-27T07:27:59.041769+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T13:37:27.953560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.379}]},{"osd":1,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.438}]},{"osd":3,"last update":"Sat Apr 27 07:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.503},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Apr 27 07:29:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.433},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Apr 27 07:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Apr 27 07:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Apr 27 07:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Apr 27 07:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298312,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446840,"statfs":{"total":95995035648,"available":95689564160,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 27 07:29:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32200000000000001},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.245},{"interface":"front","average":{"1min":0.375,"5min":0.34200000000000003,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Apr 27 07:29:00 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Apr 27 07:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.34599999999999997}]},{"osd":4,"last update":"Sat Apr 27 07:29:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 27 07:29:33 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.246,"5min":0.221,"15min":0.221},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.35499999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.315}]},{"osd":2,"last update":"Sat Apr 27 07:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Apr 27 07:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.58199999999999996}]},{"osd":4,"last update":"Sat Apr 27 07:29:46 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.62},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-27T07:30:03.644 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-27T07:30:03.644 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-27T07:30:03.644 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-27T07:30:03.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-27T07:30:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:04.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:03 smithi082 ceph-mon[26613]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:04.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:03 smithi082 ceph-mon[26613]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-27T07:30:04.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:03 smithi100 ceph-mon[34183]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:04.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:03 smithi100 ceph-mon[34183]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 -- 172.21.15.82:0/705937210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00102dc0 msgr2=0x7f3f00103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 --2- 172.21.15.82:0/705937210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00102dc0 0x7f3f00103190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009ce0 tx=0x7f3ef8004d10 comp rx=0 tx=0).stop 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 -- 172.21.15.82:0/705937210 shutdown_connections 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 --2- 172.21.15.82:0/705937210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00103760 0x7f3f000fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 --2- 172.21.15.82:0/705937210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00102dc0 0x7f3f00103190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 -- 172.21.15.82:0/705937210 >> 172.21.15.82:0/705937210 conn(0x7f3f000f8930 msgr2=0x7f3f000fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 -- 172.21.15.82:0/705937210 shutdown_connections 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.532+0000 7f3f0738d700 1 -- 172.21.15.82:0/705937210 wait complete. 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 Processor -- start 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 -- start start 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 0x7f3f00070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000721b0 con 0x7f3f00103760 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f0738d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f00070ce0 con 0x7f3f00102dc0 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f04928700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f04928700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39762/0 (socket says 172.21.15.82:39762) 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f04928700 1 -- 172.21.15.82:0/978092068 learned_addr learned my addr 172.21.15.82:0/978092068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f05129700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 0x7f3f00070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f04928700 1 -- 172.21.15.82:0/978092068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 msgr2=0x7f3f00070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.533+0000 7f3f04928700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 0x7f3f00070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3f04928700 1 -- 172.21.15.82:0/978092068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8009940 con 0x7f3f00103760 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3f05129700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 0x7f3f00070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3f04928700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4002a50 tx=0x7f3ef4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef4007cc0 con 0x7f3f00103760 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ef400f040 con 0x7f3f00103760 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f00070fc0 con 0x7f3f00103760 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef400daf0 con 0x7f3f00103760 2024-04-27T07:30:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.534+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0011a270 con 0x7f3f00103760 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.535+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f000fe510 con 0x7f3f00103760 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.535+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3ef4009810 con 0x7f3f00103760 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.536+0000 7f3efdffb700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.536+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ef4086b10 con 0x7f3f00103760 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.536+0000 7f3f05129700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:05.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.536+0000 7f3f05129700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 0x7f3ee806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80048c0 tx=0x7f3ef8004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:05.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.540+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3ef4053180 con 0x7f3f00103760 2024-04-27T07:30:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.764+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f00071740 con 0x7f3f00103760 2024-04-27T07:30:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.765+0000 7f3efdffb700 1 -- 172.21.15.82:0/978092068 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3ef40567a0 con 0x7f3f00103760 2024-04-27T07:30:05.767 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:05.767 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.766+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 msgr2=0x7f3ee806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.766+0000 7f3f0738d700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 0x7f3ee806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80048c0 tx=0x7f3ef8004d10 comp rx=0 tx=0).stop 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 msgr2=0x7f3f000707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4002a50 tx=0x7f3ef4004600 comp rx=0 tx=0).stop 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 shutdown_connections 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f3ee80692a0 0x7f3ee806b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f00102dc0 0x7f3f00070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 --2- 172.21.15.82:0/978092068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f00103760 0x7f3f000707a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 >> 172.21.15.82:0/978092068 conn(0x7f3f000f8930 msgr2=0x7f3f000f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 shutdown_connections 2024-04-27T07:30:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:05.767+0000 7f3f0738d700 1 -- 172.21.15.82:0/978092068 wait complete. 2024-04-27T07:30:06.073 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:05 smithi082 ceph-mon[26613]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:06.073 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:05 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/978092068' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-27T07:30:06.409 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-27T07:30:06.409 INFO:tasks.cephadm:Setup complete, yielding 2024-04-27T07:30:06.410 INFO:teuthology.run_tasks:Running task print... 2024-04-27T07:30:06.418 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-27T07:30:06.419 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:06.456 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:06.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-27T07:30:06.456 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:05 smithi100 ceph-mon[34183]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:06.457 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:05 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/978092068' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-27T07:30:06.710 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:08.073 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:07 smithi082 ceph-mon[26613]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 -- 172.21.15.82:0/1217186299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 msgr2=0x7fe7700ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 --2- 172.21.15.82:0/1217186299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe7700ff9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009ce0 tx=0x7fe76c004d10 comp rx=0 tx=0).stop 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 -- 172.21.15.82:0/1217186299 shutdown_connections 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 --2- 172.21.15.82:0/1217186299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 0x7fe770102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 --2- 172.21.15.82:0/1217186299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe7700ff9a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 -- 172.21.15.82:0/1217186299 >> 172.21.15.82:0/1217186299 conn(0x7fe7700f7430 msgr2=0x7fe7700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 -- 172.21.15.82:0/1217186299 shutdown_connections 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 -- 172.21.15.82:0/1217186299 wait complete. 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.276+0000 7fe777d12700 1 Processor -- start 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 -- start start 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 0x7fe77010e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77010e700 con 0x7fe7700662c0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77010ef50 con 0x7fe7700ffee0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39778/0 (socket says 172.21.15.82:39778) 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 -- 172.21.15.82:0/2868760870 learned_addr learned my addr 172.21.15.82:0/2868760870 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe7752ad700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 0x7fe77010e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 -- 172.21.15.82:0/2868760870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 msgr2=0x7fe77010e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 0x7fe77010e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 -- 172.21.15.82:0/2868760870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009940 con 0x7fe7700662c0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe775aae700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009380 tx=0x7fe76c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c00e040 con 0x7fe7700662c0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77010f1d0 con 0x7fe7700662c0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe76c0128e0 con 0x7fe7700662c0 2024-04-27T07:30:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c01c910 con 0x7fe7700662c0 2024-04-27T07:30:08.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.277+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77010f710 con 0x7fe7700662c0 2024-04-27T07:30:08.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.278+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77005f5c0 con 0x7fe7700662c0 2024-04-27T07:30:08.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.279+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe76c012a50 con 0x7fe7700662c0 2024-04-27T07:30:08.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.279+0000 7fe7667fc700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 0x7fe75c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:08.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.279+0000 7fe7752ad700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 0x7fe75c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:08.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.279+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe76c088ae0 con 0x7fe7700662c0 2024-04-27T07:30:08.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.280+0000 7fe7752ad700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 0x7fe75c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe760004d60 tx=0x7fe76000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:08.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.284+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe76c058b60 con 0x7fe7700662c0 2024-04-27T07:30:08.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:07 smithi100 ceph-mon[34183]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:08.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.471+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe77004bed0 con 0x7fe7700662c0 2024-04-27T07:30:08.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.478+0000 7fe7667fc700 1 -- 172.21.15.82:0/2868760870 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe76c0586f0 con 0x7fe7700662c0 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 msgr2=0x7fe75c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 0x7fe75c06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe760004d60 tx=0x7fe76000b040 comp rx=0 tx=0).stop 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 msgr2=0x7fe77010dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009380 tx=0x7fe76c004d10 comp rx=0 tx=0).stop 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 shutdown_connections 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fe75c0692a0 0x7fe75c06b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7700662c0 0x7fe77010dbc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 --2- 172.21.15.82:0/2868760870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7700ffee0 0x7fe77010e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:08.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 >> 172.21.15.82:0/2868760870 conn(0x7fe7700f7430 msgr2=0x7fe7700f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:08.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 shutdown_connections 2024-04-27T07:30:08.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:08.480+0000 7fe777d12700 1 -- 172.21.15.82:0/2868760870 wait complete. 2024-04-27T07:30:09.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:09.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2868760870' entity='client.admin' 2024-04-27T07:30:09.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:09.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:09.038 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:09.038 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:09.039 INFO:teuthology.run_tasks:Running task print... 2024-04-27T07:30:09.047 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-27T07:30:09.047 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:09.080 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:09.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-27T07:30:09.332 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2868760870' entity='client.admin' 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:10.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:09 smithi100 ceph-mon[34183]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:10.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:09 smithi082 ceph-mon[26613]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 -- 172.21.15.82:0/1407984120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fcf70 msgr2=0x7f19440fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 --2- 172.21.15.82:0/1407984120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fcf70 0x7f19440fd3e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1930004940 tx=0x7f1930009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 -- 172.21.15.82:0/1407984120 shutdown_connections 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 --2- 172.21.15.82:0/1407984120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fcf70 0x7f19440fd3e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 --2- 172.21.15.82:0/1407984120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fbcc0 0x7f19440fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 -- 172.21.15.82:0/1407984120 >> 172.21.15.82:0/1407984120 conn(0x7f19440f7440 msgr2=0x7f19440f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 -- 172.21.15.82:0/1407984120 shutdown_connections 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.990+0000 7f194abdd700 1 -- 172.21.15.82:0/1407984120 wait complete. 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 Processor -- start 2024-04-27T07:30:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 -- start start 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fcf70 0x7f194410df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194410e550 con 0x7f19440fbcc0 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f194abdd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194410e6c0 con 0x7f19440fcf70 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f1948979700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f1948979700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39806/0 (socket says 172.21.15.82:39806) 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f1948979700 1 -- 172.21.15.82:0/128023991 learned_addr learned my addr 172.21.15.82:0/128023991 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.991+0000 7f1943fff700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fcf70 0x7f194410df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f1948979700 1 -- 172.21.15.82:0/128023991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fcf70 msgr2=0x7f194410df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f1948979700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fcf70 0x7f194410df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f1948979700 1 -- 172.21.15.82:0/128023991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930005040 con 0x7f19440fbcc0 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f1948979700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f193800c830 tx=0x7f1938004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19380106f0 con 0x7f19440fbcc0 2024-04-27T07:30:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1938010d20 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944113080 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19380113a0 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.992+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1944113640 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.993+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944101b00 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.994+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1938012400 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.994+0000 7f19417fa700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 0x7f193406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.994+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1938086e20 con 0x7f19440fbcc0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.994+0000 7f1943fff700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 0x7f193406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.994+0000 7f1943fff700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 0x7f193406b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f193000b3b0 tx=0x7f1930009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:10.998+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1938056f20 con 0x7f19440fbcc0 2024-04-27T07:30:11.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.203+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f194402b340 con 0x7f19340692a0 2024-04-27T07:30:11.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.205+0000 7f19417fa700 1 -- 172.21.15.82:0/128023991 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f194402b340 con 0x7f19340692a0 2024-04-27T07:30:11.207 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-04-27T07:30:11.207 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-04-27T07:30:11.207 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 msgr2=0x7f193406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 0x7f193406b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f193000b3b0 tx=0x7f1930009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 msgr2=0x7f194410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f193800c830 tx=0x7f1938004470 comp rx=0 tx=0).stop 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 shutdown_connections 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f19340692a0 0x7f193406b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19440fbcc0 0x7f194410da10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 --2- 172.21.15.82:0/128023991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19440fcf70 0x7f194410df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 >> 172.21.15.82:0/128023991 conn(0x7f19440f7440 msgr2=0x7f1944066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 shutdown_connections 2024-04-27T07:30:11.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:11.207+0000 7f194abdd700 1 -- 172.21.15.82:0/128023991 wait complete. 2024-04-27T07:30:11.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-27T07:30:11.951 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:12.272 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:11 smithi082 ceph-mon[26613]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:11 smithi100 ceph-mon[34183]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:13.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:12 smithi082 ceph-mon[26613]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:13.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:12 smithi100 ceph-mon[34183]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.458+0000 7fb108c68700 1 -- 172.21.15.82:0/1064438611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fcf90 msgr2=0x7fb1040fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.458+0000 7fb108c68700 1 --2- 172.21.15.82:0/1064438611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fcf90 0x7fb1040fd400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8004940 tx=0x7fb0f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.458+0000 7fb108c68700 1 -- 172.21.15.82:0/1064438611 shutdown_connections 2024-04-27T07:30:13.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 --2- 172.21.15.82:0/1064438611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fcf90 0x7fb1040fd400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 --2- 172.21.15.82:0/1064438611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fbce0 0x7fb1040fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- 172.21.15.82:0/1064438611 >> 172.21.15.82:0/1064438611 conn(0x7fb1040f7480 msgr2=0x7fb1040f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- 172.21.15.82:0/1064438611 shutdown_connections 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- 172.21.15.82:0/1064438611 wait complete. 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 Processor -- start 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- start start 2024-04-27T07:30:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fcf90 0x7fb10410cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10410d340 con 0x7fb1040fbce0 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb108c68700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10410d4b0 con 0x7fb1040fcf90 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb10259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb10259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39828/0 (socket says 172.21.15.82:39828) 2024-04-27T07:30:13.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb10259c700 1 -- 172.21.15.82:0/188670842 learned_addr learned my addr 172.21.15.82:0/188670842 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.459+0000 7fb101d9b700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fcf90 0x7fb10410cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb10259c700 1 -- 172.21.15.82:0/188670842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fcf90 msgr2=0x7fb10410cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb10259c700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fcf90 0x7fb10410cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb10259c700 1 -- 172.21.15.82:0/188670842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8005040 con 0x7fb1040fbce0 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb10259c700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c830 tx=0x7fb0f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:13.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f40106f0 con 0x7fb1040fbce0 2024-04-27T07:30:13.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0f4010d20 con 0x7fb1040fbce0 2024-04-27T07:30:13.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f40113a0 con 0x7fb1040fbce0 2024-04-27T07:30:13.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb104111f10 con 0x7fb1040fbce0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.460+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb104112440 con 0x7fb1040fbce0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.461+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10404c710 con 0x7fb1040fbce0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.461+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb0f4012400 con 0x7fb1040fbce0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.462+0000 7fb0f2ffd700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 0x7fb0ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.462+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb0f4086e00 con 0x7fb1040fbce0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.462+0000 7fb101d9b700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 0x7fb0ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:13.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.462+0000 7fb101d9b700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 0x7fb0ec06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b970 tx=0x7fb0f8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:13.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.466+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb0f4056f00 con 0x7fb1040fbce0 2024-04-27T07:30:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.661+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb104101300 con 0x7fb0ec0692a0 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.670+0000 7fb0f2ffd700 1 -- 172.21.15.82:0/188670842 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7fb104101300 con 0x7fb0ec0692a0 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (3m) 2m ago 5m 25.7M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 2m ago 5m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (4m) 65s ago 4m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (3m) 2m ago 4m 82.3M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:30:13.676 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (6m) 2m ago 6m 472M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (4m) 65s ago 4m 432M - 17.2.7-907-g2be3efa9 1c5834633715 0b4b06a0de83 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 2m ago 6m 41.5M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (4m) 65s ago 4m 38.9M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 2m ago 5m 15.7M - 1.5.0 0da6a335fe13 2d9c1f85828b 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 65s ago 4m 17.0M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 2m ago 3m 41.0M 4288M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 2m ago 2m 40.9M 4288M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 2m ago 2m 38.0M 4288M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (2m) 65s ago 119s 39.8M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (94s) 65s ago 94s 36.6M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (69s) 65s ago 68s 11.0M 5312M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:30:13.677 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 2m ago 4m 35.8M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:30:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 msgr2=0x7fb0ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 0x7fb0ec06b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800b970 tx=0x7fb0f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 msgr2=0x7fb10410c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c830 tx=0x7fb0f4004470 comp rx=0 tx=0).stop 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 shutdown_connections 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb0ec0692a0 0x7fb0ec06b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1040fbce0 0x7fb10410c800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 --2- 172.21.15.82:0/188670842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1040fcf90 0x7fb10410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 >> 172.21.15.82:0/188670842 conn(0x7fb1040f7480 msgr2=0x7fb1040f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 shutdown_connections 2024-04-27T07:30:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:13.672+0000 7fb108c68700 1 -- 172.21.15.82:0/188670842 wait complete. 2024-04-27T07:30:14.258 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:13 smithi082 ceph-mon[26613]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:14.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-27T07:30:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:13 smithi100 ceph-mon[34183]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:14.543 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:15.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:14 smithi082 ceph-mon[26613]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:14 smithi100 ceph-mon[34183]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- 172.21.15.82:0/1911199331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 msgr2=0x7f49240fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 --2- 172.21.15.82:0/1911199331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fc750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4914004940 tx=0x7f4914009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- 172.21.15.82:0/1911199331 shutdown_connections 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 --2- 172.21.15.82:0/1911199331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 0x7f49240fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 --2- 172.21.15.82:0/1911199331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fc750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- 172.21.15.82:0/1911199331 >> 172.21.15.82:0/1911199331 conn(0x7f49240f6bd0 msgr2=0x7f49240f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- 172.21.15.82:0/1911199331 shutdown_connections 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- 172.21.15.82:0/1911199331 wait complete. 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 Processor -- start 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.175+0000 7f4928893700 1 -- start start 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 0x7f4924114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492410e530 con 0x7f49240fc340 2024-04-27T07:30:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924115090 con 0x7f49240fcc90 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51084/0 (socket says 172.21.15.82:51084) 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 -- 172.21.15.82:0/2174050158 learned_addr learned my addr 172.21.15.82:0/2174050158 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4921d9b700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 0x7f4924114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 -- 172.21.15.82:0/2174050158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 msgr2=0x7f4924114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 0x7f4924114b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 -- 172.21.15.82:0/2174050158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914005040 con 0x7f49240fc340 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f492259c700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4914009380 tx=0x7f4914009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491400e040 con 0x7f49240fc340 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f491400bd90 con 0x7f49240fc340 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924115290 con 0x7f49240fc340 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491401c790 con 0x7f49240fc340 2024-04-27T07:30:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.176+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4924115850 con 0x7f49240fc340 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.177+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492404c710 con 0x7f49240fc340 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.178+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4914013b80 con 0x7f49240fc340 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.178+0000 7f4912ffd700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 0x7f490c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.178+0000 7f4921d9b700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 0x7f490c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.178+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4914087c30 con 0x7f49240fc340 2024-04-27T07:30:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.179+0000 7f4921d9b700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 0x7f490c06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4918006fd0 tx=0x7f4918008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:16.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.183+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4914057d30 con 0x7f49240fc340 2024-04-27T07:30:16.318 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:15 smithi100 ceph-mon[34183]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:15 smithi082 ceph-mon[26613]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:16.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.380+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f49241013a0 con 0x7f490c0692a0 2024-04-27T07:30:16.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.384+0000 7f4912ffd700 1 -- 172.21.15.82:0/2174050158 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f49241013a0 con 0x7f490c0692a0 2024-04-27T07:30:16.386 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:crash 2/2 2m ago 5m * 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 2/2 2m ago 6m count:2 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:mon 2/2 2m ago 5m smithi082:172.21.15.82=smithi082;smithi100:172.21.15.100=smithi100;count:2 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:osd 6 2m ago - 2024-04-27T07:30:16.387 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 msgr2=0x7f490c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 0x7f490c06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4918006fd0 tx=0x7f4918008040 comp rx=0 tx=0).stop 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 msgr2=0x7f49240fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4914009380 tx=0x7f4914009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 shutdown_connections 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f490c0692a0 0x7f490c06b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fc340 0x7f49240fba40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 --2- 172.21.15.82:0/2174050158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240fcc90 0x7f4924114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.386+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 >> 172.21.15.82:0/2174050158 conn(0x7f49240f6bd0 msgr2=0x7f49240f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.387+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 shutdown_connections 2024-04-27T07:30:16.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:16.387+0000 7f4928893700 1 -- 172.21.15.82:0/2174050158 wait complete. 2024-04-27T07:30:16.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-27T07:30:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:17 smithi082 ceph-mon[26613]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:17 smithi082 ceph-mon[26613]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:17 smithi100 ceph-mon[34183]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:17 smithi100 ceph-mon[34183]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:18.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 -- 172.21.15.82:0/1793717002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fbcc0 msgr2=0x7f58c40fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:18.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 --2- 172.21.15.82:0/1793717002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fbcc0 0x7f58c40fc0d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58b8004940 tx=0x7f58b8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:18.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 -- 172.21.15.82:0/1793717002 shutdown_connections 2024-04-27T07:30:18.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 --2- 172.21.15.82:0/1793717002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fcf70 0x7f58c40fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 --2- 172.21.15.82:0/1793717002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fbcc0 0x7f58c40fc0d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 -- 172.21.15.82:0/1793717002 >> 172.21.15.82:0/1793717002 conn(0x7f58c40f7440 msgr2=0x7f58c40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:18.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 -- 172.21.15.82:0/1793717002 shutdown_connections 2024-04-27T07:30:18.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.696+0000 7f58cacd1700 1 -- 172.21.15.82:0/1793717002 wait complete. 2024-04-27T07:30:18.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 Processor -- start 2024-04-27T07:30:18.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 -- start start 2024-04-27T07:30:18.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fbcc0 0x7f58c410fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:18.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4110700 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58cacd1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4110870 con 0x7f58c40fbcc0 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51102/0 (socket says 172.21.15.82:51102) 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58c3fff700 1 -- 172.21.15.82:0/3579567134 learned_addr learned my addr 172.21.15.82:0/3579567134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.697+0000 7f58c8a6d700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fbcc0 0x7f58c410fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c3fff700 1 -- 172.21.15.82:0/3579567134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fbcc0 msgr2=0x7f58c410fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fbcc0 0x7f58c410fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c3fff700 1 -- 172.21.15.82:0/3579567134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8005040 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c3fff700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58b0002a50 tx=0x7f58b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b0007cc0 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58b000f040 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c4115280 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b000da30 con 0x7f58c40fcf70 2024-04-27T07:30:18.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.698+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c4115840 con 0x7f58c40fcf70 2024-04-27T07:30:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.699+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4101900 con 0x7f58c40fcf70 2024-04-27T07:30:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.700+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f58b000dbb0 con 0x7f58c40fcf70 2024-04-27T07:30:18.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.700+0000 7f58c17fa700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 0x7f58b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.700+0000 7f58c8a6d700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 0x7f58b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.700+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f58b0086c10 con 0x7f58c40fcf70 2024-04-27T07:30:18.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.701+0000 7f58c8a6d700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 0x7f58b406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b3b0 tx=0x7f58b8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:18.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.705+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f58b0056c90 con 0x7f58c40fcf70 2024-04-27T07:30:18.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.895+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f58c402b2f0 con 0x7f58b40692a0 2024-04-27T07:30:18.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.896+0000 7f58c17fa700 1 -- 172.21.15.82:0/3579567134 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f58c402b2f0 con 0x7f58b40692a0 2024-04-27T07:30:18.898 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-04-27T07:30:18.898 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-04-27T07:30:18.898 INFO:teuthology.orchestra.run.smithi082.stdout:smithi100 172.21.15.100 2024-04-27T07:30:18.899 INFO:teuthology.orchestra.run.smithi082.stdout:2 hosts in cluster 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 msgr2=0x7f58b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 0x7f58b406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b3b0 tx=0x7f58b8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 msgr2=0x7f58c4110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58b0002a50 tx=0x7f58b00046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 shutdown_connections 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f58b40692a0 0x7f58b406b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c40fbcc0 0x7f58c410fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 --2- 172.21.15.82:0/3579567134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58c40fcf70 0x7f58c4110100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 >> 172.21.15.82:0/3579567134 conn(0x7f58c40f7440 msgr2=0x7f58c4066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:18.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 shutdown_connections 2024-04-27T07:30:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:18.898+0000 7f58cacd1700 1 -- 172.21.15.82:0/3579567134 wait complete. 2024-04-27T07:30:19.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-27T07:30:19.871 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:19 smithi100 ceph-mon[34183]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:19 smithi100 ceph-mon[34183]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:20.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:19 smithi082 ceph-mon[26613]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:20.274 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:19 smithi082 ceph-mon[26613]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2444346095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fbb40 msgr2=0x7f72c40fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2444346095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fbb40 0x7f72c40fe3a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72c0004940 tx=0x7f72c0009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2444346095 shutdown_connections 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2444346095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fbb40 0x7f72c40fe3a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2444346095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fb1f0 0x7f72c40fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2444346095 >> 172.21.15.82:0/2444346095 conn(0x7f72c40f6bd0 msgr2=0x7f72c40f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.369+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2444346095 shutdown_connections 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2444346095 wait complete. 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 Processor -- start 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 -- start start 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fbb40 0x7f72c410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c410e690 con 0x7f72c40fb1f0 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72cbeaa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c410e800 con 0x7f72c40fbb40 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72c9c46700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72c9c46700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51112/0 (socket says 172.21.15.82:51112) 2024-04-27T07:30:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.370+0000 7f72c9c46700 1 -- 172.21.15.82:0/2114630095 learned_addr learned my addr 172.21.15.82:0/2114630095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72c9445700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fbb40 0x7f72c410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72c9c46700 1 -- 172.21.15.82:0/2114630095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fbb40 msgr2=0x7f72c410e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72c9c46700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fbb40 0x7f72c410e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72c9c46700 1 -- 172.21.15.82:0/2114630095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0005040 con 0x7f72c40fb1f0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72c9c46700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f72b4002a50 tx=0x7f72b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b4007cc0 con 0x7f72c40fb1f0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4113260 con 0x7f72c40fb1f0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72b400f040 con 0x7f72c40fb1f0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72b4009640 con 0x7f72c40fb1f0 2024-04-27T07:30:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.371+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4113820 con 0x7f72c40fb1f0 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.372+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c404c710 con 0x7f72c40fb1f0 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.372+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f72b40097a0 con 0x7f72c40fb1f0 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.373+0000 7f72ba7fc700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 0x7f72b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.373+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f72b4086c90 con 0x7f72c40fb1f0 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.373+0000 7f72c9445700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 0x7f72b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:21.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.373+0000 7f72c9445700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 0x7f72b006b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72c000b3b0 tx=0x7f72c0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.377+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72b4056d10 con 0x7f72c40fb1f0 2024-04-27T07:30:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.569+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c4102700 con 0x7f72b00692a0 2024-04-27T07:30:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.571+0000 7f72ba7fc700 1 -- 172.21.15.82:0/2114630095 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f72c4102700 con 0x7f72b00692a0 2024-04-27T07:30:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-27T07:30:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-27T07:30:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-04-27T07:30:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 msgr2=0x7f72b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 0x7f72b006b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72c000b3b0 tx=0x7f72c0009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 msgr2=0x7f72c410db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f72b4002a50 tx=0x7f72b40046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 shutdown_connections 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f72b00692a0 0x7f72b006b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c40fb1f0 0x7f72c410db50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 --2- 172.21.15.82:0/2114630095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c40fbb40 0x7f72c410e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 >> 172.21.15.82:0/2114630095 conn(0x7f72c40f6bd0 msgr2=0x7f72c40f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 shutdown_connections 2024-04-27T07:30:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:21.573+0000 7f72cbeaa700 1 -- 172.21.15.82:0/2114630095 wait complete. 2024-04-27T07:30:22.143 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:22 smithi082 ceph-mon[26613]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:22.170 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:22.180 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:22.180 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-27T07:30:22.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:22 smithi100 ceph-mon[34183]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:22.435 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:23.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:23 smithi082 ceph-mon[26613]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:23 smithi100 ceph-mon[34183]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- 172.21.15.82:0/920459454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa00fdce0 msgr2=0x7faaa0100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 --2- 172.21.15.82:0/920459454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa00fdce0 0x7faaa0100160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa90004940 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- 172.21.15.82:0/920459454 shutdown_connections 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 --2- 172.21.15.82:0/920459454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa00fdce0 0x7faaa0100160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 --2- 172.21.15.82:0/920459454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0066f30 0x7faaa00fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- 172.21.15.82:0/920459454 >> 172.21.15.82:0/920459454 conn(0x7faaa00f7440 msgr2=0x7faaa00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- 172.21.15.82:0/920459454 shutdown_connections 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- 172.21.15.82:0/920459454 wait complete. 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 Processor -- start 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- start start 2024-04-27T07:30:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa00fdce0 0x7faaa0114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0114b10 con 0x7faaa0066f30 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.003+0000 7faaa79b7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa01194b0 con 0x7faaa00fdce0 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51130/0 (socket says 172.21.15.82:51130) 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 -- 172.21.15.82:0/1612934484 learned_addr learned my addr 172.21.15.82:0/1612934484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa4f52700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa00fdce0 0x7faaa0114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 -- 172.21.15.82:0/1612934484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa00fdce0 msgr2=0x7faaa0114480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa00fdce0 0x7faaa0114480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 -- 172.21.15.82:0/1612934484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90005040 con 0x7faaa0066f30 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa5753700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00b790 tx=0x7faa9c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c00f6f0 con 0x7faaa0066f30 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa9c00fd20 con 0x7faaa0066f30 2024-04-27T07:30:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa0119710 con 0x7faaa0066f30 2024-04-27T07:30:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9c0103a0 con 0x7faaa0066f30 2024-04-27T07:30:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.004+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa0119c80 con 0x7faaa0066f30 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.005+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa004c710 con 0x7faaa0066f30 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.006+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7faa9c011400 con 0x7faaa0066f30 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.006+0000 7faa95ffb700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 0x7faa8c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.006+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa9c086d20 con 0x7faaa0066f30 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.006+0000 7faaa4f52700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 0x7faa8c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.007+0000 7faaa4f52700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 0x7faa8c06b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa9000b3b0 tx=0x7faa90009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.013+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faa9c056da0 con 0x7faaa0066f30 2024-04-27T07:30:24.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:24 smithi082 ceph-mon[26613]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:24.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:24.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:24.230+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa00f8f30 con 0x7faa8c0692a0 2024-04-27T07:30:24.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:24 smithi100 ceph-mon[34183]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:24.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:25 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-27T07:30:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:25 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-27T07:30:26.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.050+0000 7faa95ffb700 1 -- 172.21.15.82:0/1612934484 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faaa00f8f30 con 0x7faa8c0692a0 2024-04-27T07:30:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 msgr2=0x7faa8c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 0x7faa8c06b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa9000b3b0 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 msgr2=0x7faaa0113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00b790 tx=0x7faa9c009220 comp rx=0 tx=0).stop 2024-04-27T07:30:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 shutdown_connections 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7faa8c0692a0 0x7faa8c06b750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0066f30 0x7faaa0113f40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 --2- 172.21.15.82:0/1612934484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa00fdce0 0x7faaa0114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 >> 172.21.15.82:0/1612934484 conn(0x7faaa00f7440 msgr2=0x7faaa00f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 shutdown_connections 2024-04-27T07:30:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:26.053+0000 7faaa79b7700 1 -- 172.21.15.82:0/1612934484 wait complete. 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-mon[26613]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-mon[26613]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-mon[26613]: osdmap e42: 6 total, 6 up, 6 in 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-27T07:30:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:26 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[26609]: 2024-04-27T07:30:26.028+0000 7fe8673aa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:30:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:26 smithi100 ceph-mon[34183]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:30:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:26 smithi100 ceph-mon[34183]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:26 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-27T07:30:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:26 smithi100 ceph-mon[34183]: osdmap e42: 6 total, 6 up, 6 in 2024-04-27T07:30:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:26 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-27T07:30:26.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: osdmap e43: 6 total, 6 up, 6 in 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: osdmap e44: 6 total, 6 up, 6 in 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: fsmap cephfs:0 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: Saving service mds.cephfs spec with placement count:4 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:27.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:27.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-27T07:30:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: osdmap e43: 6 total, 6 up, 6 in 2024-04-27T07:30:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-27T07:30:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: osdmap e44: 6 total, 6 up, 6 in 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: fsmap cephfs:0 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: Saving service mds.cephfs spec with placement count:4 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:28.310 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:28 smithi082 ceph-mon[26613]: pgmap v176: 65 pgs: 13 creating+peering, 1 active+clean, 51 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:28.310 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:28 smithi082 ceph-mon[26613]: Deploying daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:30:28.310 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:28 smithi082 ceph-mon[26613]: osdmap e45: 6 total, 6 up, 6 in 2024-04-27T07:30:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:28 smithi100 ceph-mon[34183]: pgmap v176: 65 pgs: 13 creating+peering, 1 active+clean, 51 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:28 smithi100 ceph-mon[34183]: Deploying daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:30:28.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:28 smithi100 ceph-mon[34183]: osdmap e45: 6 total, 6 up, 6 in 2024-04-27T07:30:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:29 smithi082 ceph-mon[26613]: osdmap e46: 6 total, 6 up, 6 in 2024-04-27T07:30:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:29 smithi100 ceph-mon[34183]: osdmap e46: 6 total, 6 up, 6 in 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 -- 172.21.15.82:0/2847831577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 msgr2=0x7f7dac0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/2847831577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac0fc0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c004940 tx=0x7f7d9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 -- 172.21.15.82:0/2847831577 shutdown_connections 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/2847831577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac0fcf70 0x7f7dac0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/2847831577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac0fc0d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 -- 172.21.15.82:0/2847831577 >> 172.21.15.82:0/2847831577 conn(0x7f7dac0f7440 msgr2=0x7f7dac0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 -- 172.21.15.82:0/2847831577 shutdown_connections 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.580+0000 7f7db3d9c700 1 -- 172.21.15.82:0/2847831577 wait complete. 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 Processor -- start 2024-04-27T07:30:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 -- start start 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac0fcf70 0x7f7dac1127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac112d00 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db3d9c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac112e40 con 0x7f7dac0fcf70 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36554/0 (socket says 172.21.15.82:36554) 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 -- 172.21.15.82:0/63261893 learned_addr learned my addr 172.21.15.82:0/63261893 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 -- 172.21.15.82:0/63261893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac0fcf70 msgr2=0x7f7dac1127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac0fcf70 0x7f7dac1127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 -- 172.21.15.82:0/63261893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c005040 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.581+0000 7f7db1b38700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.582+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9c00e040 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.582+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d9c00bcc0 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.582+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac113040 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.582+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9c01c630 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.582+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac113600 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.583+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac04c710 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.583+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7d9c013980 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.583+0000 7f7da27fc700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 0x7f7d9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:29.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.584+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7d9c0884b0 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.584+0000 7f7db1337700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 0x7f7d9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:29.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.584+0000 7f7db1337700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 0x7f7d9806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7da8004d00 tx=0x7f7da8009ce0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.588+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7d9c0581f0 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.826+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7dac113b50 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.826+0000 7f7da27fc700 1 -- 172.21.15.82:0/63261893 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f7d9c057d80 con 0x7f7dac0fbcc0 2024-04-27T07:30:29.828 INFO:teuthology.orchestra.run.smithi082.stdout:e2 2024-04-27T07:30:29.828 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 2 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:30:26.029755+0000 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:30:29.829 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:in 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:up {} 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:30:29.830 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 msgr2=0x7f7d9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 0x7f7d9806b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7da8004d00 tx=0x7f7da8009ce0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 msgr2=0x7f7dac066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 shutdown_connections 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7d980692a0 0x7f7d9806b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac0fbcc0 0x7f7dac066cd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 --2- 172.21.15.82:0/63261893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dac0fcf70 0x7f7dac1127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 >> 172.21.15.82:0/63261893 conn(0x7f7dac0f7440 msgr2=0x7f7dac0f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 shutdown_connections 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:29.828+0000 7f7db3d9c700 1 -- 172.21.15.82:0/63261893 wait complete. 2024-04-27T07:30:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-04-27T07:30:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:30 smithi082 ceph-mon[26613]: pgmap v179: 65 pgs: 32 active+clean, 19 creating+peering, 14 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:30 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/63261893' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:30:30.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:30 smithi100 ceph-mon[34183]: pgmap v179: 65 pgs: 32 active+clean, 19 creating+peering, 14 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-27T07:30:30.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:30 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/63261893' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:30:30.657 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:30.668 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:30.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-04-27T07:30:30.922 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:boot 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: daemon mds.cephfs.smithi082.vlqbei assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: Cluster is now healthy 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: fsmap cephfs:0 1 up:standby 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:creating} 2024-04-27T07:30:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: daemon mds.cephfs.smithi082.vlqbei is now active in filesystem cephfs as rank 0 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:31 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:boot 2024-04-27T07:30:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: daemon mds.cephfs.smithi082.vlqbei assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-27T07:30:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:30:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:30:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: Cluster is now healthy 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: fsmap cephfs:0 1 up:standby 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:creating} 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: daemon mds.cephfs.smithi082.vlqbei is now active in filesystem cephfs as rank 0 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:31 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:32.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:32 smithi082 ceph-mon[26613]: Deploying daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:30:32.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:32 smithi082 ceph-mon[26613]: pgmap v180: 65 pgs: 44 active+clean, 12 creating+peering, 9 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 464 B/s wr, 1 op/s 2024-04-27T07:30:32.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:32 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:active 2024-04-27T07:30:32.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:32 smithi082 ceph-mon[26613]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2024-04-27T07:30:32.286 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:32 smithi100 ceph-mon[34183]: Deploying daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:30:32.286 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:32 smithi100 ceph-mon[34183]: pgmap v180: 65 pgs: 44 active+clean, 12 creating+peering, 9 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 464 B/s wr, 1 op/s 2024-04-27T07:30:32.286 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:32 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:active 2024-04-27T07:30:32.286 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:32 smithi100 ceph-mon[34183]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2024-04-27T07:30:32.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 -- 172.21.15.82:0/1119396238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fcf70 msgr2=0x7f45f40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:32.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 --2- 172.21.15.82:0/1119396238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fcf70 0x7f45f40fd3e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f45e8004940 tx=0x7f45e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:32.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 -- 172.21.15.82:0/1119396238 shutdown_connections 2024-04-27T07:30:32.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 --2- 172.21.15.82:0/1119396238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fcf70 0x7f45f40fd3e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:32.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 --2- 172.21.15.82:0/1119396238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fbcc0 0x7f45f40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 -- 172.21.15.82:0/1119396238 >> 172.21.15.82:0/1119396238 conn(0x7f45f40f7440 msgr2=0x7f45f40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 -- 172.21.15.82:0/1119396238 shutdown_connections 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.452+0000 7f45fa32f700 1 -- 172.21.15.82:0/1119396238 wait complete. 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 Processor -- start 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 -- start start 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fcf70 0x7f45f410cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f410d330 con 0x7f45f40fbcc0 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.453+0000 7f45fa32f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f410d4a0 con 0x7f45f40fcf70 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36594/0 (socket says 172.21.15.82:36594) 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 -- 172.21.15.82:0/3268136984 learned_addr learned my addr 172.21.15.82:0/3268136984 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:32.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f37fe700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fcf70 0x7f45f410cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:32.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 -- 172.21.15.82:0/3268136984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fcf70 msgr2=0x7f45f410cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:32.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fcf70 0x7f45f410cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:32.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 -- 172.21.15.82:0/3268136984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8005040 con 0x7f45f40fbcc0 2024-04-27T07:30:32.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.454+0000 7f45f3fff700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45e4002a50 tx=0x7f45e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:32.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.455+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e4007cc0 con 0x7f45f40fbcc0 2024-04-27T07:30:32.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.455+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45e400f040 con 0x7f45f40fbcc0 2024-04-27T07:30:32.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.455+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45e400da30 con 0x7f45f40fbcc0 2024-04-27T07:30:32.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.455+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4111f00 con 0x7f45f40fbcc0 2024-04-27T07:30:32.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.455+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f4112430 con 0x7f45f40fbcc0 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.456+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f404c710 con 0x7f45f40fbcc0 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.456+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f45e400db90 con 0x7f45f40fbcc0 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.457+0000 7f45f0ff9700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 0x7f45dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.457+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45e4086eb0 con 0x7f45f40fbcc0 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.457+0000 7f45f37fe700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 0x7f45dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:32.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.457+0000 7f45f37fe700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 0x7f45dc06b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b970 tx=0x7f45e8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:32.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.461+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f45e4056c70 con 0x7f45f40fbcc0 2024-04-27T07:30:32.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:32.696+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f45f4112670 con 0x7f45f40fbcc0 2024-04-27T07:30:33.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 4 op/s 2024-04-27T07:30:33.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:boot 2024-04-27T07:30:33.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 1 up:standby 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: Deploying daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:30:33.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:33 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3268136984' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-27T07:30:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.600+0000 7f45f0ff9700 1 -- 172.21.15.82:0/3268136984 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f45e4056800 con 0x7f45f40fbcc0 2024-04-27T07:30:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.602+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 msgr2=0x7f45dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.602+0000 7f45fa32f700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 0x7f45dc06b750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b970 tx=0x7f45e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 msgr2=0x7f45f410c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45e4002a50 tx=0x7f45e40046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 shutdown_connections 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f45dc0692a0 0x7f45dc06b750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45f40fbcc0 0x7f45f410c7f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 --2- 172.21.15.82:0/3268136984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f40fcf70 0x7f45f410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 >> 172.21.15.82:0/3268136984 conn(0x7f45f40f7440 msgr2=0x7f45f40f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 shutdown_connections 2024-04-27T07:30:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:33.603+0000 7f45fa32f700 1 -- 172.21.15.82:0/3268136984 wait complete. 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 4 op/s 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:boot 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 1 up:standby 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.812 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:33.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:33.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:33.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:33.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: Deploying daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:30:33.813 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:33 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3268136984' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3268136984' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: daemon mds.cephfs.smithi100.udlhfn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:30:34.745 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 1 up:standby 2024-04-27T07:30:34.746 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:creating} 2024-04-27T07:30:34.746 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:34 smithi100 ceph-mon[34183]: daemon mds.cephfs.smithi100.udlhfn is now active in filesystem cephfs as rank 1 2024-04-27T07:30:34.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:30:34.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3268136984' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-27T07:30:34.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: daemon mds.cephfs.smithi100.udlhfn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-27T07:30:34.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-27T07:30:34.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:30:34.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 1 up:standby 2024-04-27T07:30:34.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:creating} 2024-04-27T07:30:34.773 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:34 smithi082 ceph-mon[26613]: daemon mds.cephfs.smithi100.udlhfn is now active in filesystem cephfs as rank 1 2024-04-27T07:30:34.801 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:34.811 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:34.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-27T07:30:35.355 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:active 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:35.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:35.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:active 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-27T07:30:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:36.679 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: Deploying daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:30:36.679 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-27T07:30:36.679 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: Cluster is now healthy 2024-04-27T07:30:36.679 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] up:boot 2024-04-27T07:30:36.680 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby 2024-04-27T07:30:36.680 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:36 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 -- 172.21.15.82:0/1967415178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fc2c0 msgr2=0x7f76b80fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 --2- 172.21.15.82:0/1967415178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fc2c0 0x7f76b80fc6d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76ac004940 tx=0x7f76ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 -- 172.21.15.82:0/1967415178 shutdown_connections 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 --2- 172.21.15.82:0/1967415178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fcc10 0x7f76b80fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 --2- 172.21.15.82:0/1967415178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fc2c0 0x7f76b80fc6d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 -- 172.21.15.82:0/1967415178 >> 172.21.15.82:0/1967415178 conn(0x7f76b80f6bd0 msgr2=0x7f76b80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 -- 172.21.15.82:0/1967415178 shutdown_connections 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.875+0000 7f76bcab8700 1 -- 172.21.15.82:0/1967415178 wait complete. 2024-04-27T07:30:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 Processor -- start 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 -- start start 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fc2c0 0x7f76b810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b810e400 con 0x7f76b80fcc10 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76bcab8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b810e570 con 0x7f76b80fc2c0 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40524/0 (socket says 172.21.15.82:40524) 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 -- 172.21.15.82:0/4193773583 learned_addr learned my addr 172.21.15.82:0/4193773583 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b659c700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fc2c0 0x7f76b810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 -- 172.21.15.82:0/4193773583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fc2c0 msgr2=0x7f76b810d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fc2c0 0x7f76b810d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 -- 172.21.15.82:0/4193773583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac005040 con 0x7f76b80fcc10 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76b5d9b700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76a8002a80 tx=0x7f76a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.876+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76a8007cc0 con 0x7f76b80fcc10 2024-04-27T07:30:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.877+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76a800f040 con 0x7f76b80fcc10 2024-04-27T07:30:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.877+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8112fd0 con 0x7f76b80fcc10 2024-04-27T07:30:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.877+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76a800dac0 con 0x7f76b80fcc10 2024-04-27T07:30:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.877+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8113560 con 0x7f76b80fcc10 2024-04-27T07:30:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.878+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b8101c10 con 0x7f76b80fcc10 2024-04-27T07:30:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.878+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f76a800dcc0 con 0x7f76b80fcc10 2024-04-27T07:30:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.878+0000 7f76a6ffd700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 0x7f76a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.878+0000 7f76b659c700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 0x7f76a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.878+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f76a8086dd0 con 0x7f76b80fcc10 2024-04-27T07:30:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.879+0000 7f76b659c700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 0x7f76a006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00b970 tx=0x7f76ac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:36.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: Deploying daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:30:36.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-27T07:30:36.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: Cluster is now healthy 2024-04-27T07:30:36.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] up:boot 2024-04-27T07:30:36.884 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby 2024-04-27T07:30:36.885 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:36 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:30:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:36.883+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f76a8056b10 con 0x7f76b80fcc10 2024-04-27T07:30:37.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.111+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f76b804c710 con 0x7f76b80fcc10 2024-04-27T07:30:37.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.455+0000 7f76a6ffd700 1 -- 172.21.15.82:0/4193773583 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f76a80566a0 con 0x7f76b80fcc10 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 msgr2=0x7f76a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 0x7f76a006b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00b970 tx=0x7f76ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 msgr2=0x7f76b810de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76a8002a80 tx=0x7f76a80046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 shutdown_connections 2024-04-27T07:30:37.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f76a00692a0 0x7f76a006b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b80fc2c0 0x7f76b810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 --2- 172.21.15.82:0/4193773583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b80fcc10 0x7f76b810de00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 >> 172.21.15.82:0/4193773583 conn(0x7f76b80f6bd0 msgr2=0x7f76b80f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 shutdown_connections 2024-04-27T07:30:37.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:37.458+0000 7f76bcab8700 1 -- 172.21.15.82:0/4193773583 wait complete. 2024-04-27T07:30:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:37 smithi082 ceph-mon[26613]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 5 op/s 2024-04-27T07:30:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:37 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4193773583' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-27T07:30:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:37 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4193773583' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-27T07:30:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:37 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby-replay 2024-04-27T07:30:37.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:37 smithi100 ceph-mon[34183]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s wr, 5 op/s 2024-04-27T07:30:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:37 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/4193773583' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-27T07:30:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:37 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/4193773583' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-27T07:30:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:37 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby-replay 2024-04-27T07:30:38.160 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:38.174 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:38.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] up:boot 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:active 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby-replay 1 up:standby 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:30:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:38 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] up:boot 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] up:active 2024-04-27T07:30:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 1 up:standby-replay 1 up:standby 2024-04-27T07:30:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:30:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:38 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:40.050 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:39 smithi082 ceph-mon[26613]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-04-27T07:30:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:39 smithi100 ceph-mon[34183]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s wr, 8 op/s 2024-04-27T07:30:41.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:40 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] up:standby-replay 2024-04-27T07:30:41.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:40 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:41.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:40 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:41.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:40 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:40 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] up:standby-replay 2024-04-27T07:30:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:40 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:40 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:40 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- 172.21.15.82:0/1960288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 msgr2=0x7fa6040fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 --2- 172.21.15.82:0/1960288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa6040fd270 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4004940 tx=0x7fa5f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- 172.21.15.82:0/1960288657 shutdown_connections 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 --2- 172.21.15.82:0/1960288657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 0x7fa6040fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 --2- 172.21.15.82:0/1960288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa6040fd270 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- 172.21.15.82:0/1960288657 >> 172.21.15.82:0/1960288657 conn(0x7fa6040f8540 msgr2=0x7fa6040fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- 172.21.15.82:0/1960288657 shutdown_connections 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- 172.21.15.82:0/1960288657 wait complete. 2024-04-27T07:30:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 Processor -- start 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.190+0000 7fa60940d700 1 -- start start 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 0x7fa60410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60410e480 con 0x7fa6040fce60 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60410e5f0 con 0x7fa6040fdfd0 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40542/0 (socket says 172.21.15.82:40542) 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 -- 172.21.15.82:0/1576515099 learned_addr learned my addr 172.21.15.82:0/1576515099 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa5fa7fc700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 0x7fa60410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 -- 172.21.15.82:0/1576515099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 msgr2=0x7fa60410de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 0x7fa60410de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 -- 172.21.15.82:0/1576515099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4005040 con 0x7fa6040fce60 2024-04-27T07:30:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa602ffd700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b3b0 tx=0x7fa5f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f400e040 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5f400bcc0 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa604112ff0 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f401c630 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.191+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa604113520 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.192+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60404c710 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.193+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa5f4013980 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.193+0000 7fa5fbfff700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 0x7fa5f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.193+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa5f4087f10 con 0x7fa6040fce60 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.193+0000 7fa5fa7fc700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 0x7fa5f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.194+0000 7fa5fa7fc700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 0x7fa5f006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:41.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.197+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa5f4057cd0 con 0x7fa6040fce60 2024-04-27T07:30:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.433+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6041058c0 con 0x7fa6040fce60 2024-04-27T07:30:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.987+0000 7fa5fbfff700 1 -- 172.21.15.82:0/1576515099 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v15) v1 ==== 168+0+0 (secure 0 0 0) 0x7fa5f4057860 con 0x7fa6040fce60 2024-04-27T07:30:41.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 msgr2=0x7fa5f006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:41.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 0x7fa5f006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec009040 comp rx=0 tx=0).stop 2024-04-27T07:30:41.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 msgr2=0x7fa60410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b3b0 tx=0x7fa5f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 shutdown_connections 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa5f00692a0 0x7fa5f006b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6040fce60 0x7fa60410d940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 --2- 172.21.15.82:0/1576515099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6040fdfd0 0x7fa60410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 >> 172.21.15.82:0/1576515099 conn(0x7fa6040f8540 msgr2=0x7fa6040f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 shutdown_connections 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:41.989+0000 7fa60940d700 1 -- 172.21.15.82:0/1576515099 wait complete. 2024-04-27T07:30:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:inline data enabled 2024-04-27T07:30:42.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:41 smithi082 ceph-mon[26613]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-04-27T07:30:42.082 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:41 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1576515099' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-27T07:30:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:41 smithi100 ceph-mon[34183]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-04-27T07:30:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:41 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1576515099' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-27T07:30:42.662 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:30:42.672 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:30:42.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-27T07:30:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:42 smithi082 ceph-mon[26613]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-27T07:30:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:42 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1576515099' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-27T07:30:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:42 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] up:standby-replay 2024-04-27T07:30:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:42 smithi082 ceph-mon[26613]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:active 2024-04-27T07:30:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:42 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:43 smithi100 ceph-mon[34183]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-04-27T07:30:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:43 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1576515099' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-04-27T07:30:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:43 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] up:standby-replay 2024-04-27T07:30:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:43 smithi100 ceph-mon[34183]: mds.? [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] up:active 2024-04-27T07:30:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:43 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:30:44.072 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:44.298 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:43 smithi082 ceph-mon[26613]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-04-27T07:30:44.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:44 smithi100 ceph-mon[34183]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-04-27T07:30:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- 172.21.15.82:0/3971687735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fdfd0 msgr2=0x7f04680fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 --2- 172.21.15.82:0/3971687735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fdfd0 0x7f04680fe440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0458004940 tx=0x7f0458009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:45.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- 172.21.15.82:0/3971687735 shutdown_connections 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 --2- 172.21.15.82:0/3971687735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fdfd0 0x7f04680fe440 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 --2- 172.21.15.82:0/3971687735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fce60 0x7f04680fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- 172.21.15.82:0/3971687735 >> 172.21.15.82:0/3971687735 conn(0x7f04680f8540 msgr2=0x7f04680fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- 172.21.15.82:0/3971687735 shutdown_connections 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- 172.21.15.82:0/3971687735 wait complete. 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 Processor -- start 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- start start 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fdfd0 0x7f04680702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0468070860 con 0x7f04680fce60 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.645+0000 7f046fe81700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04680709d0 con 0x7f04680fdfd0 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:45.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45072/0 (socket says 172.21.15.82:45072) 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046d41c700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fdfd0 0x7f04680702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 -- 172.21.15.82:0/3378102572 learned_addr learned my addr 172.21.15.82:0/3378102572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 -- 172.21.15.82:0/3378102572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fdfd0 msgr2=0x7f04680702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fdfd0 0x7f04680702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 -- 172.21.15.82:0/3378102572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458005040 con 0x7f04680fce60 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046dc1d700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0464002a50 tx=0x7f04640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0464007cc0 con 0x7f04680fce60 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0468070cb0 con 0x7f04680fce60 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f046400f040 con 0x7f04680fce60 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0468115a30 con 0x7f04680fce60 2024-04-27T07:30:45.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.646+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f046400da30 con 0x7f04680fce60 2024-04-27T07:30:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.647+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0052e0 con 0x7f04680fce60 2024-04-27T07:30:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.648+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f04640097c0 con 0x7f04680fce60 2024-04-27T07:30:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.648+0000 7f045e7fc700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 0x7f045406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.648+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0464086f10 con 0x7f04680fce60 2024-04-27T07:30:45.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.648+0000 7f046d41c700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 0x7f045406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:45.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.649+0000 7f046d41c700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 0x7f045406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f045800b3b0 tx=0x7f0458009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:45.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.653+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0464053160 con 0x7f04680fce60 2024-04-27T07:30:45.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.907+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f044c005da0 con 0x7f04680fce60 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.907+0000 7f045e7fc700 1 -- 172.21.15.82:0/3378102572 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1828 (secure 0 0 0) 0x7f0464056780 con 0x7f04680fce60 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:e15 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 15 2024-04-27T07:30:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:30:41.984913+0000 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:30:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:45.912 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.909+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 msgr2=0x7f045406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.909+0000 7f046fe81700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 0x7f045406b750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f045800b3b0 tx=0x7f0458009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.909+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 msgr2=0x7f0468071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.909+0000 7f046fe81700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0464002a50 tx=0x7f04640046b0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 shutdown_connections 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f04540692a0 0x7f045406b750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04680fce60 0x7f0468071de0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 --2- 172.21.15.82:0/3378102572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04680fdfd0 0x7f04680702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 >> 172.21.15.82:0/3378102572 conn(0x7f04680f8540 msgr2=0x7f04680f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 shutdown_connections 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:45.910+0000 7f046fe81700 1 -- 172.21.15.82:0/3378102572 wait complete. 2024-04-27T07:30:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 7 op/s 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:46.298 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:46 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3378102572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:30:46.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 7 op/s 2024-04-27T07:30:46.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:46.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:46.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:46.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:30:46.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:46 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3378102572' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:30:46.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-27T07:30:47.360 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:48 smithi082 ceph-mon[26613]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-27T07:30:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:48 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:48 smithi100 ceph-mon[34183]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-27T07:30:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:48 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 -- 172.21.15.82:0/626885209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 msgr2=0x7fc5880faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 --2- 172.21.15.82:0/626885209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc5880faec0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc578004940 tx=0x7fc578009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 -- 172.21.15.82:0/626885209 shutdown_connections 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 --2- 172.21.15.82:0/626885209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 0x7fc588102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 --2- 172.21.15.82:0/626885209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc5880faec0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 -- 172.21.15.82:0/626885209 >> 172.21.15.82:0/626885209 conn(0x7fc5880f6740 msgr2=0x7fc5880f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 -- 172.21.15.82:0/626885209 shutdown_connections 2024-04-27T07:30:48.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 -- 172.21.15.82:0/626885209 wait complete. 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.855+0000 7fc58da5a700 1 Processor -- start 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 -- start start 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 0x7fc58810dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58810e3e0 con 0x7fc5880faab0 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58810e550 con 0x7fc5880fb400 2024-04-27T07:30:48.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45094/0 (socket says 172.21.15.82:45094) 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 -- 172.21.15.82:0/1949798868 learned_addr learned my addr 172.21.15.82:0/1949798868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc5867fc700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 0x7fc58810dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 -- 172.21.15.82:0/1949798868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 msgr2=0x7fc58810dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 0x7fc58810dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 -- 172.21.15.82:0/1949798868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578005040 con 0x7fc5880faab0 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc586ffd700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc578009150 tx=0x7fc578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57800e040 con 0x7fc5880faab0 2024-04-27T07:30:48.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc588112f50 con 0x7fc5880faab0 2024-04-27T07:30:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc578004290 con 0x7fc5880faab0 2024-04-27T07:30:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.856+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc57801c630 con 0x7fc5880faab0 2024-04-27T07:30:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.857+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc588113480 con 0x7fc5880faab0 2024-04-27T07:30:48.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.857+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58804c710 con 0x7fc5880faab0 2024-04-27T07:30:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.858+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc57800bbf0 con 0x7fc5880faab0 2024-04-27T07:30:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.858+0000 7fc56f7fe700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.858+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc578087e60 con 0x7fc5880faab0 2024-04-27T07:30:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.858+0000 7fc5867fc700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:48.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.859+0000 7fc5867fc700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 0x7fc57006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fd0 tx=0x7fc57c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:48.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:48.863+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc578057c20 con 0x7fc5880faab0 2024-04-27T07:30:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.099+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc588105880 con 0x7fc5880faab0 2024-04-27T07:30:49.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.100+0000 7fc56f7fe700 1 -- 172.21.15.82:0/1949798868 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fc5780577b0 con 0x7fc5880faab0 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 msgr2=0x7fc57006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 0x7fc57006b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009fd0 tx=0x7fc57c00b040 comp rx=0 tx=0).stop 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 msgr2=0x7fc58810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc578009150 tx=0x7fc578009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 shutdown_connections 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc5700692a0 0x7fc57006b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5880faab0 0x7fc58810d8a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 --2- 172.21.15.82:0/1949798868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5880fb400 0x7fc58810dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 >> 172.21.15.82:0/1949798868 conn(0x7fc5880f6740 msgr2=0x7fc588100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:49.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 shutdown_connections 2024-04-27T07:30:49.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:49.102+0000 7fc58da5a700 1 -- 172.21.15.82:0/1949798868 wait complete. 2024-04-27T07:30:49.105 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:30:49.114 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:30:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:50 smithi100 ceph-mon[34183]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-27T07:30:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:50 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1949798868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:30:50.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:50 smithi082 ceph-mon[26613]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-27T07:30:50.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:50 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1949798868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:30:50.241 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-27T07:30:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:52 smithi082 ceph-mon[26613]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T07:30:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:52 smithi100 ceph-mon[34183]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 -- 172.21.15.82:0/4015273209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 msgr2=0x7f12580fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 --2- 172.21.15.82:0/4015273209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f12580fc0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1240004940 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 -- 172.21.15.82:0/4015273209 shutdown_connections 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 --2- 172.21.15.82:0/4015273209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 0x7f12580fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 --2- 172.21.15.82:0/4015273209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f12580fc0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:53.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 -- 172.21.15.82:0/4015273209 >> 172.21.15.82:0/4015273209 conn(0x7f12580f7430 msgr2=0x7f12580f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 -- 172.21.15.82:0/4015273209 shutdown_connections 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.917+0000 7f125e8f1700 1 -- 172.21.15.82:0/4015273209 wait complete. 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 Processor -- start 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 -- start start 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 0x7f1258115070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1258066220 con 0x7f12580fbcb0 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f125e8f1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1258066360 con 0x7f12580fcf60 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f1257fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f1257fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45112/0 (socket says 172.21.15.82:45112) 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f1257fff700 1 -- 172.21.15.82:0/3694243377 learned_addr learned my addr 172.21.15.82:0/3694243377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.918+0000 7f12577fe700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 0x7f1258115070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1257fff700 1 -- 172.21.15.82:0/3694243377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 msgr2=0x7f1258115070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1257fff700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 0x7f1258115070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:53.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1257fff700 1 -- 172.21.15.82:0/3694243377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240005040 con 0x7f12580fbcb0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1257fff700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1240009150 tx=0x7f1240009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124000e040 con 0x7f12580fbcb0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f124000bbf0 con 0x7f12580fbcb0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124001c630 con 0x7f12580fbcb0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12581155b0 con 0x7f12580fbcb0 2024-04-27T07:30:53.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.919+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1258115980 con 0x7f12580fbcb0 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.920+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125805f5c0 con 0x7f12580fbcb0 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.920+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f124000bd60 con 0x7f12580fbcb0 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.921+0000 7f1254ff9700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 0x7f124406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.921+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1240088510 con 0x7f12580fbcb0 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.921+0000 7f12577fe700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 0x7f124406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.921+0000 7f12577fe700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 0x7f124406b760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12480041d0 tx=0x7f12480043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:53.925+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f12400548f0 con 0x7f12580fbcb0 2024-04-27T07:30:54.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.206+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f125804bed0 con 0x7f12580fbcb0 2024-04-27T07:30:54.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.207+0000 7f1254ff9700 1 -- 172.21.15.82:0/3694243377 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7f1240013e60 con 0x7f12580fbcb0 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 msgr2=0x7f124406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 0x7f124406b760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12480041d0 tx=0x7f12480043c0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 msgr2=0x7f1258112b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1240009150 tx=0x7f1240009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 shutdown_connections 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f12440692b0 0x7f124406b760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12580fbcb0 0x7f1258112b20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 --2- 172.21.15.82:0/3694243377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12580fcf60 0x7f1258115070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.209+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 >> 172.21.15.82:0/3694243377 conn(0x7f12580f7430 msgr2=0x7f12580f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.210+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 shutdown_connections 2024-04-27T07:30:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.210+0000 7f125e8f1700 1 -- 172.21.15.82:0/3694243377 wait complete. 2024-04-27T07:30:54.221 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:30:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:30:54.841 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-27T07:30:54.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 -- 172.21.15.82:0/1233002338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fd430 msgr2=0x7f81480fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 --2- 172.21.15.82:0/1233002338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fd430 0x7f81480fd8a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f81300048d0 tx=0x7f8130009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 -- 172.21.15.82:0/1233002338 shutdown_connections 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 --2- 172.21.15.82:0/1233002338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fd430 0x7f81480fd8a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 --2- 172.21.15.82:0/1233002338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fc160 0x7f81480fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 -- 172.21.15.82:0/1233002338 >> 172.21.15.82:0/1233002338 conn(0x7f81480f7900 msgr2=0x7f81480f9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 -- 172.21.15.82:0/1233002338 shutdown_connections 2024-04-27T07:30:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 -- 172.21.15.82:0/1233002338 wait complete. 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.957+0000 7f814da6e640 1 Processor -- start 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 -- start start 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 0x7f814810d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814810d860 con 0x7f81480fc160 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148112220 con 0x7f81480fd430 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45134/0 (socket says 172.21.15.82:45134) 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 -- 172.21.15.82:0/1074829328 learned_addr learned my addr 172.21.15.82:0/1074829328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f813ffff640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 0x7f814810d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 -- 172.21.15.82:0/1074829328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 msgr2=0x7f814810d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 0x7f814810d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 -- 172.21.15.82:0/1074829328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130005040 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f813ffff640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 0x7f814810d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f81477fe640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8138002a80 tx=0x7f8138004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8138007c30 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81481123c0 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f813800f040 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f813800db80 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.958+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481128b0 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.959+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814804bcc0 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.960+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f813801c400 con 0x7f81480fc160 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.960+0000 7f8144ff9640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 0x7f813406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.960+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8138086ad0 con 0x7f81480fc160 2024-04-27T07:30:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.960+0000 7f813ffff640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 0x7f813406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.960+0000 7f813ffff640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 0x7f813406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f814810e190 tx=0x7f8130009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:54.964+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8138052d80 con 0x7f81480fc160 2024-04-27T07:30:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.133+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8148104cd0 con 0x7f81480fc160 2024-04-27T07:30:55.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.134+0000 7f8144ff9640 1 -- 172.21.15.82:0/1074829328 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14266 (secure 0 0 0) 0x7f81380563a0 con 0x7f81480fc160 2024-04-27T07:30:55.136 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:55.136 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":46,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:30:28.036116+0000","last_up_change":"2024-04-27T07:29:11.263707+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-27T07:30:24.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-27T07:30:25.253832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6803","nonce":2738777068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6805","nonce":2738777068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6809","nonce":2738777068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2738777068},{"type":"v1","addr":"172.21.15.82:6807","nonce":2738777068}]},"public_addr":"172.21.15.82:6803/2738777068","cluster_addr":"172.21.15.82:6805/2738777068","heartbeat_back_addr":"172.21.15.82:6809/2738777068","heartbeat_front_addr":"172.21.15.82:6807/2738777068","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6811","nonce":3469545083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6813","nonce":3469545083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6817","nonce":3469545083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3469545083},{"type":"v1","addr":"172.21.15.82:6815","nonce":3469545083}]},"public_addr":"172.21.15.82:6811/3469545083","cluster_addr":"172.21.15.82:6813/3469545083","heartbeat_back_addr":"172.21.15.82:6817/3469545083","heartbeat_front_addr":"172.21.15.82:6815/3469545083","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6819","nonce":3740754295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6821","nonce":3740754295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6825","nonce":3740754295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3740754295},{"type":"v1","addr":"172.21.15.82:6823","nonce":3740754295}]},"public_addr":"172.21.15.82:6819/3740754295","cluster_addr":"172.21.15.82:6821/3740754295","heartbeat_back_addr":"172.21.15.82:6825/3740754295","heartbeat_front_addr":"172.21.15.82:6823/3740754295","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6801","nonce":4124992664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6803","nonce":4124992664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6807","nonce":4124992664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4124992664},{"type":"v1","addr":"172.21.15.100:6805","nonce":4124992664}]},"public_addr":"172.21.15.100:6801/4124992664","cluster_addr":"172.21.15.100:6803/4124992664","heartbeat_back_addr":"172.21.15.100:6807/4124992664","heartbeat_front_addr":"172.21.15.100:6805/4124992664","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6809","nonce":371286847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6811","nonce":371286847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6815","nonce":371286847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":371286847},{"type":"v1","addr":"172.21.15.100:6813","nonce":371286847}]},"public_addr":"172.21.15.100:6809/371286847","cluster_addr":"172.21.15.100:6811/371286847","heartbeat_back_addr":"172.21.15.100:6815/371286847","heartbeat_front_addr":"172.21.15.100:6813/371286847","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6817","nonce":1350134728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6819","nonce":1350134728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6823","nonce":1350134728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1350134728},{"type":"v1","addr":"172.21.15.100:6821","nonce":1350134728}]},"public_addr":"172.21.15.100:6817/1350134728","cluster_addr":"172.21.15.100:6819/1350134728","heartbeat_back_addr":"172.21.15.100:6823/1350134728","heartbeat_front_addr":"172.21.15.100:6821/1350134728","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 msgr2=0x7f813406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 0x7f813406b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f814810e190 tx=0x7f8130009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 msgr2=0x7f814810cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8138002a80 tx=0x7f8138004600 comp rx=0 tx=0).stop 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 shutdown_connections 2024-04-27T07:30:55.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8134069210 0x7f813406b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81480fd430 0x7f814810d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 --2- 172.21.15.82:0/1074829328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81480fc160 0x7f814810cca0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 >> 172.21.15.82:0/1074829328 conn(0x7f81480f7900 msgr2=0x7f81480f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 shutdown_connections 2024-04-27T07:30:55.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.136+0000 7f814da6e640 1 -- 172.21.15.82:0/1074829328 wait complete. 2024-04-27T07:30:55.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-27T07:27:58.687625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-27T07:30:24.468959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-27T07:30:25.253832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-27T07:30:55.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-27T07:30:55.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- 172.21.15.82:0/3998673091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0fa580 msgr2=0x7f86ac0fa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 --2- 172.21.15.82:0/3998673091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0fa580 0x7f86ac0fa990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f869c0048d0 tx=0x7f869c009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- 172.21.15.82:0/3998673091 shutdown_connections 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 --2- 172.21.15.82:0/3998673091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0faf60 0x7f86ac1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 --2- 172.21.15.82:0/3998673091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0fa580 0x7f86ac0fa990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- 172.21.15.82:0/3998673091 >> 172.21.15.82:0/3998673091 conn(0x7f86ac0f5fc0 msgr2=0x7f86ac0f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- 172.21.15.82:0/3998673091 shutdown_connections 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- 172.21.15.82:0/3998673091 wait complete. 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 Processor -- start 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 -- start start 2024-04-27T07:30:55.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.246+0000 7f86b1907640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0fa580 0x7f86ac10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86b1907640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86b1907640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac10d8a0 con 0x7f86ac0faf60 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86b1907640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac112260 con 0x7f86ac0fa580 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45152/0 (socket says 172.21.15.82:45152) 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 -- 172.21.15.82:0/548130451 learned_addr learned my addr 172.21.15.82:0/548130451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aaffd640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0fa580 0x7f86ac10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 -- 172.21.15.82:0/548130451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0fa580 msgr2=0x7f86ac10cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0fa580 0x7f86ac10cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 -- 172.21.15.82:0/548130451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c005040 con 0x7f86ac0faf60 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86aa7fc640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86a0002840 tx=0x7f86a0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a0007c30 con 0x7f86ac0faf60 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86a000f040 con 0x7f86ac0faf60 2024-04-27T07:30:55.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac112400 con 0x7f86ac0faf60 2024-04-27T07:30:55.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a0009570 con 0x7f86ac0faf60 2024-04-27T07:30:55.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.247+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac1128d0 con 0x7f86ac0faf60 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.248+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac04bcc0 con 0x7f86ac0faf60 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.249+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f86a000dc80 con 0x7f86ac0faf60 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.249+0000 7f86937fe640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 0x7f869406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.249+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f86a0086db0 con 0x7f86ac0faf60 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.249+0000 7f86aaffd640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 0x7f869406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.250+0000 7f86aaffd640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 0x7f869406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f869c000c00 tx=0x7f869c009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.253+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f86a0053230 con 0x7f86ac0faf60 2024-04-27T07:30:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:55 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3694243377' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-27T07:30:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:55 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3694243377' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-27T07:30:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.419+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86ac112d50 con 0x7f86ac0faf60 2024-04-27T07:30:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.419+0000 7f86937fe640 1 -- 172.21.15.82:0/548130451 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86a0056850 con 0x7f86ac0faf60 2024-04-27T07:30:55.422 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 msgr2=0x7f869406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 0x7f869406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f869c000c00 tx=0x7f869c009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 msgr2=0x7f86ac10d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86a0002840 tx=0x7f86a0004570 comp rx=0 tx=0).stop 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 shutdown_connections 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f8694069210 0x7f869406b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86ac0faf60 0x7f86ac10d250 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 --2- 172.21.15.82:0/548130451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86ac0fa580 0x7f86ac10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 >> 172.21.15.82:0/548130451 conn(0x7f86ac0f5fc0 msgr2=0x7f86ac0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.421+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 shutdown_connections 2024-04-27T07:30:55.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.422+0000 7f86b1907640 1 -- 172.21.15.82:0/548130451 wait complete. 2024-04-27T07:30:55.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- 172.21.15.82:0/1575099033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c066150 msgr2=0x7fa24c0fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 --2- 172.21.15.82:0/1575099033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c066150 0x7fa24c0fee00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa2480048d0 tx=0x7fa248009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- 172.21.15.82:0/1575099033 shutdown_connections 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 --2- 172.21.15.82:0/1575099033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c0ff340 0x7fa24c101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 --2- 172.21.15.82:0/1575099033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c066150 0x7fa24c0fee00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- 172.21.15.82:0/1575099033 >> 172.21.15.82:0/1575099033 conn(0x7fa24c0f6830 msgr2=0x7fa24c0f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- 172.21.15.82:0/1575099033 shutdown_connections 2024-04-27T07:30:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- 172.21.15.82:0/1575099033 wait complete. 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 Processor -- start 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- start start 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 0x7fa24c10cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c10d900 con 0x7fa24c0ff340 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa254514640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c112300 con 0x7fa24c066150 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa251aaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.530+0000 7fa251aaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47000/0 (socket says 172.21.15.82:47000) 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa251aaf640 1 -- 172.21.15.82:0/3737858002 learned_addr learned my addr 172.21.15.82:0/3737858002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa2522b0640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 0x7fa24c10cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa251aaf640 1 -- 172.21.15.82:0/3737858002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 msgr2=0x7fa24c10cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa251aaf640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 0x7fa24c10cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa251aaf640 1 -- 172.21.15.82:0/3737858002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248005040 con 0x7fa24c0ff340 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa2522b0640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 0x7fa24c10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:30:55.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa251aaf640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c800 tx=0x7fa23c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c00a820 con 0x7fa24c0ff340 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa23c00ae50 con 0x7fa24c0ff340 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c0115e0 con 0x7fa24c0ff340 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c1124a0 con 0x7fa24c0ff340 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.531+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c112990 con 0x7fa24c0ff340 2024-04-27T07:30:55.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.532+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c04bcc0 con 0x7fa24c0ff340 2024-04-27T07:30:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.532+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa23c012400 con 0x7fa24c0ff340 2024-04-27T07:30:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.533+0000 7fa242ffd640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 0x7fa23806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.533+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa23c0873f0 con 0x7fa24c0ff340 2024-04-27T07:30:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.533+0000 7fa2522b0640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 0x7fa23806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.533+0000 7fa2522b0640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 0x7fa23806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa248000c00 tx=0x7fa248009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.537+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa23c053720 con 0x7fa24c0ff340 2024-04-27T07:30:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.703+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa24c104cf0 con 0x7fa24c0ff340 2024-04-27T07:30:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.704+0000 7fa242ffd640 1 -- 172.21.15.82:0/3737858002 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa23c056d40 con 0x7fa24c0ff340 2024-04-27T07:30:55.706 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.705+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 msgr2=0x7fa23806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 0x7fa23806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa248000c00 tx=0x7fa248009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 msgr2=0x7fa24c10d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c800 tx=0x7fa23c004430 comp rx=0 tx=0).stop 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 shutdown_connections 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa238069210 0x7fa23806b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c0ff340 0x7fa24c10d2b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 --2- 172.21.15.82:0/3737858002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c066150 0x7fa24c10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 >> 172.21.15.82:0/3737858002 conn(0x7fa24c0f6830 msgr2=0x7fa24c0f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 shutdown_connections 2024-04-27T07:30:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.706+0000 7fa254514640 1 -- 172.21.15.82:0/3737858002 wait complete. 2024-04-27T07:30:55.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-27T07:30:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 -- 172.21.15.82:0/3239325777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fe240 msgr2=0x7fad1c0fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 --2- 172.21.15.82:0/3239325777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fe240 0x7fad1c0fa310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad100048d0 tx=0x7fad10009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 -- 172.21.15.82:0/3239325777 shutdown_connections 2024-04-27T07:30:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 --2- 172.21.15.82:0/3239325777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fe240 0x7fad1c0fa310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 --2- 172.21.15.82:0/3239325777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fd860 0x7fad1c0fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 -- 172.21.15.82:0/3239325777 >> 172.21.15.82:0/3239325777 conn(0x7fad1c0f5fc0 msgr2=0x7fad1c0f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 -- 172.21.15.82:0/3239325777 shutdown_connections 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.812+0000 7fad2295d640 1 -- 172.21.15.82:0/3239325777 wait complete. 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 Processor -- start 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 -- start start 2024-04-27T07:30:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fe240 0x7fad1c10d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c10d910 con 0x7fad1c0fd860 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad2295d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c112280 con 0x7fad1c0fe240 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47010/0 (socket says 172.21.15.82:47010) 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 -- 172.21.15.82:0/815869370 learned_addr learned my addr 172.21.15.82:0/815869370 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1b7fe640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fe240 0x7fad1c10d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 -- 172.21.15.82:0/815869370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fe240 msgr2=0x7fad1c10d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fe240 0x7fad1c10d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 -- 172.21.15.82:0/815869370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10005040 con 0x7fad1c0fd860 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.813+0000 7fad1bfff640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c7e0 tx=0x7fad0c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.814+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c00a820 con 0x7fad1c0fd860 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.814+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad0c00ae50 con 0x7fad1c0fd860 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.814+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c112420 con 0x7fad1c0fd860 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.814+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad0c0113c0 con 0x7fad1c0fd860 2024-04-27T07:30:55.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.814+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c1128f0 con 0x7fad1c0fd860 2024-04-27T07:30:55.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.815+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c04bcc0 con 0x7fad1c0fd860 2024-04-27T07:30:55.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.815+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fad0c012810 con 0x7fad1c0fd860 2024-04-27T07:30:55.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.815+0000 7fad18ff9640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 0x7fad0406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:55.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.816+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fad0c087350 con 0x7fad1c0fd860 2024-04-27T07:30:55.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.816+0000 7fad1b7fe640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 0x7fad0406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:55.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.816+0000 7fad1b7fe640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 0x7fad0406b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad100048a0 tx=0x7fad10009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:55.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.820+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fad0c057110 con 0x7fad1c0fd860 2024-04-27T07:30:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.988+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fad1c112b70 con 0x7fad1c0fd860 2024-04-27T07:30:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.988+0000 7fad18ff9640 1 -- 172.21.15.82:0/815869370 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fad1c112b70 con 0x7fad1c0fd860 2024-04-27T07:30:55.990 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 msgr2=0x7fad0406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 0x7fad0406b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad100048a0 tx=0x7fad10009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 msgr2=0x7fad1c10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c7e0 tx=0x7fad0c0043c0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 shutdown_connections 2024-04-27T07:30:55.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fad04069210 0x7fad0406b6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad1c0fe240 0x7fad1c10d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 --2- 172.21.15.82:0/815869370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad1c0fd860 0x7fad1c10cd80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 >> 172.21.15.82:0/815869370 conn(0x7fad1c0f5fc0 msgr2=0x7fad1c0f76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 shutdown_connections 2024-04-27T07:30:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:55.990+0000 7fad2295d640 1 -- 172.21.15.82:0/815869370 wait complete. 2024-04-27T07:30:56.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-27T07:30:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 -- 172.21.15.82:0/1666975221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fb080 msgr2=0x7f42640fb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 --2- 172.21.15.82:0/1666975221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fb080 0x7f42640fb490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f42540048d0 tx=0x7f4254009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 -- 172.21.15.82:0/1666975221 shutdown_connections 2024-04-27T07:30:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 --2- 172.21.15.82:0/1666975221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fc350 0x7f42640fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 --2- 172.21.15.82:0/1666975221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fb080 0x7f42640fb490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 -- 172.21.15.82:0/1666975221 >> 172.21.15.82:0/1666975221 conn(0x7f42640f6840 msgr2=0x7f42640f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 -- 172.21.15.82:0/1666975221 shutdown_connections 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.094+0000 7f4269d5d640 1 -- 172.21.15.82:0/1666975221 wait complete. 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 Processor -- start 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 -- start start 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 0x7f426410bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426410c780 con 0x7f42640fc350 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4269d5d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4264111130 con 0x7f42640fb080 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47034/0 (socket says 172.21.15.82:47034) 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 -- 172.21.15.82:0/856391777 learned_addr learned my addr 172.21.15.82:0/856391777 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 -- 172.21.15.82:0/856391777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 msgr2=0x7f426410bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f42637fe640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 0x7f426410bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 0x7f426410bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 -- 172.21.15.82:0/856391777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254005040 con 0x7f42640fc350 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f42637fe640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 0x7f426410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.095+0000 7f4262ffd640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4258002a50 tx=0x7f4258004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.096+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4258007c30 con 0x7f42640fc350 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.096+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f425800f040 con 0x7f42640fc350 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.096+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42641112d0 con 0x7f42640fc350 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.096+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f425800db50 con 0x7f42640fc350 2024-04-27T07:30:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.096+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42641117c0 con 0x7f42640fc350 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.097+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4264105580 con 0x7f42640fc350 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.097+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f425801c400 con 0x7f42640fc350 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.097+0000 7f424bfff640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 0x7f424c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.097+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4258086a90 con 0x7f42640fc350 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.097+0000 7f42637fe640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 0x7f424c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.098+0000 7f42637fe640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 0x7f424c06b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4254003080 tx=0x7f4254009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.102+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f425804d250 con 0x7f42640fc350 2024-04-27T07:30:56.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.302+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4264111a10 con 0x7f42640fc350 2024-04-27T07:30:56.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.302+0000 7f424bfff640 1 -- 172.21.15.82:0/856391777 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4258052d40 con 0x7f42640fc350 2024-04-27T07:30:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:30:56.305 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:30:41.984913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14476":{"gid":14476,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/450518230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":450518230},{"type":"v1","addr":"172.21.15.82:6829","nonce":450518230}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.100:6827/398524698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":398524698},{"type":"v1","addr":"172.21.15.100:6827","nonce":398524698}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-27T07:30:56.305 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:30:56.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 msgr2=0x7f424c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 0x7f424c06b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4254003080 tx=0x7f4254009da0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 msgr2=0x7f426410c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4258002a50 tx=0x7f4258004600 comp rx=0 tx=0).stop 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 shutdown_connections 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f424c069210 0x7f424c06b6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42640fc350 0x7f426410c130 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 --2- 172.21.15.82:0/856391777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42640fb080 0x7f426410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.304+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 >> 172.21.15.82:0/856391777 conn(0x7f42640f6840 msgr2=0x7f42640ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.305+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 shutdown_connections 2024-04-27T07:30:56.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:56.305+0000 7f4269d5d640 1 -- 172.21.15.82:0/856391777 wait complete. 2024-04-27T07:30:56.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:56 smithi082 ceph-mon[26613]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:30:56.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1074829328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:30:56.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/548130451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3737858002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.317 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:56 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/815869370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.318 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-04-27T07:30:56.318 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-27T07:30:56.345 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-27T07:30:56.345 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-27T07:30:56.345 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-27T07:30:56.345 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-27T07:30:56.345 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-27T07:30:56.345 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-27T07:30:56.346 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-27T07:30:56.346 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-27T07:30:56.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:56.346 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-27T07:30:56.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:56.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-27T07:30:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:56 smithi100 ceph-mon[34183]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:30:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:56 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1074829328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:30:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:56 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/548130451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:56 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3737858002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:56 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/815869370' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:30:56.427 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-04-27T07:30:56.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:30:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:56.428 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-27T07:30:56.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:56.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-04-27T07:30:56.520 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-04-27T07:30:56.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:30:56.522 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-27T07:30:56.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-27T07:30:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:30:57.149 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:57 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/856391777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:30:57.350 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:57 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/856391777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:30:58.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:58 smithi082 ceph-mon[26613]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:30:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:58 smithi100 ceph-mon[34183]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 -- 172.21.15.82:0/2238526844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 msgr2=0x7fd7340fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/2238526844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7340fce00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd724004940 tx=0x7fd724009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 -- 172.21.15.82:0/2238526844 shutdown_connections 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/2238526844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7340fce00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/2238526844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd7341031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 -- 172.21.15.82:0/2238526844 >> 172.21.15.82:0/2238526844 conn(0x7fd7340f8980 msgr2=0x7fd7340fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 -- 172.21.15.82:0/2238526844 shutdown_connections 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.419+0000 7fd73bfb6700 1 -- 172.21.15.82:0/2238526844 wait complete. 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 Processor -- start 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 -- start start 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd734113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734114700 con 0x7fd734103790 2024-04-27T07:30:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73410daf0 con 0x7fd734102df0 2024-04-27T07:30:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47048/0 (socket says 172.21.15.82:47048) 2024-04-27T07:30:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 -- 172.21.15.82:0/1961970330 learned_addr learned my addr 172.21.15.82:0/1961970330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:30:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739d52700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd734113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 -- 172.21.15.82:0/1961970330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 msgr2=0x7fd734113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd734113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 -- 172.21.15.82:0/1961970330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724005040 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739d52700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd734113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd739551700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd724009100 tx=0x7fd724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72400e040 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd724004290 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.420+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73410dd70 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.421+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72401c3f0 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.421+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73410e330 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.421+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7340fe540 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.422+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd724013790 con 0x7fd734103790 2024-04-27T07:30:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.422+0000 7fd72a7fc700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 0x7fd72006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:30:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.422+0000 7fd739d52700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 0x7fd72006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:30:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.422+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd724088490 con 0x7fd734103790 2024-04-27T07:30:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.423+0000 7fd739d52700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 0x7fd72006b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd72c001250 tx=0x7fd72c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:30:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.427+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd724058250 con 0x7fd734103790 2024-04-27T07:30:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.660+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd734109ed0 con 0x7fd734103790 2024-04-27T07:30:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.660+0000 7fd72a7fc700 1 -- 172.21.15.82:0/1961970330 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd724013420 con 0x7fd734103790 2024-04-27T07:30:58.663 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.662+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 msgr2=0x7fd72006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.662+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 0x7fd72006b760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd72c001250 tx=0x7fd72c00b040 comp rx=0 tx=0).stop 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.662+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 msgr2=0x7fd7341140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.662+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd724009100 tx=0x7fd724009e30 comp rx=0 tx=0).stop 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 shutdown_connections 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7200692b0 0x7fd72006b760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd734102df0 0x7fd734113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 --2- 172.21.15.82:0/1961970330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd734103790 0x7fd7341140b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 >> 172.21.15.82:0/1961970330 conn(0x7fd7340f8980 msgr2=0x7fd7340f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 shutdown_connections 2024-04-27T07:30:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:58.663+0000 7fd73bfb6700 1 -- 172.21.15.82:0/1961970330 wait complete. 2024-04-27T07:30:59.303 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:30:59 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1961970330' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-27T07:30:59.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-27T07:30:59.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-27T07:30:59.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:59.330 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-27T07:30:59.346 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42217sec preferred_lft 42217sec 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::1d72:cfdc:ebc9:3cad/64 scope link noprefixroute 2024-04-27T07:30:59.347 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:30:59.348 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-27T07:30:59.348 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-27T07:30:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:30:59 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1961970330' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-27T07:30:59.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:30:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:30:59.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:59.539 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-27T07:30:59.563 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-27T07:30:59.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:59.565 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-04-27T07:30:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-04-27T07:30:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-27T07:30:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-27T07:30:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-27T07:30:59.630 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-27T07:30:59.631 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-27T07:30:59.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:30:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:30:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:30:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:59.898 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-27T07:30:59.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:30:59.913 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-04-27T07:30:59.968 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:30:59.968 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-27T07:30:59.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-27T07:30:59.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-27T07:30:59.968 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-27T07:31:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:00.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:00 smithi082 ceph-mon[26613]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:00.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:00.083 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-27T07:31:00.084 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-27T07:31:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:00.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:00.206 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:00.206 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-27T07:31:00.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-04-27T07:31:00.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-04-27T07:31:00.206 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-27T07:31:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:00.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:00.280 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-27T07:31:00.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-27T07:31:00.281 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:00.297 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-27T07:31:00.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-27T07:31:00.298 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:00.352 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-04-27T07:31:00.416 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-04-27T07:31:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:00 smithi100 ceph-mon[34183]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:00.472 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-04-27T07:31:00.472 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-04-27T07:31:00.472 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-04-27T07:31:00.473 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysusers.service 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/459ef24997b9da9fe086028349b65a5aa9a5a47a186df9965ed546f0592a57c2/merged 2024-04-27T07:31:00.474 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/8baa41ce6447ea56a1d3ad1c01f6b971f319af516e76d1ac537015be6cf25b14/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a81906486ac0bde2d2288c9edad64e9b019174321a97008afc2889291b13a3cc/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/fb7ef0490b6cee824c19bf9ebf4c38f57dcd85329f6cac5e8990723f054efc55/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e68c555367943075130342fbddaf35478422a9ba869eb9ff1faa32a4b091db05/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/409a7c883549c2a38e16c338b00de06a8359c0f789fbffc2f71c368378588b71/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5a3b42e9d02a73b1d6037c52acc89abf128cd0ad4cfe37ba29a4344b01d2d0e/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/267300e20d50ffe3891a07d02337db848ad9e732e379302a2b53ff4f5e151f9b/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/72c6d8eaae6aec2300cdb4b2c582019caff47d3af4ea72baf7a43bcfd012353f/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/380f15da967d56c0259c008c9a052f3c97b0974da480e4ccaa5b0d5b13871185/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/c67d7a32ee415805dcd95d59bcabea1bc71fd4948993f80a249bee6152b9271e/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bba39ef03a157a98c3d27f6f788c262107bcece75deab92d412f4f356dbec22b/merged 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-04-27T07:31:00.475 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-27T07:31:00.476 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-27T07:31:00.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:00.476 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-04-27T07:31:00.528 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-27T07:31:00.528 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-27T07:31:00.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-04-27T07:31:00.595 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-04-27T07:31:00.651 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-04-27T07:31:00.651 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-04-27T07:31:00.652 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysusers.service 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/459ef24997b9da9fe086028349b65a5aa9a5a47a186df9965ed546f0592a57c2/merged 2024-04-27T07:31:00.653 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/8baa41ce6447ea56a1d3ad1c01f6b971f319af516e76d1ac537015be6cf25b14/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a81906486ac0bde2d2288c9edad64e9b019174321a97008afc2889291b13a3cc/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/fb7ef0490b6cee824c19bf9ebf4c38f57dcd85329f6cac5e8990723f054efc55/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e68c555367943075130342fbddaf35478422a9ba869eb9ff1faa32a4b091db05/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/409a7c883549c2a38e16c338b00de06a8359c0f789fbffc2f71c368378588b71/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5a3b42e9d02a73b1d6037c52acc89abf128cd0ad4cfe37ba29a4344b01d2d0e/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/267300e20d50ffe3891a07d02337db848ad9e732e379302a2b53ff4f5e151f9b/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/72c6d8eaae6aec2300cdb4b2c582019caff47d3af4ea72baf7a43bcfd012353f/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/380f15da967d56c0259c008c9a052f3c97b0974da480e4ccaa5b0d5b13871185/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/c67d7a32ee415805dcd95d59bcabea1bc71fd4948993f80a249bee6152b9271e/merged 2024-04-27T07:31:00.654 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bba39ef03a157a98c3d27f6f788c262107bcece75deab92d412f4f356dbec22b/merged 2024-04-27T07:31:00.655 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-04-27T07:31:00.655 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-27T07:31:00.655 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-27T07:31:00.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:00.655 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-04-27T07:31:00.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-04-27T07:31:00.661+0000 7feb4b4d8300 -1 init, newargv = 0x5644e98da800 newargc=15 2024-04-27T07:31:00.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[74045]: starting ceph client 2024-04-27T07:31:00.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[74045]: starting fuse 2024-04-27T07:31:00.678 INFO:teuthology.orchestra.run.smithi082.stdout:145 2024-04-27T07:31:00.679 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [145] 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-04-27T07:31:00.679 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-04-27T07:31:00.680 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-04-27T07:31:00.681 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-27T07:31:00.681 DEBUG:teuthology.orchestra.run.smithi082:> 2024-04-27T07:31:00.681 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-04-27T07:31:00.681 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-04-27T07:31:00.794 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.74045.asok 2024-04-27T07:31:00.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:00.805 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.74045.asok 2024-04-27T07:31:00.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:00.806 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.74045.asok status 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "2be3efa97a7972f8e925bd899b474329979b74d6", 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-27T07:31:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "74045", 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14526, 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 14526 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-04-27T07:31:00.935 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 88217351 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 88217351 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.14526 192.168.0.1:0/88217351", 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/88217351", 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 15, 2024-04-27T07:31:00.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 46, 2024-04-27T07:31:00.937 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-04-27T07:31:00.937 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-04-27T07:31:00.937 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-04-27T07:31:00.937 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:31:00.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-27T07:31:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:02.328 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:02 smithi082 ceph-mon[26613]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:02 smithi100 ceph-mon[34183]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:02.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 -- 172.21.15.82:0/2906611871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 msgr2=0x7f2f341021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:02.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 --2- 172.21.15.82:0/2906611871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f341021f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f24004940 tx=0x7f2f24009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 -- 172.21.15.82:0/2906611871 shutdown_connections 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 --2- 172.21.15.82:0/2906611871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f340fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 --2- 172.21.15.82:0/2906611871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f341021f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 -- 172.21.15.82:0/2906611871 >> 172.21.15.82:0/2906611871 conn(0x7f2f34071460 msgr2=0x7f2f34071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 -- 172.21.15.82:0/2906611871 shutdown_connections 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.878+0000 7f2f39b64700 1 -- 172.21.15.82:0/2906611871 wait complete. 2024-04-27T07:31:02.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 Processor -- start 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 -- start start 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f34112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341135a0 con 0x7f2f34101e20 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f39b64700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3410c9e0 con 0x7f2f340fc710 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47066/0 (socket says 172.21.15.82:47066) 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.879+0000 7f2f32ffd700 1 -- 172.21.15.82:0/1512663528 learned_addr learned my addr 172.21.15.82:0/1512663528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:02.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f337fe700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f34112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f32ffd700 1 -- 172.21.15.82:0/1512663528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 msgr2=0x7f2f34112a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f32ffd700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f34112a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f32ffd700 1 -- 172.21.15.82:0/1512663528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24005040 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f337fe700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f34112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f32ffd700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800ead0 tx=0x7f2f28004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2800cc60 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f2800cdc0 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3410cc60 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f280109f0 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.880+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3410d220 con 0x7f2f34101e20 2024-04-27T07:31:02.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.881+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340652f0 con 0x7f2f34101e20 2024-04-27T07:31:02.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.881+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f2f28010b50 con 0x7f2f34101e20 2024-04-27T07:31:02.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.882+0000 7f2f1bfff700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 0x7f2f1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:02.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.882+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2f28089a40 con 0x7f2f34101e20 2024-04-27T07:31:02.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.882+0000 7f2f337fe700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 0x7f2f1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:02.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.882+0000 7f2f337fe700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 0x7f2f1c06b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f24004560 tx=0x7f2f24009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:02.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:02.886+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2f28059800 con 0x7f2f34101e20 2024-04-27T07:31:03.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.122+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f34108eb0 con 0x7f2f34101e20 2024-04-27T07:31:03.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.122+0000 7f2f1bfff700 1 -- 172.21.15.82:0/1512663528 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2f28015070 con 0x7f2f34101e20 2024-04-27T07:31:03.125 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 msgr2=0x7f2f1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 0x7f2f1c06b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2f24004560 tx=0x7f2f24009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 msgr2=0x7f2f34112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800ead0 tx=0x7f2f28004500 comp rx=0 tx=0).stop 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 shutdown_connections 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f2f1c0692a0 0x7f2f1c06b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f340fc710 0x7f2f34112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 --2- 172.21.15.82:0/1512663528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f34101e20 0x7f2f34112f50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.124+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 >> 172.21.15.82:0/1512663528 conn(0x7f2f34071460 msgr2=0x7f2f340f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.125+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 shutdown_connections 2024-04-27T07:31:03.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:03.125+0000 7f2f39b64700 1 -- 172.21.15.82:0/1512663528 wait complete. 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:03.727 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-27T07:31:03.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-27T07:31:03.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-27T07:31:03.728 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-27T07:31:03.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:03.728 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:31:03.747 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42217sec preferred_lft 42217sec 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec9a:b51a:adc5:26a4/64 scope link noprefixroute 2024-04-27T07:31:03.748 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-04-27T07:31:03.748 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-27T07:31:03.748 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-27T07:31:03.749 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-27T07:31:03.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:03.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:03.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:03.964 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-27T07:31:03.987 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-04-27T07:31:03.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:03.989 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-04-27T07:31:04.060 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-04-27T07:31:04.061 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-27T07:31:04.061 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-27T07:31:04.061 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-27T07:31:04.061 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-27T07:31:04.061 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-27T07:31:04.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:04.155 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:04 smithi100 ceph-mon[34183]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-27T07:31:04.156 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:04 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1512663528' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-27T07:31:04.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:04.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:04 smithi082 ceph-mon[26613]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-27T07:31:04.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:04 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1512663528' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-27T07:31:04.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:04.345 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-04-27T07:31:04.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:04.361 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-04-27T07:31:04.416 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:04.416 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-27T07:31:04.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-27T07:31:04.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-27T07:31:04.416 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-27T07:31:04.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:04.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:04.534 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-27T07:31:04.535 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-27T07:31:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:04.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:04.667 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-27T07:31:04.667 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-04-27T07:31:04.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-04-27T07:31:04.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-04-27T07:31:04.667 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-04-27T07:31:04.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-27T07:31:04.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:04.742 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-27T07:31:04.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-27T07:31:04.742 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:04.768 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-27T07:31:04.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-27T07:31:04.769 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:04.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-04-27T07:31:04.890 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-04-27T07:31:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysusers.service 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-04-27T07:31:04.948 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/0 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/d1c8aef178da5e5ba66e3d209cbdd134b86bf6585cc24aeb2e523d774dc45eb4/merged 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/44a65a887960e879524194f27625810229db67f44ac8196e698ea10b91c6b7c4/merged 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/7d5ceeea577f7ede477aacf8c964464dfe793d1437629e0191b16a8f59f8dab0/merged 2024-04-27T07:31:04.949 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/08f1c255b6abdb0d24f45a0833eb24bee4869650f5c16f4272d8e07317142e68/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/cfe99cdc874a629dcffdc044f3148777b70ec2821e0f309cadaf5103ac09f372/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/6f0d8b4c5a0b32413ce5006b001a4641918dfc243877245645eb9bf0c7652236/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/d3cc52aa81faf7d1e1209379c7155a5bb099588c770d53338e6424e2058e637b/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/f943128186e3d2441ec22ceacf090d5675da0e06acd098c634dbcbb8de7afe40/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e1d4e63fa4f83b24be2dca3667bba045b64e58c5d9097f8edca17626a3ec94f8/merged 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-27T07:31:04.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:04.950 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-04-27T07:31:05.002 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-27T07:31:05.002 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-27T07:31:05.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-04-27T07:31:05.068 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-04-27T07:31:05.123 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:05.124 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysusers.service 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-04-27T07:31:05.125 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/0 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/d1c8aef178da5e5ba66e3d209cbdd134b86bf6585cc24aeb2e523d774dc45eb4/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/44a65a887960e879524194f27625810229db67f44ac8196e698ea10b91c6b7c4/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/7d5ceeea577f7ede477aacf8c964464dfe793d1437629e0191b16a8f59f8dab0/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/08f1c255b6abdb0d24f45a0833eb24bee4869650f5c16f4272d8e07317142e68/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/cfe99cdc874a629dcffdc044f3148777b70ec2821e0f309cadaf5103ac09f372/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/6f0d8b4c5a0b32413ce5006b001a4641918dfc243877245645eb9bf0c7652236/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/d3cc52aa81faf7d1e1209379c7155a5bb099588c770d53338e6424e2058e637b/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/f943128186e3d2441ec22ceacf090d5675da0e06acd098c634dbcbb8de7afe40/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/containers/storage/overlay/e1d4e63fa4f83b24be2dca3667bba045b64e58c5d9097f8edca17626a3ec94f8/merged 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-27T07:31:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-27T07:31:05.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.127 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-04-27T07:31:05.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:2024-04-27T07:31:05.158+0000 7f21680cb300 -1 init, newargv = 0x55e250670a70 newargc=15 2024-04-27T07:31:05.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:ceph-fuse[59541]: starting ceph client 2024-04-27T07:31:05.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:ceph-fuse[59541]: starting fuse 2024-04-27T07:31:05.176 INFO:teuthology.orchestra.run.smithi100.stdout:112 2024-04-27T07:31:05.176 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [112] 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-27T07:31:05.176 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-04-27T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-04-27T07:31:05.178 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-04-27T07:31:05.178 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-27T07:31:05.178 DEBUG:teuthology.orchestra.run.smithi100:> 2024-04-27T07:31:05.178 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.1")) 2024-04-27T07:31:05.178 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-04-27T07:31:05.292 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.1.59541.asok 2024-04-27T07:31:05.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-27T07:31:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-27T07:31:05.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59541.asok 2024-04-27T07:31:05.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59541.asok status 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "2be3efa97a7972f8e925bd899b474329979b74d6", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "1", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "59541", 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-27T07:31:05.433 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 24319, 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 24319 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 160342664 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-04-27T07:31:05.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 160342664 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.24319 192.168.0.1:0/160342664", 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/160342664", 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-04-27T07:31:05.435 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 15, 2024-04-27T07:31:05.437 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 46, 2024-04-27T07:31:05.437 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-04-27T07:31:05.437 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-04-27T07:31:05.438 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-04-27T07:31:05.438 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-04-27T07:31:05.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.441 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-04-27T07:31:05.441 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:05.461 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-04-27T07:31:05.462 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:05.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:05.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.535 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-04-27T07:31:05.535 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:05.550 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-04-27T07:31:05.550 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:05.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:31:05.550 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:06 smithi082 ceph-mon[26613]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T07:31:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:06 smithi100 ceph-mon[34183]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T07:31:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:08 smithi082 ceph-mon[26613]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T07:31:08.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:08 smithi100 ceph-mon[34183]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T07:31:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:09 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:09 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:09.953 INFO:teuthology.run_tasks:Running task print... 2024-04-27T07:31:09.965 INFO:teuthology.task.print:**** done client 2024-04-27T07:31:09.965 INFO:teuthology.run_tasks:Running task parallel... 2024-04-27T07:31:09.992 INFO:teuthology.task.parallel:starting parallel... 2024-04-27T07:31:09.993 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-27T07:31:09.993 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-27T07:31:09.994 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:31:09.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-27T07:31:09.994 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-27T07:31:09.994 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-27T07:31:09.998 INFO:tasks.workunit:Pulling workunits from ref 4e213a58e787437ff508e6c890ccd5fd32dc96b5 2024-04-27T07:31:09.998 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-27T07:31:09.998 INFO:tasks.workunit:timeout=3h 2024-04-27T07:31:09.998 INFO:tasks.workunit:cleanup=True 2024-04-27T07:31:09.998 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:10.018 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:10.018 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-27T07:31:10.018 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 91h/145d Inode: 1 Links: 2 2024-04-27T07:31:10.018 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:31:10.019 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-27T07:31:10.019 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-27T07:31:10.019 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-27 07:30:30.055934799 +0000 2024-04-27T07:31:10.019 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-27 07:31:05.530197938 +0000 2024-04-27T07:31:10.019 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-27T07:31:10.019 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-27T07:31:10.019 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-27T07:31:10.090 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 70h/112d Inode: 1 Links: 3 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-27 07:31:10.082810959 +0000 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-27 07:31:10.082810959 +0000 2024-04-27T07:31:10.111 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2024-04-27T07:31:10.111 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-27T07:31:10.112 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-27T07:31:10.186 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4e213a58e787437ff508e6c890ccd5fd32dc96b5 2024-04-27T07:31:10.186 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 4e213a58e787437ff508e6c890ccd5fd32dc96b5 2024-04-27T07:31:10.202 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-27T07:31:10.243 INFO:tasks.workunit.client.1.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-27T07:31:10.269 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:10 smithi082 ceph-mon[26613]: pgmap v199: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-27T07:31:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:10 smithi100 ceph-mon[34183]: pgmap v199: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 -- 172.21.15.82:0/2674134499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fe420 msgr2=0x7f1cdc0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 --2- 172.21.15.82:0/2674134499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fe420 0x7f1cdc0fe830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc004940 tx=0x7f1ccc009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 -- 172.21.15.82:0/2674134499 shutdown_connections 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 --2- 172.21.15.82:0/2674134499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cdc0fed70 0x7f1cdc0faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 --2- 172.21.15.82:0/2674134499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fe420 0x7f1cdc0fe830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:11.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 -- 172.21.15.82:0/2674134499 >> 172.21.15.82:0/2674134499 conn(0x7f1cdc0f6be0 msgr2=0x7f1cdc0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 -- 172.21.15.82:0/2674134499 shutdown_connections 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.862+0000 7f1ce24a0700 1 -- 172.21.15.82:0/2674134499 wait complete. 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 Processor -- start 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 -- start start 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cdc0fe420 0x7f1cdc10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fed70 0x7f1cdc10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc10e430 con 0x7f1cdc0fed70 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.863+0000 7f1ce24a0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc10e5a0 con 0x7f1cdc0fe420 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fed70 0x7f1cdc10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fed70 0x7f1cdc10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44076/0 (socket says 172.21.15.82:44076) 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 -- 172.21.15.82:0/281909311 learned_addr learned my addr 172.21.15.82:0/281909311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdbfff700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cdc0fe420 0x7f1cdc10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:11.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 -- 172.21.15.82:0/281909311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cdc0fe420 msgr2=0x7f1cdc10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cdc0fe420 0x7f1cdc10d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 -- 172.21.15.82:0/281909311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc005040 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cdb7fe700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cdc0fed70 0x7f1cdc10de30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c830 tx=0x7f1cd0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd000a760 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1ce24a0700 1 -- 172.21.15.82:0/281909311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc113000 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cd000ad90 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd00113a0 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.864+0000 7f1ce24a0700 1 -- 172.21.15.82:0/281909311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc113590 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.865+0000 7f1ce24a0700 1 -- 172.21.15.82:0/281909311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc04c710 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.866+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1cd0012400 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.866+0000 7f1cd8ff9700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cc40692a0 0x7f1cc406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.866+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1cd0087200 con 0x7f1cdc0fed70 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.866+0000 7f1cdbfff700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cc40692a0 0x7f1cc406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:11.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.866+0000 7f1cdbfff700 1 --2- 172.21.15.82:0/281909311 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1cc40692a0 0x7f1cc406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc000c00 tx=0x7f1ccc009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:11.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:11.870+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1cd0056fc0 con 0x7f1cdc0fed70 2024-04-27T07:31:12.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:12.062+0000 7f1ce24a0700 1 -- 172.21.15.82:0/281909311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1cdc113840 con 0x7f1cdc0fed70 2024-04-27T07:31:12.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:12.062+0000 7f1cd8ff9700 1 -- 172.21.15.82:0/281909311 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f1cd0056b50 con 0x7f1cdc0fed70 2024-04-27T07:31:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-27T07:31:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:12 smithi082 ceph-mon[26613]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-04-27T07:31:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:12 smithi100 ceph-mon[34183]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-04-27T07:31:12.742 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-27T07:31:12.742 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:31:12.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-27T07:31:13.037 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:14.308 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:14 smithi082 ceph-mon[26613]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-27T07:31:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:14 smithi100 ceph-mon[34183]: pgmap v201: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- 172.21.15.82:0/4129884946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 msgr2=0x7f0ac80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 --2- 172.21.15.82:0/4129884946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac80fd3d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4004940 tx=0x7f0ac4009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- 172.21.15.82:0/4129884946 shutdown_connections 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 --2- 172.21.15.82:0/4129884946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac80fd3d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 --2- 172.21.15.82:0/4129884946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- 172.21.15.82:0/4129884946 >> 172.21.15.82:0/4129884946 conn(0x7f0ac80f7430 msgr2=0x7f0ac80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- 172.21.15.82:0/4129884946 shutdown_connections 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- 172.21.15.82:0/4129884946 wait complete. 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 Processor -- start 2024-04-27T07:31:14.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.853+0000 7f0ad0133700 1 -- start start 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0ad0133700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac81106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0ad0133700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0ad0133700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8066420 con 0x7f0ac80fcf60 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0ad0133700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8066560 con 0x7f0ac80fbcb0 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44102/0 (socket says 172.21.15.82:44102) 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 -- 172.21.15.82:0/2493362200 learned_addr learned my addr 172.21.15.82:0/2493362200 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acdecf700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac81106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 -- 172.21.15.82:0/2493362200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 msgr2=0x7f0ac81106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac81106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 -- 172.21.15.82:0/2493362200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac4005040 con 0x7f0ac80fcf60 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acdecf700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac81106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0acd6ce700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400b3b0 tx=0x7f0ac4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac400e040 con 0x7f0ac80fcf60 2024-04-27T07:31:14.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ac400bcc0 con 0x7f0ac80fcf60 2024-04-27T07:31:14.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac8113240 con 0x7f0ac80fcf60 2024-04-27T07:31:14.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.854+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac401c630 con 0x7f0ac80fcf60 2024-04-27T07:31:14.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.855+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8113800 con 0x7f0ac80fcf60 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.856+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac805f5c0 con 0x7f0ac80fcf60 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.856+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0ac4013980 con 0x7f0ac80fcf60 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.856+0000 7f0abe7fc700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 0x7f0ab406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.856+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0ac4087fc0 con 0x7f0ac80fcf60 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.856+0000 7f0acdecf700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 0x7f0ab406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:14.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.857+0000 7f0acdecf700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 0x7f0ab406b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8066010 tx=0x7f0ab8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:14.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:14.861+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0ac4054270 con 0x7f0ac80fcf60 2024-04-27T07:31:15.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.047+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0ac8113a20 con 0x7f0ac80fcf60 2024-04-27T07:31:15.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.048+0000 7f0abe7fc700 1 -- 172.21.15.82:0/2493362200 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0ac4057890 con 0x7f0ac80fcf60 2024-04-27T07:31:15.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 msgr2=0x7f0ab406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 0x7f0ab406b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8066010 tx=0x7f0ab8008040 comp rx=0 tx=0).stop 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 msgr2=0x7f0ac8112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400b3b0 tx=0x7f0ac4009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 shutdown_connections 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f0ab40692a0 0x7f0ab406b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ac80fbcb0 0x7f0ac81106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 --2- 172.21.15.82:0/2493362200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ac80fcf60 0x7f0ac8112c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 >> 172.21.15.82:0/2493362200 conn(0x7f0ac80f7430 msgr2=0x7f0ac80f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 shutdown_connections 2024-04-27T07:31:15.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:15.050+0000 7f0ad0133700 1 -- 172.21.15.82:0/2493362200 wait complete. 2024-04-27T07:31:15.674 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-27T07:31:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:16.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:16 smithi082 ceph-mon[26613]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-04-27T07:31:16.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:16 smithi100 ceph-mon[34183]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-04-27T07:31:17.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- 172.21.15.82:0/2610904377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fce60 msgr2=0x7f4f3c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 --2- 172.21.15.82:0/2610904377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c0fd270 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c004940 tx=0x7f4f2c009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- 172.21.15.82:0/2610904377 shutdown_connections 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 --2- 172.21.15.82:0/2610904377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 --2- 172.21.15.82:0/2610904377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c0fd270 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- 172.21.15.82:0/2610904377 >> 172.21.15.82:0/2610904377 conn(0x7f4f3c0f8540 msgr2=0x7f4f3c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- 172.21.15.82:0/2610904377 shutdown_connections 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- 172.21.15.82:0/2610904377 wait complete. 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 Processor -- start 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- start start 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c10d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.552+0000 7f4f42880700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c10e400 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f42880700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c10e570 con 0x7f4f3c0fce60 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37358/0 (socket says 172.21.15.82:37358) 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 -- 172.21.15.82:0/3108384401 learned_addr learned my addr 172.21.15.82:0/3108384401 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3bfff700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c10d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 -- 172.21.15.82:0/3108384401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fce60 msgr2=0x7f4f3c10d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c10d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 -- 172.21.15.82:0/3108384401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c005040 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f3b7fe700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f30002a80 tx=0x7f4f300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f30007cc0 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c112fd0 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f3000f040 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3000dac0 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.553+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c113560 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.554+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c04c710 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.555+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4f3000dc20 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.555+0000 7f4f38ff9700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 0x7f4f2406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.555+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4f30086e00 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.555+0000 7f4f3bfff700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 0x7f4f2406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.556+0000 7f4f3bfff700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 0x7f4f2406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00b3b0 tx=0x7f4f2c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.559+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4f30056b40 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.748+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f4f3c1058c0 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.749+0000 7f4f38ff9700 1 -- 172.21.15.82:0/3108384401 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4f300566d0 con 0x7f4f3c0fdfd0 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 msgr2=0x7f4f2406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 0x7f4f2406b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00b3b0 tx=0x7f4f2c009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 msgr2=0x7f4f3c10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f30002a80 tx=0x7f4f300046b0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 shutdown_connections 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4f240692a0 0x7f4f2406b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f3c0fce60 0x7f4f3c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 --2- 172.21.15.82:0/3108384401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f3c0fdfd0 0x7f4f3c10de00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:17.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 >> 172.21.15.82:0/3108384401 conn(0x7f4f3c0f8540 msgr2=0x7f4f3c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:17.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 shutdown_connections 2024-04-27T07:31:17.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:17.751+0000 7f4f42880700 1 -- 172.21.15.82:0/3108384401 wait complete. 2024-04-27T07:31:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:18 smithi082 ceph-mon[26613]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-04-27T07:31:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:18 smithi100 ceph-mon[34183]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-04-27T07:31:18.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-27T07:31:18.710 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 -- 172.21.15.82:0/2197496125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 msgr2=0x7fc2d80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 --2- 172.21.15.82:0/2197496125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80fe440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc004940 tx=0x7fc2cc009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 -- 172.21.15.82:0/2197496125 shutdown_connections 2024-04-27T07:31:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 --2- 172.21.15.82:0/2197496125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80fe440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 --2- 172.21.15.82:0/2197496125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 0x7fc2d80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 -- 172.21.15.82:0/2197496125 >> 172.21.15.82:0/2197496125 conn(0x7fc2d80f8520 msgr2=0x7fc2d80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.307+0000 7fc2dd593700 1 -- 172.21.15.82:0/2197496125 shutdown_connections 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 -- 172.21.15.82:0/2197496125 wait complete. 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 Processor -- start 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 -- start start 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 0x7fc2d8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d80707f0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2dd593700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8070960 con 0x7fc2d80fce60 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2d67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2d67fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37374/0 (socket says 172.21.15.82:37374) 2024-04-27T07:31:20.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.308+0000 7fc2d67fc700 1 -- 172.21.15.82:0/614493958 learned_addr learned my addr 172.21.15.82:0/614493958 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2d6ffd700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 0x7fc2d8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2d67fc700 1 -- 172.21.15.82:0/614493958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 msgr2=0x7fc2d8071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2d67fc700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 0x7fc2d8071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2d67fc700 1 -- 172.21.15.82:0/614493958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc005040 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2d67fc700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00b970 tx=0x7fc2cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc00e040 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2cc00bbf0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d8070be0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2cc01c630 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.309+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d8115a50 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.310+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d804c710 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.314 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:20 smithi082 ceph-mon[26613]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-27T07:31:20.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.311+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc2cc00bd60 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.311+0000 7fc2bf7fe700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 0x7fc2c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:20.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.311+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc2cc0883e0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.311+0000 7fc2d6ffd700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 0x7fc2c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:20.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.312+0000 7fc2d6ffd700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 0x7fc2c006b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009bf0 tx=0x7fc2c80091a0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:20.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.315+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc2cc058240 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:20 smithi100 ceph-mon[34183]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-04-27T07:31:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.504+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fc2d8115cf0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.504+0000 7fc2bf7fe700 1 -- 172.21.15.82:0/614493958 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fc2cc057dd0 con 0x7fc2d80fdfd0 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 msgr2=0x7fc2c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 0x7fc2c006b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009bf0 tx=0x7fc2c80091a0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 msgr2=0x7fc2d80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00b970 tx=0x7fc2cc009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 shutdown_connections 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fc2c00692a0 0x7fc2c006b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2d80fce60 0x7fc2d8071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 --2- 172.21.15.82:0/614493958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2d80fdfd0 0x7fc2d80702b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 >> 172.21.15.82:0/614493958 conn(0x7fc2d80f8520 msgr2=0x7fc2d80f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 shutdown_connections 2024-04-27T07:31:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:20.506+0000 7fc2dd593700 1 -- 172.21.15.82:0/614493958 wait complete. 2024-04-27T07:31:21.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-27T07:31:21.456 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:22.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:22 smithi082 ceph-mon[26613]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-04-27T07:31:22.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:22 smithi100 ceph-mon[34183]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 -- 172.21.15.82:0/3842765425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 msgr2=0x7fb4540fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 --2- 172.21.15.82:0/3842765425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb4540fae70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb444004940 tx=0x7fb444009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 -- 172.21.15.82:0/3842765425 shutdown_connections 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 --2- 172.21.15.82:0/3842765425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb4540fae70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 --2- 172.21.15.82:0/3842765425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb4540fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 -- 172.21.15.82:0/3842765425 >> 172.21.15.82:0/3842765425 conn(0x7fb4540f6b80 msgr2=0x7fb4540f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 -- 172.21.15.82:0/3842765425 shutdown_connections 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.115+0000 7fb45b466700 1 -- 172.21.15.82:0/3842765425 wait complete. 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 Processor -- start 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 -- start start 2024-04-27T07:31:23.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb45410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45410e570 con 0x7fb4540fed30 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb45b466700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45410ed70 con 0x7fb4540fe3e0 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37394/0 (socket says 172.21.15.82:37394) 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 -- 172.21.15.82:0/1373983118 learned_addr learned my addr 172.21.15.82:0/1373983118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb459202700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb45410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 -- 172.21.15.82:0/1373983118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 msgr2=0x7fb45410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb45410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 -- 172.21.15.82:0/1373983118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444005040 con 0x7fb4540fed30 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb459202700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb45410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.116+0000 7fb458a01700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b3b0 tx=0x7fb444009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:23.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.117+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44400e040 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.117+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45410eff0 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.117+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb44400bcc0 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.117+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44401c630 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.117+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45410f530 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.118+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45405f5c0 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.118+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb444026440 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.119+0000 7fb449ffb700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 0x7fb44006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.119+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb444087fd0 con 0x7fb4540fed30 2024-04-27T07:31:23.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.119+0000 7fb459202700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 0x7fb44006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.119+0000 7fb459202700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 0x7fb44006b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb450001250 tx=0x7fb45000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.123+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb444057e60 con 0x7fb4540fed30 2024-04-27T07:31:23.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.330+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f", "target": ["mon-mgr", ""]}) v1 -- 0x7fb45410f900 con 0x7fb4400692a0 2024-04-27T07:31:23.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:23 smithi082 ceph-mon[26613]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-27T07:31:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.335+0000 7fb449ffb700 1 -- 172.21.15.82:0/1373983118 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fb45410f900 con 0x7fb4400692a0 2024-04-27T07:31:23.337 INFO:teuthology.orchestra.run.smithi082.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:31:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 msgr2=0x7fb44006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 0x7fb44006b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb450001250 tx=0x7fb45000b040 comp rx=0 tx=0).stop 2024-04-27T07:31:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 msgr2=0x7fb45410df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b3b0 tx=0x7fb444009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 shutdown_connections 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb4400692a0 0x7fb44006b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4540fe3e0 0x7fb45410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 --2- 172.21.15.82:0/1373983118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4540fed30 0x7fb45410df70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 >> 172.21.15.82:0/1373983118 conn(0x7fb4540f6b80 msgr2=0x7fb4540f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 shutdown_connections 2024-04-27T07:31:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:23.337+0000 7fb45b466700 1 -- 172.21.15.82:0/1373983118 wait complete. 2024-04-27T07:31:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:23 smithi100 ceph-mon[34183]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-27T07:31:24.101 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-27T07:31:24.102 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:31:24.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-27T07:31:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:24.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:24.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:24 smithi082 ceph-mon[26613]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:31:24.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:24.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:24.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:24 smithi100 ceph-mon[34183]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f 2024-04-27T07:31:25.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:25 smithi082 ceph-mon[26613]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-04-27T07:31:25.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:25 smithi100 ceph-mon[34183]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-04-27T07:31:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 -- 172.21.15.82:0/4041876574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a44066220 msgr2=0x7f7a440ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/4041876574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a44066220 0x7f7a440ffa40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a40004940 tx=0x7f7a40009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 -- 172.21.15.82:0/4041876574 shutdown_connections 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/4041876574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a440fff80 0x7f7a44102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/4041876574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a44066220 0x7f7a440ffa40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 -- 172.21.15.82:0/4041876574 >> 172.21.15.82:0/4041876574 conn(0x7f7a440f7430 msgr2=0x7f7a440f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 -- 172.21.15.82:0/4041876574 shutdown_connections 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.447+0000 7f7a4bde2700 1 -- 172.21.15.82:0/4041876574 wait complete. 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 Processor -- start 2024-04-27T07:31:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 -- start start 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a44066220 0x7f7a440fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441116e0 con 0x7f7a440fff80 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4bde2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44111850 con 0x7f7a44066220 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41104/0 (socket says 172.21.15.82:41104) 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 -- 172.21.15.82:0/1938239713 learned_addr learned my addr 172.21.15.82:0/1938239713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a49b7e700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a44066220 0x7f7a440fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 -- 172.21.15.82:0/1938239713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a44066220 msgr2=0x7f7a440fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a44066220 0x7f7a440fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.448+0000 7f7a4937d700 1 -- 172.21.15.82:0/1938239713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40005040 con 0x7f7a440fff80 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a4937d700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a34002a50 tx=0x7f7a340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a34007cc0 con 0x7f7a440fff80 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a440fbfa0 con 0x7f7a440fff80 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a3400f040 con 0x7f7a440fff80 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3400db70 con 0x7f7a440fff80 2024-04-27T07:31:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.449+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a440fc510 con 0x7f7a440fff80 2024-04-27T07:31:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.450+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4405f5c0 con 0x7f7a440fff80 2024-04-27T07:31:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.451+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7a3400dcd0 con 0x7f7a440fff80 2024-04-27T07:31:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.451+0000 7f7a3a7fc700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 0x7f7a3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.451+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7a340868f0 con 0x7f7a440fff80 2024-04-27T07:31:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.451+0000 7f7a49b7e700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 0x7f7a3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.452+0000 7f7a49b7e700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 0x7f7a3006b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a40004890 tx=0x7f7a40009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:26.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.457+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7a34052ba0 con 0x7f7a440fff80 2024-04-27T07:31:26.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.784+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a44105a40 con 0x7f7a300692a0 2024-04-27T07:31:26.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.785+0000 7f7a3a7fc700 1 -- 172.21.15.82:0/1938239713 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7a44105a40 con 0x7f7a300692a0 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 msgr2=0x7f7a3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 0x7f7a3006b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a40004890 tx=0x7f7a40009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 msgr2=0x7f7a440fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a34002a50 tx=0x7f7a340046b0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 shutdown_connections 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f7a300692a0 0x7f7a3006b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a44066220 0x7f7a440fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 --2- 172.21.15.82:0/1938239713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a440fff80 0x7f7a440fb940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.788+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 >> 172.21.15.82:0/1938239713 conn(0x7f7a440f7430 msgr2=0x7f7a440f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:26.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.789+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 shutdown_connections 2024-04-27T07:31:26.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.789+0000 7f7a4bde2700 1 -- 172.21.15.82:0/1938239713 wait complete. 2024-04-27T07:31:26.801 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:31:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- 172.21.15.82:0/556169275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 msgr2=0x7fbea00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 --2- 172.21.15.82:0/556169275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00fc0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c004940 tx=0x7fbe9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- 172.21.15.82:0/556169275 shutdown_connections 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 --2- 172.21.15.82:0/556169275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 --2- 172.21.15.82:0/556169275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00fc0c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- 172.21.15.82:0/556169275 >> 172.21.15.82:0/556169275 conn(0x7fbea00f7430 msgr2=0x7fbea00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- 172.21.15.82:0/556169275 shutdown_connections 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- 172.21.15.82:0/556169275 wait complete. 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 Processor -- start 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.930+0000 7fbea8591700 1 -- start start 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea8591700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea8591700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea8591700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00fe830 con 0x7fbea00fbcb0 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea8591700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00fe970 con 0x7fbea00fcf60 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41120/0 (socket says 172.21.15.82:41120) 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 -- 172.21.15.82:0/1538753017 learned_addr learned my addr 172.21.15.82:0/1538753017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea5b2c700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 -- 172.21.15.82:0/1538753017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 msgr2=0x7fbea00fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 -- 172.21.15.82:0/1538753017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c005040 con 0x7fbea00fbcb0 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea5b2c700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:31:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.931+0000 7fbea632d700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009150 tx=0x7fbe9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.932+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c00e040 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.932+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00febf0 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.932+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea0115a80 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.932+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c00bbf0 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.932+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9c01c630 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.933+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0101af0 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.933+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbe9c013420 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.934+0000 7fbe96ffd700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 0x7fbe8c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.934+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbe9c088590 con 0x7fbea00fbcb0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.934+0000 7fbea5b2c700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 0x7fbe8c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.934+0000 7fbea5b2c700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 0x7fbe8c06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbea0100360 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:26.938+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbe9c0548a0 con 0x7fbea00fbcb0 2024-04-27T07:31:27.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.277+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbea01048b0 con 0x7fbe8c0692b0 2024-04-27T07:31:27.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.278+0000 7fbe96ffd700 1 -- 172.21.15.82:0/1538753017 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fbea01048b0 con 0x7fbe8c0692b0 2024-04-27T07:31:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.280+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 msgr2=0x7fbe8c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.280+0000 7fbea8591700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 0x7fbe8c06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbea0100360 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2024-04-27T07:31:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.280+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 msgr2=0x7fbea00ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.280+0000 7fbea8591700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009150 tx=0x7fbe9c009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 shutdown_connections 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fbe8c0692b0 0x7fbe8c06b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00fbcb0 0x7fbea00ffd80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 --2- 172.21.15.82:0/1538753017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbea00fcf60 0x7fbea00fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 >> 172.21.15.82:0/1538753017 conn(0x7fbea00f7430 msgr2=0x7fbea0065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 shutdown_connections 2024-04-27T07:31:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.281+0000 7fbea8591700 1 -- 172.21.15.82:0/1538753017 wait complete. 2024-04-27T07:31:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/3235412652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 msgr2=0x7fd0d80fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/3235412652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d80fd700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8004940 tx=0x7fd0c8009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/3235412652 shutdown_connections 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/3235412652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 0x7fd0d80fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/3235412652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d80fd700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/3235412652 >> 172.21.15.82:0/3235412652 conn(0x7fd0d80f6bb0 msgr2=0x7fd0d80f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.411+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/3235412652 shutdown_connections 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/3235412652 wait complete. 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 Processor -- start 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 -- start start 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 0x7fd0d810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d810e580 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0dd3c4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8112f20 con 0x7fd0d80fdc40 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0d6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0d6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41128/0 (socket says 172.21.15.82:41128) 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.412+0000 7fd0d6ffd700 1 -- 172.21.15.82:0/175086380 learned_addr learned my addr 172.21.15.82:0/175086380 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0cffff700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 0x7fd0d810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0d6ffd700 1 -- 172.21.15.82:0/175086380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 msgr2=0x7fd0d810def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0d6ffd700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 0x7fd0d810def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0d6ffd700 1 -- 172.21.15.82:0/175086380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8005040 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0d6ffd700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80090d0 tx=0x7fd0c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c800e040 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d8113120 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0c8004290 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.413+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d8113690 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.414+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c801c3f0 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.415+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d8101bf0 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.416+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd0c800bbf0 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.416+0000 7fd0cf7fe700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 0x7fd0c406b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.416+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd0c8088510 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.416+0000 7fd0cffff700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 0x7fd0c406b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.417+0000 7fd0cffff700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 0x7fd0c406b6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0006fd0 tx=0x7fd0c0008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.422+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd0c80582d0 con 0x7fd0d80fd2f0 2024-04-27T07:31:27.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:27 smithi082 ceph-mon[26613]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-04-27T07:31:27.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:27 smithi082 ceph-mon[26613]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:27.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.740+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0d802b3b0 con 0x7fd0c4069240 2024-04-27T07:31:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.751+0000 7fd0cf7fe700 1 -- 172.21.15.82:0/175086380 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fd0d802b3b0 con 0x7fd0c4069240 2024-04-27T07:31:27.753 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (4m) 33s ago 6m 24.5M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 33s ago 6m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (5m) 40s ago 5m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (4m) 33s ago 6m 86.1M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (52s) 33s ago 52s 14.7M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (58s) 33s ago 57s 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (50s) 40s ago 50s 12.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (55s) 40s ago 55s 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (7m) 33s ago 7m 480M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (5m) 40s ago 5m 433M - 17.2.7-907-g2be3efa9 1c5834633715 0b4b06a0de83 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 33s ago 7m 46.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:31:27.754 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (5m) 40s ago 5m 36.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 33s ago 6m 15.4M - 1.5.0 0da6a335fe13 2d9c1f85828b 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 40s ago 5m 16.5M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 33s ago 4m 48.3M 4288M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 33s ago 4m 48.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 33s ago 3m 44.6M 4288M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (3m) 40s ago 3m 45.3M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (2m) 40s ago 2m 42.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (2m) 40s ago 2m 42.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:31:27.755 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 33s ago 5m 52.5M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 msgr2=0x7fd0c406b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 0x7fd0c406b6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0006fd0 tx=0x7fd0c0008040 comp rx=0 tx=0).stop 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 msgr2=0x7fd0d810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80090d0 tx=0x7fd0c8009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 shutdown_connections 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd0c4069240 0x7fd0c406b6f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0d80fd2f0 0x7fd0d810d9b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 --2- 172.21.15.82:0/175086380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0d80fdc40 0x7fd0d810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 >> 172.21.15.82:0/175086380 conn(0x7fd0d80f6bb0 msgr2=0x7fd0d80fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 shutdown_connections 2024-04-27T07:31:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.754+0000 7fd0dd3c4700 1 -- 172.21.15.82:0/175086380 wait complete. 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.890+0000 7fd303307700 1 -- 172.21.15.82:0/426213969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 msgr2=0x7fd2fc0fc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.890+0000 7fd303307700 1 --2- 172.21.15.82:0/426213969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc0fc6a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8004940 tx=0x7fd2f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 -- 172.21.15.82:0/426213969 shutdown_connections 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 --2- 172.21.15.82:0/426213969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 0x7fd2fc0fd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 --2- 172.21.15.82:0/426213969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc0fc6a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 -- 172.21.15.82:0/426213969 >> 172.21.15.82:0/426213969 conn(0x7fd2fc0f6b80 msgr2=0x7fd2fc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:27.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 -- 172.21.15.82:0/426213969 shutdown_connections 2024-04-27T07:31:27.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 -- 172.21.15.82:0/426213969 wait complete. 2024-04-27T07:31:27.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 Processor -- start 2024-04-27T07:31:27.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.891+0000 7fd303307700 1 -- start start 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd303307700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd303307700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 0x7fd2fc112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd303307700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0fbc80 con 0x7fd2fc0fc290 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd303307700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0fbdc0 con 0x7fd2fc0fcbe0 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41158/0 (socket says 172.21.15.82:41158) 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 -- 172.21.15.82:0/3323015594 learned_addr learned my addr 172.21.15.82:0/3323015594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3008a2700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 0x7fd2fc112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 -- 172.21.15.82:0/3323015594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 msgr2=0x7fd2fc112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 0x7fd2fc112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.892+0000 7fd3010a3700 1 -- 172.21.15.82:0/3323015594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8005040 con 0x7fd2fc0fc290 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd3010a3700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800b0d0 tx=0x7fd2f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2f800e070 con 0x7fd2fc0fc290 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2f800b410 con 0x7fd2fc0fc290 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc113160 con 0x7fd2fc0fc290 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc113720 con 0x7fd2fc0fc290 2024-04-27T07:31:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.893+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2f8012600 con 0x7fd2fc0fc290 2024-04-27T07:31:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.894+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e00052e0 con 0x7fd2fc0fc290 2024-04-27T07:31:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.895+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd2f8013af0 con 0x7fd2fc0fc290 2024-04-27T07:31:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.895+0000 7fd2f1ffb700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 0x7fd2e806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.895+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd2f8087ed0 con 0x7fd2fc0fc290 2024-04-27T07:31:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.895+0000 7fd3008a2700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 0x7fd2e806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.896+0000 7fd3008a2700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 0x7fd2e806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004600 tx=0x7fd2ec00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:27.901+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd2f8054200 con 0x7fd2fc0fc290 2024-04-27T07:31:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:27 smithi100 ceph-mon[34183]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-04-27T07:31:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:27 smithi100 ceph-mon[34183]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.298+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2e0005da0 con 0x7fd2fc0fc290 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.299+0000 7fd2f1ffb700 1 -- 172.21.15.82:0/3323015594 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fd2f8022290 con 0x7fd2fc0fc290 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:31:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:31:28.302 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:31:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 msgr2=0x7fd2e806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 0x7fd2e806b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004600 tx=0x7fd2ec00b040 comp rx=0 tx=0).stop 2024-04-27T07:31:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 msgr2=0x7fd2fc1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800b0d0 tx=0x7fd2f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:28.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 shutdown_connections 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd2e80692b0 0x7fd2e806b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc0fc290 0x7fd2fc1106d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 --2- 172.21.15.82:0/3323015594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2fc0fcbe0 0x7fd2fc112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 >> 172.21.15.82:0/3323015594 conn(0x7fd2fc0f6b80 msgr2=0x7fd2fc0f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 shutdown_connections 2024-04-27T07:31:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.301+0000 7fd303307700 1 -- 172.21.15.82:0/3323015594 wait complete. 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 -- 172.21.15.82:0/3198697021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47200fe3e0 msgr2=0x7f47200fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 --2- 172.21.15.82:0/3198697021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47200fe3e0 0x7f47200fe7f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4708004940 tx=0x7f4708009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 -- 172.21.15.82:0/3198697021 shutdown_connections 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 --2- 172.21.15.82:0/3198697021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f47200fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 --2- 172.21.15.82:0/3198697021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47200fe3e0 0x7f47200fe7f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 -- 172.21.15.82:0/3198697021 >> 172.21.15.82:0/3198697021 conn(0x7f47200f6b80 msgr2=0x7f47200f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 -- 172.21.15.82:0/3198697021 shutdown_connections 2024-04-27T07:31:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.411+0000 7f47253b7700 1 -- 172.21.15.82:0/3198697021 wait complete. 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 Processor -- start 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 -- start start 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f472006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4720070020 con 0x7f472006ea30 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.412+0000 7f47253b7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472011bd80 con 0x7f47200fed30 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41184/0 (socket says 172.21.15.82:41184) 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 -- 172.21.15.82:0/1815352585 learned_addr learned my addr 172.21.15.82:0/1815352585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471effd700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f472006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 -- 172.21.15.82:0/1815352585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 msgr2=0x7f472006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f472006e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 -- 172.21.15.82:0/1815352585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708005040 con 0x7f472006ea30 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471effd700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f472006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f471e7fc700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f471000bbe0 tx=0x7f4710009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47100092e0 con 0x7f472006ea30 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472011c030 con 0x7f472006ea30 2024-04-27T07:31:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.413+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472011c5c0 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.414+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f471000cbd0 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.414+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4710015e60 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.415+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47000052e0 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.415+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4710012070 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.415+0000 7f47177fe700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 0x7f470c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.416+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4710086cc0 con 0x7f472006ea30 2024-04-27T07:31:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.416+0000 7f471effd700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 0x7f470c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.416+0000 7f471effd700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 0x7f470c06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:28.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.420+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4710054160 con 0x7f472006ea30 2024-04-27T07:31:28.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:28 smithi082 ceph-mon[26613]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:28.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:28 smithi082 ceph-mon[26613]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:28.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:28 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3323015594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:31:28.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.816+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4700005da0 con 0x7f472006ea30 2024-04-27T07:31:28.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.816+0000 7f47177fe700 1 -- 172.21.15.82:0/1815352585 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1828 (secure 0 0 0) 0x7f4710057780 con 0x7f472006ea30 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:e15 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 15 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:31:28.819 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:30:41.984913+0000 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:31:28.820 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:31:28.821 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 msgr2=0x7f470c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 0x7f470c06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 msgr2=0x7f472006eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f471000bbe0 tx=0x7f4710009840 comp rx=0 tx=0).stop 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 shutdown_connections 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f470c0692a0 0x7f470c06b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47200fed30 0x7f472006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 --2- 172.21.15.82:0/1815352585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f472006ea30 0x7f472006eea0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.819+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 >> 172.21.15.82:0/1815352585 conn(0x7f47200f6b80 msgr2=0x7f47200f8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.820+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 shutdown_connections 2024-04-27T07:31:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.820+0000 7f47253b7700 1 -- 172.21.15.82:0/1815352585 wait complete. 2024-04-27T07:31:28.823 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:31:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:28 smithi100 ceph-mon[34183]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:28 smithi100 ceph-mon[34183]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:28 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3323015594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.962+0000 7fcbc4527700 1 -- 172.21.15.82:0/1440916608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fed30 msgr2=0x7fcbbc0fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.962+0000 7fcbc4527700 1 --2- 172.21.15.82:0/1440916608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fed30 0x7fcbbc0fae70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcbac004940 tx=0x7fcbac009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 -- 172.21.15.82:0/1440916608 shutdown_connections 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 --2- 172.21.15.82:0/1440916608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fed30 0x7fcbbc0fae70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 --2- 172.21.15.82:0/1440916608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc0fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 -- 172.21.15.82:0/1440916608 >> 172.21.15.82:0/1440916608 conn(0x7fcbbc0f6b80 msgr2=0x7fcbbc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 -- 172.21.15.82:0/1440916608 shutdown_connections 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 -- 172.21.15.82:0/1440916608 wait complete. 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 Processor -- start 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.963+0000 7fcbc4527700 1 -- start start 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc4527700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc4527700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0fed30 0x7fcbbc1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc4527700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc1106e0 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc4527700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc110f30 con 0x7fcbbc0fed30 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41200/0 (socket says 172.21.15.82:41200) 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 -- 172.21.15.82:0/570242563 learned_addr learned my addr 172.21.15.82:0/570242563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 -- 172.21.15.82:0/570242563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0fed30 msgr2=0x7fcbbc1100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0fed30 0x7fcbbc1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 -- 172.21.15.82:0/570242563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac005040 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbc22c3700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800eb40 tx=0x7fcbb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb8007cc0 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbb800f040 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.964+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb8009620 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.965+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc1111b0 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.965+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1116a0 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.966+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc101b20 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.966+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fcbb8009780 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.966+0000 7fcbb2ffd700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 0x7fcba806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.967+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcbb8086e10 con 0x7fcbbc0fe3e0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.967+0000 7fcbc1ac2700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 0x7fcba806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:28.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.967+0000 7fcbc1ac2700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 0x7fcba806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0137d0 tx=0x7fcbac009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:28.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:28.972+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcbb804e250 con 0x7fcbbc0fe3e0 2024-04-27T07:31:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.237+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbbc111910 con 0x7fcba80692a0 2024-04-27T07:31:29.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.238+0000 7fcbb2ffd700 1 -- 172.21.15.82:0/570242563 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcbbc111910 con 0x7fcba80692a0 2024-04-27T07:31:29.240 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f", 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "", 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f image", 2024-04-27T07:31:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:31:29.242 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:31:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 msgr2=0x7fcba806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 0x7fcba806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0137d0 tx=0x7fcbac009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:29.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 msgr2=0x7fcbbc10fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800eb40 tx=0x7fcbb800b040 comp rx=0 tx=0).stop 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 shutdown_connections 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fcba80692a0 0x7fcba806b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbbc0fe3e0 0x7fcbbc10fba0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 --2- 172.21.15.82:0/570242563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0fed30 0x7fcbbc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 >> 172.21.15.82:0/570242563 conn(0x7fcbbc0f6b80 msgr2=0x7fcbbc0f8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 shutdown_connections 2024-04-27T07:31:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.240+0000 7fcbc4527700 1 -- 172.21.15.82:0/570242563 wait complete. 2024-04-27T07:31:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.370+0000 7fd465a04700 1 -- 172.21.15.82:0/1305157543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 msgr2=0x7fd4600fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.370+0000 7fd465a04700 1 --2- 172.21.15.82:0/1305157543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd4600fd2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd450004940 tx=0x7fd450009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 -- 172.21.15.82:0/1305157543 shutdown_connections 2024-04-27T07:31:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 --2- 172.21.15.82:0/1305157543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 0x7fd4600fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 --2- 172.21.15.82:0/1305157543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd4600fd2a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 -- 172.21.15.82:0/1305157543 >> 172.21.15.82:0/1305157543 conn(0x7fd4600f85c0 msgr2=0x7fd4600fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 -- 172.21.15.82:0/1305157543 shutdown_connections 2024-04-27T07:31:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.371+0000 7fd465a04700 1 -- 172.21.15.82:0/1305157543 wait complete. 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 Processor -- start 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 -- start start 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 0x7fd46010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010e590 con 0x7fd4600fce90 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd465a04700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010ede0 con 0x7fd4600fe090 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd45effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd45effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41222/0 (socket says 172.21.15.82:41222) 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd45effd700 1 -- 172.21.15.82:0/3134710027 learned_addr learned my addr 172.21.15.82:0/3134710027 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.372+0000 7fd45e7fc700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 0x7fd46010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd45effd700 1 -- 172.21.15.82:0/3134710027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 msgr2=0x7fd46010df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd45effd700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 0x7fd46010df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd45effd700 1 -- 172.21.15.82:0/3134710027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450005040 con 0x7fd4600fce90 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd45effd700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd450000c00 tx=0x7fd450009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45000e040 con 0x7fd4600fce90 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd45000bbf0 con 0x7fd4600fce90 2024-04-27T07:31:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46010f060 con 0x7fd4600fce90 2024-04-27T07:31:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45001c630 con 0x7fd4600fce90 2024-04-27T07:31:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.373+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46010f5a0 con 0x7fd4600fce90 2024-04-27T07:31:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.374+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46005f5c0 con 0x7fd4600fce90 2024-04-27T07:31:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.375+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd45000bd60 con 0x7fd4600fce90 2024-04-27T07:31:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.375+0000 7fd4477fe700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 0x7fd44806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.376+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd450088490 con 0x7fd4600fce90 2024-04-27T07:31:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.376+0000 7fd45e7fc700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 0x7fd44806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.376+0000 7fd45e7fc700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 0x7fd44806b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4540041d0 tx=0x7fd4540043c0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.381+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd450058250 con 0x7fd4600fce90 2024-04-27T07:31:29.778 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:29 smithi100 ceph-mon[34183]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T07:31:29.778 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:29 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1815352585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:31:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.786+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd46004bed0 con 0x7fd4600fce90 2024-04-27T07:31:29.788 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:29 smithi082 ceph-mon[26613]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T07:31:29.788 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:29 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1815352585' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:31:29.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.786+0000 7fd4477fe700 1 -- 172.21.15.82:0/3134710027 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd450057de0 con 0x7fd4600fce90 2024-04-27T07:31:29.789 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:31:29.789 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:31:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:31:29.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 msgr2=0x7fd44806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 0x7fd44806b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4540041d0 tx=0x7fd4540043c0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 msgr2=0x7fd46010da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd450000c00 tx=0x7fd450009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 shutdown_connections 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd4480692a0 0x7fd44806b750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4600fce90 0x7fd46010da50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 --2- 172.21.15.82:0/3134710027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4600fe090 0x7fd46010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 >> 172.21.15.82:0/3134710027 conn(0x7fd4600f85c0 msgr2=0x7fd4600f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 shutdown_connections 2024-04-27T07:31:29.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:29.788+0000 7fd465a04700 1 -- 172.21.15.82:0/3134710027 wait complete. 2024-04-27T07:31:30.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:30 smithi082 ceph-mon[26613]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:30.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:30 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3134710027' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:31:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:30 smithi100 ceph-mon[34183]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:31:30.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:30 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3134710027' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:31:31.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:31 smithi082 ceph-mon[26613]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T07:31:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:31 smithi100 ceph-mon[34183]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T07:31:33.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:33 smithi082 ceph-mon[26613]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T07:31:33.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:33 smithi100 ceph-mon[34183]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T07:31:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:35 smithi082 ceph-mon[26613]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:35 smithi100 ceph-mon[34183]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:37 smithi082 ceph-mon[26613]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:37 smithi100 ceph-mon[34183]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:39.777 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:39 smithi100 ceph-mon[34183]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:39.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:39 smithi082 ceph-mon[26613]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:41 smithi082 ceph-mon[26613]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:41.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:41 smithi100 ceph-mon[34183]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:43 smithi082 ceph-mon[26613]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:43.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:43 smithi100 ceph-mon[34183]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:31:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:45 smithi082 ceph-mon[26613]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:45.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:45 smithi100 ceph-mon[34183]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:47.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:47 smithi082 ceph-mon[26613]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:47.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:47 smithi100 ceph-mon[34183]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:31:49.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:49 smithi082 ceph-mon[26613]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:49.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:49 smithi100 ceph-mon[34183]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:51.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:51 smithi082 ceph-mon[26613]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:51.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:51 smithi100 ceph-mon[34183]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: Upgrade: Target is version 19.0.0-3227-gc37f63b3 (unknown) 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d'] 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:53.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: Upgrade: Need to upgrade myself (mgr.smithi082.hhlhmf) 2024-04-27T07:31:53.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:53.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:53 smithi082 ceph-mon[26613]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d on smithi100 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: Upgrade: Target is version 19.0.0-3227-gc37f63b3 (unknown) 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d'] 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: Upgrade: Need to upgrade myself (mgr.smithi082.hhlhmf) 2024-04-27T07:31:53.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:53.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:53 smithi100 ceph-mon[34183]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d on smithi100 2024-04-27T07:31:54.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:54 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:54.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:54 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:31:55.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:55 smithi082 ceph-mon[26613]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:55.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:55 smithi100 ceph-mon[34183]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:57.806 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:57 smithi082 ceph-mon[26613]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:57.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:57 smithi100 ceph-mon[34183]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:31:59.778 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:31:59 smithi100 ceph-mon[34183]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:59.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:31:59 smithi082 ceph-mon[26613]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:31:59.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.912+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/1725952429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 msgr2=0x7f1ff8102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:59.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.912+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/1725952429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff8102330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1fec004940 tx=0x7f1fec009e30 comp rx=0 tx=0).stop 2024-04-27T07:31:59.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/1725952429 shutdown_connections 2024-04-27T07:31:59.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/1725952429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff8102330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/1725952429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/1725952429 >> 172.21.15.82:0/1725952429 conn(0x7f1ff80f7420 msgr2=0x7f1ff80f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:31:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/1725952429 shutdown_connections 2024-04-27T07:31:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/1725952429 wait complete. 2024-04-27T07:31:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.913+0000 7f1ffe5ef700 1 Processor -- start 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ffe5ef700 1 -- start start 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ffe5ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ffe5ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ff7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:52006/0 (socket says 172.21.15.82:52006) 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47502/0 (socket says 172.21.15.82:47502) 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ffe5ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80fd7d0 con 0x7f1ff80fff10 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ffe5ef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80fbe10 con 0x7f1ff8066ed0 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.914+0000 7f1ff7fff700 1 -- 172.21.15.82:0/826729725 learned_addr learned my addr 172.21.15.82:0/826729725 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:31:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.915+0000 7f1ff7fff700 1 -- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 msgr2=0x7f1ff80fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.915+0000 7f1ff7fff700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.915+0000 7f1ff7fff700 1 -- 172.21.15.82:0/826729725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec005040 con 0x7f1ff8066ed0 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.915+0000 7f1ff77fe700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.915+0000 7f1ff7fff700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800eb40 tx=0x7f1fe800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.916+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fe8007cc0 con 0x7f1ff8066ed0 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.916+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff80fc090 con 0x7f1ff8066ed0 2024-04-27T07:31:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.916+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff80fc5d0 con 0x7f1ff8066ed0 2024-04-27T07:31:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.916+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fe800f040 con 0x7f1ff8066ed0 2024-04-27T07:31:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.916+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fe800c9d0 con 0x7f1ff8066ed0 2024-04-27T07:31:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.917+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe40052e0 con 0x7f1ff8066ed0 2024-04-27T07:31:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.918+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1fe800cc40 con 0x7f1ff8066ed0 2024-04-27T07:31:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.919+0000 7f1ff4ff9700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 0x7f1fe006b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:31:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.919+0000 7f1ff77fe700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 0x7f1fe006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:31:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.919+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1fe8086c60 con 0x7f1ff8066ed0 2024-04-27T07:31:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.919+0000 7f1ff77fe700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 0x7f1fe006b540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0137b0 tx=0x7f1fec009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:31:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:31:59.926+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1fe8056ad0 con 0x7f1ff8066ed0 2024-04-27T07:32:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.175+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fe4000bf0 con 0x7f1fe0069090 2024-04-27T07:32:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.177+0000 7f1ff4ff9700 1 -- 172.21.15.82:0/826729725 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f1fe4000bf0 con 0x7f1fe0069090 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 msgr2=0x7f1fe006b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 0x7f1fe006b540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0137b0 tx=0x7f1fec009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 msgr2=0x7f1ff80fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800eb40 tx=0x7f1fe800b040 comp rx=0 tx=0).stop 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 shutdown_connections 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.179+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f1fe0069090 0x7f1fe006b540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.180+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ff8066ed0 0x7f1ff80fd1d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.180+0000 7f1ffe5ef700 1 --2- 172.21.15.82:0/826729725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ff80fff10 0x7f1ff80fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.180+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 >> 172.21.15.82:0/826729725 conn(0x7f1ff80f7420 msgr2=0x7f1ff80f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:00.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.180+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 shutdown_connections 2024-04-27T07:32:00.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.180+0000 7f1ffe5ef700 1 -- 172.21.15.82:0/826729725 wait complete. 2024-04-27T07:32:00.195 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:32:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- 172.21.15.82:0/1913640351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fcf70 msgr2=0x7f83b40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 --2- 172.21.15.82:0/1913640351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fcf70 0x7f83b40fd3e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f839c004940 tx=0x7f839c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- 172.21.15.82:0/1913640351 shutdown_connections 2024-04-27T07:32:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 --2- 172.21.15.82:0/1913640351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fcf70 0x7f83b40fd3e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 --2- 172.21.15.82:0/1913640351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fbcc0 0x7f83b40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- 172.21.15.82:0/1913640351 >> 172.21.15.82:0/1913640351 conn(0x7f83b40f7420 msgr2=0x7f83b40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- 172.21.15.82:0/1913640351 shutdown_connections 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- 172.21.15.82:0/1913640351 wait complete. 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 Processor -- start 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.309+0000 7f83ba150700 1 -- start start 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83ba150700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83ba150700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fcf70 0x7f83b40fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83ba150700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40fe840 con 0x7f83b40fbcc0 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83ba150700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40fe980 con 0x7f83b40fcf70 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47520/0 (socket says 172.21.15.82:47520) 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 -- 172.21.15.82:0/1537502752 learned_addr learned my addr 172.21.15.82:0/1537502752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83abfff700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fcf70 0x7f83b40fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 -- 172.21.15.82:0/1537502752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fcf70 msgr2=0x7f83b40fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fcf70 0x7f83b40fe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 -- 172.21.15.82:0/1537502752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c005040 con 0x7f83b40fbcc0 2024-04-27T07:32:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.310+0000 7f83b37fe700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83a400eb40 tx=0x7f83a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.311+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a4007cc0 con 0x7f83b40fbcc0 2024-04-27T07:32:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.311+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83a400f040 con 0x7f83b40fbcc0 2024-04-27T07:32:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.311+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a400ca10 con 0x7f83b40fbcc0 2024-04-27T07:32:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.311+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40fec00 con 0x7f83b40fbcc0 2024-04-27T07:32:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.311+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b40ff0c0 con 0x7f83b40fbcc0 2024-04-27T07:32:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.312+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4101b00 con 0x7f83b40fbcc0 2024-04-27T07:32:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.313+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f83a400cc80 con 0x7f83b40fbcc0 2024-04-27T07:32:00.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.313+0000 7f83b0ff9700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 0x7f83a006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.313+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f83a4086960 con 0x7f83b40fbcc0 2024-04-27T07:32:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.314+0000 7f83abfff700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 0x7f83a006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.314+0000 7f83abfff700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 0x7f83a006b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f839c009b30 tx=0x7f839c009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.321+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f83a4052c10 con 0x7f83b40fbcc0 2024-04-27T07:32:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.639+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b405e3a0 con 0x7f83a00692a0 2024-04-27T07:32:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.640+0000 7f83b0ff9700 1 -- 172.21.15.82:0/1537502752 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f83b405e3a0 con 0x7f83a00692a0 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 msgr2=0x7f83a006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 0x7f83a006b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f839c009b30 tx=0x7f839c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 msgr2=0x7f83b40ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83a400eb40 tx=0x7f83a400b040 comp rx=0 tx=0).stop 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 shutdown_connections 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f83a00692a0 0x7f83a006b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b40fbcc0 0x7f83b40ffd90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 --2- 172.21.15.82:0/1537502752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83b40fcf70 0x7f83b40fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 >> 172.21.15.82:0/1537502752 conn(0x7f83b40f7420 msgr2=0x7f83b4066360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:00.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 shutdown_connections 2024-04-27T07:32:00.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.643+0000 7f83ba150700 1 -- 172.21.15.82:0/1537502752 wait complete. 2024-04-27T07:32:00.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 -- 172.21.15.82:0/3894319082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec0ffef0 msgr2=0x7fa6ec102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 --2- 172.21.15.82:0/3894319082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec102310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8004940 tx=0x7fa6d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 -- 172.21.15.82:0/3894319082 shutdown_connections 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 --2- 172.21.15.82:0/3894319082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec102310 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 --2- 172.21.15.82:0/3894319082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 -- 172.21.15.82:0/3894319082 >> 172.21.15.82:0/3894319082 conn(0x7fa6ec0f7420 msgr2=0x7fa6ec0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 -- 172.21.15.82:0/3894319082 shutdown_connections 2024-04-27T07:32:00.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.746+0000 7fa6f3166700 1 -- 172.21.15.82:0/3894319082 wait complete. 2024-04-27T07:32:00.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.747+0000 7fa6f3166700 1 Processor -- start 2024-04-27T07:32:00.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.747+0000 7fa6f3166700 1 -- start start 2024-04-27T07:32:00.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f3166700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f3166700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec0fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f3166700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0fbe60 con 0x7fa6ec066b50 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f3166700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0fbfd0 con 0x7fa6ec0ffef0 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47542/0 (socket says 172.21.15.82:47542) 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 -- 172.21.15.82:0/897777147 learned_addr learned my addr 172.21.15.82:0/897777147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6ebfff700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec0fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 -- 172.21.15.82:0/897777147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec0ffef0 msgr2=0x7fa6ec0fb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec0fb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 -- 172.21.15.82:0/897777147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8005040 con 0x7fa6ec066b50 2024-04-27T07:32:00.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.748+0000 7fa6f0f02700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000eb40 tx=0x7fa6e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.749+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6e0007cc0 con 0x7fa6ec066b50 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.749+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6e000f040 con 0x7fa6ec066b50 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.749+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6e000c9d0 con 0x7fa6ec066b50 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.749+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec0fc250 con 0x7fa6ec066b50 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.749+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec115a20 con 0x7fa6ec066b50 2024-04-27T07:32:00.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.750+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec05f5c0 con 0x7fa6ec066b50 2024-04-27T07:32:00.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.751+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa6e000cb30 con 0x7fa6ec066b50 2024-04-27T07:32:00.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.751+0000 7fa6e97fa700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 0x7fa6dc06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:00.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.752+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa6e0086b00 con 0x7fa6ec066b50 2024-04-27T07:32:00.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.752+0000 7fa6ebfff700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 0x7fa6dc06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:00.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.752+0000 7fa6ebfff700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 0x7fa6dc06b810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800b0d0 tx=0x7fa6d8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:00.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.756+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa6e004e250 con 0x7fa6ec066b50 2024-04-27T07:32:00.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.960+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6ec0f8f60 con 0x7fa6dc069360 2024-04-27T07:32:00.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.969+0000 7fa6e97fa700 1 -- 172.21.15.82:0/897777147 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fa6ec0f8f60 con 0x7fa6dc069360 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (5m) 66s ago 6m 24.5M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 66s ago 7m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (6m) 73s ago 6m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (5m) 66s ago 6m 86.1M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (86s) 66s ago 85s 14.7M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (91s) 66s ago 90s 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (83s) 73s ago 83s 12.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (88s) 73s ago 88s 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (8m) 66s ago 8m 480M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (5m) 73s ago 5m 433M - 17.2.7-907-g2be3efa9 1c5834633715 0b4b06a0de83 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 66s ago 8m 46.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (5m) 73s ago 5m 36.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:32:00.972 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 66s ago 7m 15.4M - 1.5.0 0da6a335fe13 2d9c1f85828b 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 73s ago 6m 16.5M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 66s ago 5m 48.3M 4288M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 66s ago 4m 48.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (4m) 66s ago 4m 44.6M 4288M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (3m) 73s ago 3m 45.3M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (3m) 73s ago 3m 42.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (2m) 73s ago 2m 42.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:32:00.973 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 66s ago 6m 52.5M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:32:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 msgr2=0x7fa6dc06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 0x7fa6dc06b810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800b0d0 tx=0x7fa6d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 msgr2=0x7fa6ec0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000eb40 tx=0x7fa6e000b040 comp rx=0 tx=0).stop 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 shutdown_connections 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fa6dc069360 0x7fa6dc06b810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6ec066b50 0x7fa6ec0fd3e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 --2- 172.21.15.82:0/897777147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6ec0ffef0 0x7fa6ec0fb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 >> 172.21.15.82:0/897777147 conn(0x7fa6ec0f7420 msgr2=0x7fa6ec0f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 shutdown_connections 2024-04-27T07:32:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:00.973+0000 7fa6f3166700 1 -- 172.21.15.82:0/897777147 wait complete. 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 -- 172.21.15.82:0/1483846036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790071de0 msgr2=0x7fb7900702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 --2- 172.21.15.82:0/1483846036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790071de0 0x7fb7900702f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb78c004940 tx=0x7fb78c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 -- 172.21.15.82:0/1483846036 shutdown_connections 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 --2- 172.21.15.82:0/1483846036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790070830 0x7fb790070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 --2- 172.21.15.82:0/1483846036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790071de0 0x7fb7900702f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.101+0000 7fb79863a700 1 -- 172.21.15.82:0/1483846036 >> 172.21.15.82:0/1483846036 conn(0x7fb7900f8590 msgr2=0x7fb7900fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.102+0000 7fb79863a700 1 -- 172.21.15.82:0/1483846036 shutdown_connections 2024-04-27T07:32:01.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.102+0000 7fb79863a700 1 -- 172.21.15.82:0/1483846036 wait complete. 2024-04-27T07:32:01.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.102+0000 7fb79863a700 1 Processor -- start 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.102+0000 7fb79863a700 1 -- start start 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.102+0000 7fb79863a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb79863a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790071de0 0x7fb790110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb79863a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790110710 con 0x7fb790070830 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb79863a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790110f60 con 0x7fb790071de0 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47550/0 (socket says 172.21.15.82:47550) 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 -- 172.21.15.82:0/1735047248 learned_addr learned my addr 172.21.15.82:0/1735047248 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb795bd5700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790071de0 0x7fb790110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 -- 172.21.15.82:0/1735047248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790071de0 msgr2=0x7fb790110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790071de0 0x7fb790110110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 -- 172.21.15.82:0/1735047248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c005040 con 0x7fb790070830 2024-04-27T07:32:01.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.103+0000 7fb7963d6700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.104+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78c00e030 con 0x7fb790070830 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.104+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7901111e0 con 0x7fb790070830 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.104+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb78c009430 con 0x7fb790070830 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.104+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78c00b410 con 0x7fb790070830 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.104+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb790111720 con 0x7fb790070830 2024-04-27T07:32:01.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.105+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79005f5c0 con 0x7fb790070830 2024-04-27T07:32:01.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.106+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fb78c013af0 con 0x7fb790070830 2024-04-27T07:32:01.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.106+0000 7fb786ffd700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 0x7fb77c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.106+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb78c0885b0 con 0x7fb790070830 2024-04-27T07:32:01.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.107+0000 7fb795bd5700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 0x7fb77c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.107+0000 7fb795bd5700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 0x7fb77c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb780009b80 tx=0x7fb78000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.115+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb78c058410 con 0x7fb790070830 2024-04-27T07:32:01.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.397+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb790111990 con 0x7fb790070830 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.398+0000 7fb786ffd700 1 -- 172.21.15.82:0/1735047248 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fb78c057fa0 con 0x7fb790070830 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:01.400 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:32:01.401 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 msgr2=0x7fb77c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 0x7fb77c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb780009b80 tx=0x7fb78000b040 comp rx=0 tx=0).stop 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 msgr2=0x7fb79010fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 shutdown_connections 2024-04-27T07:32:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fb77c0692a0 0x7fb77c06b750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb790070830 0x7fb79010fbd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 --2- 172.21.15.82:0/1735047248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb790071de0 0x7fb790110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 >> 172.21.15.82:0/1735047248 conn(0x7fb7900f8590 msgr2=0x7fb7900f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:01.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 shutdown_connections 2024-04-27T07:32:01.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.401+0000 7fb79863a700 1 -- 172.21.15.82:0/1735047248 wait complete. 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 -- 172.21.15.82:0/3625219083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fedb0 msgr2=0x7f9db40faef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 --2- 172.21.15.82:0/3625219083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fedb0 0x7f9db40faef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9da8004940 tx=0x7f9da8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 -- 172.21.15.82:0/3625219083 shutdown_connections 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 --2- 172.21.15.82:0/3625219083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fedb0 0x7f9db40faef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 --2- 172.21.15.82:0/3625219083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fe460 0x7f9db40fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 -- 172.21.15.82:0/3625219083 >> 172.21.15.82:0/3625219083 conn(0x7f9db40f6b80 msgr2=0x7f9db40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 -- 172.21.15.82:0/3625219083 shutdown_connections 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.523+0000 7f9db998f700 1 -- 172.21.15.82:0/3625219083 wait complete. 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 Processor -- start 2024-04-27T07:32:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 -- start start 2024-04-27T07:32:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fedb0 0x7f9db410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db410e4f0 con 0x7f9db40fe460 2024-04-27T07:32:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db998f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db410ecf0 con 0x7f9db40fedb0 2024-04-27T07:32:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47568/0 (socket says 172.21.15.82:47568) 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db2ffd700 1 -- 172.21.15.82:0/2561852055 learned_addr learned my addr 172.21.15.82:0/2561852055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.524+0000 7f9db27fc700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fedb0 0x7f9db410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db2ffd700 1 -- 172.21.15.82:0/2561852055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fedb0 msgr2=0x7f9db410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db2ffd700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fedb0 0x7f9db410def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db2ffd700 1 -- 172.21.15.82:0/2561852055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8005040 con 0x7f9db40fe460 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db2ffd700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9da400eb40 tx=0x7f9da400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da4007cc0 con 0x7f9db40fe460 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db410ef70 con 0x7f9db40fe460 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9da400f040 con 0x7f9db40fe460 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da4007cc0 con 0x7f9db40fe460 2024-04-27T07:32:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.525+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db410f4b0 con 0x7f9db40fe460 2024-04-27T07:32:01.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.526+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db405f5c0 con 0x7f9db40fe460 2024-04-27T07:32:01.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.528+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9da40090d0 con 0x7f9db40fe460 2024-04-27T07:32:01.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.528+0000 7f9d9b7fe700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 0x7f9d9c06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.528+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9da4086c30 con 0x7f9db40fe460 2024-04-27T07:32:01.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.529+0000 7f9db27fc700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 0x7f9d9c06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.529+0000 7f9db27fc700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 0x7f9d9c06fc70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009b30 tx=0x7f9da8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.532+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9da4056a00 con 0x7f9db40fe460 2024-04-27T07:32:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.782+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9db4105890 con 0x7f9db40fe460 2024-04-27T07:32:01.785 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:01 smithi082 ceph-mon[26613]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.785 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:01 smithi082 ceph-mon[26613]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:01.785 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:01 smithi082 ceph-mon[26613]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.785 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:01 smithi082 ceph-mon[26613]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.785 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:01 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1735047248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.783+0000 7f9d9b7fe700 1 -- 172.21.15.82:0/2561852055 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1828 (secure 0 0 0) 0x7f9da4056590 con 0x7f9db40fe460 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stdout:e15 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:32:01.786 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 15 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:30:41.984913+0000 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:32:01.787 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:32:01.788 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:01.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 msgr2=0x7f9d9c06fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 0x7f9d9c06fc70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009b30 tx=0x7f9da8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 msgr2=0x7f9db410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9da400eb40 tx=0x7f9da400b040 comp rx=0 tx=0).stop 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 shutdown_connections 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f9d9c06d7c0 0x7f9d9c06fc70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db40fe460 0x7f9db410d9b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 --2- 172.21.15.82:0/2561852055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db40fedb0 0x7f9db410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 >> 172.21.15.82:0/2561852055 conn(0x7f9db40f6b80 msgr2=0x7f9db40f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 shutdown_connections 2024-04-27T07:32:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.785+0000 7f9db998f700 1 -- 172.21.15.82:0/2561852055 wait complete. 2024-04-27T07:32:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 -- 172.21.15.82:0/3990939076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 msgr2=0x7f30e40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 --2- 172.21.15.82:0/3990939076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e40fd3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f30d8004940 tx=0x7f30d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 -- 172.21.15.82:0/3990939076 shutdown_connections 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 --2- 172.21.15.82:0/3990939076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e40fd3e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 --2- 172.21.15.82:0/3990939076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 -- 172.21.15.82:0/3990939076 >> 172.21.15.82:0/3990939076 conn(0x7f30e40f7440 msgr2=0x7f30e40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 -- 172.21.15.82:0/3990939076 shutdown_connections 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.894+0000 7f30e893c700 1 -- 172.21.15.82:0/3990939076 wait complete. 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 Processor -- start 2024-04-27T07:32:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 -- start start 2024-04-27T07:32:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e4110490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41109d0 con 0x7f30e40fcf70 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e893c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4110b40 con 0x7f30e40fbcc0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e1d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e4110490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:52110/0 (socket says 172.21.15.82:52110) 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.895+0000 7f30e259c700 1 -- 172.21.15.82:0/3159860267 learned_addr learned my addr 172.21.15.82:0/3159860267 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e259c700 1 -- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 msgr2=0x7f30e4110490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e259c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e4110490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e259c700 1 -- 172.21.15.82:0/3159860267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8005040 con 0x7f30e40fbcc0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e1d9b700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e4110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e259c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30d400eb40 tx=0x7f30d400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d4007cc0 con 0x7f30e40fbcc0 2024-04-27T07:32:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4110dc0 con 0x7f30e40fbcc0 2024-04-27T07:32:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30d400f040 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d400ca10 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.896+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e4111240 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.897+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e404c710 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.898+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f30d400cc80 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.898+0000 7f30d2ffd700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 0x7f30cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.898+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f30d4086d90 con 0x7f30e40fbcc0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.898+0000 7f30e1d9b700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 0x7f30cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.899+0000 7f30e1d9b700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 0x7f30cc06b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b0d0 tx=0x7f30d8009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:01.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:01.906+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f30d404e250 con 0x7f30e40fbcc0 2024-04-27T07:32:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:01 smithi100 ceph-mon[34183]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:01 smithi100 ceph-mon[34183]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:01 smithi100 ceph-mon[34183]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:01 smithi100 ceph-mon[34183]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:01 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1735047248' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:32:02.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.285+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30e4101240 con 0x7f30cc0692a0 2024-04-27T07:32:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.287+0000 7f30d2ffd700 1 -- 172.21.15.82:0/3159860267 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f30e4101240 con 0x7f30cc0692a0 2024-04-27T07:32:02.289 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:32:02.289 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:32:02.289 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "0/21 daemons upgraded", 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d image on host smithi100", 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:32:02.290 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:32:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 msgr2=0x7f30cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 0x7f30cc06b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b0d0 tx=0x7f30d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 msgr2=0x7f30e4066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f30d400eb40 tx=0x7f30d400b040 comp rx=0 tx=0).stop 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 shutdown_connections 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f30cc0692a0 0x7f30cc06b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e40fbcc0 0x7f30e4066cd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 --2- 172.21.15.82:0/3159860267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e40fcf70 0x7f30e4110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 >> 172.21.15.82:0/3159860267 conn(0x7f30e40f7440 msgr2=0x7f30e40f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.290+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 shutdown_connections 2024-04-27T07:32:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.291+0000 7f30e893c700 1 -- 172.21.15.82:0/3159860267 wait complete. 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 -- 172.21.15.82:0/3248242275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fbcb0 msgr2=0x7ff9f80fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/3248242275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f80fc0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8004940 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 -- 172.21.15.82:0/3248242275 shutdown_connections 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/3248242275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fcf60 0x7ff9f80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/3248242275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f80fc0c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 -- 172.21.15.82:0/3248242275 >> 172.21.15.82:0/3248242275 conn(0x7ff9f80f7430 msgr2=0x7ff9f80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:02.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 -- 172.21.15.82:0/3248242275 shutdown_connections 2024-04-27T07:32:02.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.451+0000 7ff9fe50d700 1 -- 172.21.15.82:0/3248242275 wait complete. 2024-04-27T07:32:02.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.452+0000 7ff9fe50d700 1 Processor -- start 2024-04-27T07:32:02.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.452+0000 7ff9fe50d700 1 -- start start 2024-04-27T07:32:02.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9fe50d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:02.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9fe50d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fcf60 0x7ff9f810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:02.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9fe50d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810e4e0 con 0x7ff9f80fcf60 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9fe50d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810e650 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:52120/0 (socket says 172.21.15.82:52120) 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 -- 172.21.15.82:0/933775049 learned_addr learned my addr 172.21.15.82:0/933775049 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fcf60 0x7ff9f810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 -- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fcf60 msgr2=0x7ff9f810dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fcf60 0x7ff9f810dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 -- 172.21.15.82:0/933775049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e8005040 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.453+0000 7ff9f7fff700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8013870 tx=0x7ff9e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.454+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800e070 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.454+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f80fe180 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.454+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9e8009430 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.454+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f80fe6c0 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.454+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800b9f0 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.455+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e40052b0 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.456+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff9e8028030 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.456+0000 7ff9f4ff9700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 0x7ff9e006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.456+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff9e8090a60 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.456+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 0x7ff9e006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.457+0000 7ff9f77fe700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 0x7ff9e006b820 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009b80 tx=0x7ff9ec00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:02.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.465+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff9e8060800 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:02 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2561852055' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:32:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.748+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9e4005560 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.749+0000 7ff9f4ff9700 1 -- 172.21.15.82:0/933775049 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff9e8030020 con 0x7ff9f80fbcb0 2024-04-27T07:32:02.751 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:32:02.751 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:32:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:32:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 msgr2=0x7ff9e006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 0x7ff9e006b820 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009b80 tx=0x7ff9ec00b040 comp rx=0 tx=0).stop 2024-04-27T07:32:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 msgr2=0x7ff9f810d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8013870 tx=0x7ff9e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 shutdown_connections 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7ff9e0069370 0x7ff9e006b820 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f80fbcb0 0x7ff9f810d9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 --2- 172.21.15.82:0/933775049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f80fcf60 0x7ff9f810dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 >> 172.21.15.82:0/933775049 conn(0x7ff9f80f7430 msgr2=0x7ff9f80667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.751+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 shutdown_connections 2024-04-27T07:32:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:02.752+0000 7ff9fe50d700 1 -- 172.21.15.82:0/933775049 wait complete. 2024-04-27T07:32:02.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:02 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2561852055' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:32:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:03 smithi082 ceph-mon[26613]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:03 smithi082 ceph-mon[26613]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:03.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:03 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/933775049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:32:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:03 smithi100 ceph-mon[34183]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:03 smithi100 ceph-mon[34183]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:03.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:03 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/933775049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:32:05.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:05 smithi082 ceph-mon[26613]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:05 smithi100 ceph-mon[34183]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:07.806 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:07 smithi082 ceph-mon[26613]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:07 smithi100 ceph-mon[34183]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:08 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:08 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:09.778 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:09 smithi100 ceph-mon[34183]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:09 smithi082 ceph-mon[26613]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:11.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:11 smithi082 ceph-mon[26613]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:11.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:11 smithi100 ceph-mon[34183]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:13.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:13 smithi082 ceph-mon[26613]: pgmap v231: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:13.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:13 smithi100 ceph-mon[34183]: pgmap v231: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:15 smithi082 ceph-mon[26613]: pgmap v232: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:15.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:15 smithi100 ceph-mon[34183]: pgmap v232: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:17.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:17 smithi082 ceph-mon[26613]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:17.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:17 smithi100 ceph-mon[34183]: pgmap v233: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:19.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:19 smithi100 ceph-mon[34183]: pgmap v234: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:19.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:19 smithi082 ceph-mon[26613]: pgmap v234: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:21.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:21 smithi082 ceph-mon[26613]: pgmap v235: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:21.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:21 smithi100 ceph-mon[34183]: pgmap v235: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to '4e213a58e787437ff508e6c890ccd5fd32dc96b5'. 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-27T07:32:23.233 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-04-27T07:32:23.234 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at 4e213a58e78 Merge pull request #57057 from adk3798/no-downgrade 2024-04-27T07:32:23.236 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-27T07:32:23.266 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-27T07:32:23.268 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-27T07:32:23.269 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-27T07:32:23.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:23 smithi082 ceph-mon[26613]: pgmap v236: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:23.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:23 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:23.882 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-27T07:32:23.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:23 smithi100 ceph-mon[34183]: pgmap v236: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:32:23.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:23 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:23.933 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-27T07:32:23.972 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-27T07:32:23.973 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-27T07:32:23.974 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-27T07:32:24.012 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-27T07:32:24.015 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:32:24.015 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-27T07:32:24.071 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-27T07:32:24.073 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-27T07:32:24.073 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e213a58e787437ff508e6c890ccd5fd32dc96b5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-27T07:32:24.136 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir -p fsstress 2024-04-27T07:32:24.138 INFO:tasks.workunit.client.0.smithi082.stderr:+ pushd fsstress 2024-04-27T07:32:24.139 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-27T07:32:24.139 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-27T07:32:24.657 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar xzf ltp-full.tgz 2024-04-27T07:32:25.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:25 smithi082 ceph-mon[26613]: pgmap v237: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:25.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:25 smithi100 ceph-mon[34183]: pgmap v237: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:32:27.654 INFO:tasks.workunit.client.1.smithi100.stderr:Updating files: 96% (12075/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-27T07:32:27.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: pgmap v238: 65 pgs: 65 active+clean; 5.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 398 KiB/s wr, 10 op/s 2024-04-27T07:32:27.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: Upgrade: Updating mgr.smithi100.eparbe 2024-04-27T07:32:27.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:27.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:32:27.806 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:32:27.806 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:32:27.806 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:27 smithi082 ceph-mon[26613]: Deploying daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: pgmap v238: 65 pgs: 65 active+clean; 5.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 398 KiB/s wr, 10 op/s 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: Upgrade: Updating mgr.smithi100.eparbe 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:32:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:27 smithi100 ceph-mon[34183]: Deploying daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:32:28.192 INFO:tasks.workunit.client.1.smithi100.stderr:Note: switching to '4e213a58e787437ff508e6c890ccd5fd32dc96b5'. 2024-04-27T07:32:28.192 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.192 INFO:tasks.workunit.client.1.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-27T07:32:28.192 INFO:tasks.workunit.client.1.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-27T07:32:28.192 INFO:tasks.workunit.client.1.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: git switch -c 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr:Or undo this operation with: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: git switch - 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr: 2024-04-27T07:32:28.193 INFO:tasks.workunit.client.1.smithi100.stderr:HEAD is now at 4e213a58e78 Merge pull request #57057 from adk3798/no-downgrade 2024-04-27T07:32:28.194 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-27T07:32:28.259 INFO:tasks.workunit.client.1.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-27T07:32:28.261 INFO:tasks.workunit.client.1.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-27T07:32:28.261 INFO:tasks.workunit.client.1.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-27T07:32:29.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:29 smithi100 ceph-mon[34183]: pgmap v239: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.0 MiB/s wr, 32 op/s 2024-04-27T07:32:29.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:29 smithi082 ceph-mon[26613]: pgmap v239: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.0 MiB/s wr, 32 op/s 2024-04-27T07:32:31.792 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:31 smithi100 ceph-mon[34183]: pgmap v240: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 42 op/s 2024-04-27T07:32:31.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:31 smithi082 ceph-mon[26613]: pgmap v240: 65 pgs: 65 active+clean; 14 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 1.1 MiB/s wr, 42 op/s 2024-04-27T07:32:32.329 INFO:tasks.workunit.client.1.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-27T07:32:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 -- 172.21.15.82:0/1621948171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 msgr2=0x7f37f80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/1621948171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f80ff9a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f37e8004940 tx=0x7f37e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 -- 172.21.15.82:0/1621948171 shutdown_connections 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/1621948171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 0x7f37f8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/1621948171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f80ff9a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 -- 172.21.15.82:0/1621948171 >> 172.21.15.82:0/1621948171 conn(0x7f37f80f7430 msgr2=0x7f37f80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 -- 172.21.15.82:0/1621948171 shutdown_connections 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 -- 172.21.15.82:0/1621948171 wait complete. 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.878+0000 7f37fdf3f700 1 Processor -- start 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37fdf3f700 1 -- start start 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37fdf3f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37fdf3f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 0x7f37f810dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37fdf3f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f810e640 con 0x7f37f80662c0 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37fdf3f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f810ede0 con 0x7f37f80ffee0 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48352/0 (socket says 172.21.15.82:48352) 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 -- 172.21.15.82:0/2191381020 learned_addr learned my addr 172.21.15.82:0/2191381020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f6ffd700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 0x7f37f810dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 -- 172.21.15.82:0/2191381020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 msgr2=0x7f37f810dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 0x7f37f810dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 -- 172.21.15.82:0/2191381020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8005040 con 0x7f37f80662c0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.879+0000 7f37f77fe700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37e800b3b0 tx=0x7f37e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.880+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37e800e040 con 0x7f37f80662c0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.880+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f810f060 con 0x7f37f80662c0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.880+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f37e800bcc0 con 0x7f37f80662c0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.880+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37e801c630 con 0x7f37f80662c0 2024-04-27T07:32:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.880+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f810f620 con 0x7f37f80662c0 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.881+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f805f5c0 con 0x7f37f80662c0 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.881+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f37e80139f0 con 0x7f37f80662c0 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.882+0000 7f37dffff700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 0x7f37e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.882+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f37e8087fa0 con 0x7f37f80662c0 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.882+0000 7f37f6ffd700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 0x7f37e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.882+0000 7f37f6ffd700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 0x7f37e006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006fd0 tx=0x7f37ec008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:32.890+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f37e8057d60 con 0x7f37f80662c0 2024-04-27T07:32:32.964 INFO:tasks.workunit.client.1.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-27T07:32:33.134 INFO:tasks.workunit.client.1.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-27T07:32:33.136 INFO:tasks.workunit.client.1.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-27T07:32:33.136 INFO:tasks.workunit.client.1.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-27T07:32:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.178+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37f810f900 con 0x7f37e00692a0 2024-04-27T07:32:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.180+0000 7f37dffff700 1 -- 172.21.15.82:0/2191381020 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f37f810f900 con 0x7f37e00692a0 2024-04-27T07:32:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 msgr2=0x7f37e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 0x7f37e006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006fd0 tx=0x7f37ec008040 comp rx=0 tx=0).stop 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 msgr2=0x7f37f810da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37e800b3b0 tx=0x7f37e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 shutdown_connections 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f37e00692a0 0x7f37e006b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37f80662c0 0x7f37f810da70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 --2- 172.21.15.82:0/2191381020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f80ffee0 0x7f37f810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 >> 172.21.15.82:0/2191381020 conn(0x7f37f80f7430 msgr2=0x7f37f80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 shutdown_connections 2024-04-27T07:32:33.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.182+0000 7f37fdf3f700 1 -- 172.21.15.82:0/2191381020 wait complete. 2024-04-27T07:32:33.196 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- 172.21.15.82:0/1295274035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c066260 msgr2=0x7f500c0ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 --2- 172.21.15.82:0/1295274035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c066260 0x7f500c0ffa00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5008004940 tx=0x7f5008009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- 172.21.15.82:0/1295274035 shutdown_connections 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 --2- 172.21.15.82:0/1295274035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c0fff40 0x7f500c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 --2- 172.21.15.82:0/1295274035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c066260 0x7f500c0ffa00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- 172.21.15.82:0/1295274035 >> 172.21.15.82:0/1295274035 conn(0x7f500c0f7430 msgr2=0x7f500c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- 172.21.15.82:0/1295274035 shutdown_connections 2024-04-27T07:32:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- 172.21.15.82:0/1295274035 wait complete. 2024-04-27T07:32:33.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 Processor -- start 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 -- start start 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.306+0000 7f50141e2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c066260 0x7f500c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50141e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50141e2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c10e540 con 0x7f500c0fff40 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50141e2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c10ed40 con 0x7f500c066260 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48384/0 (socket says 172.21.15.82:48384) 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 -- 172.21.15.82:0/3750768844 learned_addr learned my addr 172.21.15.82:0/3750768844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f5011f7e700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c066260 0x7f500c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 -- 172.21.15.82:0/3750768844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c066260 msgr2=0x7f500c10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c066260 0x7f500c10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 -- 172.21.15.82:0/3750768844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008005040 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f501177d700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc002a80 tx=0x7f4ffc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc007cc0 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c10f020 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ffc00f040 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ffc0096f0 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.307+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c10f560 con 0x7f500c0fff40 2024-04-27T07:32:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.308+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c05f5c0 con 0x7f500c0fff40 2024-04-27T07:32:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.310+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4ffc00d690 con 0x7f500c0fff40 2024-04-27T07:32:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.310+0000 7f50027fc700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 0x7f4ff806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.310+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4ffc086880 con 0x7f500c0fff40 2024-04-27T07:32:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.310+0000 7f5011f7e700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 0x7f4ff806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.311+0000 7f5011f7e700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 0x7f4ff806b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f500800b970 tx=0x7f5008009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:33.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.315+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4ffc04d250 con 0x7f500c0fff40 2024-04-27T07:32:33.341 INFO:tasks.workunit.client.1.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-27T07:32:33.345 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-27T07:32:33.345 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-27T07:32:33.401 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-27T07:32:33.402 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-27T07:32:33.403 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e213a58e787437ff508e6c890ccd5fd32dc96b5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-27T07:32:33.465 INFO:tasks.workunit.client.1.smithi100.stderr:+ mkdir -p fsstress 2024-04-27T07:32:33.468 INFO:tasks.workunit.client.1.smithi100.stderr:+ pushd fsstress 2024-04-27T07:32:33.469 INFO:tasks.workunit.client.1.smithi100.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-27T07:32:33.469 INFO:tasks.workunit.client.1.smithi100.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-27T07:32:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.566+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f500c10f9a0 con 0x7f4ff80692a0 2024-04-27T07:32:33.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.568+0000 7f50027fc700 1 -- 172.21.15.82:0/3750768844 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f500c10f9a0 con 0x7f4ff80692a0 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 msgr2=0x7f4ff806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 0x7f4ff806b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f500800b970 tx=0x7f5008009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 msgr2=0x7f500c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc002a80 tx=0x7f4ffc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 shutdown_connections 2024-04-27T07:32:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f4ff80692a0 0x7f4ff806b750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c066260 0x7f500c10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 --2- 172.21.15.82:0/3750768844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c0fff40 0x7f500c10df40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 >> 172.21.15.82:0/3750768844 conn(0x7f500c0f7430 msgr2=0x7f500c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 shutdown_connections 2024-04-27T07:32:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.570+0000 7f50141e2700 1 -- 172.21.15.82:0/3750768844 wait complete. 2024-04-27T07:32:33.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 -- 172.21.15.82:0/1738795316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 msgr2=0x7f84500fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 --2- 172.21.15.82:0/1738795316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500fc0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8448009ce0 tx=0x7f8448004d10 comp rx=0 tx=0).stop 2024-04-27T07:32:33.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 -- 172.21.15.82:0/1738795316 shutdown_connections 2024-04-27T07:32:33.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 --2- 172.21.15.82:0/1738795316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 0x7f84500fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 --2- 172.21.15.82:0/1738795316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500fc0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 -- 172.21.15.82:0/1738795316 >> 172.21.15.82:0/1738795316 conn(0x7f84500f7430 msgr2=0x7f84500f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 -- 172.21.15.82:0/1738795316 shutdown_connections 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.693+0000 7f8455f4e700 1 -- 172.21.15.82:0/1738795316 wait complete. 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 Processor -- start 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 -- start start 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 0x7f84500fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500fe7e0 con 0x7f84500fbcb0 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f8455f4e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500fe920 con 0x7f84500fcf60 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48406/0 (socket says 172.21.15.82:48406) 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f844f7fe700 1 -- 172.21.15.82:0/4005068450 learned_addr learned my addr 172.21.15.82:0/4005068450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.694+0000 7f844effd700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 0x7f84500fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f844f7fe700 1 -- 172.21.15.82:0/4005068450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 msgr2=0x7f84500fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f844f7fe700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 0x7f84500fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f844f7fe700 1 -- 172.21.15.82:0/4005068450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009940 con 0x7f84500fbcb0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f844f7fe700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f844800bfd0 tx=0x7f8448004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800e040 con 0x7f84500fbcb0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f844801cd00 con 0x7f84500fbcb0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500feba0 con 0x7f84500fbcb0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448012c40 con 0x7f84500fbcb0 2024-04-27T07:32:33.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.695+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8450115ae0 con 0x7f84500fbcb0 2024-04-27T07:32:33.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.696+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8450101af0 con 0x7f84500fbcb0 2024-04-27T07:32:33.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.697+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f84480124a0 con 0x7f84500fbcb0 2024-04-27T07:32:33.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.697+0000 7f8437fff700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:33.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.697+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f84480894e0 con 0x7f84500fbcb0 2024-04-27T07:32:33.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.697+0000 7f844effd700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:33.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.698+0000 7f844effd700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8444009b80 tx=0x7f844400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:33.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.703+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8448055790 con 0x7f84500fbcb0 2024-04-27T07:32:33.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:33 smithi082 ceph-mon[26613]: pgmap v241: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 1.7 MiB/s wr, 75 op/s 2024-04-27T07:32:33.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:33 smithi100 ceph-mon[34183]: pgmap v241: 65 pgs: 65 active+clean; 20 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 1.7 MiB/s wr, 75 op/s 2024-04-27T07:32:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.983+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8450104890 con 0x7f84380692a0 2024-04-27T07:32:34.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:33.998+0000 7f8437fff700 1 -- 172.21.15.82:0/4005068450 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8450104890 con 0x7f84380692a0 2024-04-27T07:32:34.000 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:32:34.000 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (6m) 100s ago 7m 24.5M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:32:34.000 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 100s ago 7m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (6m) 106s ago 6m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (5m) 100s ago 7m 86.1M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (119s) 100s ago 118s 14.7M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (2m) 100s ago 2m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (116s) 106s ago 116s 12.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (2m) 106s ago 2m 14.3M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (8m) 100s ago 8m 480M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (6m) 106s ago 6m 433M - 17.2.7-907-g2be3efa9 1c5834633715 0b4b06a0de83 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 100s ago 9m 46.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (6m) 106s ago 6m 36.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 100s ago 7m 15.4M - 1.5.0 0da6a335fe13 2d9c1f85828b 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 106s ago 6m 16.5M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 100s ago 5m 48.3M 4288M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:32:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 100s ago 5m 48.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:32:34.002 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (4m) 100s ago 4m 44.6M 4288M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:32:34.002 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (4m) 106s ago 4m 45.3M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:32:34.002 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (3m) 106s ago 3m 42.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:32:34.002 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (3m) 106s ago 3m 42.1M 5312M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:32:34.002 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 100s ago 7m 52.5M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:32:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 msgr2=0x7f843806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8444009b80 tx=0x7f844400b040 comp rx=0 tx=0).stop 2024-04-27T07:32:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 msgr2=0x7f84500ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f844800bfd0 tx=0x7f8448004d10 comp rx=0 tx=0).stop 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 shutdown_connections 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.000+0000 7f8455f4e700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.001+0000 7f8455f4e700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84500fbcb0 0x7f84500ffd30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.001+0000 7f8455f4e700 1 --2- 172.21.15.82:0/4005068450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84500fcf60 0x7f84500fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.001+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 >> 172.21.15.82:0/4005068450 conn(0x7f84500f7430 msgr2=0x7f8450065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.001+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 shutdown_connections 2024-04-27T07:32:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.001+0000 7f8455f4e700 1 -- 172.21.15.82:0/4005068450 wait complete. 2024-04-27T07:32:34.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.150+0000 7fda6dd9b700 1 -- 172.21.15.82:0/2642778397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda60013b70 con 0x7fda700fbcb0 2024-04-27T07:32:34.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 -- 172.21.15.82:0/2642778397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 msgr2=0x7fda700fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 --2- 172.21.15.82:0/2642778397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda700fc0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fda60004940 tx=0x7fda60009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 -- 172.21.15.82:0/2642778397 shutdown_connections 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 --2- 172.21.15.82:0/2642778397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda700fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 --2- 172.21.15.82:0/2642778397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda700fc0c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 -- 172.21.15.82:0/2642778397 >> 172.21.15.82:0/2642778397 conn(0x7fda700f7430 msgr2=0x7fda700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 -- 172.21.15.82:0/2642778397 shutdown_connections 2024-04-27T07:32:34.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.151+0000 7fda75211700 1 -- 172.21.15.82:0/2642778397 wait complete. 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.152+0000 7fda75211700 1 Processor -- start 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.152+0000 7fda75211700 1 -- start start 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda75211700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda70105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda75211700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda75211700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70106b20 con 0x7fda700fbcb0 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda75211700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda70107370 con 0x7fda700fcf60 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:48364/0 (socket says 172.21.15.82:48364) 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 -- 172.21.15.82:0/1334932754 learned_addr learned my addr 172.21.15.82:0/1334932754 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6ed9d700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda70105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 -- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 msgr2=0x7fda70105f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda70105f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 -- 172.21.15.82:0/1334932754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60005040 con 0x7fda700fcf60 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.153+0000 7fda6e59c700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda6400eb40 tx=0x7fda6400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.154+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda64007cc0 con 0x7fda700fcf60 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.154+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda701075f0 con 0x7fda700fcf60 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.154+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda6400f040 con 0x7fda700fcf60 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.154+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda6400ca00 con 0x7fda700fcf60 2024-04-27T07:32:34.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.154+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda70107b30 con 0x7fda700fcf60 2024-04-27T07:32:34.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.155+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda701018f0 con 0x7fda700fcf60 2024-04-27T07:32:34.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.155+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fda6400cc70 con 0x7fda700fcf60 2024-04-27T07:32:34.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.156+0000 7fda577fe700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 0x7fda5806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.156+0000 7fda6ed9d700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 0x7fda5806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.156+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fda64086dd0 con 0x7fda700fcf60 2024-04-27T07:32:34.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.157+0000 7fda6ed9d700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 0x7fda5806b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda60000c00 tx=0x7fda60009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:34.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.160+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fda6404e250 con 0x7fda700fcf60 2024-04-27T07:32:34.455 INFO:tasks.workunit.client.1.smithi100.stderr:+ tar xzf ltp-full.tgz 2024-04-27T07:32:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.531+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda70104930 con 0x7fda700fcf60 2024-04-27T07:32:34.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.531+0000 7fda577fe700 1 -- 172.21.15.82:0/1334932754 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fda70104930 con 0x7fda700fcf60 2024-04-27T07:32:34.533 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:32:34.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:32:34.535 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:32:34.535 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 14 2024-04-27T07:32:34.535 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:32:34.535 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 msgr2=0x7fda5806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 0x7fda5806b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda60000c00 tx=0x7fda60009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 msgr2=0x7fda701064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda6400eb40 tx=0x7fda6400b040 comp rx=0 tx=0).stop 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 shutdown_connections 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fda580692a0 0x7fda5806b750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700fbcb0 0x7fda70105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 --2- 172.21.15.82:0/1334932754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda700fcf60 0x7fda701064d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 >> 172.21.15.82:0/1334932754 conn(0x7fda700f7430 msgr2=0x7fda700f86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:34.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 shutdown_connections 2024-04-27T07:32:34.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.533+0000 7fda75211700 1 -- 172.21.15.82:0/1334932754 wait complete. 2024-04-27T07:32:34.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 -- 172.21.15.82:0/667383309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 msgr2=0x7efdb00fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 --2- 172.21.15.82:0/667383309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb00fd290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efda0004940 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 -- 172.21.15.82:0/667383309 shutdown_connections 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 --2- 172.21.15.82:0/667383309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb00fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 --2- 172.21.15.82:0/667383309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb00fd290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 -- 172.21.15.82:0/667383309 >> 172.21.15.82:0/667383309 conn(0x7efdb00f8520 msgr2=0x7efdb00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 -- 172.21.15.82:0/667383309 shutdown_connections 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.663+0000 7efdb665d700 1 -- 172.21.15.82:0/667383309 wait complete. 2024-04-27T07:32:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 Processor -- start 2024-04-27T07:32:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 -- start start 2024-04-27T07:32:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01106d0 con 0x7efdb00fce80 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdb665d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0110f20 con 0x7efdb00fdff0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdaf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdaf7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:48384/0 (socket says 172.21.15.82:48384) 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.664+0000 7efdaf7fe700 1 -- 172.21.15.82:0/3631181148 learned_addr learned my addr 172.21.15.82:0/3631181148 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdaffff700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdaf7fe700 1 -- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 msgr2=0x7efdb010fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdaf7fe700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb010fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdaf7fe700 1 -- 172.21.15.82:0/3631181148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0005040 con 0x7efdb00fdff0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdaf7fe700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd9800eb40 tx=0x7efd9800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd98007cc0 con 0x7efdb00fdff0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb01111a0 con 0x7efdb00fdff0 2024-04-27T07:32:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd9800f040 con 0x7efdb00fdff0 2024-04-27T07:32:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd9800ca10 con 0x7efdb00fdff0 2024-04-27T07:32:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.665+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb01116e0 con 0x7efdb00fdff0 2024-04-27T07:32:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.666+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb005f5c0 con 0x7efdb00fdff0 2024-04-27T07:32:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.667+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7efd9800cc80 con 0x7efdb00fdff0 2024-04-27T07:32:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.668+0000 7efdacff9700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 0x7efd9c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.668+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efd98086df0 con 0x7efdb00fdff0 2024-04-27T07:32:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.668+0000 7efdaffff700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 0x7efd9c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.668+0000 7efdaffff700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 0x7efd9c06b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efda0009b30 tx=0x7efda0009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.672+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efd9804e250 con 0x7efdb00fdff0 2024-04-27T07:32:34.771 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:34 smithi100 ceph-mon[34183]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.771 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:34 smithi100 ceph-mon[34183]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.771 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:34 smithi100 ceph-mon[34183]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:34 smithi082 ceph-mon[26613]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:34 smithi082 ceph-mon[26613]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:34 smithi082 ceph-mon[26613]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.987+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efdb004bed0 con 0x7efdb00fdff0 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.988+0000 7efdacff9700 1 -- 172.21.15.82:0/3631181148 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1828 (secure 0 0 0) 0x7efd98056b80 con 0x7efdb00fdff0 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout:e15 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:34.990 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 15 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:30:41.984913+0000 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:32:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:34.992 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:32:34.993 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:34.993 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 msgr2=0x7efd9c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 0x7efd9c06b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efda0009b30 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 msgr2=0x7efdb01100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd9800eb40 tx=0x7efd9800b040 comp rx=0 tx=0).stop 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 shutdown_connections 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7efd9c0692a0 0x7efd9c06b750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdb00fce80 0x7efdb010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 --2- 172.21.15.82:0/3631181148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdb00fdff0 0x7efdb01100d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 >> 172.21.15.82:0/3631181148 conn(0x7efdb00f8520 msgr2=0x7efdb00f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 shutdown_connections 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:34.990+0000 7efdb665d700 1 -- 172.21.15.82:0/3631181148 wait complete. 2024-04-27T07:32:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-04-27T07:32:35.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3375445721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 msgr2=0x7fd79c102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3375445721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c102320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd78c004940 tx=0x7fd78c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3375445721 shutdown_connections 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3375445721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c102320 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3375445721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 0x7fd79c0ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3375445721 >> 172.21.15.82:0/3375445721 conn(0x7fd79c0f7430 msgr2=0x7fd79c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3375445721 shutdown_connections 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3375445721 wait complete. 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.123+0000 7fd7a3f2c700 1 Processor -- start 2024-04-27T07:32:35.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a3f2c700 1 -- start start 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a3f2c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 0x7fd79c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a3f2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a3f2c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c10e4f0 con 0x7fd79c0fff40 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a3f2c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c10ecf0 con 0x7fd79c066260 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48472/0 (socket says 172.21.15.82:48472) 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 -- 172.21.15.82:0/3271065689 learned_addr learned my addr 172.21.15.82:0/3271065689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a1cc8700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 0x7fd79c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 -- 172.21.15.82:0/3271065689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 msgr2=0x7fd79c10d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 0x7fd79c10d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 -- 172.21.15.82:0/3271065689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c005040 con 0x7fd79c0fff40 2024-04-27T07:32:35.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.124+0000 7fd7a14c7700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd78c013870 tx=0x7fd78c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.125+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd78c00e070 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.125+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd78c013de0 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.125+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd78c01cea0 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.125+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c10ef70 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.125+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c10f450 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.126+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c05f5c0 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.127+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd78c01c690 con 0x7fd79c0fff40 2024-04-27T07:32:35.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.127+0000 7fd7927fc700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 0x7fd78806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.127+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd78c0887b0 con 0x7fd79c0fff40 2024-04-27T07:32:35.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.127+0000 7fd7a1cc8700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 0x7fd78806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.128+0000 7fd7a1cc8700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 0x7fd78806b760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd798009b80 tx=0x7fd79800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.135+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd78c058610 con 0x7fd79c0fff40 2024-04-27T07:32:35.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.500+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 --> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd79c10f6c0 con 0x7fd7880692b0 2024-04-27T07:32:35.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.502+0000 7fd7927fc700 1 -- 172.21.15.82:0/3271065689 <== mgr.14208 v2:172.21.15.82:6800/1079100432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fd79c10f6c0 con 0x7fd7880692b0 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "", 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mgr daemons", 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:32:35.504 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.504+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 msgr2=0x7fd78806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.504+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 0x7fd78806b760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd798009b80 tx=0x7fd79800b040 comp rx=0 tx=0).stop 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.504+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 msgr2=0x7fd79c10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.504+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd78c013870 tx=0x7fd78c009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 shutdown_connections 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7fd7880692b0 0x7fd78806b760 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd79c066260 0x7fd79c10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 --2- 172.21.15.82:0/3271065689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd79c0fff40 0x7fd79c10def0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 >> 172.21.15.82:0/3271065689 conn(0x7fd79c0f7430 msgr2=0x7fd79c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 shutdown_connections 2024-04-27T07:32:35.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.505+0000 7fd7a3f2c700 1 -- 172.21.15.82:0/3271065689 wait complete. 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 -- 172.21.15.82:0/2733200631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fedd0 msgr2=0x7f13580faf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 --2- 172.21.15.82:0/2733200631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fedd0 0x7f13580faf10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1348004940 tx=0x7f1348009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 -- 172.21.15.82:0/2733200631 shutdown_connections 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 --2- 172.21.15.82:0/2733200631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fedd0 0x7f13580faf10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 --2- 172.21.15.82:0/2733200631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fe480 0x7f13580fe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 -- 172.21.15.82:0/2733200631 >> 172.21.15.82:0/2733200631 conn(0x7f13580f6b80 msgr2=0x7f13580f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 -- 172.21.15.82:0/2733200631 shutdown_connections 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.636+0000 7f135f615700 1 -- 172.21.15.82:0/2733200631 wait complete. 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 Processor -- start 2024-04-27T07:32:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 -- start start 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fedd0 0x7f135810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135810e520 con 0x7f13580fe480 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135f615700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135810ed70 con 0x7f13580fedd0 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135d3b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135d3b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48156/0 (socket says 172.21.15.82:48156) 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135d3b1700 1 -- 172.21.15.82:0/4021734382 learned_addr learned my addr 172.21.15.82:0/4021734382 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.637+0000 7f135cbb0700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fedd0 0x7f135810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135d3b1700 1 -- 172.21.15.82:0/4021734382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fedd0 msgr2=0x7f135810df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135d3b1700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fedd0 0x7f135810df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135d3b1700 1 -- 172.21.15.82:0/4021734382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348005040 con 0x7f13580fe480 2024-04-27T07:32:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135d3b1700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1354002a50 tx=0x7f13540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1354007cc0 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135810f050 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f135400f040 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135400da30 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.638+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135810f590 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.639+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135805f5c0 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.640+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f135400db90 con 0x7f13580fe480 2024-04-27T07:32:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.640+0000 7f134dffb700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 0x7f134406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:32:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.640+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1354086f50 con 0x7f13580fe480 2024-04-27T07:32:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.640+0000 7f135cbb0700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 0x7f134406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:32:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.641+0000 7f135cbb0700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 0x7f134406b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f134800b970 tx=0x7f1348009e30 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:32:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:35.645+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1354056c90 con 0x7f13580fe480 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: pgmap v242: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1.7 MiB/s wr, 83 op/s 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1334932754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3631181148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:35.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:35 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: pgmap v242: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1.7 MiB/s wr, 83 op/s 2024-04-27T07:32:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1334932754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:32:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3631181148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:32:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:35.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:35.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:35 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.030+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f135810f910 con 0x7f13580fe480 2024-04-27T07:32:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.030+0000 7f134dffb700 1 -- 172.21.15.82:0/4021734382 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1354056820 con 0x7f13580fe480 2024-04-27T07:32:36.033 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:32:36.033 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:32:36.033 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 msgr2=0x7f134406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 0x7f134406b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f134800b970 tx=0x7f1348009e30 comp rx=0 tx=0).stop 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 msgr2=0x7f135810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1354002a50 tx=0x7f13540046b0 comp rx=0 tx=0).stop 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 shutdown_connections 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:6800/1079100432,v1:172.21.15.82:6801/1079100432] conn(0x7f13440692a0 0x7f134406b750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fe480 0x7f135810d9e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 --2- 172.21.15.82:0/4021734382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fedd0 0x7f135810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 >> 172.21.15.82:0/4021734382 conn(0x7f13580f6b80 msgr2=0x7f13580f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:32:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 shutdown_connections 2024-04-27T07:32:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:32:36.033+0000 7f135f615700 1 -- 172.21.15.82:0/4021734382 wait complete. 2024-04-27T07:32:36.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:36 smithi100 ceph-mon[34183]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:36.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:36 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/4021734382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:32:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:36 smithi082 ceph-mon[26613]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:32:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:36 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/4021734382' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:32:37.776 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:37 smithi100 ceph-mon[34183]: pgmap v243: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 888 KiB/s rd, 3.2 MiB/s wr, 112 op/s 2024-04-27T07:32:37.805 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:37 smithi082 ceph-mon[26613]: pgmap v243: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 888 KiB/s rd, 3.2 MiB/s wr, 112 op/s 2024-04-27T07:32:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:38 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:38.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:38 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:39.762 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:39 smithi100 ceph-mon[34183]: pgmap v244: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 149 op/s 2024-04-27T07:32:39.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:39 smithi082 ceph-mon[26613]: pgmap v244: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 149 op/s 2024-04-27T07:32:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:41 smithi082 ceph-mon[26613]: pgmap v245: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 141 op/s 2024-04-27T07:32:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:41 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:32:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:41 smithi100 ceph-mon[34183]: pgmap v245: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 141 op/s 2024-04-27T07:32:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:41 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:32:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:42 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:32:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:42 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:32:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:43 smithi082 ceph-mon[26613]: pgmap v246: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 179 op/s 2024-04-27T07:32:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:43 smithi082 ceph-mon[26613]: mgrmap e20: smithi082.hhlhmf(active, since 7m), standbys: smithi100.eparbe 2024-04-27T07:32:43.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:43 smithi100 ceph-mon[34183]: pgmap v246: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 179 op/s 2024-04-27T07:32:43.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:43 smithi100 ceph-mon[34183]: mgrmap e20: smithi082.hhlhmf(active, since 7m), standbys: smithi100.eparbe 2024-04-27T07:32:45.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:45 smithi100 ceph-mon[34183]: pgmap v247: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 153 op/s 2024-04-27T07:32:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:45 smithi082 ceph-mon[26613]: pgmap v247: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 153 op/s 2024-04-27T07:32:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:46 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.355 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.355 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.355 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:47.355 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:46 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:48.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:47 smithi082 ceph-mon[26613]: pgmap v248: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 178 op/s 2024-04-27T07:32:48.367 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:47 smithi100 ceph-mon[34183]: pgmap v248: 65 pgs: 65 active+clean; 75 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 178 op/s 2024-04-27T07:32:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:49 smithi082 ceph-mon[26613]: pgmap v249: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-04-27T07:32:50.416 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:49 smithi100 ceph-mon[34183]: pgmap v249: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.1 MiB/s wr, 180 op/s 2024-04-27T07:32:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:51 smithi082 ceph-mon[26613]: pgmap v250: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 149 op/s 2024-04-27T07:32:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:51 smithi100 ceph-mon[34183]: pgmap v250: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 149 op/s 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: pgmap v251: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 220 op/s 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:32:54.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr fail", "who": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: Activating manager daemon smithi100.eparbe 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: osdmap e47: 6 total, 6 up, 6 in 2024-04-27T07:32:54.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "mgr fail", "who": "smithi082.hhlhmf"}]': finished 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: mgrmap e21: smithi100.eparbe(active, starting, since 0.0106757s) 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: Manager daemon smithi100.eparbe is now available 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/trash_purge_schedule"}]: dispatch 2024-04-27T07:32:54.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:53 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/trash_purge_schedule"}]: dispatch 2024-04-27T07:32:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: pgmap v251: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 220 op/s 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr fail", "who": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: Activating manager daemon smithi100.eparbe 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:32:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: osdmap e47: 6 total, 6 up, 6 in 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.14208 172.21.15.82:0/3950741498' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "mgr fail", "who": "smithi082.hhlhmf"}]': finished 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: mgrmap e21: smithi100.eparbe(active, starting, since 0.0106757s) 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:32:54.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: Manager daemon smithi100.eparbe is now available 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/trash_purge_schedule"}]: dispatch 2024-04-27T07:32:54.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:53 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi100.eparbe/trash_purge_schedule"}]: dispatch 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: Deploying cephadm binary to smithi100 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: Deploying cephadm binary to smithi082 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: mgrmap e22: smithi100.eparbe(active, since 1.00905s) 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: pgmap v3: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:32:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:55 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: Deploying cephadm binary to smithi100 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: Deploying cephadm binary to smithi082 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: mgrmap e22: smithi100.eparbe(active, since 1.00905s) 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: pgmap v3: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:32:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:55 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:32:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:56 smithi100 ceph-mon[34183]: mgrmap e23: smithi100.eparbe(active, since 2s) 2024-04-27T07:32:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:56 smithi100 ceph-mon[34183]: pgmap v4: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:56 smithi100 ceph-mon[34183]: [27/Apr/2024:07:32:55] ENGINE Bus STARTING 2024-04-27T07:32:56.447 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:56 smithi082 ceph-mon[26613]: mgrmap e23: smithi100.eparbe(active, since 2s) 2024-04-27T07:32:56.447 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:56 smithi082 ceph-mon[26613]: pgmap v4: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:56.447 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:56 smithi082 ceph-mon[26613]: [27/Apr/2024:07:32:55] ENGINE Bus STARTING 2024-04-27T07:32:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:57 smithi082 ceph-mon[26613]: [27/Apr/2024:07:32:55] ENGINE Serving on https://172.21.15.100:7150 2024-04-27T07:32:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:57 smithi082 ceph-mon[26613]: [27/Apr/2024:07:32:55] ENGINE Serving on http://172.21.15.100:8765 2024-04-27T07:32:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:57 smithi082 ceph-mon[26613]: [27/Apr/2024:07:32:55] ENGINE Bus STARTED 2024-04-27T07:32:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:57 smithi100 ceph-mon[34183]: [27/Apr/2024:07:32:55] ENGINE Serving on https://172.21.15.100:7150 2024-04-27T07:32:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:57 smithi100 ceph-mon[34183]: [27/Apr/2024:07:32:55] ENGINE Serving on http://172.21.15.100:8765 2024-04-27T07:32:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:57 smithi100 ceph-mon[34183]: [27/Apr/2024:07:32:55] ENGINE Bus STARTED 2024-04-27T07:32:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:58 smithi100 ceph-mon[34183]: pgmap v5: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:32:58 smithi100 ceph-mon[34183]: mgrmap e24: smithi100.eparbe(active, since 4s) 2024-04-27T07:32:58.476 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:58 smithi082 ceph-mon[26613]: pgmap v5: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:32:58.476 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:32:58 smithi082 ceph-mon[26613]: mgrmap e24: smithi100.eparbe(active, since 4s) 2024-04-27T07:33:00.279 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:00 smithi082 ceph-mon[26613]: pgmap v6: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 394 KiB/s rd, 555 KiB/s wr, 51 op/s 2024-04-27T07:33:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:00 smithi100 ceph-mon[34183]: pgmap v6: 65 pgs: 65 active+clean; 136 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 394 KiB/s rd, 555 KiB/s wr, 51 op/s 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: pgmap v7: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 278 op/s 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: Standby manager daemon smithi082.hhlhmf started 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/crt"}]: dispatch 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/key"}]: dispatch 2024-04-27T07:33:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:02 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:33:02.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: pgmap v7: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 278 op/s 2024-04-27T07:33:02.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: Standby manager daemon smithi082.hhlhmf started 2024-04-27T07:33:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/crt"}]: dispatch 2024-04-27T07:33:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:33:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/key"}]: dispatch 2024-04-27T07:33:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:02 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/590358694' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:33:03.235 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:03 smithi100 ceph-mon[34183]: mgrmap e25: smithi100.eparbe(active, since 9s), standbys: smithi082.hhlhmf 2024-04-27T07:33:03.235 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:03 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:33:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:03 smithi082 ceph-mon[26613]: mgrmap e25: smithi100.eparbe(active, since 9s), standbys: smithi082.hhlhmf 2024-04-27T07:33:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:03 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:33:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:04 smithi082 ceph-mon[26613]: pgmap v8: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 216 op/s 2024-04-27T07:33:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:04 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:04 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:04 smithi100 ceph-mon[34183]: pgmap v8: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 216 op/s 2024-04-27T07:33:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:04 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:04 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:05.764 INFO:tasks.workunit.client.0.smithi082.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-27T07:33:05.770 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-27T07:33:05.770 INFO:tasks.workunit.client.0.smithi082.stderr:+ make 2024-04-27T07:33:05.837 INFO:tasks.workunit.client.0.smithi082.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-27T07:33:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 -- 172.21.15.82:0/3336490850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 msgr2=0x7f24fc101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 --2- 172.21.15.82:0/3336490850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc101e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f24ec004940 tx=0x7f24ec009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 -- 172.21.15.82:0/3336490850 shutdown_connections 2024-04-27T07:33:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 --2- 172.21.15.82:0/3336490850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 --2- 172.21.15.82:0/3336490850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc101e00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.146+0000 7f2501a2d700 1 -- 172.21.15.82:0/3336490850 >> 172.21.15.82:0/3336490850 conn(0x7f24fc0f7430 msgr2=0x7f24fc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.147+0000 7f2501a2d700 1 -- 172.21.15.82:0/3336490850 shutdown_connections 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.147+0000 7f2501a2d700 1 -- 172.21.15.82:0/3336490850 wait complete. 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.147+0000 7f2501a2d700 1 Processor -- start 2024-04-27T07:33:06.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.147+0000 7f2501a2d700 1 -- start start 2024-04-27T07:33:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f2501a2d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f2501a2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f2501a2d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc110730 con 0x7f24fc066260 2024-04-27T07:33:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f2501a2d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc110f30 con 0x7f24fc102340 2024-04-27T07:33:06.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24faffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50956/0 (socket says 172.21.15.82:50956) 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24fa7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24faffd700 1 -- 172.21.15.82:0/444912594 learned_addr learned my addr 172.21.15.82:0/444912594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24fa7fc700 1 -- 172.21.15.82:0/444912594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 msgr2=0x7f24fc10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24fa7fc700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24fa7fc700 1 -- 172.21.15.82:0/444912594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec005040 con 0x7f24fc102340 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24faffd700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24fa7fc700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc110130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009fd0 tx=0x7f24f000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.148+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f0004e90 con 0x7f24fc102340 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.149+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24f000f040 con 0x7f24fc102340 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.149+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc1111b0 con 0x7f24fc102340 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.149+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24f000ca50 con 0x7f24fc102340 2024-04-27T07:33:06.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.149+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc1116f0 con 0x7f24fc102340 2024-04-27T07:33:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.150+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc05f5c0 con 0x7f24fc102340 2024-04-27T07:33:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.150+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f24f000cc00 con 0x7f24fc102340 2024-04-27T07:33:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.150+0000 7f24e37fe700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 0x7f24e406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.151+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f24f008a580 con 0x7f24fc102340 2024-04-27T07:33:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.151+0000 7f24faffd700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 0x7f24e406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.151+0000 7f24faffd700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 0x7f24e406e1a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0045a0 tx=0x7f24ec009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.156+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f24f0050930 con 0x7f24fc102340 2024-04-27T07:33:06.282 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:06 smithi100 ceph-mon[34183]: pgmap v9: 65 pgs: 65 active+clean; 183 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 353 op/s 2024-04-27T07:33:06.283 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:06 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:06.283 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:06 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.418+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24fc1119d0 con 0x7f24e406bcf0 2024-04-27T07:33:06.421 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:06 smithi082 ceph-mon[26613]: pgmap v9: 65 pgs: 65 active+clean; 183 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 353 op/s 2024-04-27T07:33:06.421 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:06 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:06.421 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:06 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.420+0000 7f24e37fe700 1 -- 172.21.15.82:0/444912594 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f24fc1119d0 con 0x7f24e406bcf0 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 msgr2=0x7f24e406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 0x7f24e406e1a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0045a0 tx=0x7f24ec009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 msgr2=0x7f24fc110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc110130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009fd0 tx=0x7f24f000b040 comp rx=0 tx=0).stop 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 shutdown_connections 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f24e406bcf0 0x7f24e406e1a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24fc066260 0x7f24fc10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 --2- 172.21.15.82:0/444912594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc102340 0x7f24fc110130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 >> 172.21.15.82:0/444912594 conn(0x7f24fc0f7430 msgr2=0x7f24fc0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 shutdown_connections 2024-04-27T07:33:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.422+0000 7f2501a2d700 1 -- 172.21.15.82:0/444912594 wait complete. 2024-04-27T07:33:06.438 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:33:06.526 INFO:tasks.workunit.client.0.smithi082.stderr:++ readlink -f fsstress 2024-04-27T07:33:06.527 INFO:tasks.workunit.client.0.smithi082.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-27T07:33:06.527 INFO:tasks.workunit.client.0.smithi082.stderr:+ popd 2024-04-27T07:33:06.528 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-27T07:33:06.529 INFO:tasks.workunit.client.0.smithi082.stderr:+ popd 2024-04-27T07:33:06.529 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-27T07:33:06.529 INFO:tasks.workunit.client.0.smithi082.stderr:++ mktemp -d -p . 2024-04-27T07:33:06.532 INFO:tasks.workunit.client.0.smithi082.stderr:+ T=./tmp.10xfbqYoF6 2024-04-27T07:33:06.532 INFO:tasks.workunit.client.0.smithi082.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.10xfbqYoF6 -l 1 -n 1000 -p 10 -v 2024-04-27T07:33:06.535 INFO:tasks.workunit.client.0.smithi082.stdout:seed = 1713668220 2024-04-27T07:33:06.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/0: write - no filename 2024-04-27T07:33:06.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/1: stat - no entries 2024-04-27T07:33:06.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/2: dread - no filename 2024-04-27T07:33:06.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/3: write - no filename 2024-04-27T07:33:06.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/4: write - no filename 2024-04-27T07:33:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 -- 172.21.15.82:0/3847818194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 msgr2=0x7f35f00fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 --2- 172.21.15.82:0/3847818194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f00fd400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35e4004940 tx=0x7f35e4009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:06.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 -- 172.21.15.82:0/3847818194 shutdown_connections 2024-04-27T07:33:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 --2- 172.21.15.82:0/3847818194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f00fd400 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 --2- 172.21.15.82:0/3847818194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f00fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 -- 172.21.15.82:0/3847818194 >> 172.21.15.82:0/3847818194 conn(0x7f35f00f7440 msgr2=0x7f35f00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 -- 172.21.15.82:0/3847818194 shutdown_connections 2024-04-27T07:33:06.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.539+0000 7f35f5343700 1 -- 172.21.15.82:0/3847818194 wait complete. 2024-04-27T07:33:06.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/0: dwrite - no filename 2024-04-27T07:33:06.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/1: unlink - no file 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/2: dwrite - no filename 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/3: truncate - no filename 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/4: dread - no filename 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/5: read - no filename 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:0/5: mknod c0 0 2024-04-27T07:33:06.543 INFO:tasks.workunit.client.0.smithi082.stdout:0/6: fdatasync - no filename 2024-04-27T07:33:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 Processor -- start 2024-04-27T07:33:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 -- start start 2024-04-27T07:33:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f010c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f010d400 con 0x7f35f00fcf90 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35f5343700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f010dc50 con 0x7f35f00fbce0 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35ee7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50960/0 (socket says 172.21.15.82:50960) 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35ee7fc700 1 -- 172.21.15.82:0/4205771359 learned_addr learned my addr 172.21.15.82:0/4205771359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.540+0000 7f35eeffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f010c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35ee7fc700 1 -- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 msgr2=0x7f35f010c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35ee7fc700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f010c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35ee7fc700 1 -- 172.21.15.82:0/4205771359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4005040 con 0x7f35f00fcf90 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35eeffd700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f010c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35ee7fc700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35e4013870 tx=0x7f35e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e400e070 con 0x7f35f00fcf90 2024-04-27T07:33:06.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/0: rmdir - no directory 2024-04-27T07:33:06.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/1: fsync - no filename 2024-04-27T07:33:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f010ded0 con 0x7f35f00fcf90 2024-04-27T07:33:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35e401a480 con 0x7f35f00fcf90 2024-04-27T07:33:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e4023640 con 0x7f35f00fcf90 2024-04-27T07:33:06.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.541+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f010e410 con 0x7f35f00fcf90 2024-04-27T07:33:06.547 INFO:tasks.workunit.client.0.smithi082.stdout:0/7: symlink l1 0 2024-04-27T07:33:06.547 INFO:tasks.workunit.client.0.smithi082.stdout:1/6: symlink l0 0 2024-04-27T07:33:06.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.543+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f005f5c0 con 0x7f35f00fcf90 2024-04-27T07:33:06.547 INFO:tasks.workunit.client.0.smithi082.stdout:1/7: stat l0 0 2024-04-27T07:33:06.547 INFO:tasks.workunit.client.0.smithi082.stdout:1/8: truncate - no filename 2024-04-27T07:33:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.543+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f35e401a5f0 con 0x7f35f00fcf90 2024-04-27T07:33:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.544+0000 7f35d77fe700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 0x7f35d806e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.544+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f35e408e310 con 0x7f35f00fcf90 2024-04-27T07:33:06.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.544+0000 7f35eeffd700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 0x7f35d806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.548 INFO:tasks.workunit.client.0.smithi082.stdout:3/0: dread - no filename 2024-04-27T07:33:06.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.544+0000 7f35eeffd700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 0x7f35d806e210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35e0004fd0 tx=0x7f35e000b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.549 INFO:tasks.workunit.client.0.smithi082.stdout:0/8: creat f2 x:0 0 0 2024-04-27T07:33:06.549 INFO:tasks.workunit.client.0.smithi082.stdout:1/9: creat f1 x:0 0 0 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:1/10: fdatasync f1 0 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:0/9: truncate f2 13667 0 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:2/2: mknod c0 0 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:2/3: truncate - no filename 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:4/0: truncate - no filename 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:4/1: rename - no filename 2024-04-27T07:33:06.550 INFO:tasks.workunit.client.0.smithi082.stdout:4/2: write - no filename 2024-04-27T07:33:06.551 INFO:tasks.workunit.client.0.smithi082.stdout:0/10: creat f3 x:0 0 0 2024-04-27T07:33:06.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.549+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f35e405b450 con 0x7f35f00fcf90 2024-04-27T07:33:06.551 INFO:tasks.workunit.client.0.smithi082.stdout:0/11: chown l1 166 1 2024-04-27T07:33:06.552 INFO:tasks.workunit.client.0.smithi082.stdout:1/11: creat f2 x:0 0 0 2024-04-27T07:33:06.553 INFO:tasks.workunit.client.0.smithi082.stdout:2/4: rename c0 to c1 0 2024-04-27T07:33:06.553 INFO:tasks.workunit.client.0.smithi082.stdout:2/5: dwrite - no filename 2024-04-27T07:33:06.553 INFO:tasks.workunit.client.0.smithi082.stdout:3/1: mknod c0 0 2024-04-27T07:33:06.555 INFO:tasks.workunit.client.0.smithi082.stdout:5/0: read - no filename 2024-04-27T07:33:06.555 INFO:tasks.workunit.client.0.smithi082.stdout:5/1: chown . 250601 1 2024-04-27T07:33:06.555 INFO:tasks.workunit.client.0.smithi082.stdout:1/12: mknod c3 0 2024-04-27T07:33:06.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/12: creat f4 x:0 0 0 2024-04-27T07:33:06.559 INFO:tasks.workunit.client.0.smithi082.stdout:3/2: creat f1 x:0 0 0 2024-04-27T07:33:06.559 INFO:tasks.workunit.client.0.smithi082.stdout:4/3: creat f0 x:0 0 0 2024-04-27T07:33:06.560 INFO:tasks.workunit.client.0.smithi082.stdout:4/4: chown f0 5 1 2024-04-27T07:33:06.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/0: dread - no filename 2024-04-27T07:33:06.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/1: write - no filename 2024-04-27T07:33:06.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/2: write - no filename 2024-04-27T07:33:06.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/3: truncate - no filename 2024-04-27T07:33:06.562 INFO:tasks.workunit.client.0.smithi082.stdout:6/4: write - no filename 2024-04-27T07:33:06.562 INFO:tasks.workunit.client.0.smithi082.stdout:6/5: unlink - no file 2024-04-27T07:33:06.562 INFO:tasks.workunit.client.0.smithi082.stdout:6/6: stat - no entries 2024-04-27T07:33:06.562 INFO:tasks.workunit.client.0.smithi082.stdout:1/13: mkdir d4 0 2024-04-27T07:33:06.562 INFO:tasks.workunit.client.0.smithi082.stdout:0/13: creat f5 x:0 0 0 2024-04-27T07:33:06.563 INFO:tasks.workunit.client.0.smithi082.stdout:1/14: chown f1 371512 1 2024-04-27T07:33:06.563 INFO:tasks.workunit.client.0.smithi082.stdout:5/2: mknod c0 0 2024-04-27T07:33:06.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/7: getdents . 0 2024-04-27T07:33:06.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/8: dwrite - no filename 2024-04-27T07:33:06.566 INFO:tasks.workunit.client.0.smithi082.stdout:5/3: chown c0 2 1 2024-04-27T07:33:06.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/0: dwrite - no filename 2024-04-27T07:33:06.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/1: truncate - no filename 2024-04-27T07:33:06.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/2: write - no filename 2024-04-27T07:33:06.569 INFO:tasks.workunit.client.0.smithi082.stdout:0/14: write f5 [22020,8233] 0 2024-04-27T07:33:06.571 INFO:tasks.workunit.client.0.smithi082.stdout:8/0: unlink - no file 2024-04-27T07:33:06.571 INFO:tasks.workunit.client.0.smithi082.stdout:8/1: write - no filename 2024-04-27T07:33:06.572 INFO:tasks.workunit.client.0.smithi082.stdout:5/4: symlink l1 0 2024-04-27T07:33:06.574 INFO:tasks.workunit.client.0.smithi082.stdout:1/15: creat d4/f5 x:0 0 0 2024-04-27T07:33:06.576 INFO:tasks.workunit.client.0.smithi082.stdout:3/3: dwrite f1 [0,4194304] 0 2024-04-27T07:33:06.576 INFO:tasks.workunit.client.0.smithi082.stdout:1/16: dread - f1 zero size 2024-04-27T07:33:06.577 INFO:tasks.workunit.client.0.smithi082.stdout:6/9: creat f0 x:0 0 0 2024-04-27T07:33:06.580 INFO:tasks.workunit.client.0.smithi082.stdout:4/5: dwrite f0 [0,4194304] 0 2024-04-27T07:33:06.581 INFO:tasks.workunit.client.0.smithi082.stdout:4/6: readlink - no filename 2024-04-27T07:33:06.582 INFO:tasks.workunit.client.0.smithi082.stdout:6/10: write f0 [121200,105681] 0 2024-04-27T07:33:06.582 INFO:tasks.workunit.client.0.smithi082.stdout:0/15: rename f3 to f6 0 2024-04-27T07:33:06.585 INFO:tasks.workunit.client.0.smithi082.stdout:5/5: mknod c2 0 2024-04-27T07:33:06.586 INFO:tasks.workunit.client.0.smithi082.stdout:0/16: write f5 [970747,59194] 0 2024-04-27T07:33:06.586 INFO:tasks.workunit.client.0.smithi082.stdout:0/17: rmdir - no directory 2024-04-27T07:33:06.588 INFO:tasks.workunit.client.0.smithi082.stdout:1/17: symlink d4/l6 0 2024-04-27T07:33:06.588 INFO:tasks.workunit.client.0.smithi082.stdout:0/18: dread - f4 zero size 2024-04-27T07:33:06.589 INFO:tasks.workunit.client.0.smithi082.stdout:3/4: dread f1 [0,4194304] 0 2024-04-27T07:33:06.589 INFO:tasks.workunit.client.0.smithi082.stdout:7/3: creat f0 x:0 0 0 2024-04-27T07:33:06.592 INFO:tasks.workunit.client.0.smithi082.stdout:1/18: chown d4/f5 228958376 1 2024-04-27T07:33:06.595 INFO:tasks.workunit.client.0.smithi082.stdout:8/2: mkdir d0 0 2024-04-27T07:33:06.595 INFO:tasks.workunit.client.0.smithi082.stdout:8/3: dread - no filename 2024-04-27T07:33:06.595 INFO:tasks.workunit.client.0.smithi082.stdout:8/4: write - no filename 2024-04-27T07:33:06.595 INFO:tasks.workunit.client.0.smithi082.stdout:8/5: dwrite - no filename 2024-04-27T07:33:06.595 INFO:tasks.workunit.client.0.smithi082.stdout:4/7: dwrite f0 [0,4194304] 0 2024-04-27T07:33:06.597 INFO:tasks.workunit.client.0.smithi082.stdout:8/6: rename d0 to d0/d1 22 2024-04-27T07:33:06.597 INFO:tasks.workunit.client.0.smithi082.stdout:6/11: unlink f0 0 2024-04-27T07:33:06.602 INFO:tasks.workunit.client.0.smithi082.stdout:8/7: chown d0 17578622 1 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:8/8: write - no filename 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:8/9: read - no filename 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:8/10: write - no filename 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:6/12: chown . 24442 1 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:6/13: dread - no filename 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:6/14: dread - no filename 2024-04-27T07:33:06.603 INFO:tasks.workunit.client.0.smithi082.stdout:5/6: creat f3 x:0 0 0 2024-04-27T07:33:06.606 INFO:tasks.workunit.client.0.smithi082.stdout:9/0: creat f0 x:0 0 0 2024-04-27T07:33:06.607 INFO:tasks.workunit.client.0.smithi082.stdout:3/5: rename f1 to f2 0 2024-04-27T07:33:06.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/4: dwrite f0 [0,4194304] 0 2024-04-27T07:33:06.608 INFO:tasks.workunit.client.0.smithi082.stdout:1/19: creat d4/f7 x:0 0 0 2024-04-27T07:33:06.609 INFO:tasks.workunit.client.0.smithi082.stdout:0/19: write f6 [811639,87096] 0 2024-04-27T07:33:06.611 INFO:tasks.workunit.client.0.smithi082.stdout:9/1: write f0 [787709,126558] 0 2024-04-27T07:33:06.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/8: creat f1 x:0 0 0 2024-04-27T07:33:06.612 INFO:tasks.workunit.client.0.smithi082.stdout:4/9: readlink - no filename 2024-04-27T07:33:06.614 INFO:tasks.workunit.client.0.smithi082.stdout:0/20: chown f4 21450 1 2024-04-27T07:33:06.614 INFO:tasks.workunit.client.0.smithi082.stdout:6/15: creat f1 x:0 0 0 2024-04-27T07:33:06.615 INFO:tasks.workunit.client.0.smithi082.stdout:1/20: write f2 [440895,47664] 0 2024-04-27T07:33:06.617 INFO:tasks.workunit.client.0.smithi082.stdout:9/2: chown f0 14737 1 2024-04-27T07:33:06.617 INFO:tasks.workunit.client.0.smithi082.stdout:9/3: rmdir - no directory 2024-04-27T07:33:06.618 INFO:tasks.workunit.client.0.smithi082.stdout:1/21: read - f1 zero size 2024-04-27T07:33:06.619 INFO:tasks.workunit.client.0.smithi082.stdout:6/16: dread - f1 zero size 2024-04-27T07:33:06.621 INFO:tasks.workunit.client.0.smithi082.stdout:5/7: dwrite f3 [0,4194304] 0 2024-04-27T07:33:06.621 INFO:tasks.workunit.client.0.smithi082.stdout:3/6: write f2 [4096889,50567] 0 2024-04-27T07:33:06.624 INFO:tasks.workunit.client.0.smithi082.stdout:5/8: chown c0 12398 1 2024-04-27T07:33:06.625 INFO:tasks.workunit.client.0.smithi082.stdout:4/10: creat f2 x:0 0 0 2024-04-27T07:33:06.626 INFO:tasks.workunit.client.0.smithi082.stdout:7/5: dread f0 [0,4194304] 0 2024-04-27T07:33:06.627 INFO:tasks.workunit.client.0.smithi082.stdout:4/11: read f0 [1798929,23710] 0 2024-04-27T07:33:06.627 INFO:tasks.workunit.client.0.smithi082.stdout:9/4: creat f1 x:0 0 0 2024-04-27T07:33:06.628 INFO:tasks.workunit.client.0.smithi082.stdout:6/17: mkdir d2 0 2024-04-27T07:33:06.630 INFO:tasks.workunit.client.0.smithi082.stdout:1/22: creat d4/f8 x:0 0 0 2024-04-27T07:33:06.631 INFO:tasks.workunit.client.0.smithi082.stdout:3/7: mknod c3 0 2024-04-27T07:33:06.631 INFO:tasks.workunit.client.0.smithi082.stdout:0/21: dwrite f2 [0,4194304] 0 2024-04-27T07:33:06.632 INFO:tasks.workunit.client.0.smithi082.stdout:4/12: read - f1 zero size 2024-04-27T07:33:06.638 INFO:tasks.workunit.client.0.smithi082.stdout:5/9: creat f4 x:0 0 0 2024-04-27T07:33:06.639 INFO:tasks.workunit.client.0.smithi082.stdout:9/5: mknod c2 0 2024-04-27T07:33:06.639 INFO:tasks.workunit.client.0.smithi082.stdout:5/10: write f4 [501857,88489] 0 2024-04-27T07:33:06.642 INFO:tasks.workunit.client.0.smithi082.stdout:0/22: dread f6 [0,4194304] 0 2024-04-27T07:33:06.643 INFO:tasks.workunit.client.0.smithi082.stdout:1/23: mknod d4/c9 0 2024-04-27T07:33:06.643 INFO:tasks.workunit.client.0.smithi082.stdout:0/23: readlink l1 0 2024-04-27T07:33:06.645 INFO:tasks.workunit.client.0.smithi082.stdout:1/24: truncate d4/f7 888014 0 2024-04-27T07:33:06.646 INFO:tasks.workunit.client.0.smithi082.stdout:3/8: dwrite f2 [0,4194304] 0 2024-04-27T07:33:06.647 INFO:tasks.workunit.client.0.smithi082.stdout:4/13: mkdir d3 0 2024-04-27T07:33:06.648 INFO:tasks.workunit.client.0.smithi082.stdout:4/14: read - f2 zero size 2024-04-27T07:33:06.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/6: creat f3 x:0 0 0 2024-04-27T07:33:06.655 INFO:tasks.workunit.client.0.smithi082.stdout:5/11: creat f5 x:0 0 0 2024-04-27T07:33:06.656 INFO:tasks.workunit.client.0.smithi082.stdout:6/18: mkdir d2/d3 0 2024-04-27T07:33:06.657 INFO:tasks.workunit.client.0.smithi082.stdout:0/24: creat f7 x:0 0 0 2024-04-27T07:33:06.657 INFO:tasks.workunit.client.0.smithi082.stdout:1/25: dwrite d4/f7 [0,4194304] 0 2024-04-27T07:33:06.658 INFO:tasks.workunit.client.0.smithi082.stdout:3/9: dread f2 [0,4194304] 0 2024-04-27T07:33:06.659 INFO:tasks.workunit.client.0.smithi082.stdout:1/26: stat d4/f7 0 2024-04-27T07:33:06.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/27: dread f2 [0,4194304] 0 2024-04-27T07:33:06.665 INFO:tasks.workunit.client.0.smithi082.stdout:3/10: fdatasync f2 0 2024-04-27T07:33:06.666 INFO:tasks.workunit.client.0.smithi082.stdout:9/7: rename f1 to f4 0 2024-04-27T07:33:06.667 INFO:tasks.workunit.client.0.smithi082.stdout:9/8: dread - f3 zero size 2024-04-27T07:33:06.667 INFO:tasks.workunit.client.0.smithi082.stdout:5/12: rename c2 to c6 0 2024-04-27T07:33:06.669 INFO:tasks.workunit.client.0.smithi082.stdout:0/25: symlink l8 0 2024-04-27T07:33:06.672 INFO:tasks.workunit.client.0.smithi082.stdout:6/19: rename f1 to d2/f4 0 2024-04-27T07:33:06.674 INFO:tasks.workunit.client.0.smithi082.stdout:4/15: dwrite f0 [0,4194304] 0 2024-04-27T07:33:06.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/11: creat f4 x:0 0 0 2024-04-27T07:33:06.676 INFO:tasks.workunit.client.0.smithi082.stdout:9/9: creat f5 x:0 0 0 2024-04-27T07:33:06.681 INFO:tasks.workunit.client.0.smithi082.stdout:1/28: dwrite f2 [0,4194304] 0 2024-04-27T07:33:06.682 INFO:tasks.workunit.client.0.smithi082.stdout:6/20: write d2/f4 [638503,87023] 0 2024-04-27T07:33:06.684 INFO:tasks.workunit.client.0.smithi082.stdout:3/12: creat f5 x:0 0 0 2024-04-27T07:33:06.685 INFO:tasks.workunit.client.0.smithi082.stdout:3/13: read - f5 zero size 2024-04-27T07:33:06.686 INFO:tasks.workunit.client.0.smithi082.stdout:5/13: dwrite f3 [0,4194304] 0 2024-04-27T07:33:06.688 INFO:tasks.workunit.client.0.smithi082.stdout:9/10: write f4 [849346,86970] 0 2024-04-27T07:33:06.689 INFO:tasks.workunit.client.0.smithi082.stdout:3/14: dread - f4 zero size 2024-04-27T07:33:06.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/11: chown f3 1830117 1 2024-04-27T07:33:06.693 INFO:tasks.workunit.client.0.smithi082.stdout:5/14: write f3 [2919028,74526] 0 2024-04-27T07:33:06.694 INFO:tasks.workunit.client.0.smithi082.stdout:4/16: link f1 d3/f4 0 2024-04-27T07:33:06.695 INFO:tasks.workunit.client.0.smithi082.stdout:4/17: chown f2 90048397 1 2024-04-27T07:33:06.696 INFO:tasks.workunit.client.0.smithi082.stdout:3/15: creat f6 x:0 0 0 2024-04-27T07:33:06.698 INFO:tasks.workunit.client.0.smithi082.stdout:3/16: write f6 [553002,48824] 0 2024-04-27T07:33:06.698 INFO:tasks.workunit.client.0.smithi082.stdout:3/17: readlink - no filename 2024-04-27T07:33:06.700 INFO:tasks.workunit.client.0.smithi082.stdout:1/29: dwrite d4/f8 [0,4194304] 0 2024-04-27T07:33:06.701 INFO:tasks.workunit.client.0.smithi082.stdout:5/15: creat f7 x:0 0 0 2024-04-27T07:33:06.703 INFO:tasks.workunit.client.0.smithi082.stdout:1/30: read d4/f8 [1174653,7748] 0 2024-04-27T07:33:06.703 INFO:tasks.workunit.client.0.smithi082.stdout:3/18: symlink l7 0 2024-04-27T07:33:06.704 INFO:tasks.workunit.client.0.smithi082.stdout:6/21: dread d2/f4 [0,4194304] 0 2024-04-27T07:33:06.705 INFO:tasks.workunit.client.0.smithi082.stdout:6/22: chown d2/f4 2 1 2024-04-27T07:33:06.708 INFO:tasks.workunit.client.0.smithi082.stdout:5/16: mkdir d8 0 2024-04-27T07:33:06.710 INFO:tasks.workunit.client.0.smithi082.stdout:3/19: mkdir d8 0 2024-04-27T07:33:06.715 INFO:tasks.workunit.client.0.smithi082.stdout:5/17: creat d8/f9 x:0 0 0 2024-04-27T07:33:06.717 INFO:tasks.workunit.client.0.smithi082.stdout:9/12: dread f4 [0,4194304] 0 2024-04-27T07:33:06.717 INFO:tasks.workunit.client.0.smithi082.stdout:5/18: write f4 [1309130,57785] 0 2024-04-27T07:33:06.717 INFO:tasks.workunit.client.0.smithi082.stdout:3/20: mkdir d8/d9 0 2024-04-27T07:33:06.718 INFO:tasks.workunit.client.0.smithi082.stdout:5/19: read - d8/f9 zero size 2024-04-27T07:33:06.720 INFO:tasks.workunit.client.0.smithi082.stdout:9/13: write f4 [1154686,116727] 0 2024-04-27T07:33:06.723 INFO:tasks.workunit.client.0.smithi082.stdout:9/14: mknod c6 0 2024-04-27T07:33:06.725 INFO:tasks.workunit.client.0.smithi082.stdout:3/21: link c0 d8/ca 0 2024-04-27T07:33:06.750 INFO:tasks.workunit.client.0.smithi082.stdout:2/6: rename c1 to c2 0 2024-04-27T07:33:06.765 INFO:tasks.workunit.client.0.smithi082.stdout:3/22: rename f2 to d8/fb 0 2024-04-27T07:33:06.768 INFO:tasks.workunit.client.0.smithi082.stdout:3/23: creat d8/d9/fc x:0 0 0 2024-04-27T07:33:06.769 INFO:tasks.workunit.client.0.smithi082.stdout:3/24: mkdir d8/d9/dd 0 2024-04-27T07:33:06.772 INFO:tasks.workunit.client.0.smithi082.stdout:1/31: getdents d4 0 2024-04-27T07:33:06.776 INFO:tasks.workunit.client.0.smithi082.stdout:3/25: dwrite f5 [0,4194304] 0 2024-04-27T07:33:06.776 INFO:tasks.workunit.client.0.smithi082.stdout:3/26: write f6 [880965,38733] 0 2024-04-27T07:33:06.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.873+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35f010e6f0 con 0x7f35d806bd60 2024-04-27T07:33:06.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.874+0000 7f35d77fe700 1 -- 172.21.15.82:0/4205771359 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f35f010e6f0 con 0x7f35d806bd60 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 msgr2=0x7f35d806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 0x7f35d806e210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f35e0004fd0 tx=0x7f35e000b040 comp rx=0 tx=0).stop 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 msgr2=0x7f35f010ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35e4013870 tx=0x7f35e4009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 shutdown_connections 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f35d806bd60 0x7f35d806e210 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35f00fbce0 0x7f35f010c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.876+0000 7f35f5343700 1 --2- 172.21.15.82:0/4205771359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f00fcf90 0x7f35f010ce00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.877+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 >> 172.21.15.82:0/4205771359 conn(0x7f35f00f7440 msgr2=0x7f35f00f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.877+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 shutdown_connections 2024-04-27T07:33:06.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.877+0000 7f35f5343700 1 -- 172.21.15.82:0/4205771359 wait complete. 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 -- 172.21.15.82:0/3329415355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fcf70 msgr2=0x7fe55c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 --2- 172.21.15.82:0/3329415355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fcf70 0x7fe55c0fd3e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe550004940 tx=0x7fe550009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 -- 172.21.15.82:0/3329415355 shutdown_connections 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 --2- 172.21.15.82:0/3329415355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fcf70 0x7fe55c0fd3e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 --2- 172.21.15.82:0/3329415355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 -- 172.21.15.82:0/3329415355 >> 172.21.15.82:0/3329415355 conn(0x7fe55c0f7420 msgr2=0x7fe55c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:06.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 -- 172.21.15.82:0/3329415355 shutdown_connections 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.976+0000 7fe562328700 1 -- 172.21.15.82:0/3329415355 wait complete. 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 Processor -- start 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 -- start start 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fcf70 0x7fe55c112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c112cb0 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe562328700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c112e20 con 0x7fe55c0fcf70 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe55bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe55bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50986/0 (socket says 172.21.15.82:50986) 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe55bfff700 1 -- 172.21.15.82:0/1751213208 learned_addr learned my addr 172.21.15.82:0/1751213208 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.977+0000 7fe55b7fe700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fcf70 0x7fe55c112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe55bfff700 1 -- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fcf70 msgr2=0x7fe55c112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe55bfff700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fcf70 0x7fe55c112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:06.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe55bfff700 1 -- 172.21.15.82:0/1751213208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550005040 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe55bfff700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00b790 tx=0x7fe54c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c00f6f0 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c113100 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe54c00fd20 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c0103a0 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.978+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1136c0 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.979+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c04c710 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.980+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe54c011400 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.980+0000 7fe558ff9700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 0x7fe54406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.981+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe54c08a750 con 0x7fe55c0fbcc0 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.981+0000 7fe55b7fe700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 0x7fe54406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:06.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.981+0000 7fe55b7fe700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 0x7fe54406e1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe550009fd0 tx=0x7fe550009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:06.985+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe54c0579a0 con 0x7fe55c0fbcc0 2024-04-27T07:33:07.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/32: rmdir d4 39 2024-04-27T07:33:07.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/6: truncate f0 965743 0 2024-04-27T07:33:07.028 INFO:tasks.workunit.client.0.smithi082.stdout:3/27: rename l7 to d8/le 0 2024-04-27T07:33:07.032 INFO:tasks.workunit.client.0.smithi082.stdout:3/28: creat d8/ff x:0 0 0 2024-04-27T07:33:07.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/33: dwrite d4/f5 [0,4194304] 0 2024-04-27T07:33:07.040 INFO:tasks.workunit.client.0.smithi082.stdout:6/23: unlink d2/f4 0 2024-04-27T07:33:07.040 INFO:tasks.workunit.client.0.smithi082.stdout:6/24: write - no filename 2024-04-27T07:33:07.041 INFO:tasks.workunit.client.0.smithi082.stdout:1/34: rmdir d4 39 2024-04-27T07:33:07.045 INFO:tasks.workunit.client.0.smithi082.stdout:3/29: dwrite d8/fb [4194304,4194304] 0 2024-04-27T07:33:07.046 INFO:tasks.workunit.client.0.smithi082.stdout:6/25: creat d2/f5 x:0 0 0 2024-04-27T07:33:07.047 INFO:tasks.workunit.client.0.smithi082.stdout:6/26: write d2/f5 [125756,1869] 0 2024-04-27T07:33:07.050 INFO:tasks.workunit.client.0.smithi082.stdout:0/26: truncate f2 1507896 0 2024-04-27T07:33:07.051 INFO:tasks.workunit.client.0.smithi082.stdout:3/30: unlink f4 0 2024-04-27T07:33:07.053 INFO:tasks.workunit.client.0.smithi082.stdout:1/35: creat d4/fa x:0 0 0 2024-04-27T07:33:07.056 INFO:tasks.workunit.client.0.smithi082.stdout:3/31: symlink d8/l10 0 2024-04-27T07:33:07.057 INFO:tasks.workunit.client.0.smithi082.stdout:6/27: creat d2/d3/f6 x:0 0 0 2024-04-27T07:33:07.058 INFO:tasks.workunit.client.0.smithi082.stdout:6/28: dread - d2/d3/f6 zero size 2024-04-27T07:33:07.058 INFO:tasks.workunit.client.0.smithi082.stdout:6/29: readlink - no filename 2024-04-27T07:33:07.059 INFO:tasks.workunit.client.0.smithi082.stdout:6/30: chown d2/f5 41 1 2024-04-27T07:33:07.059 INFO:tasks.workunit.client.0.smithi082.stdout:6/31: readlink - no filename 2024-04-27T07:33:07.059 INFO:tasks.workunit.client.0.smithi082.stdout:3/32: symlink d8/d9/l11 0 2024-04-27T07:33:07.062 INFO:tasks.workunit.client.0.smithi082.stdout:6/32: mkdir d2/d7 0 2024-04-27T07:33:07.063 INFO:tasks.workunit.client.0.smithi082.stdout:3/33: unlink d8/d9/fc 0 2024-04-27T07:33:07.064 INFO:tasks.workunit.client.0.smithi082.stdout:6/33: creat d2/d3/f8 x:0 0 0 2024-04-27T07:33:07.066 INFO:tasks.workunit.client.0.smithi082.stdout:5/20: getdents d8 0 2024-04-27T07:33:07.066 INFO:tasks.workunit.client.0.smithi082.stdout:5/21: truncate d8/f9 378457 0 2024-04-27T07:33:07.067 INFO:tasks.workunit.client.0.smithi082.stdout:3/34: symlink d8/d9/l12 0 2024-04-27T07:33:07.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/22: dread d8/f9 [0,4194304] 0 2024-04-27T07:33:07.069 INFO:tasks.workunit.client.0.smithi082.stdout:6/34: unlink d2/f5 0 2024-04-27T07:33:07.069 INFO:tasks.workunit.client.0.smithi082.stdout:5/23: dread d8/f9 [0,4194304] 0 2024-04-27T07:33:07.070 INFO:tasks.workunit.client.0.smithi082.stdout:9/15: getdents . 0 2024-04-27T07:33:07.070 INFO:tasks.workunit.client.0.smithi082.stdout:6/35: dread - d2/d3/f6 zero size 2024-04-27T07:33:07.071 INFO:tasks.workunit.client.0.smithi082.stdout:9/16: fsync f0 0 2024-04-27T07:33:07.071 INFO:tasks.workunit.client.0.smithi082.stdout:9/17: truncate f5 866207 0 2024-04-27T07:33:07.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/24: unlink l1 0 2024-04-27T07:33:07.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/25: read - f7 zero size 2024-04-27T07:33:07.080 INFO:tasks.workunit.client.0.smithi082.stdout:7/7: read f0 [664295,101127] 0 2024-04-27T07:33:07.081 INFO:tasks.workunit.client.0.smithi082.stdout:7/8: chown f0 55 1 2024-04-27T07:33:07.083 INFO:tasks.workunit.client.0.smithi082.stdout:9/18: creat f7 x:0 0 0 2024-04-27T07:33:07.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/7: chown c2 2225 1 2024-04-27T07:33:07.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/8: fdatasync - no filename 2024-04-27T07:33:07.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/9: write - no filename 2024-04-27T07:33:07.086 INFO:tasks.workunit.client.0.smithi082.stdout:5/26: creat d8/fa x:0 0 0 2024-04-27T07:33:07.087 INFO:tasks.workunit.client.0.smithi082.stdout:3/35: dwrite f5 [4194304,4194304] 0 2024-04-27T07:33:07.089 INFO:tasks.workunit.client.0.smithi082.stdout:7/9: mknod c1 0 2024-04-27T07:33:07.091 INFO:tasks.workunit.client.0.smithi082.stdout:2/10: creat f3 x:0 0 0 2024-04-27T07:33:07.092 INFO:tasks.workunit.client.0.smithi082.stdout:5/27: mkdir d8/db 0 2024-04-27T07:33:07.093 INFO:tasks.workunit.client.0.smithi082.stdout:5/28: chown f7 1466 1 2024-04-27T07:33:07.096 INFO:tasks.workunit.client.0.smithi082.stdout:3/36: stat c0 0 2024-04-27T07:33:07.097 INFO:tasks.workunit.client.0.smithi082.stdout:3/37: chown d8/ff 2693 1 2024-04-27T07:33:07.102 INFO:tasks.workunit.client.0.smithi082.stdout:5/29: dwrite f7 [0,4194304] 0 2024-04-27T07:33:07.105 INFO:tasks.workunit.client.0.smithi082.stdout:1/36: truncate f2 1966280 0 2024-04-27T07:33:07.106 INFO:tasks.workunit.client.0.smithi082.stdout:1/37: chown f1 15899 1 2024-04-27T07:33:07.106 INFO:tasks.workunit.client.0.smithi082.stdout:1/38: fdatasync d4/f7 0 2024-04-27T07:33:07.110 INFO:tasks.workunit.client.0.smithi082.stdout:3/38: mkdir d8/d9/dd/d13 0 2024-04-27T07:33:07.114 INFO:tasks.workunit.client.0.smithi082.stdout:1/39: mknod d4/cb 0 2024-04-27T07:33:07.114 INFO:tasks.workunit.client.0.smithi082.stdout:6/36: getdents d2/d3 0 2024-04-27T07:33:07.115 INFO:tasks.workunit.client.0.smithi082.stdout:1/40: read - d4/fa zero size 2024-04-27T07:33:07.115 INFO:tasks.workunit.client.0.smithi082.stdout:6/37: dread - d2/d3/f6 zero size 2024-04-27T07:33:07.116 INFO:tasks.workunit.client.0.smithi082.stdout:6/38: write d2/d3/f6 [424858,71968] 0 2024-04-27T07:33:07.117 INFO:tasks.workunit.client.0.smithi082.stdout:6/39: write d2/d3/f8 [916530,6003] 0 2024-04-27T07:33:07.117 INFO:tasks.workunit.client.0.smithi082.stdout:1/41: fsync d4/f8 0 2024-04-27T07:33:07.121 INFO:tasks.workunit.client.0.smithi082.stdout:6/40: rename d2/d7 to d2/d3/d9 0 2024-04-27T07:33:07.125 INFO:tasks.workunit.client.0.smithi082.stdout:1/42: dwrite d4/f8 [0,4194304] 0 2024-04-27T07:33:07.125 INFO:tasks.workunit.client.0.smithi082.stdout:5/30: truncate d8/f9 358870 0 2024-04-27T07:33:07.129 INFO:tasks.workunit.client.0.smithi082.stdout:1/43: creat d4/fc x:0 0 0 2024-04-27T07:33:07.133 INFO:tasks.workunit.client.0.smithi082.stdout:9/19: truncate f5 519156 0 2024-04-27T07:33:07.138 INFO:tasks.workunit.client.0.smithi082.stdout:5/31: dwrite f7 [0,4194304] 0 2024-04-27T07:33:07.139 INFO:tasks.workunit.client.0.smithi082.stdout:3/39: rmdir d8 39 2024-04-27T07:33:07.140 INFO:tasks.workunit.client.0.smithi082.stdout:7/10: dwrite f0 [0,4194304] 0 2024-04-27T07:33:07.144 INFO:tasks.workunit.client.0.smithi082.stdout:7/11: chown f0 135 1 2024-04-27T07:33:07.145 INFO:tasks.workunit.client.0.smithi082.stdout:1/44: dwrite d4/fa [0,4194304] 0 2024-04-27T07:33:07.147 INFO:tasks.workunit.client.0.smithi082.stdout:7/12: chown f0 52011 1 2024-04-27T07:33:07.156 INFO:tasks.workunit.client.0.smithi082.stdout:3/40: dwrite f5 [8388608,4194304] 0 2024-04-27T07:33:07.158 INFO:tasks.workunit.client.0.smithi082.stdout:3/41: write f5 [4263118,37053] 0 2024-04-27T07:33:07.162 INFO:tasks.workunit.client.0.smithi082.stdout:9/20: dread f5 [0,4194304] 0 2024-04-27T07:33:07.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/21: dread - f7 zero size 2024-04-27T07:33:07.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/22: readlink - no filename 2024-04-27T07:33:07.164 INFO:tasks.workunit.client.0.smithi082.stdout:7/13: dwrite f0 [0,4194304] 0 2024-04-27T07:33:07.165 INFO:tasks.workunit.client.0.smithi082.stdout:6/41: rmdir d2/d3/d9 0 2024-04-27T07:33:07.169 INFO:tasks.workunit.client.0.smithi082.stdout:3/42: dread f5 [8388608,4194304] 0 2024-04-27T07:33:07.171 INFO:tasks.workunit.client.0.smithi082.stdout:1/45: link d4/f7 d4/fd 0 2024-04-27T07:33:07.178 INFO:tasks.workunit.client.0.smithi082.stdout:9/23: symlink l8 0 2024-04-27T07:33:07.182 INFO:tasks.workunit.client.0.smithi082.stdout:7/14: dwrite f0 [0,4194304] 0 2024-04-27T07:33:07.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/42: dwrite d2/d3/f8 [0,4194304] 0 2024-04-27T07:33:07.186 INFO:tasks.workunit.client.0.smithi082.stdout:9/24: write f0 [1034684,74260] 0 2024-04-27T07:33:07.186 INFO:tasks.workunit.client.0.smithi082.stdout:5/32: link c6 d8/db/cc 0 2024-04-27T07:33:07.187 INFO:tasks.workunit.client.0.smithi082.stdout:3/43: write d8/ff [667238,5946] 0 2024-04-27T07:33:07.187 INFO:tasks.workunit.client.0.smithi082.stdout:7/15: read f0 [2117966,77701] 0 2024-04-27T07:33:07.189 INFO:tasks.workunit.client.0.smithi082.stdout:3/44: write f6 [549123,56150] 0 2024-04-27T07:33:07.191 INFO:tasks.workunit.client.0.smithi082.stdout:5/33: chown f5 3 1 2024-04-27T07:33:07.192 INFO:tasks.workunit.client.0.smithi082.stdout:5/34: write f4 [1917011,102667] 0 2024-04-27T07:33:07.192 INFO:tasks.workunit.client.0.smithi082.stdout:1/46: dwrite d4/fc [0,4194304] 0 2024-04-27T07:33:07.193 INFO:tasks.workunit.client.0.smithi082.stdout:6/43: symlink d2/d3/la 0 2024-04-27T07:33:07.197 INFO:tasks.workunit.client.0.smithi082.stdout:1/47: chown d4/f8 174390 1 2024-04-27T07:33:07.198 INFO:tasks.workunit.client.0.smithi082.stdout:7/16: read f0 [448525,20044] 0 2024-04-27T07:33:07.198 INFO:tasks.workunit.client.0.smithi082.stdout:9/25: mkdir d9 0 2024-04-27T07:33:07.198 INFO:tasks.workunit.client.0.smithi082.stdout:3/45: dread f5 [0,4194304] 0 2024-04-27T07:33:07.199 INFO:tasks.workunit.client.0.smithi082.stdout:9/26: fdatasync f4 0 2024-04-27T07:33:07.201 INFO:tasks.workunit.client.0.smithi082.stdout:5/35: unlink c0 0 2024-04-27T07:33:07.204 INFO:tasks.workunit.client.0.smithi082.stdout:3/46: chown d8/ca 29254656 1 2024-04-27T07:33:07.205 INFO:tasks.workunit.client.0.smithi082.stdout:3/47: chown d8/d9 65135 1 2024-04-27T07:33:07.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.292+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe55c1012e0 con 0x7fe54406bd00 2024-04-27T07:33:07.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.303+0000 7fe558ff9700 1 -- 172.21.15.82:0/1751213208 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fe55c1012e0 con 0x7fe54406bd00 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (6m) 2m ago 7m 24.5M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 2m ago 8m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (7m) 3s ago 7m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (6m) 2m ago 7m 86.1M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (2m) 2m ago 2m 14.7M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (2m) 2m ago 2m 13.8M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (2m) 3s ago 2m 66.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (2m) 3s ago 2m 102M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (9m) 2m ago 9m 480M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (35s) 3s ago 7m 490M - 19.0.0-3227-gc37f63b3 d1033e293654 b143c0687007 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (9m) 2m ago 9m 46.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:33:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (6m) 3s ago 6m 39.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (8m) 2m ago 8m 15.4M - 1.5.0 0da6a335fe13 2d9c1f85828b 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 3s ago 7m 16.6M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 2m ago 6m 48.3M 4288M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 2m ago 5m 48.4M 4288M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 2m ago 5m 44.6M 4288M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (4m) 3s ago 4m 95.5M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (4m) 3s ago 4m 86.3M 5312M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (4m) 3s ago 4m 77.2M 5312M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:33:07.307 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 2m ago 7m 52.5M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 msgr2=0x7fe54406e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 0x7fe54406e1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe550009fd0 tx=0x7fe550009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 msgr2=0x7fe55c066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00b790 tx=0x7fe54c009250 comp rx=0 tx=0).stop 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 shutdown_connections 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe54406bd00 0x7fe54406e1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe55c0fbcc0 0x7fe55c066cf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 --2- 172.21.15.82:0/1751213208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe55c0fcf70 0x7fe55c112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 >> 172.21.15.82:0/1751213208 conn(0x7fe55c0f7420 msgr2=0x7fe55c0f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:07.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 shutdown_connections 2024-04-27T07:33:07.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.306+0000 7fe562328700 1 -- 172.21.15.82:0/1751213208 wait complete. 2024-04-27T07:33:07.364 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:07 smithi100 ceph-mon[34183]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 -- 172.21.15.82:0/1210176659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fbcb0 msgr2=0x7f86a40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/1210176659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fbcb0 0x7f86a40fc0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f86a0004940 tx=0x7f86a0009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 -- 172.21.15.82:0/1210176659 shutdown_connections 2024-04-27T07:33:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/1210176659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fcf60 0x7f86a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/1210176659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fbcb0 0x7f86a40fc0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 -- 172.21.15.82:0/1210176659 >> 172.21.15.82:0/1210176659 conn(0x7f86a40f7430 msgr2=0x7f86a40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 -- 172.21.15.82:0/1210176659 shutdown_connections 2024-04-27T07:33:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.411+0000 7f86ac1dd700 1 -- 172.21.15.82:0/1210176659 wait complete. 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 Processor -- start 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 -- start start 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fbcb0 0x7f86a41106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4066330 con 0x7f86a40fcf60 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86ac1dd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4066470 con 0x7f86a40fbcb0 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51000/0 (socket says 172.21.15.82:51000) 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 -- 172.21.15.82:0/2201053305 learned_addr learned my addr 172.21.15.82:0/2201053305 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9f79700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fbcb0 0x7f86a41106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 -- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fbcb0 msgr2=0x7f86a41106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fbcb0 0x7f86a41106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 -- 172.21.15.82:0/2201053305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0005040 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.412+0000 7f86a9778700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f869400eb40 tx=0x7f869400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.413+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8694007cc0 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.413+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a4113130 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.413+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f869400f040 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.413+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f869400ca10 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.413+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a4113670 con 0x7f86a40fcf60 2024-04-27T07:33:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.414+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a405f5c0 con 0x7f86a40fcf60 2024-04-27T07:33:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.415+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f869400cc80 con 0x7f86a40fcf60 2024-04-27T07:33:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.415+0000 7f869a7fc700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 0x7f869006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.415+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f869408a680 con 0x7f86a40fcf60 2024-04-27T07:33:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.415+0000 7f86a9f79700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 0x7f869006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.416+0000 7f86a9f79700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 0x7f869006e1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86a0004890 tx=0x7f86a0009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:07.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.420+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8694050930 con 0x7f86a40fcf60 2024-04-27T07:33:07.471 INFO:tasks.workunit.client.0.smithi082.stdout:3/48: fsync d8/ff 0 2024-04-27T07:33:07.472 INFO:tasks.workunit.client.0.smithi082.stdout:1/48: read f2 [1143849,75463] 0 2024-04-27T07:33:07.472 INFO:tasks.workunit.client.0.smithi082.stdout:6/44: dwrite d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:07.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/17: dread f0 [0,4194304] 0 2024-04-27T07:33:07.474 INFO:tasks.workunit.client.0.smithi082.stdout:3/49: write f6 [618530,109067] 0 2024-04-27T07:33:07.479 INFO:tasks.workunit.client.0.smithi082.stdout:7/18: dread f0 [0,4194304] 0 2024-04-27T07:33:07.479 INFO:tasks.workunit.client.0.smithi082.stdout:7/19: stat f0 0 2024-04-27T07:33:07.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:07 smithi082 ceph-mon[26613]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:07.601 INFO:tasks.workunit.client.0.smithi082.stdout:9/27: mkdir d9/da 0 2024-04-27T07:33:07.606 INFO:tasks.workunit.client.0.smithi082.stdout:5/36: rename c6 to d8/cd 0 2024-04-27T07:33:07.607 INFO:tasks.workunit.client.0.smithi082.stdout:5/37: chown d8 8552 1 2024-04-27T07:33:07.607 INFO:tasks.workunit.client.0.smithi082.stdout:1/49: fdatasync d4/fd 0 2024-04-27T07:33:07.607 INFO:tasks.workunit.client.0.smithi082.stdout:6/45: symlink d2/d3/lb 0 2024-04-27T07:33:07.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/20: creat f2 x:0 0 0 2024-04-27T07:33:07.607 INFO:tasks.workunit.client.0.smithi082.stdout:9/28: creat d9/fb x:0 0 0 2024-04-27T07:33:07.702 INFO:tasks.workunit.client.0.smithi082.stdout:1/50: creat d4/fe x:0 0 0 2024-04-27T07:33:07.703 INFO:tasks.workunit.client.0.smithi082.stdout:3/50: mknod d8/d9/dd/d13/c14 0 2024-04-27T07:33:07.704 INFO:tasks.workunit.client.0.smithi082.stdout:6/46: symlink d2/lc 0 2024-04-27T07:33:07.704 INFO:tasks.workunit.client.0.smithi082.stdout:7/21: dwrite f2 [0,4194304] 0 2024-04-27T07:33:07.705 INFO:tasks.workunit.client.0.smithi082.stdout:7/22: chown c1 231 1 2024-04-27T07:33:07.706 INFO:tasks.workunit.client.0.smithi082.stdout:3/51: truncate d8/ff 1634712 0 2024-04-27T07:33:07.717 INFO:tasks.workunit.client.0.smithi082.stdout:5/38: rmdir d8 39 2024-04-27T07:33:07.717 INFO:tasks.workunit.client.0.smithi082.stdout:1/51: creat d4/ff x:0 0 0 2024-04-27T07:33:07.717 INFO:tasks.workunit.client.0.smithi082.stdout:9/29: mkdir d9/da/dc 0 2024-04-27T07:33:07.718 INFO:tasks.workunit.client.0.smithi082.stdout:7/23: mkdir d3 0 2024-04-27T07:33:07.718 INFO:tasks.workunit.client.0.smithi082.stdout:3/52: mknod d8/d9/dd/c15 0 2024-04-27T07:33:07.718 INFO:tasks.workunit.client.0.smithi082.stdout:9/30: chown f7 58486677 1 2024-04-27T07:33:07.719 INFO:tasks.workunit.client.0.smithi082.stdout:1/52: truncate d4/fc 4468891 0 2024-04-27T07:33:07.721 INFO:tasks.workunit.client.0.smithi082.stdout:7/24: write f0 [2930804,60250] 0 2024-04-27T07:33:07.721 INFO:tasks.workunit.client.0.smithi082.stdout:5/39: write d8/fa [181587,83467] 0 2024-04-27T07:33:07.722 INFO:tasks.workunit.client.0.smithi082.stdout:3/53: creat d8/d9/dd/d13/f16 x:0 0 0 2024-04-27T07:33:07.726 INFO:tasks.workunit.client.0.smithi082.stdout:5/40: chown d8/f9 1098574 1 2024-04-27T07:33:07.726 INFO:tasks.workunit.client.0.smithi082.stdout:9/31: dread f0 [0,4194304] 0 2024-04-27T07:33:07.726 INFO:tasks.workunit.client.0.smithi082.stdout:7/25: mknod d3/c4 0 2024-04-27T07:33:07.726 INFO:tasks.workunit.client.0.smithi082.stdout:5/41: write f4 [412492,57693] 0 2024-04-27T07:33:07.730 INFO:tasks.workunit.client.0.smithi082.stdout:9/32: mknod d9/cd 0 2024-04-27T07:33:07.733 INFO:tasks.workunit.client.0.smithi082.stdout:5/42: unlink f3 0 2024-04-27T07:33:07.734 INFO:tasks.workunit.client.0.smithi082.stdout:5/43: read d8/f9 [13080,52928] 0 2024-04-27T07:33:07.734 INFO:tasks.workunit.client.0.smithi082.stdout:3/54: link c3 d8/d9/dd/c17 0 2024-04-27T07:33:07.735 INFO:tasks.workunit.client.0.smithi082.stdout:9/33: symlink d9/le 0 2024-04-27T07:33:07.736 INFO:tasks.workunit.client.0.smithi082.stdout:9/34: chown l8 265315768 1 2024-04-27T07:33:07.738 INFO:tasks.workunit.client.0.smithi082.stdout:7/26: link f0 d3/f5 0 2024-04-27T07:33:07.739 INFO:tasks.workunit.client.0.smithi082.stdout:1/53: dwrite d4/fd [0,4194304] 0 2024-04-27T07:33:07.739 INFO:tasks.workunit.client.0.smithi082.stdout:5/44: rmdir d8 39 2024-04-27T07:33:07.740 INFO:tasks.workunit.client.0.smithi082.stdout:1/54: truncate f1 295184 0 2024-04-27T07:33:07.741 INFO:tasks.workunit.client.0.smithi082.stdout:3/55: mknod d8/d9/c18 0 2024-04-27T07:33:07.742 INFO:tasks.workunit.client.0.smithi082.stdout:9/35: mkdir d9/df 0 2024-04-27T07:33:07.747 INFO:tasks.workunit.client.0.smithi082.stdout:1/55: dread d4/f5 [0,4194304] 0 2024-04-27T07:33:07.747 INFO:tasks.workunit.client.0.smithi082.stdout:3/56: creat d8/f19 x:0 0 0 2024-04-27T07:33:07.748 INFO:tasks.workunit.client.0.smithi082.stdout:5/45: dwrite f7 [0,4194304] 0 2024-04-27T07:33:07.751 INFO:tasks.workunit.client.0.smithi082.stdout:3/57: truncate f6 1350753 0 2024-04-27T07:33:07.757 INFO:tasks.workunit.client.0.smithi082.stdout:3/58: unlink f6 0 2024-04-27T07:33:07.758 INFO:tasks.workunit.client.0.smithi082.stdout:9/36: dwrite f0 [0,4194304] 0 2024-04-27T07:33:07.762 INFO:tasks.workunit.client.0.smithi082.stdout:5/46: creat d8/fe x:0 0 0 2024-04-27T07:33:07.765 INFO:tasks.workunit.client.0.smithi082.stdout:1/56: dwrite d4/f5 [0,4194304] 0 2024-04-27T07:33:07.765 INFO:tasks.workunit.client.0.smithi082.stdout:7/27: getdents d3 0 2024-04-27T07:33:07.768 INFO:tasks.workunit.client.0.smithi082.stdout:1/57: fdatasync f1 0 2024-04-27T07:33:07.774 INFO:tasks.workunit.client.0.smithi082.stdout:9/37: dwrite f4 [0,4194304] 0 2024-04-27T07:33:07.776 INFO:tasks.workunit.client.0.smithi082.stdout:1/58: creat d4/f10 x:0 0 0 2024-04-27T07:33:07.777 INFO:tasks.workunit.client.0.smithi082.stdout:3/59: link d8/ff d8/d9/dd/f1a 0 2024-04-27T07:33:07.782 INFO:tasks.workunit.client.0.smithi082.stdout:5/47: link f7 d8/db/ff 0 2024-04-27T07:33:07.783 INFO:tasks.workunit.client.0.smithi082.stdout:1/59: creat d4/f11 x:0 0 0 2024-04-27T07:33:07.785 INFO:tasks.workunit.client.0.smithi082.stdout:5/48: dread d8/fa [0,4194304] 0 2024-04-27T07:33:07.786 INFO:tasks.workunit.client.0.smithi082.stdout:3/60: fdatasync d8/d9/dd/f1a 0 2024-04-27T07:33:07.789 INFO:tasks.workunit.client.0.smithi082.stdout:9/38: dwrite d9/fb [0,4194304] 0 2024-04-27T07:33:07.791 INFO:tasks.workunit.client.0.smithi082.stdout:5/49: write d8/fe [381115,90122] 0 2024-04-27T07:33:07.793 INFO:tasks.workunit.client.0.smithi082.stdout:5/50: dread - f5 zero size 2024-04-27T07:33:07.794 INFO:tasks.workunit.client.0.smithi082.stdout:3/61: fsync f5 0 2024-04-27T07:33:07.802 INFO:tasks.workunit.client.0.smithi082.stdout:5/51: mknod d8/c10 0 2024-04-27T07:33:07.802 INFO:tasks.workunit.client.0.smithi082.stdout:1/60: dwrite d4/fc [4194304,4194304] 0 2024-04-27T07:33:07.808 INFO:tasks.workunit.client.0.smithi082.stdout:9/39: dwrite f3 [0,4194304] 0 2024-04-27T07:33:07.813 INFO:tasks.workunit.client.0.smithi082.stdout:7/28: dwrite d3/f5 [0,4194304] 0 2024-04-27T07:33:07.817 INFO:tasks.workunit.client.0.smithi082.stdout:5/52: link f7 d8/db/f11 0 2024-04-27T07:33:07.818 INFO:tasks.workunit.client.0.smithi082.stdout:7/29: creat d3/f6 x:0 0 0 2024-04-27T07:33:07.821 INFO:tasks.workunit.client.0.smithi082.stdout:3/62: getdents d8 0 2024-04-27T07:33:07.821 INFO:tasks.workunit.client.0.smithi082.stdout:1/61: dwrite d4/fc [0,4194304] 0 2024-04-27T07:33:07.821 INFO:tasks.workunit.client.0.smithi082.stdout:9/40: dread f4 [0,4194304] 0 2024-04-27T07:33:07.824 INFO:tasks.workunit.client.0.smithi082.stdout:5/53: unlink d8/fe 0 2024-04-27T07:33:07.824 INFO:tasks.workunit.client.0.smithi082.stdout:7/30: creat d3/f7 x:0 0 0 2024-04-27T07:33:07.827 INFO:tasks.workunit.client.0.smithi082.stdout:3/63: mkdir d8/d9/dd/d13/d1b 0 2024-04-27T07:33:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.830+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86a404bed0 con 0x7f86a40fcf60 2024-04-27T07:33:07.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.831+0000 7f869a7fc700 1 -- 172.21.15.82:0/2201053305 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f8694053cc0 con 0x7f86a40fcf60 2024-04-27T07:33:07.833 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:33:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 13, 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:33:07.835 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:33:07.835 INFO:tasks.workunit.client.0.smithi082.stdout:5/54: unlink d8/c10 0 2024-04-27T07:33:07.835 INFO:tasks.workunit.client.0.smithi082.stdout:9/41: dwrite f7 [0,4194304] 0 2024-04-27T07:33:07.836 INFO:tasks.workunit.client.0.smithi082.stdout:7/31: creat d3/f8 x:0 0 0 2024-04-27T07:33:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 msgr2=0x7f869006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 0x7f869006e1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86a0004890 tx=0x7f86a0009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 msgr2=0x7f86a4112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f869400eb40 tx=0x7f869400b040 comp rx=0 tx=0).stop 2024-04-27T07:33:07.838 INFO:tasks.workunit.client.0.smithi082.stdout:1/62: link d4/f7 d4/f12 0 2024-04-27T07:33:07.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 shutdown_connections 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f869006bcf0 0x7f869006e1a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86a40fbcb0 0x7f86a41106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 --2- 172.21.15.82:0/2201053305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86a40fcf60 0x7f86a4112bf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 >> 172.21.15.82:0/2201053305 conn(0x7f86a40f7430 msgr2=0x7f86a40f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.835+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 shutdown_connections 2024-04-27T07:33:07.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:07.836+0000 7f86ac1dd700 1 -- 172.21.15.82:0/2201053305 wait complete. 2024-04-27T07:33:07.839 INFO:tasks.workunit.client.0.smithi082.stdout:5/55: unlink d8/f9 0 2024-04-27T07:33:07.840 INFO:tasks.workunit.client.0.smithi082.stdout:1/63: write d4/fa [2896676,50340] 0 2024-04-27T07:33:07.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/32: mkdir d3/d9 0 2024-04-27T07:33:07.843 INFO:tasks.workunit.client.0.smithi082.stdout:7/33: fsync f2 0 2024-04-27T07:33:07.845 INFO:tasks.workunit.client.0.smithi082.stdout:1/64: rename d4/c9 to d4/c13 0 2024-04-27T07:33:07.846 INFO:tasks.workunit.client.0.smithi082.stdout:3/64: dwrite d8/d9/dd/d13/f16 [0,4194304] 0 2024-04-27T07:33:07.847 INFO:tasks.workunit.client.0.smithi082.stdout:9/42: mknod d9/da/dc/c10 0 2024-04-27T07:33:07.851 INFO:tasks.workunit.client.0.smithi082.stdout:7/34: creat d3/d9/fa x:0 0 0 2024-04-27T07:33:07.853 INFO:tasks.workunit.client.0.smithi082.stdout:9/43: mknod d9/da/dc/c11 0 2024-04-27T07:33:07.855 INFO:tasks.workunit.client.0.smithi082.stdout:9/44: dread f5 [0,4194304] 0 2024-04-27T07:33:07.856 INFO:tasks.workunit.client.0.smithi082.stdout:3/65: rename d8/f19 to d8/d9/f1c 0 2024-04-27T07:33:07.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/45: rename d9 to d9/d12 22 2024-04-27T07:33:07.858 INFO:tasks.workunit.client.0.smithi082.stdout:3/66: chown d8/d9/dd/c15 29918385 1 2024-04-27T07:33:07.861 INFO:tasks.workunit.client.0.smithi082.stdout:1/65: link d4/f5 d4/f14 0 2024-04-27T07:33:07.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/35: dwrite d3/f7 [0,4194304] 0 2024-04-27T07:33:07.863 INFO:tasks.workunit.client.0.smithi082.stdout:9/46: unlink c6 0 2024-04-27T07:33:07.867 INFO:tasks.workunit.client.0.smithi082.stdout:1/66: mkdir d4/d15 0 2024-04-27T07:33:07.869 INFO:tasks.workunit.client.0.smithi082.stdout:7/36: unlink d3/d9/fa 0 2024-04-27T07:33:07.869 INFO:tasks.workunit.client.0.smithi082.stdout:7/37: dread - d3/f8 zero size 2024-04-27T07:33:07.869 INFO:tasks.workunit.client.0.smithi082.stdout:7/38: readlink - no filename 2024-04-27T07:33:07.870 INFO:tasks.workunit.client.0.smithi082.stdout:7/39: stat d3 0 2024-04-27T07:33:07.871 INFO:tasks.workunit.client.0.smithi082.stdout:9/47: mknod d9/da/c13 0 2024-04-27T07:33:07.871 INFO:tasks.workunit.client.0.smithi082.stdout:9/48: readlink l8 0 2024-04-27T07:33:07.872 INFO:tasks.workunit.client.0.smithi082.stdout:5/56: write f7 [2071737,2637] 0 2024-04-27T07:33:07.873 INFO:tasks.workunit.client.0.smithi082.stdout:9/49: dread f5 [0,4194304] 0 2024-04-27T07:33:07.875 INFO:tasks.workunit.client.0.smithi082.stdout:1/67: fsync d4/fd 0 2024-04-27T07:33:07.876 INFO:tasks.workunit.client.0.smithi082.stdout:7/40: mkdir d3/db 0 2024-04-27T07:33:07.877 INFO:tasks.workunit.client.0.smithi082.stdout:7/41: write d3/f5 [224358,17448] 0 2024-04-27T07:33:07.878 INFO:tasks.workunit.client.0.smithi082.stdout:5/57: rmdir d8/db 39 2024-04-27T07:33:07.878 INFO:tasks.workunit.client.0.smithi082.stdout:5/58: readlink - no filename 2024-04-27T07:33:07.878 INFO:tasks.workunit.client.0.smithi082.stdout:5/59: readlink - no filename 2024-04-27T07:33:07.879 INFO:tasks.workunit.client.0.smithi082.stdout:5/60: write f5 [299618,92089] 0 2024-04-27T07:33:07.883 INFO:tasks.workunit.client.0.smithi082.stdout:1/68: creat d4/f16 x:0 0 0 2024-04-27T07:33:07.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/42: dread f2 [0,4194304] 0 2024-04-27T07:33:07.886 INFO:tasks.workunit.client.0.smithi082.stdout:3/67: getdents d8 0 2024-04-27T07:33:07.891 INFO:tasks.workunit.client.0.smithi082.stdout:5/61: write d8/db/f11 [907233,115377] 0 2024-04-27T07:33:07.892 INFO:tasks.workunit.client.0.smithi082.stdout:3/68: fsync d8/d9/f1c 0 2024-04-27T07:33:07.892 INFO:tasks.workunit.client.0.smithi082.stdout:1/69: dwrite d4/f16 [0,4194304] 0 2024-04-27T07:33:07.895 INFO:tasks.workunit.client.0.smithi082.stdout:9/50: truncate f7 3758775 0 2024-04-27T07:33:07.898 INFO:tasks.workunit.client.0.smithi082.stdout:7/43: truncate f0 3971084 0 2024-04-27T07:33:07.900 INFO:tasks.workunit.client.0.smithi082.stdout:9/51: dread f4 [0,4194304] 0 2024-04-27T07:33:07.900 INFO:tasks.workunit.client.0.smithi082.stdout:3/69: mkdir d8/d9/d1d 0 2024-04-27T07:33:07.902 INFO:tasks.workunit.client.0.smithi082.stdout:5/62: unlink d8/db/cc 0 2024-04-27T07:33:07.904 INFO:tasks.workunit.client.0.smithi082.stdout:3/70: unlink d8/d9/dd/d13/c14 0 2024-04-27T07:33:07.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/63: dread d8/fa [0,4194304] 0 2024-04-27T07:33:07.912 INFO:tasks.workunit.client.0.smithi082.stdout:1/70: getdents d4 0 2024-04-27T07:33:07.913 INFO:tasks.workunit.client.0.smithi082.stdout:9/52: dwrite f4 [0,4194304] 0 2024-04-27T07:33:07.918 INFO:tasks.workunit.client.0.smithi082.stdout:5/64: dread f4 [0,4194304] 0 2024-04-27T07:33:07.918 INFO:tasks.workunit.client.0.smithi082.stdout:1/71: fdatasync d4/f12 0 2024-04-27T07:33:07.918 INFO:tasks.workunit.client.0.smithi082.stdout:5/65: stat d8/fa 0 2024-04-27T07:33:07.921 INFO:tasks.workunit.client.0.smithi082.stdout:3/71: link d8/fb d8/d9/dd/d13/f1e 0 2024-04-27T07:33:07.924 INFO:tasks.workunit.client.0.smithi082.stdout:9/53: mknod d9/df/c14 0 2024-04-27T07:33:07.925 INFO:tasks.workunit.client.0.smithi082.stdout:7/44: write d3/f5 [486512,18405] 0 2024-04-27T07:33:07.925 INFO:tasks.workunit.client.0.smithi082.stdout:9/54: dread f5 [0,4194304] 0 2024-04-27T07:33:07.928 INFO:tasks.workunit.client.0.smithi082.stdout:5/66: symlink d8/l12 0 2024-04-27T07:33:07.929 INFO:tasks.workunit.client.0.smithi082.stdout:9/55: mkdir d9/d15 0 2024-04-27T07:33:07.932 INFO:tasks.workunit.client.0.smithi082.stdout:5/67: creat d8/db/f13 x:0 0 0 2024-04-27T07:33:07.933 INFO:tasks.workunit.client.0.smithi082.stdout:7/45: mknod d3/db/cc 0 2024-04-27T07:33:07.934 INFO:tasks.workunit.client.0.smithi082.stdout:7/46: stat d3/db 0 2024-04-27T07:33:07.934 INFO:tasks.workunit.client.0.smithi082.stdout:7/47: readlink - no filename 2024-04-27T07:33:07.935 INFO:tasks.workunit.client.0.smithi082.stdout:7/48: chown d3/d9 39623 1 2024-04-27T07:33:07.937 INFO:tasks.workunit.client.0.smithi082.stdout:9/56: dwrite f0 [4194304,4194304] 0 2024-04-27T07:33:07.937 INFO:tasks.workunit.client.0.smithi082.stdout:7/49: write d3/f5 [1054558,89313] 0 2024-04-27T07:33:07.938 INFO:tasks.workunit.client.0.smithi082.stdout:3/72: truncate d8/d9/dd/d13/f16 1718156 0 2024-04-27T07:33:07.942 INFO:tasks.workunit.client.0.smithi082.stdout:3/73: rmdir d8/d9 39 2024-04-27T07:33:07.944 INFO:tasks.workunit.client.0.smithi082.stdout:9/57: creat d9/da/dc/f16 x:0 0 0 2024-04-27T07:33:07.947 INFO:tasks.workunit.client.0.smithi082.stdout:5/68: dwrite d8/db/f13 [0,4194304] 0 2024-04-27T07:33:07.948 INFO:tasks.workunit.client.0.smithi082.stdout:5/69: chown d8/db 13 1 2024-04-27T07:33:07.948 INFO:tasks.workunit.client.0.smithi082.stdout:9/58: creat d9/da/dc/f17 x:0 0 0 2024-04-27T07:33:07.948 INFO:tasks.workunit.client.0.smithi082.stdout:7/50: dread f2 [0,4194304] 0 2024-04-27T07:33:07.950 INFO:tasks.workunit.client.0.smithi082.stdout:5/70: write f5 [1164462,98853] 0 2024-04-27T07:33:07.952 INFO:tasks.workunit.client.0.smithi082.stdout:5/71: stat d8/db/f11 0 2024-04-27T07:33:07.954 INFO:tasks.workunit.client.0.smithi082.stdout:9/59: mknod d9/da/c18 0 2024-04-27T07:33:07.957 INFO:tasks.workunit.client.0.smithi082.stdout:5/72: mkdir d8/d14 0 2024-04-27T07:33:07.957 INFO:tasks.workunit.client.0.smithi082.stdout:7/51: dread f0 [0,4194304] 0 2024-04-27T07:33:07.958 INFO:tasks.workunit.client.0.smithi082.stdout:7/52: rename d3 to d3/db/dd 22 2024-04-27T07:33:07.960 INFO:tasks.workunit.client.0.smithi082.stdout:7/53: mkdir d3/de 0 2024-04-27T07:33:07.965 INFO:tasks.workunit.client.0.smithi082.stdout:5/73: dwrite d8/db/f11 [0,4194304] 0 2024-04-27T07:33:07.965 INFO:tasks.workunit.client.0.smithi082.stdout:7/54: unlink d3/db/cc 0 2024-04-27T07:33:07.966 INFO:tasks.workunit.client.0.smithi082.stdout:3/74: dread d8/d9/dd/d13/f16 [0,4194304] 0 2024-04-27T07:33:07.966 INFO:tasks.workunit.client.0.smithi082.stdout:7/55: write d3/f8 [209522,21549] 0 2024-04-27T07:33:07.967 INFO:tasks.workunit.client.0.smithi082.stdout:3/75: readlink d8/d9/l11 0 2024-04-27T07:33:07.969 INFO:tasks.workunit.client.0.smithi082.stdout:5/74: chown d8/cd 0 1 2024-04-27T07:33:07.972 INFO:tasks.workunit.client.0.smithi082.stdout:7/56: dread f2 [0,4194304] 0 2024-04-27T07:33:07.975 INFO:tasks.workunit.client.0.smithi082.stdout:9/60: truncate f0 7729138 0 2024-04-27T07:33:07.978 INFO:tasks.workunit.client.0.smithi082.stdout:3/76: write d8/d9/dd/d13/f16 [2304091,8459] 0 2024-04-27T07:33:07.979 INFO:tasks.workunit.client.0.smithi082.stdout:7/57: rmdir d3 39 2024-04-27T07:33:07.981 INFO:tasks.workunit.client.0.smithi082.stdout:3/77: mkdir d8/d9/d1f 0 2024-04-27T07:33:07.982 INFO:tasks.workunit.client.0.smithi082.stdout:7/58: chown d3/db 131454084 1 2024-04-27T07:33:07.984 INFO:tasks.workunit.client.0.smithi082.stdout:3/78: rename d8/le to d8/d9/d1d/l20 0 2024-04-27T07:33:07.985 INFO:tasks.workunit.client.0.smithi082.stdout:3/79: rename d8/d9/dd to d8/d9/dd/d21 22 2024-04-27T07:33:07.987 INFO:tasks.workunit.client.0.smithi082.stdout:3/80: mknod d8/d9/dd/d13/c22 0 2024-04-27T07:33:07.987 INFO:tasks.workunit.client.0.smithi082.stdout:9/61: dread f0 [4194304,4194304] 0 2024-04-27T07:33:07.989 INFO:tasks.workunit.client.0.smithi082.stdout:3/81: creat d8/d9/d1d/f23 x:0 0 0 2024-04-27T07:33:07.991 INFO:tasks.workunit.client.0.smithi082.stdout:7/59: getdents d3/d9 0 2024-04-27T07:33:07.995 INFO:tasks.workunit.client.0.smithi082.stdout:3/82: creat d8/d9/dd/d13/d1b/f24 x:0 0 0 2024-04-27T07:33:07.996 INFO:tasks.workunit.client.0.smithi082.stdout:7/60: dwrite d3/f7 [0,4194304] 0 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 -- 172.21.15.82:0/2063787841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fcf70 msgr2=0x7f58ec0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 --2- 172.21.15.82:0/2063787841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fcf70 0x7f58ec0fd3e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f58e0004940 tx=0x7f58e0009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 -- 172.21.15.82:0/2063787841 shutdown_connections 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 --2- 172.21.15.82:0/2063787841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fcf70 0x7f58ec0fd3e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 --2- 172.21.15.82:0/2063787841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 -- 172.21.15.82:0/2063787841 >> 172.21.15.82:0/2063787841 conn(0x7f58ec0f7440 msgr2=0x7f58ec0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.007+0000 7f58f082f700 1 -- 172.21.15.82:0/2063787841 shutdown_connections 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 -- 172.21.15.82:0/2063787841 wait complete. 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 Processor -- start 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 -- start start 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fcf70 0x7f58ec10cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec10d3e0 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58f082f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec10d550 con 0x7f58ec0fcf70 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58ea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51016/0 (socket says 172.21.15.82:51016) 2024-04-27T07:33:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.008+0000 7f58ea59c700 1 -- 172.21.15.82:0/492500596 learned_addr learned my addr 172.21.15.82:0/492500596 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58e9d9b700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fcf70 0x7f58ec10cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58ea59c700 1 -- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fcf70 msgr2=0x7f58ec10cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58ea59c700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fcf70 0x7f58ec10cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58ea59c700 1 -- 172.21.15.82:0/492500596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0005040 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58ea59c700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f58dc002a50 tx=0x7f58dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58dc007cc0 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58dc00f040 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0662d0 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58dc00da30 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.009+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec066890 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.010+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec04c710 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.011+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f58dc00db90 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.011+0000 7f58daffd700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 0x7f58d406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.011+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f58dc08a8e0 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.011+0000 7f58e9d9b700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 0x7f58d406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.012+0000 7f58e9d9b700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 0x7f58d406e1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58e000b3b0 tx=0x7f58e0009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.023 INFO:tasks.workunit.client.0.smithi082.stdout:7/61: dread d3/f8 [0,4194304] 0 2024-04-27T07:33:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.017+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f58dc057900 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.024 INFO:tasks.workunit.client.0.smithi082.stdout:5/75: fdatasync d8/db/f11 0 2024-04-27T07:33:08.024 INFO:tasks.workunit.client.0.smithi082.stdout:5/76: read d8/db/f11 [4122857,33820] 0 2024-04-27T07:33:08.024 INFO:tasks.workunit.client.0.smithi082.stdout:7/62: getdents d3 0 2024-04-27T07:33:08.027 INFO:tasks.workunit.client.0.smithi082.stdout:7/63: creat d3/db/ff x:0 0 0 2024-04-27T07:33:08.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/83: rmdir d8/d9/dd/d13 39 2024-04-27T07:33:08.030 INFO:tasks.workunit.client.0.smithi082.stdout:5/77: write d8/fa [815377,63291] 0 2024-04-27T07:33:08.032 INFO:tasks.workunit.client.0.smithi082.stdout:5/78: chown d8/d14 26920 1 2024-04-27T07:33:08.034 INFO:tasks.workunit.client.0.smithi082.stdout:3/84: fsync d8/d9/dd/d13/f16 0 2024-04-27T07:33:08.034 INFO:tasks.workunit.client.0.smithi082.stdout:7/64: dread f0 [0,4194304] 0 2024-04-27T07:33:08.034 INFO:tasks.workunit.client.0.smithi082.stdout:9/62: dwrite f7 [0,4194304] 0 2024-04-27T07:33:08.034 INFO:tasks.workunit.client.0.smithi082.stdout:5/79: chown d8/db/f11 7887523 1 2024-04-27T07:33:08.038 INFO:tasks.workunit.client.0.smithi082.stdout:3/85: mkdir d8/d9/d25 0 2024-04-27T07:33:08.040 INFO:tasks.workunit.client.0.smithi082.stdout:7/65: creat d3/db/f10 x:0 0 0 2024-04-27T07:33:08.040 INFO:tasks.workunit.client.0.smithi082.stdout:9/63: write f5 [250127,47102] 0 2024-04-27T07:33:08.041 INFO:tasks.workunit.client.0.smithi082.stdout:9/64: write f7 [5006721,40229] 0 2024-04-27T07:33:08.042 INFO:tasks.workunit.client.0.smithi082.stdout:3/86: mkdir d8/d9/d25/d26 0 2024-04-27T07:33:08.046 INFO:tasks.workunit.client.0.smithi082.stdout:3/87: dread d8/d9/dd/d13/f1e [0,4194304] 0 2024-04-27T07:33:08.047 INFO:tasks.workunit.client.0.smithi082.stdout:5/80: rename d8/db to d8/d15 0 2024-04-27T07:33:08.050 INFO:tasks.workunit.client.0.smithi082.stdout:7/66: link f0 d3/f11 0 2024-04-27T07:33:08.054 INFO:tasks.workunit.client.0.smithi082.stdout:9/65: rmdir d9/d15 0 2024-04-27T07:33:08.055 INFO:tasks.workunit.client.0.smithi082.stdout:5/81: creat d8/d14/f16 x:0 0 0 2024-04-27T07:33:08.056 INFO:tasks.workunit.client.0.smithi082.stdout:5/82: chown f5 15974455 1 2024-04-27T07:33:08.056 INFO:tasks.workunit.client.0.smithi082.stdout:7/67: symlink d3/de/l12 0 2024-04-27T07:33:08.057 INFO:tasks.workunit.client.0.smithi082.stdout:3/88: truncate d8/fb 5942646 0 2024-04-27T07:33:08.062 INFO:tasks.workunit.client.0.smithi082.stdout:3/89: symlink d8/d9/d1f/l27 0 2024-04-27T07:33:08.066 INFO:tasks.workunit.client.0.smithi082.stdout:3/90: unlink d8/d9/l12 0 2024-04-27T07:33:08.066 INFO:tasks.workunit.client.0.smithi082.stdout:5/83: dwrite d8/d14/f16 [0,4194304] 0 2024-04-27T07:33:08.077 INFO:tasks.workunit.client.0.smithi082.stdout:3/91: unlink d8/ca 0 2024-04-27T07:33:08.078 INFO:tasks.workunit.client.0.smithi082.stdout:7/68: dwrite d3/f8 [0,4194304] 0 2024-04-27T07:33:08.080 INFO:tasks.workunit.client.0.smithi082.stdout:7/69: read - d3/f6 zero size 2024-04-27T07:33:08.081 INFO:tasks.workunit.client.0.smithi082.stdout:9/66: dwrite f0 [0,4194304] 0 2024-04-27T07:33:08.084 INFO:tasks.workunit.client.0.smithi082.stdout:5/84: dread d8/d15/f11 [0,4194304] 0 2024-04-27T07:33:08.084 INFO:tasks.workunit.client.0.smithi082.stdout:7/70: fdatasync d3/f7 0 2024-04-27T07:33:08.086 INFO:tasks.workunit.client.0.smithi082.stdout:9/67: creat d9/df/f19 x:0 0 0 2024-04-27T07:33:08.086 INFO:tasks.workunit.client.0.smithi082.stdout:3/92: getdents d8/d9/dd/d13/d1b 0 2024-04-27T07:33:08.097 INFO:tasks.workunit.client.0.smithi082.stdout:9/68: dwrite d9/fb [4194304,4194304] 0 2024-04-27T07:33:08.098 INFO:tasks.workunit.client.0.smithi082.stdout:3/93: rename d8/d9/dd/d13/f16 to d8/d9/dd/d13/d1b/f28 0 2024-04-27T07:33:08.101 INFO:tasks.workunit.client.0.smithi082.stdout:7/71: getdents d3 0 2024-04-27T07:33:08.105 INFO:tasks.workunit.client.0.smithi082.stdout:7/72: fsync d3/f5 0 2024-04-27T07:33:08.106 INFO:tasks.workunit.client.0.smithi082.stdout:9/69: dread f7 [4194304,4194304] 0 2024-04-27T07:33:08.106 INFO:tasks.workunit.client.0.smithi082.stdout:7/73: fdatasync d3/f6 0 2024-04-27T07:33:08.107 INFO:tasks.workunit.client.0.smithi082.stdout:7/74: chown d3/de/l12 32102172 1 2024-04-27T07:33:08.107 INFO:tasks.workunit.client.0.smithi082.stdout:7/75: readlink d3/de/l12 0 2024-04-27T07:33:08.108 INFO:tasks.workunit.client.0.smithi082.stdout:5/85: truncate d8/d14/f16 2014972 0 2024-04-27T07:33:08.109 INFO:tasks.workunit.client.0.smithi082.stdout:9/70: creat d9/df/f1a x:0 0 0 2024-04-27T07:33:08.110 INFO:tasks.workunit.client.0.smithi082.stdout:7/76: rename f2 to d3/de/f13 0 2024-04-27T07:33:08.111 INFO:tasks.workunit.client.0.smithi082.stdout:7/77: fdatasync d3/f6 0 2024-04-27T07:33:08.112 INFO:tasks.workunit.client.0.smithi082.stdout:9/71: creat d9/da/dc/f1b x:0 0 0 2024-04-27T07:33:08.112 INFO:tasks.workunit.client.0.smithi082.stdout:5/86: mknod d8/c17 0 2024-04-27T07:33:08.114 INFO:tasks.workunit.client.0.smithi082.stdout:7/78: rename d3/f7 to d3/de/f14 0 2024-04-27T07:33:08.115 INFO:tasks.workunit.client.0.smithi082.stdout:9/72: symlink d9/da/l1c 0 2024-04-27T07:33:08.118 INFO:tasks.workunit.client.0.smithi082.stdout:5/87: unlink d8/cd 0 2024-04-27T07:33:08.118 INFO:tasks.workunit.client.0.smithi082.stdout:3/94: truncate d8/d9/dd/d13/d1b/f28 2279478 0 2024-04-27T07:33:08.120 INFO:tasks.workunit.client.0.smithi082.stdout:7/79: mkdir d3/db/d15 0 2024-04-27T07:33:08.120 INFO:tasks.workunit.client.0.smithi082.stdout:3/95: fsync d8/d9/d1d/f23 0 2024-04-27T07:33:08.120 INFO:tasks.workunit.client.0.smithi082.stdout:7/80: dread - d3/f6 zero size 2024-04-27T07:33:08.123 INFO:tasks.workunit.client.0.smithi082.stdout:7/81: chown d3/c4 18565866 1 2024-04-27T07:33:08.123 INFO:tasks.workunit.client.0.smithi082.stdout:9/73: dwrite f3 [0,4194304] 0 2024-04-27T07:33:08.123 INFO:tasks.workunit.client.0.smithi082.stdout:5/88: mknod d8/d14/c18 0 2024-04-27T07:33:08.128 INFO:tasks.workunit.client.0.smithi082.stdout:7/82: symlink d3/db/l16 0 2024-04-27T07:33:08.129 INFO:tasks.workunit.client.0.smithi082.stdout:7/83: dread - d3/f6 zero size 2024-04-27T07:33:08.130 INFO:tasks.workunit.client.0.smithi082.stdout:3/96: truncate d8/fb 5560234 0 2024-04-27T07:33:08.131 INFO:tasks.workunit.client.0.smithi082.stdout:9/74: symlink d9/l1d 0 2024-04-27T07:33:08.132 INFO:tasks.workunit.client.0.smithi082.stdout:5/89: symlink d8/l19 0 2024-04-27T07:33:08.133 INFO:tasks.workunit.client.0.smithi082.stdout:5/90: stat d8/c17 0 2024-04-27T07:33:08.136 INFO:tasks.workunit.client.0.smithi082.stdout:3/97: symlink d8/d9/dd/d13/d1b/l29 0 2024-04-27T07:33:08.137 INFO:tasks.workunit.client.0.smithi082.stdout:9/75: mknod d9/da/c1e 0 2024-04-27T07:33:08.138 INFO:tasks.workunit.client.0.smithi082.stdout:9/76: readlink d9/l1d 0 2024-04-27T07:33:08.140 INFO:tasks.workunit.client.0.smithi082.stdout:3/98: mkdir d8/d9/d1f/d2a 0 2024-04-27T07:33:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:3/99: write d8/d9/d1d/f23 [447294,77612] 0 2024-04-27T07:33:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:5/91: mkdir d8/d1a 0 2024-04-27T07:33:08.142 INFO:tasks.workunit.client.0.smithi082.stdout:3/100: dread - d8/d9/dd/d13/d1b/f24 zero size 2024-04-27T07:33:08.144 INFO:tasks.workunit.client.0.smithi082.stdout:9/77: mknod d9/da/dc/c1f 0 2024-04-27T07:33:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/78: fdatasync d9/da/dc/f16 0 2024-04-27T07:33:08.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/79: fdatasync d9/fb 0 2024-04-27T07:33:08.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/92: mkdir d8/d14/d1b 0 2024-04-27T07:33:08.150 INFO:tasks.workunit.client.0.smithi082.stdout:9/80: creat d9/da/dc/f20 x:0 0 0 2024-04-27T07:33:08.150 INFO:tasks.workunit.client.0.smithi082.stdout:3/101: symlink d8/d9/d1f/d2a/l2b 0 2024-04-27T07:33:08.153 INFO:tasks.workunit.client.0.smithi082.stdout:7/84: dwrite d3/f5 [0,4194304] 0 2024-04-27T07:33:08.154 INFO:tasks.workunit.client.0.smithi082.stdout:9/81: dread f5 [0,4194304] 0 2024-04-27T07:33:08.155 INFO:tasks.workunit.client.0.smithi082.stdout:9/82: read d9/fb [1891865,58915] 0 2024-04-27T07:33:08.155 INFO:tasks.workunit.client.0.smithi082.stdout:7/85: write d3/db/ff [222970,87262] 0 2024-04-27T07:33:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:7/86: fsync d3/f6 0 2024-04-27T07:33:08.157 INFO:tasks.workunit.client.0.smithi082.stdout:9/83: chown d9/da/c1e 19 1 2024-04-27T07:33:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:5/93: link d8/fa d8/d15/f1c 0 2024-04-27T07:33:08.158 INFO:tasks.workunit.client.0.smithi082.stdout:9/84: write d9/df/f1a [482679,43402] 0 2024-04-27T07:33:08.159 INFO:tasks.workunit.client.0.smithi082.stdout:5/94: chown d8/c17 0 1 2024-04-27T07:33:08.160 INFO:tasks.workunit.client.0.smithi082.stdout:3/102: symlink d8/l2c 0 2024-04-27T07:33:08.161 INFO:tasks.workunit.client.0.smithi082.stdout:3/103: fsync d8/ff 0 2024-04-27T07:33:08.162 INFO:tasks.workunit.client.0.smithi082.stdout:7/87: mknod d3/de/c17 0 2024-04-27T07:33:08.166 INFO:tasks.workunit.client.0.smithi082.stdout:9/85: creat d9/f21 x:0 0 0 2024-04-27T07:33:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:9/86: read d9/df/f1a [436159,89776] 0 2024-04-27T07:33:08.169 INFO:tasks.workunit.client.0.smithi082.stdout:7/88: link d3/de/f14 d3/db/f18 0 2024-04-27T07:33:08.171 INFO:tasks.workunit.client.0.smithi082.stdout:7/89: fdatasync d3/f6 0 2024-04-27T07:33:08.173 INFO:tasks.workunit.client.0.smithi082.stdout:5/95: dwrite f4 [0,4194304] 0 2024-04-27T07:33:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:5/96: readlink d8/l19 0 2024-04-27T07:33:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:9/87: mknod d9/c22 0 2024-04-27T07:33:08.174 INFO:tasks.workunit.client.0.smithi082.stdout:9/88: truncate f3 5198936 0 2024-04-27T07:33:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:7/90: symlink d3/l19 0 2024-04-27T07:33:08.175 INFO:tasks.workunit.client.0.smithi082.stdout:9/89: dread - d9/da/dc/f16 zero size 2024-04-27T07:33:08.179 INFO:tasks.workunit.client.0.smithi082.stdout:7/91: mknod d3/c1a 0 2024-04-27T07:33:08.180 INFO:tasks.workunit.client.0.smithi082.stdout:7/92: fdatasync d3/db/ff 0 2024-04-27T07:33:08.181 INFO:tasks.workunit.client.0.smithi082.stdout:5/97: fdatasync d8/d14/f16 0 2024-04-27T07:33:08.185 INFO:tasks.workunit.client.0.smithi082.stdout:7/93: creat d3/de/f1b x:0 0 0 2024-04-27T07:33:08.191 INFO:tasks.workunit.client.0.smithi082.stdout:9/90: dwrite d9/df/f1a [0,4194304] 0 2024-04-27T07:33:08.192 INFO:tasks.workunit.client.0.smithi082.stdout:5/98: link d8/d15/f1c d8/d14/d1b/f1d 0 2024-04-27T07:33:08.193 INFO:tasks.workunit.client.0.smithi082.stdout:3/104: dread d8/d9/dd/d13/f1e [0,4194304] 0 2024-04-27T07:33:08.197 INFO:tasks.workunit.client.0.smithi082.stdout:3/105: creat d8/d9/d1d/f2d x:0 0 0 2024-04-27T07:33:08.201 INFO:tasks.workunit.client.0.smithi082.stdout:5/99: dread d8/fa [0,4194304] 0 2024-04-27T07:33:08.201 INFO:tasks.workunit.client.0.smithi082.stdout:3/106: truncate d8/d9/dd/d13/f1e 953159 0 2024-04-27T07:33:08.205 INFO:tasks.workunit.client.0.smithi082.stdout:3/107: creat d8/f2e x:0 0 0 2024-04-27T07:33:08.206 INFO:tasks.workunit.client.0.smithi082.stdout:3/108: chown d8/d9/d1f/d2a/l2b 11851 1 2024-04-27T07:33:08.207 INFO:tasks.workunit.client.0.smithi082.stdout:3/109: chown d8/f2e 0 1 2024-04-27T07:33:08.208 INFO:tasks.workunit.client.0.smithi082.stdout:5/100: getdents d8/d14/d1b 0 2024-04-27T07:33:08.210 INFO:tasks.workunit.client.0.smithi082.stdout:3/110: symlink d8/d9/d25/l2f 0 2024-04-27T07:33:08.213 INFO:tasks.workunit.client.0.smithi082.stdout:3/111: link d8/d9/d1d/f23 d8/d9/d25/f30 0 2024-04-27T07:33:08.215 INFO:tasks.workunit.client.0.smithi082.stdout:3/112: write d8/d9/d1d/f23 [604974,81164] 0 2024-04-27T07:33:08.218 INFO:tasks.workunit.client.0.smithi082.stdout:3/113: creat d8/d9/dd/d13/d1b/f31 x:0 0 0 2024-04-27T07:33:08.228 INFO:tasks.workunit.client.0.smithi082.stdout:3/114: fsync d8/fb 0 2024-04-27T07:33:08.229 INFO:tasks.workunit.client.0.smithi082.stdout:5/101: dwrite d8/d14/d1b/f1d [0,4194304] 0 2024-04-27T07:33:08.231 INFO:tasks.workunit.client.0.smithi082.stdout:5/102: rmdir d8/d15 39 2024-04-27T07:33:08.231 INFO:tasks.workunit.client.0.smithi082.stdout:5/103: chown f5 3081 1 2024-04-27T07:33:08.232 INFO:tasks.workunit.client.0.smithi082.stdout:3/115: mkdir d8/d9/dd/d13/d32 0 2024-04-27T07:33:08.236 INFO:tasks.workunit.client.0.smithi082.stdout:5/104: symlink d8/d14/d1b/l1e 0 2024-04-27T07:33:08.237 INFO:tasks.workunit.client.0.smithi082.stdout:5/105: truncate f5 2247972 0 2024-04-27T07:33:08.240 INFO:tasks.workunit.client.0.smithi082.stdout:5/106: chown d8/d15 0 1 2024-04-27T07:33:08.244 INFO:tasks.workunit.client.0.smithi082.stdout:3/116: rename d8/d9/d25/f30 to d8/f33 0 2024-04-27T07:33:08.244 INFO:tasks.workunit.client.0.smithi082.stdout:5/107: dread d8/d15/f13 [0,4194304] 0 2024-04-27T07:33:08.244 INFO:tasks.workunit.client.0.smithi082.stdout:3/117: readlink d8/l2c 0 2024-04-27T07:33:08.245 INFO:tasks.workunit.client.0.smithi082.stdout:5/108: write d8/d14/d1b/f1d [2335725,1928] 0 2024-04-27T07:33:08.246 INFO:tasks.workunit.client.0.smithi082.stdout:3/118: write d8/d9/dd/f1a [4874,86734] 0 2024-04-27T07:33:08.246 INFO:tasks.workunit.client.0.smithi082.stdout:5/109: read f4 [3009323,94414] 0 2024-04-27T07:33:08.251 INFO:tasks.workunit.client.0.smithi082.stdout:3/119: write d8/f33 [1440575,86626] 0 2024-04-27T07:33:08.255 INFO:tasks.workunit.client.0.smithi082.stdout:3/120: rename d8/d9/dd/d13/d1b/l29 to d8/d9/d25/l34 0 2024-04-27T07:33:08.259 INFO:tasks.workunit.client.0.smithi082.stdout:3/121: creat d8/d9/dd/f35 x:0 0 0 2024-04-27T07:33:08.261 INFO:tasks.workunit.client.0.smithi082.stdout:3/122: truncate d8/d9/d1d/f23 2370578 0 2024-04-27T07:33:08.268 INFO:tasks.workunit.client.0.smithi082.stdout:3/123: rename d8/d9/d25/l34 to d8/d9/dd/d13/l36 0 2024-04-27T07:33:08.269 INFO:tasks.workunit.client.0.smithi082.stdout:3/124: truncate d8/d9/dd/f35 492375 0 2024-04-27T07:33:08.271 INFO:tasks.workunit.client.0.smithi082.stdout:3/125: dread d8/fb [0,4194304] 0 2024-04-27T07:33:08.272 INFO:tasks.workunit.client.0.smithi082.stdout:3/126: chown d8/d9/dd/f1a 8519 1 2024-04-27T07:33:08.276 INFO:tasks.workunit.client.0.smithi082.stdout:3/127: rename c3 to d8/c37 0 2024-04-27T07:33:08.282 INFO:tasks.workunit.client.0.smithi082.stdout:3/128: dwrite f5 [8388608,4194304] 0 2024-04-27T07:33:08.283 INFO:tasks.workunit.client.0.smithi082.stdout:3/129: read - d8/f2e zero size 2024-04-27T07:33:08.287 INFO:tasks.workunit.client.0.smithi082.stdout:3/130: creat d8/d9/dd/d13/d32/f38 x:0 0 0 2024-04-27T07:33:08.288 INFO:tasks.workunit.client.0.smithi082.stdout:3/131: write d8/d9/d1d/f23 [356358,65543] 0 2024-04-27T07:33:08.292 INFO:tasks.workunit.client.0.smithi082.stdout:3/132: rmdir d8/d9/d1d 39 2024-04-27T07:33:08.293 INFO:tasks.workunit.client.0.smithi082.stdout:3/133: chown d8/fb 25 1 2024-04-27T07:33:08.293 INFO:tasks.workunit.client.0.smithi082.stdout:3/134: readlink d8/l2c 0 2024-04-27T07:33:08.297 INFO:tasks.workunit.client.0.smithi082.stdout:3/135: rename d8/d9/dd/c15 to d8/d9/d1f/d2a/c39 0 2024-04-27T07:33:08.302 INFO:tasks.workunit.client.0.smithi082.stdout:3/136: rename d8/d9/c18 to d8/d9/d1d/c3a 0 2024-04-27T07:33:08.309 INFO:tasks.workunit.client.0.smithi082.stdout:3/137: dwrite d8/ff [0,4194304] 0 2024-04-27T07:33:08.312 INFO:tasks.workunit.client.0.smithi082.stdout:3/138: mknod d8/d9/dd/d13/d32/c3b 0 2024-04-27T07:33:08.312 INFO:tasks.workunit.client.0.smithi082.stdout:3/139: chown d8/d9/f1c 22591455 1 2024-04-27T07:33:08.321 INFO:tasks.workunit.client.0.smithi082.stdout:3/140: dwrite d8/d9/dd/d13/d1b/f24 [0,4194304] 0 2024-04-27T07:33:08.323 INFO:tasks.workunit.client.0.smithi082.stdout:3/141: dread - d8/d9/dd/d13/d32/f38 zero size 2024-04-27T07:33:08.324 INFO:tasks.workunit.client.0.smithi082.stdout:3/142: write d8/ff [2229458,70364] 0 2024-04-27T07:33:08.330 INFO:tasks.workunit.client.0.smithi082.stdout:3/143: rename d8/d9/d1f/l27 to d8/d9/d1f/l3c 0 2024-04-27T07:33:08.330 INFO:tasks.workunit.client.0.smithi082.stdout:3/144: chown d8 251789560 1 2024-04-27T07:33:08.334 INFO:tasks.workunit.client.0.smithi082.stdout:3/145: rename d8/d9/dd/d13/d32 to d8/d9/d25/d26/d3d 0 2024-04-27T07:33:08.336 INFO:tasks.workunit.client.0.smithi082.stdout:3/146: mknod d8/d9/dd/d13/c3e 0 2024-04-27T07:33:08.343 INFO:tasks.workunit.client.0.smithi082.stdout:3/147: fdatasync d8/d9/dd/d13/d1b/f24 0 2024-04-27T07:33:08.344 INFO:tasks.workunit.client.0.smithi082.stdout:3/148: write d8/f33 [208226,120968] 0 2024-04-27T07:33:08.347 INFO:tasks.workunit.client.0.smithi082.stdout:3/149: chown d8/d9/d1d/l20 1771432 1 2024-04-27T07:33:08.348 INFO:tasks.workunit.client.0.smithi082.stdout:3/150: stat d8/d9/dd 0 2024-04-27T07:33:08.348 INFO:tasks.workunit.client.0.smithi082.stdout:3/151: dread - d8/d9/d25/d26/d3d/f38 zero size 2024-04-27T07:33:08.349 INFO:tasks.workunit.client.0.smithi082.stdout:3/152: fsync d8/d9/f1c 0 2024-04-27T07:33:08.351 INFO:tasks.workunit.client.0.smithi082.stdout:3/153: mkdir d8/d9/d3f 0 2024-04-27T07:33:08.353 INFO:tasks.workunit.client.0.smithi082.stdout:3/154: rename d8/d9/d1d/c3a to d8/d9/d1f/c40 0 2024-04-27T07:33:08.354 INFO:tasks.workunit.client.0.smithi082.stdout:3/155: fsync d8/f33 0 2024-04-27T07:33:08.355 INFO:tasks.workunit.client.0.smithi082.stdout:3/156: write d8/d9/d25/d26/d3d/f38 [762344,1078] 0 2024-04-27T07:33:08.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/157: creat d8/d9/d1f/f41 x:0 0 0 2024-04-27T07:33:08.363 INFO:tasks.workunit.client.0.smithi082.stdout:3/158: dwrite d8/ff [0,4194304] 0 2024-04-27T07:33:08.364 INFO:tasks.workunit.client.0.smithi082.stdout:3/159: dread - d8/d9/d1f/f41 zero size 2024-04-27T07:33:08.365 INFO:tasks.workunit.client.0.smithi082.stdout:3/160: write d8/d9/f1c [457351,88306] 0 2024-04-27T07:33:08.366 INFO:tasks.workunit.client.0.smithi082.stdout:3/161: chown d8/d9/d25/l2f 5191 1 2024-04-27T07:33:08.373 INFO:tasks.workunit.client.0.smithi082.stdout:3/162: dwrite d8/d9/d25/d26/d3d/f38 [0,4194304] 0 2024-04-27T07:33:08.376 INFO:tasks.workunit.client.0.smithi082.stdout:3/163: mknod d8/d9/d1f/c42 0 2024-04-27T07:33:08.377 INFO:tasks.workunit.client.0.smithi082.stdout:3/164: dread - d8/f2e zero size 2024-04-27T07:33:08.380 INFO:tasks.workunit.client.0.smithi082.stdout:3/165: mknod d8/d9/d25/c43 0 2024-04-27T07:33:08.387 INFO:tasks.workunit.client.0.smithi082.stdout:3/166: dwrite d8/d9/d25/d26/d3d/f38 [0,4194304] 0 2024-04-27T07:33:08.390 INFO:tasks.workunit.client.0.smithi082.stdout:3/167: creat d8/d9/d1f/d2a/f44 x:0 0 0 2024-04-27T07:33:08.393 INFO:tasks.workunit.client.0.smithi082.stdout:3/168: creat d8/d9/dd/d13/f45 x:0 0 0 2024-04-27T07:33:08.395 INFO:tasks.workunit.client.0.smithi082.stdout:3/169: creat d8/d9/d1f/f46 x:0 0 0 2024-04-27T07:33:08.397 INFO:tasks.workunit.client.0.smithi082.stdout:3/170: fsync d8/d9/dd/d13/d1b/f31 0 2024-04-27T07:33:08.397 INFO:tasks.workunit.client.0.smithi082.stdout:3/171: stat d8/d9/d25/d26/d3d/c3b 0 2024-04-27T07:33:08.397 INFO:tasks.workunit.client.0.smithi082.stdout:3/172: chown d8/d9/dd/d13 809 1 2024-04-27T07:33:08.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/173: write d8/d9/d1f/f41 [816471,9173] 0 2024-04-27T07:33:08.403 INFO:tasks.workunit.client.0.smithi082.stdout:3/174: dread d8/ff [0,4194304] 0 2024-04-27T07:33:08.405 INFO:tasks.workunit.client.0.smithi082.stdout:3/175: mknod d8/d9/d25/d26/c47 0 2024-04-27T07:33:08.406 INFO:tasks.workunit.client.0.smithi082.stdout:3/176: creat d8/d9/dd/d13/f48 x:0 0 0 2024-04-27T07:33:08.406 INFO:tasks.workunit.client.0.smithi082.stdout:3/177: chown d8/d9/f1c 1582 1 2024-04-27T07:33:08.407 INFO:tasks.workunit.client.0.smithi082.stdout:3/178: write d8/d9/dd/d13/f45 [819856,5948] 0 2024-04-27T07:33:08.410 INFO:tasks.workunit.client.0.smithi082.stdout:3/179: symlink d8/d9/dd/l49 0 2024-04-27T07:33:08.411 INFO:tasks.workunit.client.0.smithi082.stdout:3/180: write d8/ff [2962182,124848] 0 2024-04-27T07:33:08.417 INFO:tasks.workunit.client.0.smithi082.stdout:3/181: truncate d8/d9/d1f/f41 386923 0 2024-04-27T07:33:08.420 INFO:tasks.workunit.client.0.smithi082.stdout:3/182: unlink d8/d9/d25/c43 0 2024-04-27T07:33:08.422 INFO:tasks.workunit.client.0.smithi082.stdout:3/183: creat d8/d9/d3f/f4a x:0 0 0 2024-04-27T07:33:08.426 INFO:tasks.workunit.client.0.smithi082.stdout:3/184: readlink d8/d9/d1f/l3c 0 2024-04-27T07:33:08.427 INFO:tasks.workunit.client.0.smithi082.stdout:3/185: creat d8/d9/dd/d13/f4b x:0 0 0 2024-04-27T07:33:08.428 INFO:tasks.workunit.client.0.smithi082.stdout:3/186: rmdir d8/d9/d1f 39 2024-04-27T07:33:08.430 INFO:tasks.workunit.client.0.smithi082.stdout:3/187: dread d8/fb [0,4194304] 0 2024-04-27T07:33:08.432 INFO:tasks.workunit.client.0.smithi082.stdout:3/188: rmdir d8/d9/d25/d26 39 2024-04-27T07:33:08.434 INFO:tasks.workunit.client.0.smithi082.stdout:3/189: creat d8/d9/d1f/f4c x:0 0 0 2024-04-27T07:33:08.436 INFO:tasks.workunit.client.0.smithi082.stdout:3/190: mkdir d8/d9/d25/d26/d4d 0 2024-04-27T07:33:08.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.442+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f58ec066ab0 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.442+0000 7f58daffd700 1 -- 172.21.15.82:0/492500596 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1845 (secure 0 0 0) 0x7f58dc08a070 con 0x7f58ec0fbcc0 2024-04-27T07:33:08.444 INFO:teuthology.orchestra.run.smithi082.stdout:e16 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 16 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:32:40.495590+0000 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:33:08.445 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:33:08.446 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 msgr2=0x7f58d406e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 0x7f58d406e1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58e000b3b0 tx=0x7f58e0009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 msgr2=0x7f58ec10c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f58dc002a50 tx=0x7f58dc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 shutdown_connections 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f58d406bd00 0x7f58d406e1b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58ec0fbcc0 0x7f58ec10c8a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 --2- 172.21.15.82:0/492500596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ec0fcf70 0x7f58ec10cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.445+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 >> 172.21.15.82:0/492500596 conn(0x7f58ec0f7440 msgr2=0x7f58ec0f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.446+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 shutdown_connections 2024-04-27T07:33:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.446+0000 7f58f082f700 1 -- 172.21.15.82:0/492500596 wait complete. 2024-04-27T07:33:08.452 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-04-27T07:33:08.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:08 smithi082 ceph-mon[26613]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:08.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:08 smithi082 ceph-mon[26613]: pgmap v10: 65 pgs: 65 active+clean; 183 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 324 op/s 2024-04-27T07:33:08.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:08 smithi082 ceph-mon[26613]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:08.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:08 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2201053305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:33:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 -- 172.21.15.82:0/429887866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c070830 msgr2=0x7f4f6c070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 --2- 172.21.15.82:0/429887866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c070830 0x7f4f6c070ca0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c004940 tx=0x7f4f5c009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 -- 172.21.15.82:0/429887866 shutdown_connections 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 --2- 172.21.15.82:0/429887866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c070830 0x7f4f6c070ca0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 --2- 172.21.15.82:0/429887866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c071de0 0x7f4f6c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.592+0000 7f4f736b9700 1 -- 172.21.15.82:0/429887866 >> 172.21.15.82:0/429887866 conn(0x7f4f6c0f8540 msgr2=0x7f4f6c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 -- 172.21.15.82:0/429887866 shutdown_connections 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 -- 172.21.15.82:0/429887866 wait complete. 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 Processor -- start 2024-04-27T07:33:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 -- start start 2024-04-27T07:33:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c070830 0x7f4f6c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c1106c0 con 0x7f4f6c071de0 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f736b9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c110f10 con 0x7f4f6c070830 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.593+0000 7f4f70c54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51022/0 (socket says 172.21.15.82:51022) 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 -- 172.21.15.82:0/1495115418 learned_addr learned my addr 172.21.15.82:0/1495115418 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f71455700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c070830 0x7f4f6c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 -- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c070830 msgr2=0x7f4f6c10fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c070830 0x7f4f6c10fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 -- 172.21.15.82:0/1495115418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c005040 con 0x7f4f6c071de0 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f70c54700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b0d0 tx=0x7f4f5c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c00e030 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f5c01c400 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c00b630 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.594+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c111190 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.595+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c1116d0 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.596+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c05f5c0 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.596+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f4f5c013af0 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.597+0000 7f4f61ffb700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 0x7f4f5806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.597+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f4f5c08c140 con 0x7f4f6c071de0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.597+0000 7f4f71455700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 0x7f4f5806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.597+0000 7f4f71455700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 0x7f4f5806e1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009b80 tx=0x7f4f6800b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.603+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f4f5c059320 con 0x7f4f6c071de0 2024-04-27T07:33:08.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:08 smithi100 ceph-mon[34183]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:08.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:08 smithi100 ceph-mon[34183]: pgmap v10: 65 pgs: 65 active+clean; 183 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 324 op/s 2024-04-27T07:33:08.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:08 smithi100 ceph-mon[34183]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:08.648 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:08 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2201053305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:33:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.848+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f6c111a50 con 0x7f4f5806bcf0 2024-04-27T07:33:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.849+0000 7f4f61ffb700 1 -- 172.21.15.82:0/1495115418 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4f6c111a50 con 0x7f4f5806bcf0 2024-04-27T07:33:08.851 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/21 daemons upgraded", 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:33:08.852 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:33:08.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.851+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 msgr2=0x7f4f5806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.851+0000 7f4f736b9700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 0x7f4f5806e1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009b80 tx=0x7f4f6800b040 comp rx=0 tx=0).stop 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 msgr2=0x7f4f6c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b0d0 tx=0x7f4f5c009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 shutdown_connections 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f4f5806bcf0 0x7f4f5806e1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f6c070830 0x7f4f6c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 --2- 172.21.15.82:0/1495115418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f6c071de0 0x7f4f6c1100c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 >> 172.21.15.82:0/1495115418 conn(0x7f4f6c0f8540 msgr2=0x7f4f6c0f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 shutdown_connections 2024-04-27T07:33:08.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.852+0000 7f4f736b9700 1 -- 172.21.15.82:0/1495115418 wait complete. 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 -- 172.21.15.82:0/1933029546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 msgr2=0x7ff8900fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 --2- 172.21.15.82:0/1933029546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff8900fd3d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff880004940 tx=0x7ff880009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 -- 172.21.15.82:0/1933029546 shutdown_connections 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 --2- 172.21.15.82:0/1933029546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff8900fd3d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 --2- 172.21.15.82:0/1933029546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 0x7ff8900fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.962+0000 7ff898248700 1 -- 172.21.15.82:0/1933029546 >> 172.21.15.82:0/1933029546 conn(0x7ff8900f7430 msgr2=0x7ff8900f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:08.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 -- 172.21.15.82:0/1933029546 shutdown_connections 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 -- 172.21.15.82:0/1933029546 wait complete. 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 Processor -- start 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 -- start start 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 0x7ff89010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89010e4e0 con 0x7ff8900fcf60 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff898248700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89010ed30 con 0x7ff8900fbcb0 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff8957e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff8957e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51030/0 (socket says 172.21.15.82:51030) 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff8957e3700 1 -- 172.21.15.82:0/728800756 learned_addr learned my addr 172.21.15.82:0/728800756 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.963+0000 7ff895fe4700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 0x7ff89010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8957e3700 1 -- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 msgr2=0x7ff89010d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8957e3700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 0x7ff89010d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:08.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8957e3700 1 -- 172.21.15.82:0/728800756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880005040 con 0x7ff8900fcf60 2024-04-27T07:33:08.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8957e3700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff880009150 tx=0x7ff880009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88000e040 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89010efb0 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89010f4f0 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff880004290 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.964+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88001c630 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.965+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8740052e0 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.966+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7ff88000bbf0 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.966+0000 7ff8867fc700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 0x7ff87c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.966+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7ff88008b430 con 0x7ff8900fcf60 2024-04-27T07:33:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.966+0000 7ff895fe4700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 0x7ff87c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:08.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.967+0000 7ff895fe4700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 0x7ff87c06e1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009fd0 tx=0x7ff88c00b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:08.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:08.971+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7ff880058730 con 0x7ff8900fcf60 2024-04-27T07:33:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.273+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff874005860 con 0x7ff8900fcf60 2024-04-27T07:33:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.273+0000 7ff8867fc700 1 -- 172.21.15.82:0/728800756 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff88000bea0 con 0x7ff8900fcf60 2024-04-27T07:33:09.276 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:33:09.277 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:33:09.277 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 msgr2=0x7ff87c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 0x7ff87c06e1a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009fd0 tx=0x7ff88c00b040 comp rx=0 tx=0).stop 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 msgr2=0x7ff89010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff880009150 tx=0x7ff880009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 shutdown_connections 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7ff87c06bcf0 0x7ff87c06e1a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8900fbcb0 0x7ff89010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 --2- 172.21.15.82:0/728800756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8900fcf60 0x7ff89010dee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 >> 172.21.15.82:0/728800756 conn(0x7ff8900f7430 msgr2=0x7ff8900f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 shutdown_connections 2024-04-27T07:33:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:09.275+0000 7ff898248700 1 -- 172.21.15.82:0/728800756 wait complete. 2024-04-27T07:33:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:09 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:09 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/492500596' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:33:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:09 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:09 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/492500596' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: pgmap v11: 65 pgs: 65 active+clean; 274 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 399 op/s 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/728800756' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi100 to 2581M 2024-04-27T07:33:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:10 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.489 INFO:tasks.workunit.client.0.smithi082.stdout:8/11: sync 2024-04-27T07:33:10.489 INFO:tasks.workunit.client.0.smithi082.stdout:4/18: sync 2024-04-27T07:33:10.489 INFO:tasks.workunit.client.0.smithi082.stdout:4/19: chown d3 481 1 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/12: rename d0 to d0/d2 22 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/13: chown d0 363664128 1 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/14: dread - no filename 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/15: dread - no filename 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/16: write - no filename 2024-04-27T07:33:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/17: chown d0 496051 1 2024-04-27T07:33:10.492 INFO:tasks.workunit.client.0.smithi082.stdout:4/20: symlink d3/l5 0 2024-04-27T07:33:10.494 INFO:tasks.workunit.client.0.smithi082.stdout:4/21: mkdir d3/d6 0 2024-04-27T07:33:10.494 INFO:tasks.workunit.client.0.smithi082.stdout:4/22: rmdir d3 39 2024-04-27T07:33:10.495 INFO:tasks.workunit.client.0.smithi082.stdout:4/23: truncate f2 315538 0 2024-04-27T07:33:10.497 INFO:tasks.workunit.client.0.smithi082.stdout:4/24: mknod d3/d6/c7 0 2024-04-27T07:33:10.498 INFO:tasks.workunit.client.0.smithi082.stdout:4/25: symlink d3/d6/l8 0 2024-04-27T07:33:10.520 INFO:tasks.workunit.client.0.smithi082.stdout:4/26: write f2 [732956,46211] 0 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: pgmap v11: 65 pgs: 65 active+clean; 274 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 399 op/s 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/728800756' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:10.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi100 to 2581M 2024-04-27T07:33:10.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:10 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:10.627 INFO:tasks.workunit.client.0.smithi082.stdout:0/27: sync 2024-04-27T07:33:10.656 INFO:tasks.workunit.client.0.smithi082.stdout:4/27: mkdir d3/d9 0 2024-04-27T07:33:10.657 INFO:tasks.workunit.client.0.smithi082.stdout:4/28: chown d3/l5 51335357 1 2024-04-27T07:33:10.661 INFO:tasks.workunit.client.0.smithi082.stdout:4/29: link f0 d3/d9/fa 0 2024-04-27T07:33:10.661 INFO:tasks.workunit.client.0.smithi082.stdout:4/30: readlink d3/d6/l8 0 2024-04-27T07:33:10.664 INFO:tasks.workunit.client.0.smithi082.stdout:4/31: link f0 d3/d9/fb 0 2024-04-27T07:33:10.664 INFO:tasks.workunit.client.0.smithi082.stdout:4/32: stat d3/d6 0 2024-04-27T07:33:10.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/33: fdatasync d3/f4 0 2024-04-27T07:33:10.667 INFO:tasks.workunit.client.0.smithi082.stdout:4/34: symlink d3/lc 0 2024-04-27T07:33:10.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/35: creat d3/fd x:0 0 0 2024-04-27T07:33:10.756 INFO:tasks.workunit.client.0.smithi082.stdout:0/28: dwrite f6 [0,4194304] 0 2024-04-27T07:33:10.759 INFO:tasks.workunit.client.0.smithi082.stdout:0/29: link f2 f9 0 2024-04-27T07:33:10.760 INFO:tasks.workunit.client.0.smithi082.stdout:0/30: mkdir da 0 2024-04-27T07:33:10.760 INFO:tasks.workunit.client.0.smithi082.stdout:0/31: stat l8 0 2024-04-27T07:33:10.762 INFO:tasks.workunit.client.0.smithi082.stdout:0/32: creat da/fb x:0 0 0 2024-04-27T07:33:10.764 INFO:tasks.workunit.client.0.smithi082.stdout:0/33: link l1 da/lc 0 2024-04-27T07:33:10.764 INFO:tasks.workunit.client.0.smithi082.stdout:0/34: dread - da/fb zero size 2024-04-27T07:33:10.766 INFO:tasks.workunit.client.0.smithi082.stdout:0/35: symlink da/ld 0 2024-04-27T07:33:10.766 INFO:tasks.workunit.client.0.smithi082.stdout:0/36: dread - f4 zero size 2024-04-27T07:33:10.767 INFO:tasks.workunit.client.0.smithi082.stdout:0/37: creat da/fe x:0 0 0 2024-04-27T07:33:10.768 INFO:tasks.workunit.client.0.smithi082.stdout:0/38: readlink da/ld 0 2024-04-27T07:33:10.770 INFO:tasks.workunit.client.0.smithi082.stdout:0/39: rename f2 to da/ff 0 2024-04-27T07:33:10.772 INFO:tasks.workunit.client.0.smithi082.stdout:0/40: chown f9 4 1 2024-04-27T07:33:10.773 INFO:tasks.workunit.client.0.smithi082.stdout:0/41: mknod da/c10 0 2024-04-27T07:33:10.774 INFO:tasks.workunit.client.0.smithi082.stdout:0/42: truncate da/fb 111735 0 2024-04-27T07:33:10.776 INFO:tasks.workunit.client.0.smithi082.stdout:0/43: dread f9 [0,4194304] 0 2024-04-27T07:33:10.777 INFO:tasks.workunit.client.0.smithi082.stdout:0/44: chown l1 20936 1 2024-04-27T07:33:10.779 INFO:tasks.workunit.client.0.smithi082.stdout:0/45: rename l8 to da/l11 0 2024-04-27T07:33:10.780 INFO:tasks.workunit.client.0.smithi082.stdout:0/46: unlink da/fb 0 2024-04-27T07:33:10.781 INFO:tasks.workunit.client.0.smithi082.stdout:0/47: chown f9 6154 1 2024-04-27T07:33:10.781 INFO:tasks.workunit.client.0.smithi082.stdout:0/48: chown da/ff 0 1 2024-04-27T07:33:10.781 INFO:tasks.workunit.client.0.smithi082.stdout:0/49: chown f9 593927 1 2024-04-27T07:33:10.782 INFO:tasks.workunit.client.0.smithi082.stdout:0/50: dread - f4 zero size 2024-04-27T07:33:10.783 INFO:tasks.workunit.client.0.smithi082.stdout:0/51: creat da/f12 x:0 0 0 2024-04-27T07:33:10.783 INFO:tasks.workunit.client.0.smithi082.stdout:0/52: write da/fe [923753,8917] 0 2024-04-27T07:33:10.824 INFO:tasks.workunit.client.0.smithi082.stdout:2/11: sync 2024-04-27T07:33:10.826 INFO:tasks.workunit.client.0.smithi082.stdout:2/12: symlink l4 0 2024-04-27T07:33:10.828 INFO:tasks.workunit.client.0.smithi082.stdout:2/13: link c2 c5 0 2024-04-27T07:33:10.830 INFO:tasks.workunit.client.0.smithi082.stdout:2/14: rename l4 to l6 0 2024-04-27T07:33:10.831 INFO:tasks.workunit.client.0.smithi082.stdout:2/15: mkdir d7 0 2024-04-27T07:33:10.831 INFO:tasks.workunit.client.0.smithi082.stdout:2/16: stat d7 0 2024-04-27T07:33:10.831 INFO:tasks.workunit.client.0.smithi082.stdout:2/17: fsync f3 0 2024-04-27T07:33:10.836 INFO:tasks.workunit.client.0.smithi082.stdout:2/18: chown l6 3039 1 2024-04-27T07:33:10.836 INFO:tasks.workunit.client.0.smithi082.stdout:2/19: truncate f3 633945 0 2024-04-27T07:33:10.837 INFO:tasks.workunit.client.0.smithi082.stdout:2/20: mkdir d7/d8 0 2024-04-27T07:33:10.838 INFO:tasks.workunit.client.0.smithi082.stdout:2/21: dread f3 [0,4194304] 0 2024-04-27T07:33:10.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/22: truncate f3 5706 0 2024-04-27T07:33:10.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/23: chown d7/d8 21636 1 2024-04-27T07:33:10.845 INFO:tasks.workunit.client.0.smithi082.stdout:2/24: dread f3 [0,4194304] 0 2024-04-27T07:33:10.848 INFO:tasks.workunit.client.0.smithi082.stdout:2/25: unlink l6 0 2024-04-27T07:33:10.849 INFO:tasks.workunit.client.0.smithi082.stdout:2/26: mkdir d7/d9 0 2024-04-27T07:33:10.849 INFO:tasks.workunit.client.0.smithi082.stdout:2/27: chown d7/d9 31182095 1 2024-04-27T07:33:10.857 INFO:tasks.workunit.client.0.smithi082.stdout:2/28: dwrite f3 [0,4194304] 0 2024-04-27T07:33:10.860 INFO:tasks.workunit.client.0.smithi082.stdout:2/29: creat d7/fa x:0 0 0 2024-04-27T07:33:10.861 INFO:tasks.workunit.client.0.smithi082.stdout:2/30: chown c2 2716388 1 2024-04-27T07:33:10.865 INFO:tasks.workunit.client.0.smithi082.stdout:2/31: dread f3 [0,4194304] 0 2024-04-27T07:33:10.867 INFO:tasks.workunit.client.0.smithi082.stdout:2/32: write f3 [4826797,7890] 0 2024-04-27T07:33:10.868 INFO:tasks.workunit.client.0.smithi082.stdout:2/33: dread - d7/fa zero size 2024-04-27T07:33:10.871 INFO:tasks.workunit.client.0.smithi082.stdout:2/34: dread f3 [0,4194304] 0 2024-04-27T07:33:10.872 INFO:tasks.workunit.client.0.smithi082.stdout:2/35: symlink d7/lb 0 2024-04-27T07:33:10.877 INFO:tasks.workunit.client.0.smithi082.stdout:2/36: truncate f3 2814909 0 2024-04-27T07:33:10.879 INFO:tasks.workunit.client.0.smithi082.stdout:2/37: fdatasync f3 0 2024-04-27T07:33:10.879 INFO:tasks.workunit.client.0.smithi082.stdout:2/38: write d7/fa [830202,69709] 0 2024-04-27T07:33:10.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/39: rename d7/fa to d7/fc 0 2024-04-27T07:33:10.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/40: rename d7/d8 to d7/d8/dd 22 2024-04-27T07:33:10.889 INFO:tasks.workunit.client.0.smithi082.stdout:2/41: dwrite f3 [0,4194304] 0 2024-04-27T07:33:10.892 INFO:tasks.workunit.client.0.smithi082.stdout:2/42: rename d7/lb to d7/d9/le 0 2024-04-27T07:33:10.895 INFO:tasks.workunit.client.0.smithi082.stdout:2/43: link d7/fc d7/d8/ff 0 2024-04-27T07:33:10.897 INFO:tasks.workunit.client.0.smithi082.stdout:2/44: write d7/fc [154773,66025] 0 2024-04-27T07:33:10.905 INFO:tasks.workunit.client.0.smithi082.stdout:2/45: dwrite d7/d8/ff [0,4194304] 0 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:6/47: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:7/94: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:9/91: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:4/36: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:3/191: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:5/110: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:8/18: sync 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:8/19: dread - no filename 2024-04-27T07:33:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:1/72: sync 2024-04-27T07:33:11.047 INFO:tasks.workunit.client.0.smithi082.stdout:7/95: chown f0 3 1 2024-04-27T07:33:11.047 INFO:tasks.workunit.client.0.smithi082.stdout:6/48: rmdir d2/d3 39 2024-04-27T07:33:11.048 INFO:tasks.workunit.client.0.smithi082.stdout:9/92: creat d9/df/f23 x:0 0 0 2024-04-27T07:33:11.049 INFO:tasks.workunit.client.0.smithi082.stdout:7/96: write d3/f5 [4972281,109243] 0 2024-04-27T07:33:11.049 INFO:tasks.workunit.client.0.smithi082.stdout:9/93: chown d9/le 1014 1 2024-04-27T07:33:11.051 INFO:tasks.workunit.client.0.smithi082.stdout:1/73: rename d4/f14 to d4/d15/f17 0 2024-04-27T07:33:11.052 INFO:tasks.workunit.client.0.smithi082.stdout:5/111: mkdir d8/d14/d1b/d1f 0 2024-04-27T07:33:11.053 INFO:tasks.workunit.client.0.smithi082.stdout:9/94: truncate d9/df/f23 497430 0 2024-04-27T07:33:11.055 INFO:tasks.workunit.client.0.smithi082.stdout:9/95: chown d9/f21 6567 1 2024-04-27T07:33:11.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/20: mkdir d0/d3 0 2024-04-27T07:33:11.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/21: dwrite - no filename 2024-04-27T07:33:11.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/22: dread - no filename 2024-04-27T07:33:11.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/23: chown d0 180390312 1 2024-04-27T07:33:11.057 INFO:tasks.workunit.client.0.smithi082.stdout:8/24: write - no filename 2024-04-27T07:33:11.058 INFO:tasks.workunit.client.0.smithi082.stdout:3/192: dwrite d8/d9/dd/d13/f1e [0,4194304] 0 2024-04-27T07:33:11.058 INFO:tasks.workunit.client.0.smithi082.stdout:7/97: symlink d3/de/l1c 0 2024-04-27T07:33:11.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/25: rename d0 to d0/d3/d4 22 2024-04-27T07:33:11.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/26: chown d0/d3 471 1 2024-04-27T07:33:11.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/27: stat d0/d3 0 2024-04-27T07:33:11.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/28: readlink - no filename 2024-04-27T07:33:11.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/29: write - no filename 2024-04-27T07:33:11.060 INFO:tasks.workunit.client.0.smithi082.stdout:3/193: read - d8/d9/d3f/f4a zero size 2024-04-27T07:33:11.063 INFO:tasks.workunit.client.0.smithi082.stdout:5/112: unlink d8/d15/f1c 0 2024-04-27T07:33:11.064 INFO:tasks.workunit.client.0.smithi082.stdout:5/113: readlink d8/d14/d1b/l1e 0 2024-04-27T07:33:11.066 INFO:tasks.workunit.client.0.smithi082.stdout:6/49: creat d2/d3/fd x:0 0 0 2024-04-27T07:33:11.068 INFO:tasks.workunit.client.0.smithi082.stdout:6/50: fsync d2/d3/f8 0 2024-04-27T07:33:11.068 INFO:tasks.workunit.client.0.smithi082.stdout:9/96: rename d9/da/dc/c11 to d9/da/dc/c24 0 2024-04-27T07:33:11.069 INFO:tasks.workunit.client.0.smithi082.stdout:6/51: fdatasync d2/d3/fd 0 2024-04-27T07:33:11.071 INFO:tasks.workunit.client.0.smithi082.stdout:4/37: link d3/d6/c7 d3/ce 0 2024-04-27T07:33:11.073 INFO:tasks.workunit.client.0.smithi082.stdout:1/74: dwrite d4/f5 [0,4194304] 0 2024-04-27T07:33:11.073 INFO:tasks.workunit.client.0.smithi082.stdout:4/38: write d3/fd [223474,27384] 0 2024-04-27T07:33:11.075 INFO:tasks.workunit.client.0.smithi082.stdout:8/30: mknod d0/d3/c5 0 2024-04-27T07:33:11.077 INFO:tasks.workunit.client.0.smithi082.stdout:3/194: mkdir d8/d9/d25/d4e 0 2024-04-27T07:33:11.080 INFO:tasks.workunit.client.0.smithi082.stdout:6/52: dread d2/d3/f8 [0,4194304] 0 2024-04-27T07:33:11.080 INFO:tasks.workunit.client.0.smithi082.stdout:3/195: write d8/d9/dd/d13/f45 [1141481,38003] 0 2024-04-27T07:33:11.080 INFO:tasks.workunit.client.0.smithi082.stdout:8/31: creat d0/f6 x:0 0 0 2024-04-27T07:33:11.083 INFO:tasks.workunit.client.0.smithi082.stdout:4/39: symlink d3/d9/lf 0 2024-04-27T07:33:11.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/53: write d2/d3/f8 [3740877,76276] 0 2024-04-27T07:33:11.086 INFO:tasks.workunit.client.0.smithi082.stdout:4/40: mkdir d3/d10 0 2024-04-27T07:33:11.089 INFO:tasks.workunit.client.0.smithi082.stdout:5/114: truncate d8/fa 209823 0 2024-04-27T07:33:11.089 INFO:tasks.workunit.client.0.smithi082.stdout:1/75: dwrite d4/fa [0,4194304] 0 2024-04-27T07:33:11.091 INFO:tasks.workunit.client.0.smithi082.stdout:6/54: mkdir d2/de 0 2024-04-27T07:33:11.093 INFO:tasks.workunit.client.0.smithi082.stdout:5/115: stat d8/d14/d1b/d1f 0 2024-04-27T07:33:11.093 INFO:tasks.workunit.client.0.smithi082.stdout:3/196: rename d8/d9/dd/d13/l36 to d8/d9/dd/d13/l4f 0 2024-04-27T07:33:11.095 INFO:tasks.workunit.client.0.smithi082.stdout:8/32: dwrite d0/f6 [0,4194304] 0 2024-04-27T07:33:11.095 INFO:tasks.workunit.client.0.smithi082.stdout:4/41: rename d3/d6/l8 to d3/d10/l11 0 2024-04-27T07:33:11.096 INFO:tasks.workunit.client.0.smithi082.stdout:1/76: dread f2 [0,4194304] 0 2024-04-27T07:33:11.096 INFO:tasks.workunit.client.0.smithi082.stdout:6/55: rename d2 to d2/de/df 22 2024-04-27T07:33:11.097 INFO:tasks.workunit.client.0.smithi082.stdout:5/116: mkdir d8/d14/d20 0 2024-04-27T07:33:11.098 INFO:tasks.workunit.client.0.smithi082.stdout:3/197: mknod d8/d9/d1d/c50 0 2024-04-27T07:33:11.101 INFO:tasks.workunit.client.0.smithi082.stdout:4/42: rename d3/l5 to d3/l12 0 2024-04-27T07:33:11.105 INFO:tasks.workunit.client.0.smithi082.stdout:1/77: rename d4/f8 to d4/d15/f18 0 2024-04-27T07:33:11.111 INFO:tasks.workunit.client.0.smithi082.stdout:4/43: unlink f1 0 2024-04-27T07:33:11.112 INFO:tasks.workunit.client.0.smithi082.stdout:4/44: readlink d3/d9/lf 0 2024-04-27T07:33:11.112 INFO:tasks.workunit.client.0.smithi082.stdout:4/45: chown d3/lc 2 1 2024-04-27T07:33:11.114 INFO:tasks.workunit.client.0.smithi082.stdout:0/53: sync 2024-04-27T07:33:11.114 INFO:tasks.workunit.client.0.smithi082.stdout:2/46: sync 2024-04-27T07:33:11.117 INFO:tasks.workunit.client.0.smithi082.stdout:3/198: fdatasync d8/d9/d1f/f41 0 2024-04-27T07:33:11.118 INFO:tasks.workunit.client.0.smithi082.stdout:6/56: creat d2/f10 x:0 0 0 2024-04-27T07:33:11.124 INFO:tasks.workunit.client.0.smithi082.stdout:0/54: stat da/lc 0 2024-04-27T07:33:11.124 INFO:tasks.workunit.client.0.smithi082.stdout:2/47: rmdir d7/d8 39 2024-04-27T07:33:11.125 INFO:tasks.workunit.client.0.smithi082.stdout:6/57: dwrite d2/d3/f8 [0,4194304] 0 2024-04-27T07:33:11.125 INFO:tasks.workunit.client.0.smithi082.stdout:2/48: read d7/fc [2657854,89293] 0 2024-04-27T07:33:11.127 INFO:tasks.workunit.client.0.smithi082.stdout:5/117: rmdir d8/d1a 0 2024-04-27T07:33:11.128 INFO:tasks.workunit.client.0.smithi082.stdout:4/46: write d3/d9/fa [3670038,56702] 0 2024-04-27T07:33:11.130 INFO:tasks.workunit.client.0.smithi082.stdout:3/199: creat d8/d9/d25/d26/d3d/f51 x:0 0 0 2024-04-27T07:33:11.130 INFO:tasks.workunit.client.0.smithi082.stdout:1/78: truncate d4/d15/f17 2400889 0 2024-04-27T07:33:11.130 INFO:tasks.workunit.client.0.smithi082.stdout:3/200: readlink d8/d9/d1d/l20 0 2024-04-27T07:33:11.131 INFO:tasks.workunit.client.0.smithi082.stdout:1/79: fsync d4/f11 0 2024-04-27T07:33:11.133 INFO:tasks.workunit.client.0.smithi082.stdout:0/55: mknod da/c13 0 2024-04-27T07:33:11.135 INFO:tasks.workunit.client.0.smithi082.stdout:0/56: dread da/ff [0,4194304] 0 2024-04-27T07:33:11.137 INFO:tasks.workunit.client.0.smithi082.stdout:6/58: creat d2/d3/f11 x:0 0 0 2024-04-27T07:33:11.138 INFO:tasks.workunit.client.0.smithi082.stdout:5/118: creat d8/d14/f21 x:0 0 0 2024-04-27T07:33:11.140 INFO:tasks.workunit.client.0.smithi082.stdout:1/80: rmdir d4/d15 39 2024-04-27T07:33:11.144 INFO:tasks.workunit.client.0.smithi082.stdout:0/57: fdatasync da/ff 0 2024-04-27T07:33:11.145 INFO:tasks.workunit.client.0.smithi082.stdout:2/49: symlink d7/l10 0 2024-04-27T07:33:11.146 INFO:tasks.workunit.client.0.smithi082.stdout:6/59: symlink d2/d3/l12 0 2024-04-27T07:33:11.147 INFO:tasks.workunit.client.0.smithi082.stdout:6/60: dread - d2/d3/fd zero size 2024-04-27T07:33:11.147 INFO:tasks.workunit.client.0.smithi082.stdout:5/119: mkdir d8/d15/d22 0 2024-04-27T07:33:11.148 INFO:tasks.workunit.client.0.smithi082.stdout:6/61: dread - d2/d3/fd zero size 2024-04-27T07:33:11.149 INFO:tasks.workunit.client.0.smithi082.stdout:3/201: mknod d8/d9/dd/c52 0 2024-04-27T07:33:11.154 INFO:tasks.workunit.client.0.smithi082.stdout:2/50: fsync d7/d8/ff 0 2024-04-27T07:33:11.155 INFO:tasks.workunit.client.0.smithi082.stdout:5/120: creat d8/d14/f23 x:0 0 0 2024-04-27T07:33:11.161 INFO:tasks.workunit.client.0.smithi082.stdout:2/51: dwrite f3 [0,4194304] 0 2024-04-27T07:33:11.163 INFO:tasks.workunit.client.0.smithi082.stdout:6/62: mkdir d2/de/d13 0 2024-04-27T07:33:11.163 INFO:tasks.workunit.client.0.smithi082.stdout:3/202: getdents d8/d9/d25/d26/d4d 0 2024-04-27T07:33:11.165 INFO:tasks.workunit.client.0.smithi082.stdout:5/121: creat d8/d15/f24 x:0 0 0 2024-04-27T07:33:11.170 INFO:tasks.workunit.client.0.smithi082.stdout:1/81: creat d4/f19 x:0 0 0 2024-04-27T07:33:11.170 INFO:tasks.workunit.client.0.smithi082.stdout:1/82: dread - d4/ff zero size 2024-04-27T07:33:11.171 INFO:tasks.workunit.client.0.smithi082.stdout:0/58: link da/ld da/l14 0 2024-04-27T07:33:11.171 INFO:tasks.workunit.client.0.smithi082.stdout:0/59: readlink da/ld 0 2024-04-27T07:33:11.172 INFO:tasks.workunit.client.0.smithi082.stdout:6/63: symlink d2/d3/l14 0 2024-04-27T07:33:11.173 INFO:tasks.workunit.client.0.smithi082.stdout:0/60: dread da/ff [0,4194304] 0 2024-04-27T07:33:11.173 INFO:tasks.workunit.client.0.smithi082.stdout:3/203: mkdir d8/d9/d1f/d53 0 2024-04-27T07:33:11.175 INFO:tasks.workunit.client.0.smithi082.stdout:3/204: fdatasync d8/d9/dd/d13/f1e 0 2024-04-27T07:33:11.177 INFO:tasks.workunit.client.0.smithi082.stdout:0/61: creat da/f15 x:0 0 0 2024-04-27T07:33:11.178 INFO:tasks.workunit.client.0.smithi082.stdout:4/47: truncate d3/f4 712508 0 2024-04-27T07:33:11.180 INFO:tasks.workunit.client.0.smithi082.stdout:3/205: mknod d8/d9/d1f/d2a/c54 0 2024-04-27T07:33:11.181 INFO:tasks.workunit.client.0.smithi082.stdout:6/64: symlink d2/l15 0 2024-04-27T07:33:11.182 INFO:tasks.workunit.client.0.smithi082.stdout:0/62: creat da/f16 x:0 0 0 2024-04-27T07:33:11.182 INFO:tasks.workunit.client.0.smithi082.stdout:3/206: write d8/d9/dd/d13/f48 [1010215,108796] 0 2024-04-27T07:33:11.185 INFO:tasks.workunit.client.0.smithi082.stdout:0/63: write da/f12 [439039,64955] 0 2024-04-27T07:33:11.187 INFO:tasks.workunit.client.0.smithi082.stdout:4/48: dwrite f2 [0,4194304] 0 2024-04-27T07:33:11.187 INFO:tasks.workunit.client.0.smithi082.stdout:0/64: truncate f4 183605 0 2024-04-27T07:33:11.188 INFO:tasks.workunit.client.0.smithi082.stdout:3/207: creat d8/d9/d3f/f55 x:0 0 0 2024-04-27T07:33:11.188 INFO:tasks.workunit.client.0.smithi082.stdout:1/83: link d4/l6 d4/l1a 0 2024-04-27T07:33:11.190 INFO:tasks.workunit.client.0.smithi082.stdout:6/65: creat d2/de/d13/f16 x:0 0 0 2024-04-27T07:33:11.191 INFO:tasks.workunit.client.0.smithi082.stdout:5/122: link d8/fa d8/f25 0 2024-04-27T07:33:11.193 INFO:tasks.workunit.client.0.smithi082.stdout:0/65: mknod da/c17 0 2024-04-27T07:33:11.194 INFO:tasks.workunit.client.0.smithi082.stdout:0/66: truncate f5 1505681 0 2024-04-27T07:33:11.197 INFO:tasks.workunit.client.0.smithi082.stdout:3/208: truncate d8/fb 3681335 0 2024-04-27T07:33:11.198 INFO:tasks.workunit.client.0.smithi082.stdout:6/66: dwrite d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:11.199 INFO:tasks.workunit.client.0.smithi082.stdout:3/209: write d8/d9/d1f/f4c [97794,30273] 0 2024-04-27T07:33:11.199 INFO:tasks.workunit.client.0.smithi082.stdout:6/67: truncate d2/f10 71796 0 2024-04-27T07:33:11.200 INFO:tasks.workunit.client.0.smithi082.stdout:0/67: rename da/l14 to da/l18 0 2024-04-27T07:33:11.201 INFO:tasks.workunit.client.0.smithi082.stdout:3/210: write d8/f33 [1959833,101203] 0 2024-04-27T07:33:11.201 INFO:tasks.workunit.client.0.smithi082.stdout:0/68: truncate da/f16 945257 0 2024-04-27T07:33:11.202 INFO:tasks.workunit.client.0.smithi082.stdout:5/123: link d8/d14/f23 d8/d14/d1b/d1f/f26 0 2024-04-27T07:33:11.207 INFO:tasks.workunit.client.0.smithi082.stdout:0/69: truncate da/ff 1007102 0 2024-04-27T07:33:11.208 INFO:tasks.workunit.client.0.smithi082.stdout:3/211: dwrite d8/f2e [0,4194304] 0 2024-04-27T07:33:11.209 INFO:tasks.workunit.client.0.smithi082.stdout:0/70: chown da/fe 50 1 2024-04-27T07:33:11.210 INFO:tasks.workunit.client.0.smithi082.stdout:0/71: read da/f12 [500537,58846] 0 2024-04-27T07:33:11.211 INFO:tasks.workunit.client.0.smithi082.stdout:1/84: getdents d4 0 2024-04-27T07:33:11.211 INFO:tasks.workunit.client.0.smithi082.stdout:0/72: readlink da/lc 0 2024-04-27T07:33:11.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/68: rmdir d2/de/d13 39 2024-04-27T07:33:11.215 INFO:tasks.workunit.client.0.smithi082.stdout:6/69: truncate d2/d3/f11 61714 0 2024-04-27T07:33:11.215 INFO:tasks.workunit.client.0.smithi082.stdout:4/49: link d3/ce d3/d6/c13 0 2024-04-27T07:33:11.217 INFO:tasks.workunit.client.0.smithi082.stdout:6/70: read d2/d3/f6 [2754472,105517] 0 2024-04-27T07:33:11.218 INFO:tasks.workunit.client.0.smithi082.stdout:1/85: rmdir d4/d15 39 2024-04-27T07:33:11.220 INFO:tasks.workunit.client.0.smithi082.stdout:0/73: dwrite f6 [0,4194304] 0 2024-04-27T07:33:11.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/74: dread f4 [0,4194304] 0 2024-04-27T07:33:11.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/50: creat d3/f14 x:0 0 0 2024-04-27T07:33:11.228 INFO:tasks.workunit.client.0.smithi082.stdout:0/75: creat da/f19 x:0 0 0 2024-04-27T07:33:11.231 INFO:tasks.workunit.client.0.smithi082.stdout:1/86: creat d4/d15/f1b x:0 0 0 2024-04-27T07:33:11.235 INFO:tasks.workunit.client.0.smithi082.stdout:6/71: truncate d2/d3/f6 1663531 0 2024-04-27T07:33:11.236 INFO:tasks.workunit.client.0.smithi082.stdout:0/76: creat da/f1a x:0 0 0 2024-04-27T07:33:11.237 INFO:tasks.workunit.client.0.smithi082.stdout:1/87: dread - d4/f19 zero size 2024-04-27T07:33:11.237 INFO:tasks.workunit.client.0.smithi082.stdout:3/212: link d8/d9/dd/d13/f1e d8/d9/d1f/d53/f56 0 2024-04-27T07:33:11.240 INFO:tasks.workunit.client.0.smithi082.stdout:0/77: chown da/ld 995047 1 2024-04-27T07:33:11.241 INFO:tasks.workunit.client.0.smithi082.stdout:1/88: mkdir d4/d15/d1c 0 2024-04-27T07:33:11.242 INFO:tasks.workunit.client.0.smithi082.stdout:3/213: symlink d8/d9/d1f/l57 0 2024-04-27T07:33:11.244 INFO:tasks.workunit.client.0.smithi082.stdout:0/78: creat da/f1b x:0 0 0 2024-04-27T07:33:11.249 INFO:tasks.workunit.client.0.smithi082.stdout:0/79: rename da/f16 to da/f1c 0 2024-04-27T07:33:11.252 INFO:tasks.workunit.client.0.smithi082.stdout:0/80: mkdir da/d1d 0 2024-04-27T07:33:11.254 INFO:tasks.workunit.client.0.smithi082.stdout:3/214: rename d8/d9/d25/d26/d3d/c3b to d8/d9/dd/c58 0 2024-04-27T07:33:11.256 INFO:tasks.workunit.client.0.smithi082.stdout:1/89: rename d4/f7 to d4/f1d 0 2024-04-27T07:33:11.257 INFO:tasks.workunit.client.0.smithi082.stdout:4/51: dwrite d3/f4 [0,4194304] 0 2024-04-27T07:33:11.260 INFO:tasks.workunit.client.0.smithi082.stdout:0/81: rename l1 to da/l1e 0 2024-04-27T07:33:11.265 INFO:tasks.workunit.client.0.smithi082.stdout:0/82: creat da/f1f x:0 0 0 2024-04-27T07:33:11.265 INFO:tasks.workunit.client.0.smithi082.stdout:4/52: dread d3/fd [0,4194304] 0 2024-04-27T07:33:11.271 INFO:tasks.workunit.client.0.smithi082.stdout:1/90: creat d4/f1e x:0 0 0 2024-04-27T07:33:11.273 INFO:tasks.workunit.client.0.smithi082.stdout:3/215: getdents d8/d9/d25/d26/d3d 0 2024-04-27T07:33:11.274 INFO:tasks.workunit.client.0.smithi082.stdout:4/53: unlink d3/lc 0 2024-04-27T07:33:11.278 INFO:tasks.workunit.client.0.smithi082.stdout:3/216: dread d8/d9/dd/f1a [0,4194304] 0 2024-04-27T07:33:11.278 INFO:tasks.workunit.client.0.smithi082.stdout:4/54: dread f2 [0,4194304] 0 2024-04-27T07:33:11.279 INFO:tasks.workunit.client.0.smithi082.stdout:3/217: chown d8/d9/d1f/d53 460572412 1 2024-04-27T07:33:11.280 INFO:tasks.workunit.client.0.smithi082.stdout:1/91: rename d4/fe to d4/f1f 0 2024-04-27T07:33:11.280 INFO:tasks.workunit.client.0.smithi082.stdout:4/55: write d3/f14 [854297,6418] 0 2024-04-27T07:33:11.282 INFO:tasks.workunit.client.0.smithi082.stdout:3/218: unlink d8/f33 0 2024-04-27T07:33:11.287 INFO:tasks.workunit.client.0.smithi082.stdout:1/92: dwrite d4/f1e [0,4194304] 0 2024-04-27T07:33:11.290 INFO:tasks.workunit.client.0.smithi082.stdout:4/56: rename d3/d9/fa to d3/d10/f15 0 2024-04-27T07:33:11.291 INFO:tasks.workunit.client.0.smithi082.stdout:7/98: sync 2024-04-27T07:33:11.295 INFO:tasks.workunit.client.0.smithi082.stdout:4/57: unlink d3/l12 0 2024-04-27T07:33:11.296 INFO:tasks.workunit.client.0.smithi082.stdout:4/58: truncate d3/d10/f15 4892207 0 2024-04-27T07:33:11.322 INFO:tasks.workunit.client.0.smithi082.stdout:1/93: getdents d4 0 2024-04-27T07:33:11.323 INFO:tasks.workunit.client.0.smithi082.stdout:7/99: link d3/db/f18 d3/de/f1d 0 2024-04-27T07:33:11.326 INFO:tasks.workunit.client.0.smithi082.stdout:1/94: symlink d4/d15/l20 0 2024-04-27T07:33:11.326 INFO:tasks.workunit.client.0.smithi082.stdout:7/100: creat d3/de/f1e x:0 0 0 2024-04-27T07:33:11.327 INFO:tasks.workunit.client.0.smithi082.stdout:4/59: mkdir d3/d6/d16 0 2024-04-27T07:33:11.328 INFO:tasks.workunit.client.0.smithi082.stdout:7/101: creat d3/f1f x:0 0 0 2024-04-27T07:33:11.329 INFO:tasks.workunit.client.0.smithi082.stdout:7/102: fsync d3/f5 0 2024-04-27T07:33:11.329 INFO:tasks.workunit.client.0.smithi082.stdout:4/60: creat d3/d10/f17 x:0 0 0 2024-04-27T07:33:11.330 INFO:tasks.workunit.client.0.smithi082.stdout:4/61: write d3/f14 [1439582,46184] 0 2024-04-27T07:33:11.331 INFO:tasks.workunit.client.0.smithi082.stdout:7/103: creat d3/f20 x:0 0 0 2024-04-27T07:33:11.336 INFO:tasks.workunit.client.0.smithi082.stdout:7/104: rename f0 to d3/db/d15/f21 0 2024-04-27T07:33:11.338 INFO:tasks.workunit.client.0.smithi082.stdout:1/95: write d4/f12 [1740678,78507] 0 2024-04-27T07:33:11.339 INFO:tasks.workunit.client.0.smithi082.stdout:1/96: fsync d4/fa 0 2024-04-27T07:33:11.346 INFO:tasks.workunit.client.0.smithi082.stdout:7/105: dwrite d3/f8 [4194304,4194304] 0 2024-04-27T07:33:11.349 INFO:tasks.workunit.client.0.smithi082.stdout:4/62: dwrite d3/fd [0,4194304] 0 2024-04-27T07:33:11.355 INFO:tasks.workunit.client.0.smithi082.stdout:7/106: rename d3/de/f13 to d3/db/f22 0 2024-04-27T07:33:11.356 INFO:tasks.workunit.client.0.smithi082.stdout:1/97: dwrite d4/f5 [0,4194304] 0 2024-04-27T07:33:11.360 INFO:tasks.workunit.client.0.smithi082.stdout:1/98: mknod d4/d15/d1c/c21 0 2024-04-27T07:33:11.362 INFO:tasks.workunit.client.0.smithi082.stdout:1/99: chown l0 23337 1 2024-04-27T07:33:11.363 INFO:tasks.workunit.client.0.smithi082.stdout:4/63: dwrite f2 [0,4194304] 0 2024-04-27T07:33:11.365 INFO:tasks.workunit.client.0.smithi082.stdout:1/100: creat d4/f22 x:0 0 0 2024-04-27T07:33:11.368 INFO:tasks.workunit.client.0.smithi082.stdout:4/64: dread f0 [4194304,4194304] 0 2024-04-27T07:33:11.369 INFO:tasks.workunit.client.0.smithi082.stdout:7/107: unlink d3/db/f22 0 2024-04-27T07:33:11.372 INFO:tasks.workunit.client.0.smithi082.stdout:4/65: dread d3/d9/fb [0,4194304] 0 2024-04-27T07:33:11.373 INFO:tasks.workunit.client.0.smithi082.stdout:7/108: truncate d3/db/f18 1614956 0 2024-04-27T07:33:11.375 INFO:tasks.workunit.client.0.smithi082.stdout:4/66: mknod d3/d6/d16/c18 0 2024-04-27T07:33:11.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/101: truncate d4/f16 525131 0 2024-04-27T07:33:11.378 INFO:tasks.workunit.client.0.smithi082.stdout:4/67: write d3/d10/f15 [5744433,18484] 0 2024-04-27T07:33:11.379 INFO:tasks.workunit.client.0.smithi082.stdout:4/68: chown d3/fd 41809 1 2024-04-27T07:33:11.380 INFO:tasks.workunit.client.0.smithi082.stdout:1/102: truncate d4/f1e 4371191 0 2024-04-27T07:33:11.380 INFO:tasks.workunit.client.0.smithi082.stdout:1/103: dread - d4/f19 zero size 2024-04-27T07:33:11.386 INFO:tasks.workunit.client.0.smithi082.stdout:4/69: fsync f2 0 2024-04-27T07:33:11.390 INFO:tasks.workunit.client.0.smithi082.stdout:4/70: dread f0 [0,4194304] 0 2024-04-27T07:33:11.469 INFO:tasks.workunit.client.0.smithi082.stdout:9/97: sync 2024-04-27T07:33:11.470 INFO:tasks.workunit.client.0.smithi082.stdout:9/98: fdatasync f5 0 2024-04-27T07:33:11.472 INFO:tasks.workunit.client.0.smithi082.stdout:9/99: mknod d9/da/c25 0 2024-04-27T07:33:11.480 INFO:tasks.workunit.client.0.smithi082.stdout:9/100: truncate f4 1213675 0 2024-04-27T07:33:11.486 INFO:tasks.workunit.client.0.smithi082.stdout:9/101: dread f4 [0,4194304] 0 2024-04-27T07:33:11.489 INFO:tasks.workunit.client.0.smithi082.stdout:9/102: creat d9/da/f26 x:0 0 0 2024-04-27T07:33:11.490 INFO:tasks.workunit.client.0.smithi082.stdout:9/103: chown d9/le 35728 1 2024-04-27T07:33:11.490 INFO:tasks.workunit.client.0.smithi082.stdout:9/104: symlink d9/da/l27 0 2024-04-27T07:33:11.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/33: sync 2024-04-27T07:33:11.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/34: write d0/f6 [2332892,106251] 0 2024-04-27T07:33:11.787 INFO:tasks.workunit.client.0.smithi082.stdout:8/35: creat d0/f7 x:0 0 0 2024-04-27T07:33:11.787 INFO:tasks.workunit.client.0.smithi082.stdout:8/36: chown d0 6126459 1 2024-04-27T07:33:11.788 INFO:tasks.workunit.client.0.smithi082.stdout:8/37: creat d0/d3/f8 x:0 0 0 2024-04-27T07:33:11.834 INFO:tasks.workunit.client.0.smithi082.stdout:2/52: sync 2024-04-27T07:33:11.838 INFO:tasks.workunit.client.0.smithi082.stdout:2/53: write d7/d8/ff [965763,91963] 0 2024-04-27T07:33:11.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/54: truncate d7/fc 3742372 0 2024-04-27T07:33:11.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/55: write f3 [1345573,34990] 0 2024-04-27T07:33:11.846 INFO:tasks.workunit.client.0.smithi082.stdout:2/56: write d7/fc [2666731,13908] 0 2024-04-27T07:33:11.848 INFO:tasks.workunit.client.0.smithi082.stdout:2/57: mknod d7/d9/c11 0 2024-04-27T07:33:11.849 INFO:tasks.workunit.client.0.smithi082.stdout:2/58: mknod d7/d9/c12 0 2024-04-27T07:33:11.854 INFO:tasks.workunit.client.0.smithi082.stdout:2/59: dwrite d7/fc [0,4194304] 0 2024-04-27T07:33:11.856 INFO:tasks.workunit.client.0.smithi082.stdout:2/60: mkdir d7/d8/d13 0 2024-04-27T07:33:11.860 INFO:tasks.workunit.client.0.smithi082.stdout:2/61: dread f3 [0,4194304] 0 2024-04-27T07:33:11.860 INFO:tasks.workunit.client.0.smithi082.stdout:2/62: chown d7/d9 1 1 2024-04-27T07:33:11.862 INFO:tasks.workunit.client.0.smithi082.stdout:2/63: mkdir d7/d14 0 2024-04-27T07:33:11.865 INFO:tasks.workunit.client.0.smithi082.stdout:2/64: dread d7/fc [0,4194304] 0 2024-04-27T07:33:11.871 INFO:tasks.workunit.client.0.smithi082.stdout:2/65: dwrite f3 [4194304,4194304] 0 2024-04-27T07:33:11.872 INFO:tasks.workunit.client.0.smithi082.stdout:2/66: chown d7/l10 134 1 2024-04-27T07:33:11.873 INFO:tasks.workunit.client.0.smithi082.stdout:2/67: mkdir d7/d14/d15 0 2024-04-27T07:33:11.876 INFO:tasks.workunit.client.0.smithi082.stdout:2/68: mknod d7/d14/c16 0 2024-04-27T07:33:11.877 INFO:tasks.workunit.client.0.smithi082.stdout:2/69: fsync d7/fc 0 2024-04-27T07:33:11.878 INFO:tasks.workunit.client.0.smithi082.stdout:2/70: truncate d7/d8/ff 5207546 0 2024-04-27T07:33:11.879 INFO:tasks.workunit.client.0.smithi082.stdout:2/71: write d7/d8/ff [4301230,74373] 0 2024-04-27T07:33:11.879 INFO:tasks.workunit.client.0.smithi082.stdout:2/72: chown d7/d9 1560114258 1 2024-04-27T07:33:11.881 INFO:tasks.workunit.client.0.smithi082.stdout:2/73: unlink d7/d8/ff 0 2024-04-27T07:33:11.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/74: getdents d7/d8/d13 0 2024-04-27T07:33:11.886 INFO:tasks.workunit.client.0.smithi082.stdout:2/75: dread d7/fc [0,4194304] 0 2024-04-27T07:33:11.889 INFO:tasks.workunit.client.0.smithi082.stdout:2/76: rename d7/d14/d15 to d7/d17 0 2024-04-27T07:33:11.892 INFO:tasks.workunit.client.0.smithi082.stdout:2/77: dread f3 [4194304,4194304] 0 2024-04-27T07:33:11.897 INFO:tasks.workunit.client.0.smithi082.stdout:2/78: dwrite d7/fc [0,4194304] 0 2024-04-27T07:33:11.898 INFO:tasks.workunit.client.0.smithi082.stdout:2/79: chown f3 210503516 1 2024-04-27T07:33:11.901 INFO:tasks.workunit.client.0.smithi082.stdout:2/80: dread f3 [0,4194304] 0 2024-04-27T07:33:11.902 INFO:tasks.workunit.client.0.smithi082.stdout:2/81: creat d7/d9/f18 x:0 0 0 2024-04-27T07:33:11.906 INFO:tasks.workunit.client.0.smithi082.stdout:2/82: rmdir d7/d9 39 2024-04-27T07:33:11.908 INFO:tasks.workunit.client.0.smithi082.stdout:2/83: write f3 [4925412,54452] 0 2024-04-27T07:33:11.910 INFO:tasks.workunit.client.0.smithi082.stdout:2/84: creat d7/d8/f19 x:0 0 0 2024-04-27T07:33:11.913 INFO:tasks.workunit.client.0.smithi082.stdout:2/85: link c5 d7/d17/c1a 0 2024-04-27T07:33:11.914 INFO:tasks.workunit.client.0.smithi082.stdout:2/86: rename d7 to d7/d9/d1b 22 2024-04-27T07:33:11.915 INFO:tasks.workunit.client.0.smithi082.stdout:2/87: symlink d7/d17/l1c 0 2024-04-27T07:33:11.916 INFO:tasks.workunit.client.0.smithi082.stdout:2/88: creat d7/d9/f1d x:0 0 0 2024-04-27T07:33:11.918 INFO:tasks.workunit.client.0.smithi082.stdout:2/89: symlink d7/d8/d13/l1e 0 2024-04-27T07:33:11.919 INFO:tasks.workunit.client.0.smithi082.stdout:2/90: rmdir d7/d14 39 2024-04-27T07:33:11.920 INFO:tasks.workunit.client.0.smithi082.stdout:2/91: creat d7/d8/f1f x:0 0 0 2024-04-27T07:33:11.921 INFO:tasks.workunit.client.0.smithi082.stdout:2/92: dread - d7/d9/f1d zero size 2024-04-27T07:33:11.923 INFO:tasks.workunit.client.0.smithi082.stdout:2/93: symlink d7/l20 0 2024-04-27T07:33:11.927 INFO:tasks.workunit.client.0.smithi082.stdout:2/94: link d7/d9/le d7/d8/d13/l21 0 2024-04-27T07:33:11.927 INFO:tasks.workunit.client.0.smithi082.stdout:2/95: write d7/d8/f19 [944910,26581] 0 2024-04-27T07:33:11.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/96: creat d7/d8/d13/f22 x:0 0 0 2024-04-27T07:33:11.930 INFO:tasks.workunit.client.0.smithi082.stdout:2/97: chown d7/d8/f1f 2 1 2024-04-27T07:33:11.931 INFO:tasks.workunit.client.0.smithi082.stdout:2/98: mkdir d7/d17/d23 0 2024-04-27T07:33:11.938 INFO:tasks.workunit.client.0.smithi082.stdout:2/99: getdents d7 0 2024-04-27T07:33:11.939 INFO:tasks.workunit.client.0.smithi082.stdout:2/100: mkdir d7/d8/d24 0 2024-04-27T07:33:11.940 INFO:tasks.workunit.client.0.smithi082.stdout:2/101: chown d7/d17/d23 4999376 1 2024-04-27T07:33:11.941 INFO:tasks.workunit.client.0.smithi082.stdout:2/102: stat d7/d17/c1a 0 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:6/72: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/83: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:5/124: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:1/104: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:7/109: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:9/105: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:4/71: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:3/219: sync 2024-04-27T07:33:11.943 INFO:tasks.workunit.client.0.smithi082.stdout:2/103: mkdir d7/d17/d23/d25 0 2024-04-27T07:33:11.944 INFO:tasks.workunit.client.0.smithi082.stdout:0/84: dread - f7 zero size 2024-04-27T07:33:11.944 INFO:tasks.workunit.client.0.smithi082.stdout:1/105: write d4/f12 [3999907,19695] 0 2024-04-27T07:33:11.944 INFO:tasks.workunit.client.0.smithi082.stdout:3/220: readlink d8/d9/d1d/l20 0 2024-04-27T07:33:11.946 INFO:tasks.workunit.client.0.smithi082.stdout:0/85: truncate da/f1f 917454 0 2024-04-27T07:33:11.946 INFO:tasks.workunit.client.0.smithi082.stdout:4/72: creat d3/d6/f19 x:0 0 0 2024-04-27T07:33:11.989 INFO:tasks.workunit.client.0.smithi082.stdout:1/106: rename c3 to d4/c23 0 2024-04-27T07:33:11.990 INFO:tasks.workunit.client.0.smithi082.stdout:2/104: symlink d7/d17/d23/d25/l26 0 2024-04-27T07:33:11.990 INFO:tasks.workunit.client.0.smithi082.stdout:3/221: chown d8/d9/d1f/c40 3 1 2024-04-27T07:33:11.991 INFO:tasks.workunit.client.0.smithi082.stdout:1/107: dread - d4/f19 zero size 2024-04-27T07:33:11.992 INFO:tasks.workunit.client.0.smithi082.stdout:5/125: rename d8/d14/d1b/f1d to d8/d14/d1b/f27 0 2024-04-27T07:33:11.992 INFO:tasks.workunit.client.0.smithi082.stdout:2/105: dread - d7/d8/f1f zero size 2024-04-27T07:33:11.993 INFO:tasks.workunit.client.0.smithi082.stdout:4/73: mknod d3/d10/c1a 0 2024-04-27T07:33:11.995 INFO:tasks.workunit.client.0.smithi082.stdout:4/74: readlink d3/d9/lf 0 2024-04-27T07:33:11.995 INFO:tasks.workunit.client.0.smithi082.stdout:5/126: write d8/d14/f21 [766276,37142] 0 2024-04-27T07:33:11.996 INFO:tasks.workunit.client.0.smithi082.stdout:2/106: dread - d7/d8/f1f zero size 2024-04-27T07:33:11.996 INFO:tasks.workunit.client.0.smithi082.stdout:3/222: mkdir d8/d9/d25/d26/d59 0 2024-04-27T07:33:11.997 INFO:tasks.workunit.client.0.smithi082.stdout:7/110: dwrite d3/de/f1e [0,4194304] 0 2024-04-27T07:33:11.998 INFO:tasks.workunit.client.0.smithi082.stdout:3/223: chown d8/d9/d25/l2f 165176976 1 2024-04-27T07:33:11.999 INFO:tasks.workunit.client.0.smithi082.stdout:7/111: chown d3/de/l12 0 1 2024-04-27T07:33:12.000 INFO:tasks.workunit.client.0.smithi082.stdout:7/112: readlink d3/de/l1c 0 2024-04-27T07:33:12.000 INFO:tasks.workunit.client.0.smithi082.stdout:1/108: link d4/f11 d4/d15/d1c/f24 0 2024-04-27T07:33:12.002 INFO:tasks.workunit.client.0.smithi082.stdout:2/107: symlink d7/d17/d23/l27 0 2024-04-27T07:33:12.004 INFO:tasks.workunit.client.0.smithi082.stdout:2/108: write d7/fc [5247345,100438] 0 2024-04-27T07:33:12.008 INFO:tasks.workunit.client.0.smithi082.stdout:3/224: dwrite d8/d9/d1f/f46 [0,4194304] 0 2024-04-27T07:33:12.012 INFO:tasks.workunit.client.0.smithi082.stdout:7/113: dread d3/de/f1d [0,4194304] 0 2024-04-27T07:33:12.013 INFO:tasks.workunit.client.0.smithi082.stdout:3/225: write d8/ff [3056746,121285] 0 2024-04-27T07:33:12.014 INFO:tasks.workunit.client.0.smithi082.stdout:1/109: dread d4/f16 [0,4194304] 0 2024-04-27T07:33:12.016 INFO:tasks.workunit.client.0.smithi082.stdout:3/226: stat d8/d9/d1d 0 2024-04-27T07:33:12.020 INFO:tasks.workunit.client.0.smithi082.stdout:7/114: truncate d3/de/f1b 886800 0 2024-04-27T07:33:12.022 INFO:tasks.workunit.client.0.smithi082.stdout:2/109: dwrite d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:12.022 INFO:tasks.workunit.client.0.smithi082.stdout:1/110: rename d4/fa to d4/d15/d1c/f25 0 2024-04-27T07:33:12.024 INFO:tasks.workunit.client.0.smithi082.stdout:2/110: chown d7/d17 19 1 2024-04-27T07:33:12.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/115: rmdir d3/db/d15 39 2024-04-27T07:33:12.026 INFO:tasks.workunit.client.0.smithi082.stdout:0/86: dwrite da/ff [0,4194304] 0 2024-04-27T07:33:12.028 INFO:tasks.workunit.client.0.smithi082.stdout:1/111: mknod d4/c26 0 2024-04-27T07:33:12.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/87: dread - da/f19 zero size 2024-04-27T07:33:12.034 INFO:tasks.workunit.client.0.smithi082.stdout:3/227: rename d8/d9/d3f/f55 to d8/d9/dd/f5a 0 2024-04-27T07:33:12.034 INFO:tasks.workunit.client.0.smithi082.stdout:1/112: truncate d4/f1f 923177 0 2024-04-27T07:33:12.035 INFO:tasks.workunit.client.0.smithi082.stdout:0/88: write f6 [1796802,28394] 0 2024-04-27T07:33:12.038 INFO:tasks.workunit.client.0.smithi082.stdout:5/127: dwrite d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:12.039 INFO:tasks.workunit.client.0.smithi082.stdout:2/111: dread d7/fc [0,4194304] 0 2024-04-27T07:33:12.040 INFO:tasks.workunit.client.0.smithi082.stdout:1/113: write d4/fd [522079,130113] 0 2024-04-27T07:33:12.041 INFO:tasks.workunit.client.0.smithi082.stdout:3/228: mkdir d8/d9/d1f/d2a/d5b 0 2024-04-27T07:33:12.046 INFO:tasks.workunit.client.0.smithi082.stdout:5/128: rename d8/l12 to d8/d14/l28 0 2024-04-27T07:33:12.048 INFO:tasks.workunit.client.0.smithi082.stdout:7/116: dwrite d3/f1f [0,4194304] 0 2024-04-27T07:33:12.048 INFO:tasks.workunit.client.0.smithi082.stdout:0/89: fsync f6 0 2024-04-27T07:33:12.050 INFO:tasks.workunit.client.0.smithi082.stdout:0/90: dread - da/f1a zero size 2024-04-27T07:33:12.050 INFO:tasks.workunit.client.0.smithi082.stdout:3/229: read d8/d9/d1f/f46 [3753518,54520] 0 2024-04-27T07:33:12.051 INFO:tasks.workunit.client.0.smithi082.stdout:7/117: read d3/db/ff [195986,22679] 0 2024-04-27T07:33:12.055 INFO:tasks.workunit.client.0.smithi082.stdout:5/129: mkdir d8/d29 0 2024-04-27T07:33:12.056 INFO:tasks.workunit.client.0.smithi082.stdout:5/130: stat d8/d14/d1b/l1e 0 2024-04-27T07:33:12.058 INFO:tasks.workunit.client.0.smithi082.stdout:3/230: symlink d8/d9/d1f/l5c 0 2024-04-27T07:33:12.060 INFO:tasks.workunit.client.0.smithi082.stdout:0/91: getdents da/d1d 0 2024-04-27T07:33:12.062 INFO:tasks.workunit.client.0.smithi082.stdout:2/112: truncate f3 5362420 0 2024-04-27T07:33:12.063 INFO:tasks.workunit.client.0.smithi082.stdout:1/114: link d4/d15/l20 d4/d15/l27 0 2024-04-27T07:33:12.066 INFO:tasks.workunit.client.0.smithi082.stdout:2/113: dread - d7/d8/d13/f22 zero size 2024-04-27T07:33:12.067 INFO:tasks.workunit.client.0.smithi082.stdout:5/131: dwrite d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:12.069 INFO:tasks.workunit.client.0.smithi082.stdout:3/231: dread d8/d9/d1f/f41 [0,4194304] 0 2024-04-27T07:33:12.070 INFO:tasks.workunit.client.0.smithi082.stdout:8/38: sync 2024-04-27T07:33:12.071 INFO:tasks.workunit.client.0.smithi082.stdout:1/115: creat d4/f28 x:0 0 0 2024-04-27T07:33:12.073 INFO:tasks.workunit.client.0.smithi082.stdout:0/92: creat da/d1d/f20 x:0 0 0 2024-04-27T07:33:12.073 INFO:tasks.workunit.client.0.smithi082.stdout:7/118: link d3/l19 d3/db/d15/l23 0 2024-04-27T07:33:12.074 INFO:tasks.workunit.client.0.smithi082.stdout:3/232: creat d8/d9/dd/d13/d1b/f5d x:0 0 0 2024-04-27T07:33:12.075 INFO:tasks.workunit.client.0.smithi082.stdout:2/114: dwrite d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:12.076 INFO:tasks.workunit.client.0.smithi082.stdout:8/39: creat d0/d3/f9 x:0 0 0 2024-04-27T07:33:12.077 INFO:tasks.workunit.client.0.smithi082.stdout:7/119: truncate d3/f6 223049 0 2024-04-27T07:33:12.077 INFO:tasks.workunit.client.0.smithi082.stdout:5/132: symlink d8/d29/l2a 0 2024-04-27T07:33:12.077 INFO:tasks.workunit.client.0.smithi082.stdout:3/233: fsync d8/ff 0 2024-04-27T07:33:12.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/115: fdatasync d7/d9/f18 0 2024-04-27T07:33:12.079 INFO:tasks.workunit.client.0.smithi082.stdout:5/133: chown d8/d29 742593929 1 2024-04-27T07:33:12.080 INFO:tasks.workunit.client.0.smithi082.stdout:1/116: fsync d4/f16 0 2024-04-27T07:33:12.084 INFO:tasks.workunit.client.0.smithi082.stdout:8/40: creat d0/fa x:0 0 0 2024-04-27T07:33:12.085 INFO:tasks.workunit.client.0.smithi082.stdout:7/120: rmdir d3 39 2024-04-27T07:33:12.091 INFO:tasks.workunit.client.0.smithi082.stdout:8/41: symlink d0/lb 0 2024-04-27T07:33:12.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/42: write d0/fa [734839,36277] 0 2024-04-27T07:33:12.094 INFO:tasks.workunit.client.0.smithi082.stdout:0/93: truncate da/f1c 656940 0 2024-04-27T07:33:12.095 INFO:tasks.workunit.client.0.smithi082.stdout:0/94: truncate f7 1004509 0 2024-04-27T07:33:12.098 INFO:tasks.workunit.client.0.smithi082.stdout:3/234: creat d8/f5e x:0 0 0 2024-04-27T07:33:12.098 INFO:tasks.workunit.client.0.smithi082.stdout:1/117: write f2 [1921665,24726] 0 2024-04-27T07:33:12.099 INFO:tasks.workunit.client.0.smithi082.stdout:7/121: symlink d3/db/d15/l24 0 2024-04-27T07:33:12.102 INFO:tasks.workunit.client.0.smithi082.stdout:7/122: stat d3/de/l1c 0 2024-04-27T07:33:12.102 INFO:tasks.workunit.client.0.smithi082.stdout:2/116: rmdir d7/d8/d24 0 2024-04-27T07:33:12.103 INFO:tasks.workunit.client.0.smithi082.stdout:2/117: read d7/d8/f19 [15482,68195] 0 2024-04-27T07:33:12.103 INFO:tasks.workunit.client.0.smithi082.stdout:2/118: chown d7/d9 0 1 2024-04-27T07:33:12.104 INFO:tasks.workunit.client.0.smithi082.stdout:0/95: mknod da/c21 0 2024-04-27T07:33:12.105 INFO:tasks.workunit.client.0.smithi082.stdout:5/134: truncate f5 1505353 0 2024-04-27T07:33:12.106 INFO:tasks.workunit.client.0.smithi082.stdout:1/118: mkdir d4/d15/d29 0 2024-04-27T07:33:12.107 INFO:tasks.workunit.client.0.smithi082.stdout:3/235: dwrite d8/d9/dd/f35 [0,4194304] 0 2024-04-27T07:33:12.115 INFO:tasks.workunit.client.0.smithi082.stdout:1/119: mkdir d4/d2a 0 2024-04-27T07:33:12.117 INFO:tasks.workunit.client.0.smithi082.stdout:7/123: dwrite d3/db/d15/f21 [4194304,4194304] 0 2024-04-27T07:33:12.119 INFO:tasks.workunit.client.0.smithi082.stdout:3/236: truncate d8/d9/d1f/d53/f56 3075808 0 2024-04-27T07:33:12.126 INFO:tasks.workunit.client.0.smithi082.stdout:5/135: dread d8/d15/f13 [0,4194304] 0 2024-04-27T07:33:12.127 INFO:tasks.workunit.client.0.smithi082.stdout:7/124: symlink d3/d9/l25 0 2024-04-27T07:33:12.128 INFO:tasks.workunit.client.0.smithi082.stdout:1/120: dwrite d4/f12 [4194304,4194304] 0 2024-04-27T07:33:12.128 INFO:tasks.workunit.client.0.smithi082.stdout:5/136: readlink d8/d29/l2a 0 2024-04-27T07:33:12.129 INFO:tasks.workunit.client.0.smithi082.stdout:1/121: stat d4/ff 0 2024-04-27T07:33:12.129 INFO:tasks.workunit.client.0.smithi082.stdout:3/237: mknod d8/d9/d1f/c5f 0 2024-04-27T07:33:12.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/137: stat d8/d14/f16 0 2024-04-27T07:33:12.130 INFO:tasks.workunit.client.0.smithi082.stdout:1/122: dread - d4/ff zero size 2024-04-27T07:33:12.132 INFO:tasks.workunit.client.0.smithi082.stdout:0/96: link da/lc da/l22 0 2024-04-27T07:33:12.134 INFO:tasks.workunit.client.0.smithi082.stdout:2/119: getdents d7/d17/d23 0 2024-04-27T07:33:12.137 INFO:tasks.workunit.client.0.smithi082.stdout:5/138: rmdir d8/d14/d1b 39 2024-04-27T07:33:12.139 INFO:tasks.workunit.client.0.smithi082.stdout:0/97: mknod da/d1d/c23 0 2024-04-27T07:33:12.141 INFO:tasks.workunit.client.0.smithi082.stdout:3/238: symlink d8/d9/d25/d26/d4d/l60 0 2024-04-27T07:33:12.141 INFO:tasks.workunit.client.0.smithi082.stdout:7/125: dwrite d3/de/f1b [0,4194304] 0 2024-04-27T07:33:12.144 INFO:tasks.workunit.client.0.smithi082.stdout:5/139: symlink d8/d14/d20/l2b 0 2024-04-27T07:33:12.145 INFO:tasks.workunit.client.0.smithi082.stdout:7/126: rename d3 to d3/de/d26 22 2024-04-27T07:33:12.148 INFO:tasks.workunit.client.0.smithi082.stdout:3/239: mknod d8/d9/d1d/c61 0 2024-04-27T07:33:12.152 INFO:tasks.workunit.client.0.smithi082.stdout:2/120: dwrite d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:12.153 INFO:tasks.workunit.client.0.smithi082.stdout:0/98: link f5 da/d1d/f24 0 2024-04-27T07:33:12.154 INFO:tasks.workunit.client.0.smithi082.stdout:1/123: dwrite d4/d15/f17 [4194304,4194304] 0 2024-04-27T07:33:12.158 INFO:tasks.workunit.client.0.smithi082.stdout:7/127: dread d3/de/f1e [0,4194304] 0 2024-04-27T07:33:12.162 INFO:tasks.workunit.client.0.smithi082.stdout:0/99: creat da/d1d/f25 x:0 0 0 2024-04-27T07:33:12.164 INFO:tasks.workunit.client.0.smithi082.stdout:1/124: rename d4/f19 to d4/d15/f2b 0 2024-04-27T07:33:12.165 INFO:tasks.workunit.client.0.smithi082.stdout:1/125: chown d4/d15/d1c/c21 378 1 2024-04-27T07:33:12.171 INFO:tasks.workunit.client.0.smithi082.stdout:1/126: rename d4/f1f to d4/d15/d1c/f2c 0 2024-04-27T07:33:12.172 INFO:tasks.workunit.client.0.smithi082.stdout:3/240: rmdir d8/d9/d1f/d2a/d5b 0 2024-04-27T07:33:12.173 INFO:tasks.workunit.client.0.smithi082.stdout:1/127: chown d4/f10 19120838 1 2024-04-27T07:33:12.174 INFO:tasks.workunit.client.0.smithi082.stdout:5/140: dwrite d8/fa [0,4194304] 0 2024-04-27T07:33:12.174 INFO:tasks.workunit.client.0.smithi082.stdout:7/128: creat d3/db/f27 x:0 0 0 2024-04-27T07:33:12.176 INFO:tasks.workunit.client.0.smithi082.stdout:3/241: creat d8/d9/d3f/f62 x:0 0 0 2024-04-27T07:33:12.176 INFO:tasks.workunit.client.0.smithi082.stdout:1/128: dread d4/d15/d1c/f2c [0,4194304] 0 2024-04-27T07:33:12.179 INFO:tasks.workunit.client.0.smithi082.stdout:7/129: truncate d3/de/f1b 4305902 0 2024-04-27T07:33:12.179 INFO:tasks.workunit.client.0.smithi082.stdout:1/129: dread - d4/f11 zero size 2024-04-27T07:33:12.180 INFO:tasks.workunit.client.0.smithi082.stdout:7/130: fsync d3/f20 0 2024-04-27T07:33:12.183 INFO:tasks.workunit.client.0.smithi082.stdout:7/131: chown d3/f5 466842 1 2024-04-27T07:33:12.183 INFO:tasks.workunit.client.0.smithi082.stdout:1/130: readlink d4/l6 0 2024-04-27T07:33:12.184 INFO:tasks.workunit.client.0.smithi082.stdout:5/141: dread f5 [0,4194304] 0 2024-04-27T07:33:12.187 INFO:tasks.workunit.client.0.smithi082.stdout:2/121: dwrite f3 [4194304,4194304] 0 2024-04-27T07:33:12.188 INFO:tasks.workunit.client.0.smithi082.stdout:2/122: readlink d7/d17/d23/d25/l26 0 2024-04-27T07:33:12.190 INFO:tasks.workunit.client.0.smithi082.stdout:7/132: link d3/de/l1c d3/d9/l28 0 2024-04-27T07:33:12.191 INFO:tasks.workunit.client.0.smithi082.stdout:0/100: write f5 [260493,78328] 0 2024-04-27T07:33:12.191 INFO:tasks.workunit.client.0.smithi082.stdout:5/142: dread f7 [0,4194304] 0 2024-04-27T07:33:12.193 INFO:tasks.workunit.client.0.smithi082.stdout:7/133: dread d3/f6 [0,4194304] 0 2024-04-27T07:33:12.194 INFO:tasks.workunit.client.0.smithi082.stdout:7/134: chown d3/de/c17 3 1 2024-04-27T07:33:12.198 INFO:tasks.workunit.client.0.smithi082.stdout:0/101: creat da/f26 x:0 0 0 2024-04-27T07:33:12.204 INFO:tasks.workunit.client.0.smithi082.stdout:7/135: unlink d3/db/f10 0 2024-04-27T07:33:12.204 INFO:tasks.workunit.client.0.smithi082.stdout:0/102: dread f9 [0,4194304] 0 2024-04-27T07:33:12.207 INFO:tasks.workunit.client.0.smithi082.stdout:3/242: write d8/d9/dd/d13/f1e [3394924,18457] 0 2024-04-27T07:33:12.208 INFO:tasks.workunit.client.0.smithi082.stdout:1/131: dwrite d4/f11 [0,4194304] 0 2024-04-27T07:33:12.209 INFO:tasks.workunit.client.0.smithi082.stdout:1/132: dread - d4/f28 zero size 2024-04-27T07:33:12.210 INFO:tasks.workunit.client.0.smithi082.stdout:7/136: readlink d3/d9/l28 0 2024-04-27T07:33:12.212 INFO:tasks.workunit.client.0.smithi082.stdout:0/103: rename da/d1d/c23 to da/d1d/c27 0 2024-04-27T07:33:12.213 INFO:tasks.workunit.client.0.smithi082.stdout:2/123: truncate d7/fc 2386656 0 2024-04-27T07:33:12.215 INFO:tasks.workunit.client.0.smithi082.stdout:2/124: fdatasync d7/d9/f1d 0 2024-04-27T07:33:12.217 INFO:tasks.workunit.client.0.smithi082.stdout:3/243: rename d8/fb to d8/d9/d1f/f63 0 2024-04-27T07:33:12.218 INFO:tasks.workunit.client.0.smithi082.stdout:1/133: mknod d4/d15/c2d 0 2024-04-27T07:33:12.219 INFO:tasks.workunit.client.0.smithi082.stdout:2/125: chown d7/l20 351952519 1 2024-04-27T07:33:12.219 INFO:tasks.workunit.client.0.smithi082.stdout:5/143: dwrite d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:12.221 INFO:tasks.workunit.client.0.smithi082.stdout:3/244: chown d8/d9/d1f/c40 0 1 2024-04-27T07:33:12.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/104: mkdir da/d28 0 2024-04-27T07:33:12.225 INFO:tasks.workunit.client.0.smithi082.stdout:7/137: dwrite d3/f5 [0,4194304] 0 2024-04-27T07:33:12.225 INFO:tasks.workunit.client.0.smithi082.stdout:0/105: read - da/d1d/f25 zero size 2024-04-27T07:33:12.226 INFO:tasks.workunit.client.0.smithi082.stdout:1/134: symlink d4/d15/l2e 0 2024-04-27T07:33:12.229 INFO:tasks.workunit.client.0.smithi082.stdout:1/135: chown d4/d15/d1c/f24 106 1 2024-04-27T07:33:12.230 INFO:tasks.workunit.client.0.smithi082.stdout:2/126: dwrite d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:12.239 INFO:tasks.workunit.client.0.smithi082.stdout:0/106: dwrite da/fe [0,4194304] 0 2024-04-27T07:33:12.239 INFO:tasks.workunit.client.0.smithi082.stdout:0/107: write f6 [3639174,58422] 0 2024-04-27T07:33:12.240 INFO:tasks.workunit.client.0.smithi082.stdout:2/127: creat d7/f28 x:0 0 0 2024-04-27T07:33:12.242 INFO:tasks.workunit.client.0.smithi082.stdout:0/108: symlink da/d1d/l29 0 2024-04-27T07:33:12.243 INFO:tasks.workunit.client.0.smithi082.stdout:2/128: write d7/d9/f1d [4550491,24493] 0 2024-04-27T07:33:12.252 INFO:tasks.workunit.client.0.smithi082.stdout:2/129: link c5 d7/d17/d23/c29 0 2024-04-27T07:33:12.254 INFO:tasks.workunit.client.0.smithi082.stdout:5/144: dwrite f5 [0,4194304] 0 2024-04-27T07:33:12.255 INFO:tasks.workunit.client.0.smithi082.stdout:5/145: write d8/f25 [5026612,114464] 0 2024-04-27T07:33:12.263 INFO:tasks.workunit.client.0.smithi082.stdout:5/146: dwrite d8/f25 [0,4194304] 0 2024-04-27T07:33:12.265 INFO:tasks.workunit.client.0.smithi082.stdout:5/147: symlink d8/d15/l2c 0 2024-04-27T07:33:12.269 INFO:tasks.workunit.client.0.smithi082.stdout:3/245: truncate f5 119369 0 2024-04-27T07:33:12.270 INFO:tasks.workunit.client.0.smithi082.stdout:5/148: dread d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:12.271 INFO:tasks.workunit.client.0.smithi082.stdout:3/246: symlink d8/d9/dd/d13/d1b/l64 0 2024-04-27T07:33:12.272 INFO:tasks.workunit.client.0.smithi082.stdout:3/247: chown d8/l2c 6836 1 2024-04-27T07:33:12.274 INFO:tasks.workunit.client.0.smithi082.stdout:1/136: truncate d4/f12 2151169 0 2024-04-27T07:33:12.276 INFO:tasks.workunit.client.0.smithi082.stdout:0/109: write da/ff [1712213,70914] 0 2024-04-27T07:33:12.276 INFO:tasks.workunit.client.0.smithi082.stdout:1/137: write d4/f5 [8730773,364] 0 2024-04-27T07:33:12.278 INFO:tasks.workunit.client.0.smithi082.stdout:0/110: truncate da/f19 914075 0 2024-04-27T07:33:12.279 INFO:tasks.workunit.client.0.smithi082.stdout:5/149: dwrite d8/f25 [4194304,4194304] 0 2024-04-27T07:33:12.279 INFO:tasks.workunit.client.0.smithi082.stdout:1/138: write d4/f1e [1988362,78431] 0 2024-04-27T07:33:12.280 INFO:tasks.workunit.client.0.smithi082.stdout:5/150: readlink d8/d14/d20/l2b 0 2024-04-27T07:33:12.281 INFO:tasks.workunit.client.0.smithi082.stdout:5/151: write d8/d14/f23 [1700380,54268] 0 2024-04-27T07:33:12.282 INFO:tasks.workunit.client.0.smithi082.stdout:3/248: rmdir d8/d9/d25/d26/d59 0 2024-04-27T07:33:12.284 INFO:tasks.workunit.client.0.smithi082.stdout:0/111: rmdir da/d1d 39 2024-04-27T07:33:12.286 INFO:tasks.workunit.client.0.smithi082.stdout:2/130: truncate d7/d8/f1f 1726243 0 2024-04-27T07:33:12.295 INFO:tasks.workunit.client.0.smithi082.stdout:2/131: dread d7/d8/f19 [0,4194304] 0 2024-04-27T07:33:12.295 INFO:tasks.workunit.client.0.smithi082.stdout:2/132: chown d7/d9/f18 46 1 2024-04-27T07:33:12.296 INFO:tasks.workunit.client.0.smithi082.stdout:0/112: mkdir da/d2a 0 2024-04-27T07:33:12.302 INFO:tasks.workunit.client.0.smithi082.stdout:2/133: rename d7/d17/c1a to d7/d8/d13/c2a 0 2024-04-27T07:33:12.304 INFO:tasks.workunit.client.0.smithi082.stdout:0/113: dwrite da/f1b [0,4194304] 0 2024-04-27T07:33:12.305 INFO:tasks.workunit.client.0.smithi082.stdout:3/249: truncate d8/f2e 3106857 0 2024-04-27T07:33:12.309 INFO:tasks.workunit.client.0.smithi082.stdout:5/152: dwrite f4 [0,4194304] 0 2024-04-27T07:33:12.310 INFO:tasks.workunit.client.0.smithi082.stdout:5/153: fsync f7 0 2024-04-27T07:33:12.311 INFO:tasks.workunit.client.0.smithi082.stdout:0/114: symlink da/d28/l2b 0 2024-04-27T07:33:12.320 INFO:tasks.workunit.client.0.smithi082.stdout:2/134: chown d7/d8/d13/c2a 5446755 1 2024-04-27T07:33:12.321 INFO:tasks.workunit.client.0.smithi082.stdout:0/115: creat da/d1d/f2c x:0 0 0 2024-04-27T07:33:12.322 INFO:tasks.workunit.client.0.smithi082.stdout:5/154: creat d8/f2d x:0 0 0 2024-04-27T07:33:12.322 INFO:tasks.workunit.client.0.smithi082.stdout:0/116: dread - da/d1d/f2c zero size 2024-04-27T07:33:12.325 INFO:tasks.workunit.client.0.smithi082.stdout:0/117: unlink da/d1d/f2c 0 2024-04-27T07:33:12.337 INFO:tasks.workunit.client.0.smithi082.stdout:3/250: dread d8/d9/dd/d13/d1b/f28 [0,4194304] 0 2024-04-27T07:33:12.338 INFO:tasks.workunit.client.0.smithi082.stdout:2/135: dwrite d7/fc [0,4194304] 0 2024-04-27T07:33:12.340 INFO:tasks.workunit.client.0.smithi082.stdout:0/118: dwrite da/f1c [0,4194304] 0 2024-04-27T07:33:12.341 INFO:tasks.workunit.client.0.smithi082.stdout:3/251: rmdir d8/d9/d25/d26/d4d 39 2024-04-27T07:33:12.342 INFO:tasks.workunit.client.0.smithi082.stdout:0/119: write f6 [177286,52803] 0 2024-04-27T07:33:12.344 INFO:tasks.workunit.client.0.smithi082.stdout:3/252: fsync d8/d9/dd/f35 0 2024-04-27T07:33:12.344 INFO:tasks.workunit.client.0.smithi082.stdout:0/120: write da/f15 [273150,31349] 0 2024-04-27T07:33:12.345 INFO:tasks.workunit.client.0.smithi082.stdout:3/253: fdatasync d8/d9/dd/d13/f48 0 2024-04-27T07:33:12.346 INFO:tasks.workunit.client.0.smithi082.stdout:2/136: dread d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:12.347 INFO:tasks.workunit.client.0.smithi082.stdout:0/121: unlink da/f1b 0 2024-04-27T07:33:12.348 INFO:tasks.workunit.client.0.smithi082.stdout:2/137: readlink d7/d17/d23/d25/l26 0 2024-04-27T07:33:12.350 INFO:tasks.workunit.client.0.smithi082.stdout:3/254: symlink d8/d9/d25/d26/d3d/l65 0 2024-04-27T07:33:12.352 INFO:tasks.workunit.client.0.smithi082.stdout:0/122: creat da/d1d/f2d x:0 0 0 2024-04-27T07:33:12.353 INFO:tasks.workunit.client.0.smithi082.stdout:2/138: rmdir d7/d8/d13 39 2024-04-27T07:33:12.356 INFO:tasks.workunit.client.0.smithi082.stdout:0/123: creat da/d28/f2e x:0 0 0 2024-04-27T07:33:12.358 INFO:tasks.workunit.client.0.smithi082.stdout:3/255: dwrite d8/d9/d1f/f4c [0,4194304] 0 2024-04-27T07:33:12.359 INFO:tasks.workunit.client.0.smithi082.stdout:0/124: mknod da/c2f 0 2024-04-27T07:33:12.361 INFO:tasks.workunit.client.0.smithi082.stdout:3/256: mkdir d8/d9/d25/d66 0 2024-04-27T07:33:12.362 INFO:tasks.workunit.client.0.smithi082.stdout:3/257: readlink d8/d9/dd/d13/d1b/l64 0 2024-04-27T07:33:12.366 INFO:tasks.workunit.client.0.smithi082.stdout:3/258: symlink d8/d9/dd/d13/l67 0 2024-04-27T07:33:12.368 INFO:tasks.workunit.client.0.smithi082.stdout:3/259: mknod d8/d9/d1f/d2a/c68 0 2024-04-27T07:33:12.369 INFO:tasks.workunit.client.0.smithi082.stdout:3/260: symlink d8/d9/d1f/l69 0 2024-04-27T07:33:12.370 INFO:tasks.workunit.client.0.smithi082.stdout:0/125: truncate da/d1d/f24 762709 0 2024-04-27T07:33:12.370 INFO:tasks.workunit.client.0.smithi082.stdout:0/126: chown da/c17 34578 1 2024-04-27T07:33:12.374 INFO:tasks.workunit.client.0.smithi082.stdout:0/127: creat da/d2a/f30 x:0 0 0 2024-04-27T07:33:12.377 INFO:tasks.workunit.client.0.smithi082.stdout:0/128: dread da/ff [0,4194304] 0 2024-04-27T07:33:12.377 INFO:tasks.workunit.client.0.smithi082.stdout:3/261: write f5 [177695,85463] 0 2024-04-27T07:33:12.378 INFO:tasks.workunit.client.0.smithi082.stdout:3/262: write f5 [1114512,46154] 0 2024-04-27T07:33:12.379 INFO:tasks.workunit.client.0.smithi082.stdout:3/263: chown d8/d9/d1d/l20 101 1 2024-04-27T07:33:12.380 INFO:tasks.workunit.client.0.smithi082.stdout:3/264: read d8/d9/d1f/f41 [109846,38906] 0 2024-04-27T07:33:12.381 INFO:tasks.workunit.client.0.smithi082.stdout:0/129: mknod da/c31 0 2024-04-27T07:33:12.382 INFO:tasks.workunit.client.0.smithi082.stdout:3/265: fdatasync d8/d9/d1f/f63 0 2024-04-27T07:33:12.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/130: mknod da/d2a/c32 0 2024-04-27T07:33:12.384 INFO:tasks.workunit.client.0.smithi082.stdout:3/266: mknod d8/d9/d1f/d2a/c6a 0 2024-04-27T07:33:12.384 INFO:tasks.workunit.client.0.smithi082.stdout:0/131: mknod da/d2a/c33 0 2024-04-27T07:33:12.387 INFO:tasks.workunit.client.0.smithi082.stdout:3/267: getdents d8/d9 0 2024-04-27T07:33:12.389 INFO:tasks.workunit.client.0.smithi082.stdout:3/268: creat d8/d9/d25/d26/d3d/f6b x:0 0 0 2024-04-27T07:33:12.390 INFO:tasks.workunit.client.0.smithi082.stdout:3/269: mknod d8/d9/d1d/c6c 0 2024-04-27T07:33:12.391 INFO:tasks.workunit.client.0.smithi082.stdout:0/132: truncate f9 2937763 0 2024-04-27T07:33:12.391 INFO:tasks.workunit.client.0.smithi082.stdout:0/133: stat da/l18 0 2024-04-27T07:33:12.392 INFO:tasks.workunit.client.0.smithi082.stdout:0/134: write da/f19 [1459051,31424] 0 2024-04-27T07:33:12.393 INFO:tasks.workunit.client.0.smithi082.stdout:0/135: mkdir da/d2a/d34 0 2024-04-27T07:33:12.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/136: creat da/d1d/f35 x:0 0 0 2024-04-27T07:33:12.398 INFO:tasks.workunit.client.0.smithi082.stdout:3/270: getdents d8/d9/d25/d26/d4d 0 2024-04-27T07:33:12.401 INFO:tasks.workunit.client.0.smithi082.stdout:0/137: unlink da/d1d/c27 0 2024-04-27T07:33:12.406 INFO:tasks.workunit.client.0.smithi082.stdout:3/271: dwrite d8/d9/dd/f5a [0,4194304] 0 2024-04-27T07:33:12.408 INFO:tasks.workunit.client.0.smithi082.stdout:3/272: stat d8/d9/d1f/d2a/c54 0 2024-04-27T07:33:12.409 INFO:tasks.workunit.client.0.smithi082.stdout:6/73: sync 2024-04-27T07:33:12.410 INFO:tasks.workunit.client.0.smithi082.stdout:0/138: dwrite f7 [0,4194304] 0 2024-04-27T07:33:12.416 INFO:tasks.workunit.client.0.smithi082.stdout:0/139: mkdir da/d28/d36 0 2024-04-27T07:33:12.417 INFO:tasks.workunit.client.0.smithi082.stdout:0/140: readlink da/d28/l2b 0 2024-04-27T07:33:12.418 INFO:tasks.workunit.client.0.smithi082.stdout:3/273: dread d8/d9/d1f/f46 [0,4194304] 0 2024-04-27T07:33:12.418 INFO:tasks.workunit.client.0.smithi082.stdout:0/141: read da/f19 [1421781,30652] 0 2024-04-27T07:33:12.423 INFO:tasks.workunit.client.0.smithi082.stdout:3/274: rename d8/d9/d1f/d2a to d8/d9/d25/d66/d6d 0 2024-04-27T07:33:12.425 INFO:tasks.workunit.client.0.smithi082.stdout:0/142: mknod da/d2a/c37 0 2024-04-27T07:33:12.425 INFO:tasks.workunit.client.0.smithi082.stdout:0/143: fdatasync da/d1d/f25 0 2024-04-27T07:33:12.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/74: getdents d2/de/d13 0 2024-04-27T07:33:12.426 INFO:tasks.workunit.client.0.smithi082.stdout:6/75: stat d2/de/d13 0 2024-04-27T07:33:12.429 INFO:tasks.workunit.client.0.smithi082.stdout:0/144: mkdir da/d38 0 2024-04-27T07:33:12.430 INFO:tasks.workunit.client.0.smithi082.stdout:3/275: creat d8/d9/d25/d26/f6e x:0 0 0 2024-04-27T07:33:12.434 INFO:tasks.workunit.client.0.smithi082.stdout:6/76: link d2/d3/fd d2/de/f17 0 2024-04-27T07:33:12.438 INFO:tasks.workunit.client.0.smithi082.stdout:3/276: link f5 d8/d9/dd/d13/f6f 0 2024-04-27T07:33:12.441 INFO:tasks.workunit.client.0.smithi082.stdout:3/277: creat d8/d9/f70 x:0 0 0 2024-04-27T07:33:12.442 INFO:tasks.workunit.client.0.smithi082.stdout:6/77: dwrite d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:12.443 INFO:tasks.workunit.client.0.smithi082.stdout:6/78: fsync d2/d3/f8 0 2024-04-27T07:33:12.448 INFO:tasks.workunit.client.0.smithi082.stdout:6/79: dread d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:12.448 INFO:tasks.workunit.client.0.smithi082.stdout:6/80: chown d2/de 108703 1 2024-04-27T07:33:12.450 INFO:tasks.workunit.client.0.smithi082.stdout:6/81: write d2/d3/f8 [2337109,130428] 0 2024-04-27T07:33:12.452 INFO:tasks.workunit.client.0.smithi082.stdout:6/82: chown d2/d3/fd 2475992 1 2024-04-27T07:33:12.454 INFO:tasks.workunit.client.0.smithi082.stdout:0/145: dwrite f4 [0,4194304] 0 2024-04-27T07:33:12.462 INFO:tasks.workunit.client.0.smithi082.stdout:6/83: creat d2/f18 x:0 0 0 2024-04-27T07:33:12.466 INFO:tasks.workunit.client.0.smithi082.stdout:6/84: write d2/d3/f6 [809191,21219] 0 2024-04-27T07:33:12.466 INFO:tasks.workunit.client.0.smithi082.stdout:0/146: link da/l1e da/d1d/l39 0 2024-04-27T07:33:12.467 INFO:tasks.workunit.client.0.smithi082.stdout:3/278: symlink d8/d9/dd/l71 0 2024-04-27T07:33:12.469 INFO:tasks.workunit.client.0.smithi082.stdout:6/85: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:12.470 INFO:tasks.workunit.client.0.smithi082.stdout:3/279: read - d8/d9/d25/d26/d3d/f6b zero size 2024-04-27T07:33:12.472 INFO:tasks.workunit.client.0.smithi082.stdout:0/147: link da/d1d/f24 da/d38/f3a 0 2024-04-27T07:33:12.473 INFO:tasks.workunit.client.0.smithi082.stdout:6/86: symlink d2/l19 0 2024-04-27T07:33:12.475 INFO:tasks.workunit.client.0.smithi082.stdout:0/148: mknod da/d38/c3b 0 2024-04-27T07:33:12.478 INFO:tasks.workunit.client.0.smithi082.stdout:0/149: rmdir da/d28 39 2024-04-27T07:33:12.479 INFO:tasks.workunit.client.0.smithi082.stdout:3/280: dwrite d8/d9/d1d/f2d [0,4194304] 0 2024-04-27T07:33:12.485 INFO:tasks.workunit.client.0.smithi082.stdout:6/87: link d2/d3/la d2/de/l1a 0 2024-04-27T07:33:12.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/88: mkdir d2/d3/d1b 0 2024-04-27T07:33:12.496 INFO:tasks.workunit.client.0.smithi082.stdout:3/281: write f5 [725051,125406] 0 2024-04-27T07:33:12.497 INFO:tasks.workunit.client.0.smithi082.stdout:6/89: dwrite d2/f10 [0,4194304] 0 2024-04-27T07:33:12.499 INFO:tasks.workunit.client.0.smithi082.stdout:0/150: truncate da/f1f 911333 0 2024-04-27T07:33:12.499 INFO:tasks.workunit.client.0.smithi082.stdout:0/151: stat da/d1d/f35 0 2024-04-27T07:33:12.500 INFO:tasks.workunit.client.0.smithi082.stdout:0/152: fdatasync da/f26 0 2024-04-27T07:33:12.501 INFO:tasks.workunit.client.0.smithi082.stdout:3/282: readlink d8/d9/d1f/l5c 0 2024-04-27T07:33:12.504 INFO:tasks.workunit.client.0.smithi082.stdout:0/153: truncate da/d1d/f2d 556774 0 2024-04-27T07:33:12.504 INFO:tasks.workunit.client.0.smithi082.stdout:3/283: chown d8/d9/d25/d26/d4d/l60 995 1 2024-04-27T07:33:12.506 INFO:tasks.workunit.client.0.smithi082.stdout:3/284: chown f5 4025 1 2024-04-27T07:33:12.509 INFO:tasks.workunit.client.0.smithi082.stdout:6/90: dwrite d2/f10 [4194304,4194304] 0 2024-04-27T07:33:12.512 INFO:tasks.workunit.client.0.smithi082.stdout:3/285: creat d8/d9/d1f/f72 x:0 0 0 2024-04-27T07:33:12.513 INFO:tasks.workunit.client.0.smithi082.stdout:6/91: creat d2/de/d13/f1c x:0 0 0 2024-04-27T07:33:12.515 INFO:tasks.workunit.client.0.smithi082.stdout:0/154: dwrite da/d2a/f30 [0,4194304] 0 2024-04-27T07:33:12.516 INFO:tasks.workunit.client.0.smithi082.stdout:3/286: creat d8/d9/d25/d66/d6d/f73 x:0 0 0 2024-04-27T07:33:12.520 INFO:tasks.workunit.client.0.smithi082.stdout:0/155: mkdir da/d3c 0 2024-04-27T07:33:12.523 INFO:tasks.workunit.client.0.smithi082.stdout:6/92: rename d2/f10 to d2/de/f1d 0 2024-04-27T07:33:12.525 INFO:tasks.workunit.client.0.smithi082.stdout:6/93: write d2/d3/f11 [132086,128813] 0 2024-04-27T07:33:12.525 INFO:tasks.workunit.client.0.smithi082.stdout:3/287: creat d8/f74 x:0 0 0 2024-04-27T07:33:12.529 INFO:tasks.workunit.client.0.smithi082.stdout:0/156: fdatasync f5 0 2024-04-27T07:33:12.530 INFO:tasks.workunit.client.0.smithi082.stdout:3/288: unlink d8/d9/d25/d66/d6d/c68 0 2024-04-27T07:33:12.533 INFO:tasks.workunit.client.0.smithi082.stdout:3/289: mknod d8/c75 0 2024-04-27T07:33:12.534 INFO:tasks.workunit.client.0.smithi082.stdout:0/157: symlink da/d3c/l3d 0 2024-04-27T07:33:12.534 INFO:tasks.workunit.client.0.smithi082.stdout:3/290: chown d8/d9/d25/d26/c47 6857 1 2024-04-27T07:33:12.536 INFO:tasks.workunit.client.0.smithi082.stdout:0/158: dread da/f15 [0,4194304] 0 2024-04-27T07:33:12.537 INFO:tasks.workunit.client.0.smithi082.stdout:6/94: getdents d2/de/d13 0 2024-04-27T07:33:12.540 INFO:tasks.workunit.client.0.smithi082.stdout:3/291: mknod d8/d9/d25/d4e/c76 0 2024-04-27T07:33:12.541 INFO:tasks.workunit.client.0.smithi082.stdout:6/95: rmdir d2/de 39 2024-04-27T07:33:12.543 INFO:tasks.workunit.client.0.smithi082.stdout:0/159: rename da/l1e to da/d2a/l3e 0 2024-04-27T07:33:12.546 INFO:tasks.workunit.client.0.smithi082.stdout:3/292: rmdir d8/d9/d3f 39 2024-04-27T07:33:12.547 INFO:tasks.workunit.client.0.smithi082.stdout:6/96: mkdir d2/d1e 0 2024-04-27T07:33:12.555 INFO:tasks.workunit.client.0.smithi082.stdout:6/97: rename d2/l15 to d2/de/l1f 0 2024-04-27T07:33:12.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/160: dwrite da/f19 [0,4194304] 0 2024-04-27T07:33:12.557 INFO:tasks.workunit.client.0.smithi082.stdout:3/293: creat d8/d9/d25/f77 x:0 0 0 2024-04-27T07:33:12.560 INFO:tasks.workunit.client.0.smithi082.stdout:6/98: unlink d2/d3/lb 0 2024-04-27T07:33:12.560 INFO:tasks.workunit.client.0.smithi082.stdout:0/161: chown da/l11 1438315 1 2024-04-27T07:33:12.560 INFO:tasks.workunit.client.0.smithi082.stdout:6/99: stat d2/d3/f11 0 2024-04-27T07:33:12.564 INFO:tasks.workunit.client.0.smithi082.stdout:6/100: rename d2/d3/f8 to d2/d3/d1b/f20 0 2024-04-27T07:33:12.565 INFO:tasks.workunit.client.0.smithi082.stdout:0/162: rmdir da/d28 39 2024-04-27T07:33:12.567 INFO:tasks.workunit.client.0.smithi082.stdout:6/101: write d2/de/f1d [7044334,103077] 0 2024-04-27T07:33:12.572 INFO:tasks.workunit.client.0.smithi082.stdout:6/102: link d2/de/f17 d2/de/d13/f21 0 2024-04-27T07:33:12.575 INFO:tasks.workunit.client.0.smithi082.stdout:6/103: dread - d2/de/d13/f21 zero size 2024-04-27T07:33:12.576 INFO:tasks.workunit.client.0.smithi082.stdout:6/104: fdatasync d2/f18 0 2024-04-27T07:33:12.579 INFO:tasks.workunit.client.0.smithi082.stdout:6/105: creat d2/d1e/f22 x:0 0 0 2024-04-27T07:33:12.580 INFO:tasks.workunit.client.0.smithi082.stdout:0/163: dwrite da/d1d/f24 [0,4194304] 0 2024-04-27T07:33:12.582 INFO:tasks.workunit.client.0.smithi082.stdout:6/106: write d2/de/d13/f16 [1939085,113522] 0 2024-04-27T07:33:12.583 INFO:tasks.workunit.client.0.smithi082.stdout:6/107: read d2/d3/d1b/f20 [3700017,44193] 0 2024-04-27T07:33:12.584 INFO:tasks.workunit.client.0.smithi082.stdout:0/164: dread f7 [0,4194304] 0 2024-04-27T07:33:12.585 INFO:tasks.workunit.client.0.smithi082.stdout:6/108: rmdir d2 39 2024-04-27T07:33:12.587 INFO:tasks.workunit.client.0.smithi082.stdout:0/165: mkdir da/d3c/d3f 0 2024-04-27T07:33:12.591 INFO:tasks.workunit.client.0.smithi082.stdout:6/109: creat d2/f23 x:0 0 0 2024-04-27T07:33:12.591 INFO:tasks.workunit.client.0.smithi082.stdout:0/166: dread f4 [0,4194304] 0 2024-04-27T07:33:12.592 INFO:tasks.workunit.client.0.smithi082.stdout:0/167: write da/fe [2456063,12971] 0 2024-04-27T07:33:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:12 smithi082 ceph-mon[26613]: pgmap v12: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 27 MiB/s wr, 447 op/s 2024-04-27T07:33:12.593 INFO:tasks.workunit.client.0.smithi082.stdout:0/168: dread - da/d1d/f35 zero size 2024-04-27T07:33:12.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/110: creat d2/de/f24 x:0 0 0 2024-04-27T07:33:12.597 INFO:tasks.workunit.client.0.smithi082.stdout:6/111: mknod d2/c25 0 2024-04-27T07:33:12.598 INFO:tasks.workunit.client.0.smithi082.stdout:0/169: mkdir da/d28/d36/d40 0 2024-04-27T07:33:12.599 INFO:tasks.workunit.client.0.smithi082.stdout:6/112: symlink d2/d3/l26 0 2024-04-27T07:33:12.601 INFO:tasks.workunit.client.0.smithi082.stdout:0/170: rename f6 to da/d3c/d3f/f41 0 2024-04-27T07:33:12.602 INFO:tasks.workunit.client.0.smithi082.stdout:6/113: unlink d2/l19 0 2024-04-27T07:33:12.605 INFO:tasks.workunit.client.0.smithi082.stdout:6/114: rename d2/d3/d1b/f20 to d2/d3/f27 0 2024-04-27T07:33:12.606 INFO:tasks.workunit.client.0.smithi082.stdout:0/171: creat da/f42 x:0 0 0 2024-04-27T07:33:12.608 INFO:tasks.workunit.client.0.smithi082.stdout:0/172: creat da/d28/f43 x:0 0 0 2024-04-27T07:33:12.611 INFO:tasks.workunit.client.0.smithi082.stdout:6/115: dwrite d2/d3/f11 [0,4194304] 0 2024-04-27T07:33:12.613 INFO:tasks.workunit.client.0.smithi082.stdout:6/116: fsync d2/d3/f6 0 2024-04-27T07:33:12.615 INFO:tasks.workunit.client.0.smithi082.stdout:0/173: dwrite da/d1d/f2d [0,4194304] 0 2024-04-27T07:33:12.621 INFO:tasks.workunit.client.0.smithi082.stdout:0/174: dwrite f5 [0,4194304] 0 2024-04-27T07:33:12.624 INFO:tasks.workunit.client.0.smithi082.stdout:0/175: unlink da/f1a 0 2024-04-27T07:33:12.629 INFO:tasks.workunit.client.0.smithi082.stdout:0/176: rename da/ff to da/d28/d36/d40/f44 0 2024-04-27T07:33:12.630 INFO:tasks.workunit.client.0.smithi082.stdout:0/177: read - da/f26 zero size 2024-04-27T07:33:12.631 INFO:tasks.workunit.client.0.smithi082.stdout:0/178: creat da/d2a/d34/f45 x:0 0 0 2024-04-27T07:33:12.633 INFO:tasks.workunit.client.0.smithi082.stdout:0/179: link da/f42 da/d2a/f46 0 2024-04-27T07:33:12.634 INFO:tasks.workunit.client.0.smithi082.stdout:0/180: rmdir da/d28/d36 39 2024-04-27T07:33:12.635 INFO:tasks.workunit.client.0.smithi082.stdout:0/181: rmdir da/d1d 39 2024-04-27T07:33:12.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:12 smithi100 ceph-mon[34183]: pgmap v12: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 27 MiB/s wr, 447 op/s 2024-04-27T07:33:12.668 INFO:tasks.workunit.client.0.smithi082.stdout:0/182: getdents da/d2a 0 2024-04-27T07:33:12.669 INFO:tasks.workunit.client.0.smithi082.stdout:0/183: fsync da/f1f 0 2024-04-27T07:33:12.672 INFO:tasks.workunit.client.0.smithi082.stdout:0/184: creat da/d38/f47 x:0 0 0 2024-04-27T07:33:12.674 INFO:tasks.workunit.client.0.smithi082.stdout:0/185: write da/d1d/f24 [613824,51617] 0 2024-04-27T07:33:12.675 INFO:tasks.workunit.client.0.smithi082.stdout:0/186: symlink da/d2a/d34/l48 0 2024-04-27T07:33:12.677 INFO:tasks.workunit.client.0.smithi082.stdout:0/187: creat da/d28/d36/d40/f49 x:0 0 0 2024-04-27T07:33:12.886 INFO:tasks.workunit.client.0.smithi082.stdout:9/106: sync 2024-04-27T07:33:12.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/107: dread - d9/da/dc/f16 zero size 2024-04-27T07:33:12.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/108: chown d9/da/dc/f20 1 1 2024-04-27T07:33:12.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/109: stat f4 0 2024-04-27T07:33:12.890 INFO:tasks.workunit.client.0.smithi082.stdout:9/110: symlink d9/da/dc/l28 0 2024-04-27T07:33:12.895 INFO:tasks.workunit.client.0.smithi082.stdout:9/111: dwrite d9/df/f1a [0,4194304] 0 2024-04-27T07:33:12.896 INFO:tasks.workunit.client.0.smithi082.stdout:9/112: fsync d9/da/dc/f17 0 2024-04-27T07:33:12.898 INFO:tasks.workunit.client.0.smithi082.stdout:9/113: mknod d9/da/dc/c29 0 2024-04-27T07:33:12.899 INFO:tasks.workunit.client.0.smithi082.stdout:9/114: chown d9/da/dc/f16 19 1 2024-04-27T07:33:12.911 INFO:tasks.workunit.client.0.smithi082.stdout:9/115: dread f3 [0,4194304] 0 2024-04-27T07:33:12.917 INFO:tasks.workunit.client.0.smithi082.stdout:9/116: dwrite d9/df/f19 [0,4194304] 0 2024-04-27T07:33:12.919 INFO:tasks.workunit.client.0.smithi082.stdout:9/117: creat d9/da/dc/f2a x:0 0 0 2024-04-27T07:33:12.919 INFO:tasks.workunit.client.0.smithi082.stdout:9/118: dread - d9/da/dc/f2a zero size 2024-04-27T07:33:12.920 INFO:tasks.workunit.client.0.smithi082.stdout:9/119: chown d9/da 173 1 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:2/139: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:4/75: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:8/43: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:0/188: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:1/139: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:3/294: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:7/138: sync 2024-04-27T07:33:13.002 INFO:tasks.workunit.client.0.smithi082.stdout:6/117: sync 2024-04-27T07:33:13.003 INFO:tasks.workunit.client.0.smithi082.stdout:5/155: sync 2024-04-27T07:33:13.003 INFO:tasks.workunit.client.0.smithi082.stdout:8/44: fdatasync d0/d3/f8 0 2024-04-27T07:33:13.005 INFO:tasks.workunit.client.0.smithi082.stdout:6/118: unlink d2/lc 0 2024-04-27T07:33:13.005 INFO:tasks.workunit.client.0.smithi082.stdout:6/119: chown d2/d3 136 1 2024-04-27T07:33:13.005 INFO:tasks.workunit.client.0.smithi082.stdout:7/139: read d3/f6 [81168,84724] 0 2024-04-27T07:33:13.006 INFO:tasks.workunit.client.0.smithi082.stdout:0/189: mkdir da/d2a/d34/d4a 0 2024-04-27T07:33:13.008 INFO:tasks.workunit.client.0.smithi082.stdout:4/76: mkdir d3/d9/d1b 0 2024-04-27T07:33:13.009 INFO:tasks.workunit.client.0.smithi082.stdout:1/140: creat d4/d15/f2f x:0 0 0 2024-04-27T07:33:13.010 INFO:tasks.workunit.client.0.smithi082.stdout:4/77: dread d3/d9/fb [4194304,4194304] 0 2024-04-27T07:33:13.011 INFO:tasks.workunit.client.0.smithi082.stdout:2/140: creat d7/d8/d13/f2b x:0 0 0 2024-04-27T07:33:13.011 INFO:tasks.workunit.client.0.smithi082.stdout:1/141: read d4/d15/d1c/f24 [984622,49483] 0 2024-04-27T07:33:13.011 INFO:tasks.workunit.client.0.smithi082.stdout:2/141: chown d7 1314889130 1 2024-04-27T07:33:13.012 INFO:tasks.workunit.client.0.smithi082.stdout:3/295: mknod d8/d9/d25/d26/d4d/c78 0 2024-04-27T07:33:13.013 INFO:tasks.workunit.client.0.smithi082.stdout:8/45: mknod d0/cc 0 2024-04-27T07:33:13.014 INFO:tasks.workunit.client.0.smithi082.stdout:8/46: write d0/f7 [444999,18237] 0 2024-04-27T07:33:13.014 INFO:tasks.workunit.client.0.smithi082.stdout:6/120: creat d2/d3/d1b/f28 x:0 0 0 2024-04-27T07:33:13.014 INFO:tasks.workunit.client.0.smithi082.stdout:7/140: truncate d3/db/f18 519769 0 2024-04-27T07:33:13.015 INFO:tasks.workunit.client.0.smithi082.stdout:6/121: dread - d2/f23 zero size 2024-04-27T07:33:13.017 INFO:tasks.workunit.client.0.smithi082.stdout:4/78: symlink d3/d6/d16/l1c 0 2024-04-27T07:33:13.020 INFO:tasks.workunit.client.0.smithi082.stdout:1/142: symlink d4/d15/l30 0 2024-04-27T07:33:13.021 INFO:tasks.workunit.client.0.smithi082.stdout:7/141: dwrite d3/de/f1b [0,4194304] 0 2024-04-27T07:33:13.021 INFO:tasks.workunit.client.0.smithi082.stdout:1/143: chown d4/d15/d29 866341640 1 2024-04-27T07:33:13.023 INFO:tasks.workunit.client.0.smithi082.stdout:8/47: creat d0/d3/fd x:0 0 0 2024-04-27T07:33:13.025 INFO:tasks.workunit.client.0.smithi082.stdout:5/156: rename d8/d14/d20 to d8/d2e 0 2024-04-27T07:33:13.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/190: truncate f9 3525355 0 2024-04-27T07:33:13.029 INFO:tasks.workunit.client.0.smithi082.stdout:2/142: rmdir d7 39 2024-04-27T07:33:13.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/191: fdatasync da/f26 0 2024-04-27T07:33:13.030 INFO:tasks.workunit.client.0.smithi082.stdout:8/48: dwrite d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:13.031 INFO:tasks.workunit.client.0.smithi082.stdout:0/192: fsync da/d2a/f30 0 2024-04-27T07:33:13.034 INFO:tasks.workunit.client.0.smithi082.stdout:3/296: creat d8/d9/d1d/f79 x:0 0 0 2024-04-27T07:33:13.035 INFO:tasks.workunit.client.0.smithi082.stdout:9/120: sync 2024-04-27T07:33:13.036 INFO:tasks.workunit.client.0.smithi082.stdout:7/142: mkdir d3/db/d15/d29 0 2024-04-27T07:33:13.038 INFO:tasks.workunit.client.0.smithi082.stdout:6/122: symlink d2/de/l29 0 2024-04-27T07:33:13.038 INFO:tasks.workunit.client.0.smithi082.stdout:8/49: dwrite d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:13.041 INFO:tasks.workunit.client.0.smithi082.stdout:8/50: write d0/fa [888415,8218] 0 2024-04-27T07:33:13.044 INFO:tasks.workunit.client.0.smithi082.stdout:9/121: dread d9/df/f19 [0,4194304] 0 2024-04-27T07:33:13.048 INFO:tasks.workunit.client.0.smithi082.stdout:4/79: link d3/d10/f17 d3/d9/f1d 0 2024-04-27T07:33:13.048 INFO:tasks.workunit.client.0.smithi082.stdout:6/123: dwrite d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:13.048 INFO:tasks.workunit.client.0.smithi082.stdout:6/124: stat d2/d3/d1b 0 2024-04-27T07:33:13.049 INFO:tasks.workunit.client.0.smithi082.stdout:1/144: mknod d4/d2a/c31 0 2024-04-27T07:33:13.053 INFO:tasks.workunit.client.0.smithi082.stdout:6/125: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:13.053 INFO:tasks.workunit.client.0.smithi082.stdout:2/143: chown d7/d14 3 1 2024-04-27T07:33:13.054 INFO:tasks.workunit.client.0.smithi082.stdout:6/126: fsync d2/de/f1d 0 2024-04-27T07:33:13.054 INFO:tasks.workunit.client.0.smithi082.stdout:2/144: chown d7/d17/d23/d25/l26 101657 1 2024-04-27T07:33:13.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/51: mknod d0/ce 0 2024-04-27T07:33:13.057 INFO:tasks.workunit.client.0.smithi082.stdout:4/80: mknod d3/d10/c1e 0 2024-04-27T07:33:13.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/52: dread d0/fa [0,4194304] 0 2024-04-27T07:33:13.063 INFO:tasks.workunit.client.0.smithi082.stdout:2/145: dread d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:13.063 INFO:tasks.workunit.client.0.smithi082.stdout:0/193: creat da/d28/f4b x:0 0 0 2024-04-27T07:33:13.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/194: read da/f19 [2339883,64638] 0 2024-04-27T07:33:13.065 INFO:tasks.workunit.client.0.smithi082.stdout:4/81: mkdir d3/d10/d1f 0 2024-04-27T07:33:13.065 INFO:tasks.workunit.client.0.smithi082.stdout:5/157: truncate d8/d15/f13 3403183 0 2024-04-27T07:33:13.067 INFO:tasks.workunit.client.0.smithi082.stdout:8/53: mknod d0/cf 0 2024-04-27T07:33:13.069 INFO:tasks.workunit.client.0.smithi082.stdout:2/146: symlink d7/d17/d23/l2c 0 2024-04-27T07:33:13.069 INFO:tasks.workunit.client.0.smithi082.stdout:2/147: read - d7/f28 zero size 2024-04-27T07:33:13.070 INFO:tasks.workunit.client.0.smithi082.stdout:0/195: fdatasync da/d3c/d3f/f41 0 2024-04-27T07:33:13.070 INFO:tasks.workunit.client.0.smithi082.stdout:2/148: stat d7/d17/d23 0 2024-04-27T07:33:13.071 INFO:tasks.workunit.client.0.smithi082.stdout:4/82: mkdir d3/d10/d20 0 2024-04-27T07:33:13.071 INFO:tasks.workunit.client.0.smithi082.stdout:5/158: chown d8/d14/l28 765 1 2024-04-27T07:33:13.072 INFO:tasks.workunit.client.0.smithi082.stdout:6/127: creat d2/f2a x:0 0 0 2024-04-27T07:33:13.074 INFO:tasks.workunit.client.0.smithi082.stdout:8/54: symlink d0/l10 0 2024-04-27T07:33:13.074 INFO:tasks.workunit.client.0.smithi082.stdout:6/128: dread - d2/d3/d1b/f28 zero size 2024-04-27T07:33:13.075 INFO:tasks.workunit.client.0.smithi082.stdout:6/129: stat d2/f23 0 2024-04-27T07:33:13.076 INFO:tasks.workunit.client.0.smithi082.stdout:9/122: getdents d9 0 2024-04-27T07:33:13.077 INFO:tasks.workunit.client.0.smithi082.stdout:0/196: mkdir da/d3c/d3f/d4c 0 2024-04-27T07:33:13.081 INFO:tasks.workunit.client.0.smithi082.stdout:9/123: read - d9/da/dc/f1b zero size 2024-04-27T07:33:13.081 INFO:tasks.workunit.client.0.smithi082.stdout:4/83: dwrite d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:13.084 INFO:tasks.workunit.client.0.smithi082.stdout:9/124: chown d9/cd 6491 1 2024-04-27T07:33:13.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/130: rename d2/d3/l26 to d2/de/d13/l2b 0 2024-04-27T07:33:13.085 INFO:tasks.workunit.client.0.smithi082.stdout:9/125: stat d9/df 0 2024-04-27T07:33:13.086 INFO:tasks.workunit.client.0.smithi082.stdout:8/55: dwrite d0/f7 [0,4194304] 0 2024-04-27T07:33:13.089 INFO:tasks.workunit.client.0.smithi082.stdout:5/159: creat d8/d14/d1b/f2f x:0 0 0 2024-04-27T07:33:13.091 INFO:tasks.workunit.client.0.smithi082.stdout:0/197: dread da/d28/d36/d40/f44 [0,4194304] 0 2024-04-27T07:33:13.093 INFO:tasks.workunit.client.0.smithi082.stdout:8/56: dread d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:13.093 INFO:tasks.workunit.client.0.smithi082.stdout:0/198: chown da/f1f 12 1 2024-04-27T07:33:13.095 INFO:tasks.workunit.client.0.smithi082.stdout:6/131: creat d2/d1e/f2c x:0 0 0 2024-04-27T07:33:13.097 INFO:tasks.workunit.client.0.smithi082.stdout:2/149: write d7/d8/f1f [1942486,116328] 0 2024-04-27T07:33:13.099 INFO:tasks.workunit.client.0.smithi082.stdout:8/57: symlink d0/l11 0 2024-04-27T07:33:13.100 INFO:tasks.workunit.client.0.smithi082.stdout:6/132: stat d2/de/l1a 0 2024-04-27T07:33:13.104 INFO:tasks.workunit.client.0.smithi082.stdout:5/160: creat d8/d14/d1b/d1f/f30 x:0 0 0 2024-04-27T07:33:13.104 INFO:tasks.workunit.client.0.smithi082.stdout:5/161: chown d8 41099718 1 2024-04-27T07:33:13.105 INFO:tasks.workunit.client.0.smithi082.stdout:4/84: fsync d3/d6/f19 0 2024-04-27T07:33:13.108 INFO:tasks.workunit.client.0.smithi082.stdout:9/126: write d9/df/f19 [1225048,90169] 0 2024-04-27T07:33:13.108 INFO:tasks.workunit.client.0.smithi082.stdout:6/133: write d2/d3/f27 [1811822,9726] 0 2024-04-27T07:33:13.108 INFO:tasks.workunit.client.0.smithi082.stdout:0/199: creat da/d28/f4d x:0 0 0 2024-04-27T07:33:13.109 INFO:tasks.workunit.client.0.smithi082.stdout:8/58: dwrite d0/d3/f8 [0,4194304] 0 2024-04-27T07:33:13.112 INFO:tasks.workunit.client.0.smithi082.stdout:6/134: write d2/de/d13/f16 [4496476,99441] 0 2024-04-27T07:33:13.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/150: rename d7/d8/d13/f22 to d7/d8/f2d 0 2024-04-27T07:33:13.117 INFO:tasks.workunit.client.0.smithi082.stdout:8/59: dread d0/d3/f8 [0,4194304] 0 2024-04-27T07:33:13.117 INFO:tasks.workunit.client.0.smithi082.stdout:9/127: mkdir d9/df/d2b 0 2024-04-27T07:33:13.118 INFO:tasks.workunit.client.0.smithi082.stdout:9/128: chown d9/da/f26 2 1 2024-04-27T07:33:13.119 INFO:tasks.workunit.client.0.smithi082.stdout:5/162: symlink d8/d15/d22/l31 0 2024-04-27T07:33:13.120 INFO:tasks.workunit.client.0.smithi082.stdout:5/163: chown d8/d14/d1b/f2f 97481 1 2024-04-27T07:33:13.120 INFO:tasks.workunit.client.0.smithi082.stdout:0/200: creat da/d28/d36/f4e x:0 0 0 2024-04-27T07:33:13.121 INFO:tasks.workunit.client.0.smithi082.stdout:4/85: write d3/d10/f17 [412176,54579] 0 2024-04-27T07:33:13.123 INFO:tasks.workunit.client.0.smithi082.stdout:2/151: symlink d7/d17/d23/l2e 0 2024-04-27T07:33:13.124 INFO:tasks.workunit.client.0.smithi082.stdout:8/60: symlink d0/d3/l12 0 2024-04-27T07:33:13.125 INFO:tasks.workunit.client.0.smithi082.stdout:4/86: fsync d3/d9/f1d 0 2024-04-27T07:33:13.125 INFO:tasks.workunit.client.0.smithi082.stdout:5/164: mknod d8/d2e/c32 0 2024-04-27T07:33:13.126 INFO:tasks.workunit.client.0.smithi082.stdout:5/165: chown d8/d14/d1b 23905 1 2024-04-27T07:33:13.127 INFO:tasks.workunit.client.0.smithi082.stdout:0/201: rename da/d2a/f30 to da/d2a/d34/f4f 0 2024-04-27T07:33:13.129 INFO:tasks.workunit.client.0.smithi082.stdout:0/202: chown da/d28/d36/d40/f49 806803 1 2024-04-27T07:33:13.130 INFO:tasks.workunit.client.0.smithi082.stdout:4/87: mkdir d3/d10/d1f/d21 0 2024-04-27T07:33:13.132 INFO:tasks.workunit.client.0.smithi082.stdout:5/166: rename d8/d14/d1b/d1f/f30 to d8/d2e/f33 0 2024-04-27T07:33:13.133 INFO:tasks.workunit.client.0.smithi082.stdout:8/61: dwrite d0/d3/fd [0,4194304] 0 2024-04-27T07:33:13.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/167: symlink d8/l34 0 2024-04-27T07:33:13.139 INFO:tasks.workunit.client.0.smithi082.stdout:0/203: link da/f1f da/d38/f50 0 2024-04-27T07:33:13.141 INFO:tasks.workunit.client.0.smithi082.stdout:9/129: dread f7 [0,4194304] 0 2024-04-27T07:33:13.141 INFO:tasks.workunit.client.0.smithi082.stdout:8/62: rmdir d0/d3 39 2024-04-27T07:33:13.142 INFO:tasks.workunit.client.0.smithi082.stdout:9/130: write d9/df/f23 [1349099,125636] 0 2024-04-27T07:33:13.143 INFO:tasks.workunit.client.0.smithi082.stdout:0/204: symlink da/d2a/l51 0 2024-04-27T07:33:13.144 INFO:tasks.workunit.client.0.smithi082.stdout:9/131: dread - d9/da/dc/f17 zero size 2024-04-27T07:33:13.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/168: link d8/f2d d8/d29/f35 0 2024-04-27T07:33:13.149 INFO:tasks.workunit.client.0.smithi082.stdout:5/169: write d8/d14/d1b/f2f [646857,36207] 0 2024-04-27T07:33:13.150 INFO:tasks.workunit.client.0.smithi082.stdout:0/205: dread da/fe [0,4194304] 0 2024-04-27T07:33:13.153 INFO:tasks.workunit.client.0.smithi082.stdout:9/132: dwrite d9/da/dc/f1b [0,4194304] 0 2024-04-27T07:33:13.153 INFO:tasks.workunit.client.0.smithi082.stdout:4/88: truncate d3/d10/f15 455610 0 2024-04-27T07:33:13.155 INFO:tasks.workunit.client.0.smithi082.stdout:4/89: write d3/f14 [1321459,50373] 0 2024-04-27T07:33:13.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/63: creat d0/f13 x:0 0 0 2024-04-27T07:33:13.157 INFO:tasks.workunit.client.0.smithi082.stdout:0/206: creat da/d28/d36/d40/f52 x:0 0 0 2024-04-27T07:33:13.157 INFO:tasks.workunit.client.0.smithi082.stdout:0/207: readlink da/l11 0 2024-04-27T07:33:13.159 INFO:tasks.workunit.client.0.smithi082.stdout:9/133: symlink d9/df/l2c 0 2024-04-27T07:33:13.162 INFO:tasks.workunit.client.0.smithi082.stdout:8/64: read d0/d3/fd [1508854,45017] 0 2024-04-27T07:33:13.162 INFO:tasks.workunit.client.0.smithi082.stdout:4/90: dwrite d3/f4 [0,4194304] 0 2024-04-27T07:33:13.164 INFO:tasks.workunit.client.0.smithi082.stdout:0/208: write f7 [4632394,8745] 0 2024-04-27T07:33:13.169 INFO:tasks.workunit.client.0.smithi082.stdout:0/209: mknod da/d2a/d34/c53 0 2024-04-27T07:33:13.173 INFO:tasks.workunit.client.0.smithi082.stdout:0/210: creat da/d3c/d3f/d4c/f54 x:0 0 0 2024-04-27T07:33:13.174 INFO:tasks.workunit.client.0.smithi082.stdout:9/134: rename d9/df to d9/d2d 0 2024-04-27T07:33:13.175 INFO:tasks.workunit.client.0.smithi082.stdout:9/135: write d9/f21 [994858,96811] 0 2024-04-27T07:33:13.176 INFO:tasks.workunit.client.0.smithi082.stdout:0/211: mknod da/c55 0 2024-04-27T07:33:13.181 INFO:tasks.workunit.client.0.smithi082.stdout:0/212: link da/d2a/d34/c53 da/d28/c56 0 2024-04-27T07:33:13.182 INFO:tasks.workunit.client.0.smithi082.stdout:8/65: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:13.185 INFO:tasks.workunit.client.0.smithi082.stdout:8/66: mkdir d0/d14 0 2024-04-27T07:33:13.188 INFO:tasks.workunit.client.0.smithi082.stdout:0/213: dwrite da/d1d/f35 [0,4194304] 0 2024-04-27T07:33:13.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/67: rename d0/ce to d0/d3/c15 0 2024-04-27T07:33:13.194 INFO:tasks.workunit.client.0.smithi082.stdout:8/68: rmdir d0/d3 39 2024-04-27T07:33:13.198 INFO:tasks.workunit.client.0.smithi082.stdout:0/214: dwrite da/d28/f4b [0,4194304] 0 2024-04-27T07:33:13.199 INFO:tasks.workunit.client.0.smithi082.stdout:8/69: mkdir d0/d14/d16 0 2024-04-27T07:33:13.204 INFO:tasks.workunit.client.0.smithi082.stdout:8/70: creat d0/f17 x:0 0 0 2024-04-27T07:33:13.205 INFO:tasks.workunit.client.0.smithi082.stdout:0/215: dread da/d1d/f2d [0,4194304] 0 2024-04-27T07:33:13.209 INFO:tasks.workunit.client.0.smithi082.stdout:0/216: getdents da 0 2024-04-27T07:33:13.210 INFO:tasks.workunit.client.0.smithi082.stdout:0/217: write da/d2a/d34/f45 [944554,115644] 0 2024-04-27T07:33:13.213 INFO:tasks.workunit.client.0.smithi082.stdout:0/218: truncate f9 1810871 0 2024-04-27T07:33:13.214 INFO:tasks.workunit.client.0.smithi082.stdout:8/71: getdents d0/d14 0 2024-04-27T07:33:13.215 INFO:tasks.workunit.client.0.smithi082.stdout:0/219: mkdir da/d3c/d3f/d57 0 2024-04-27T07:33:13.216 INFO:tasks.workunit.client.0.smithi082.stdout:0/220: dread - da/d28/d36/d40/f52 zero size 2024-04-27T07:33:13.220 INFO:tasks.workunit.client.0.smithi082.stdout:8/72: rename d0/f6 to d0/d3/f18 0 2024-04-27T07:33:13.221 INFO:tasks.workunit.client.0.smithi082.stdout:8/73: truncate d0/f13 913846 0 2024-04-27T07:33:13.223 INFO:tasks.workunit.client.0.smithi082.stdout:8/74: rename d0/d14/d16 to d0/d14/d16/d19 22 2024-04-27T07:33:13.224 INFO:tasks.workunit.client.0.smithi082.stdout:0/221: dwrite da/d28/d36/f4e [0,4194304] 0 2024-04-27T07:33:13.229 INFO:tasks.workunit.client.0.smithi082.stdout:8/75: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:13.230 INFO:tasks.workunit.client.0.smithi082.stdout:0/222: creat da/d2a/d34/d4a/f58 x:0 0 0 2024-04-27T07:33:13.231 INFO:tasks.workunit.client.0.smithi082.stdout:0/223: chown da/d28/d36/d40/f52 51956 1 2024-04-27T07:33:13.234 INFO:tasks.workunit.client.0.smithi082.stdout:8/76: dread d0/d3/fd [0,4194304] 0 2024-04-27T07:33:13.234 INFO:tasks.workunit.client.0.smithi082.stdout:0/224: fdatasync da/f1f 0 2024-04-27T07:33:13.235 INFO:tasks.workunit.client.0.smithi082.stdout:0/225: fsync da/d38/f3a 0 2024-04-27T07:33:13.238 INFO:tasks.workunit.client.0.smithi082.stdout:0/226: symlink da/d3c/d3f/l59 0 2024-04-27T07:33:13.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/77: rmdir d0/d14/d16 0 2024-04-27T07:33:13.242 INFO:tasks.workunit.client.0.smithi082.stdout:8/78: creat d0/d3/f1a x:0 0 0 2024-04-27T07:33:13.245 INFO:tasks.workunit.client.0.smithi082.stdout:0/227: link da/c31 da/d3c/d3f/c5a 0 2024-04-27T07:33:13.245 INFO:tasks.workunit.client.0.smithi082.stdout:0/228: read - da/d28/f4d zero size 2024-04-27T07:33:13.249 INFO:tasks.workunit.client.0.smithi082.stdout:0/229: getdents da/d3c/d3f/d4c 0 2024-04-27T07:33:13.254 INFO:tasks.workunit.client.0.smithi082.stdout:0/230: link da/d1d/f35 da/d3c/d3f/f5b 0 2024-04-27T07:33:13.255 INFO:tasks.workunit.client.0.smithi082.stdout:8/79: rmdir d0/d14 0 2024-04-27T07:33:13.256 INFO:tasks.workunit.client.0.smithi082.stdout:0/231: creat da/d1d/f5c x:0 0 0 2024-04-27T07:33:13.257 INFO:tasks.workunit.client.0.smithi082.stdout:8/80: write d0/f7 [1461217,73714] 0 2024-04-27T07:33:13.257 INFO:tasks.workunit.client.0.smithi082.stdout:8/81: readlink d0/l10 0 2024-04-27T07:33:13.258 INFO:tasks.workunit.client.0.smithi082.stdout:0/232: creat da/d2a/f5d x:0 0 0 2024-04-27T07:33:13.260 INFO:tasks.workunit.client.0.smithi082.stdout:0/233: write da/d2a/d34/f4f [3347267,100527] 0 2024-04-27T07:33:13.260 INFO:tasks.workunit.client.0.smithi082.stdout:0/234: read da/f1f [574651,29570] 0 2024-04-27T07:33:13.262 INFO:tasks.workunit.client.0.smithi082.stdout:0/235: symlink da/d2a/d34/d4a/l5e 0 2024-04-27T07:33:13.266 INFO:tasks.workunit.client.0.smithi082.stdout:0/236: dread da/d2a/d34/f45 [0,4194304] 0 2024-04-27T07:33:13.272 INFO:tasks.workunit.client.0.smithi082.stdout:0/237: getdents da/d1d 0 2024-04-27T07:33:13.273 INFO:tasks.workunit.client.0.smithi082.stdout:0/238: dread - da/d3c/d3f/d4c/f54 zero size 2024-04-27T07:33:13.273 INFO:tasks.workunit.client.0.smithi082.stdout:0/239: dread - da/f42 zero size 2024-04-27T07:33:13.275 INFO:tasks.workunit.client.0.smithi082.stdout:0/240: mknod da/c5f 0 2024-04-27T07:33:13.277 INFO:tasks.workunit.client.0.smithi082.stdout:0/241: symlink da/d3c/d3f/d4c/l60 0 2024-04-27T07:33:13.278 INFO:tasks.workunit.client.0.smithi082.stdout:0/242: truncate da/d28/f4d 791085 0 2024-04-27T07:33:13.281 INFO:tasks.workunit.client.0.smithi082.stdout:0/243: creat da/d28/f61 x:0 0 0 2024-04-27T07:33:13.281 INFO:tasks.workunit.client.0.smithi082.stdout:0/244: write da/f26 [64160,64945] 0 2024-04-27T07:33:13.282 INFO:tasks.workunit.client.0.smithi082.stdout:0/245: fsync f5 0 2024-04-27T07:33:13.283 INFO:tasks.workunit.client.0.smithi082.stdout:0/246: truncate da/d28/d36/f4e 4494652 0 2024-04-27T07:33:13.285 INFO:tasks.workunit.client.0.smithi082.stdout:0/247: unlink da/d28/f2e 0 2024-04-27T07:33:13.287 INFO:tasks.workunit.client.0.smithi082.stdout:0/248: creat da/f62 x:0 0 0 2024-04-27T07:33:13.289 INFO:tasks.workunit.client.0.smithi082.stdout:0/249: write da/f42 [842180,58362] 0 2024-04-27T07:33:13.296 INFO:tasks.workunit.client.0.smithi082.stdout:0/250: write da/f19 [4583602,7638] 0 2024-04-27T07:33:13.297 INFO:tasks.workunit.client.0.smithi082.stdout:0/251: mknod da/d28/c63 0 2024-04-27T07:33:13.298 INFO:tasks.workunit.client.0.smithi082.stdout:0/252: fdatasync da/f1f 0 2024-04-27T07:33:13.303 INFO:tasks.workunit.client.0.smithi082.stdout:0/253: truncate da/f19 724755 0 2024-04-27T07:33:13.306 INFO:tasks.workunit.client.0.smithi082.stdout:0/254: rename da/d28/f4b to da/d28/d36/d40/f64 0 2024-04-27T07:33:13.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/255: creat da/d28/d36/f65 x:0 0 0 2024-04-27T07:33:13.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/256: fsync da/d28/d36/d40/f49 0 2024-04-27T07:33:13.313 INFO:tasks.workunit.client.0.smithi082.stdout:0/257: creat da/d28/f66 x:0 0 0 2024-04-27T07:33:13.314 INFO:tasks.workunit.client.0.smithi082.stdout:0/258: mknod da/d1d/c67 0 2024-04-27T07:33:13.315 INFO:tasks.workunit.client.0.smithi082.stdout:0/259: dread - da/d38/f47 zero size 2024-04-27T07:33:13.316 INFO:tasks.workunit.client.0.smithi082.stdout:0/260: write da/fe [3005749,61482] 0 2024-04-27T07:33:13.320 INFO:tasks.workunit.client.0.smithi082.stdout:0/261: rmdir da 39 2024-04-27T07:33:13.322 INFO:tasks.workunit.client.0.smithi082.stdout:0/262: mknod da/c68 0 2024-04-27T07:33:13.327 INFO:tasks.workunit.client.0.smithi082.stdout:0/263: dwrite da/d1d/f20 [0,4194304] 0 2024-04-27T07:33:13.334 INFO:tasks.workunit.client.0.smithi082.stdout:0/264: dwrite da/f26 [0,4194304] 0 2024-04-27T07:33:13.336 INFO:tasks.workunit.client.0.smithi082.stdout:0/265: mknod da/d3c/c69 0 2024-04-27T07:33:13.338 INFO:tasks.workunit.client.0.smithi082.stdout:0/266: mkdir da/d1d/d6a 0 2024-04-27T07:33:13.341 INFO:tasks.workunit.client.0.smithi082.stdout:0/267: rename c0 to da/d2a/d34/d4a/c6b 0 2024-04-27T07:33:13.342 INFO:tasks.workunit.client.0.smithi082.stdout:0/268: chown da/d38/f50 5958 1 2024-04-27T07:33:13.497 INFO:tasks.workunit.client.0.smithi082.stdout:3/297: sync 2024-04-27T07:33:13.498 INFO:tasks.workunit.client.0.smithi082.stdout:3/298: chown d8/d9/dd/d13/d1b/f5d 20 1 2024-04-27T07:33:13.501 INFO:tasks.workunit.client.0.smithi082.stdout:3/299: getdents d8/d9/dd/d13 0 2024-04-27T07:33:13.507 INFO:tasks.workunit.client.0.smithi082.stdout:3/300: dwrite d8/f74 [0,4194304] 0 2024-04-27T07:33:13.508 INFO:tasks.workunit.client.0.smithi082.stdout:3/301: dread - d8/d9/d25/d26/f6e zero size 2024-04-27T07:33:13.509 INFO:tasks.workunit.client.0.smithi082.stdout:3/302: write d8/d9/d25/d26/d3d/f6b [1017470,86463] 0 2024-04-27T07:33:13.524 INFO:tasks.workunit.client.0.smithi082.stdout:3/303: dread d8/d9/dd/d13/f1e [0,4194304] 0 2024-04-27T07:33:13.529 INFO:tasks.workunit.client.0.smithi082.stdout:3/304: mknod d8/d9/d25/d26/c7a 0 2024-04-27T07:33:13.530 INFO:tasks.workunit.client.0.smithi082.stdout:3/305: fdatasync d8/f5e 0 2024-04-27T07:33:13.532 INFO:tasks.workunit.client.0.smithi082.stdout:3/306: rename d8/d9/dd/d13/d1b/f24 to d8/d9/dd/d13/f7b 0 2024-04-27T07:33:13.534 INFO:tasks.workunit.client.0.smithi082.stdout:3/307: truncate d8/d9/d25/d66/d6d/f73 423719 0 2024-04-27T07:33:13.534 INFO:tasks.workunit.client.0.smithi082.stdout:3/308: fsync d8/ff 0 2024-04-27T07:33:13.539 INFO:tasks.workunit.client.0.smithi082.stdout:3/309: write d8/d9/d1f/d53/f56 [1196017,84306] 0 2024-04-27T07:33:13.540 INFO:tasks.workunit.client.0.smithi082.stdout:3/310: stat d8/d9/d25/d26 0 2024-04-27T07:33:13.542 INFO:tasks.workunit.client.0.smithi082.stdout:3/311: fdatasync d8/d9/d1f/f41 0 2024-04-27T07:33:13.554 INFO:tasks.workunit.client.0.smithi082.stdout:3/312: dwrite d8/d9/f1c [0,4194304] 0 2024-04-27T07:33:13.555 INFO:tasks.workunit.client.0.smithi082.stdout:3/313: write d8/ff [184077,95905] 0 2024-04-27T07:33:13.560 INFO:tasks.workunit.client.0.smithi082.stdout:3/314: link d8/f5e d8/d9/d25/d4e/f7c 0 2024-04-27T07:33:13.562 INFO:tasks.workunit.client.0.smithi082.stdout:3/315: creat d8/d9/d25/d66/d6d/f7d x:0 0 0 2024-04-27T07:33:13.563 INFO:tasks.workunit.client.0.smithi082.stdout:3/316: chown d8/d9/d3f 170516 1 2024-04-27T07:33:13.564 INFO:tasks.workunit.client.0.smithi082.stdout:3/317: dread d8/d9/d25/d66/d6d/f73 [0,4194304] 0 2024-04-27T07:33:13.566 INFO:tasks.workunit.client.0.smithi082.stdout:3/318: dread - d8/d9/dd/d13/d1b/f31 zero size 2024-04-27T07:33:13.573 INFO:tasks.workunit.client.0.smithi082.stdout:3/319: dwrite d8/d9/d1f/f63 [0,4194304] 0 2024-04-27T07:33:13.584 INFO:tasks.workunit.client.0.smithi082.stdout:3/320: dread d8/d9/dd/f35 [0,4194304] 0 2024-04-27T07:33:13.586 INFO:tasks.workunit.client.0.smithi082.stdout:3/321: mknod d8/d9/d25/d66/c7e 0 2024-04-27T07:33:13.588 INFO:tasks.workunit.client.0.smithi082.stdout:3/322: creat d8/d9/d25/d66/d6d/f7f x:0 0 0 2024-04-27T07:33:13.589 INFO:tasks.workunit.client.0.smithi082.stdout:3/323: write d8/d9/f70 [1016070,122582] 0 2024-04-27T07:33:13.593 INFO:tasks.workunit.client.0.smithi082.stdout:3/324: getdents d8/d9/d1f 0 2024-04-27T07:33:13.595 INFO:tasks.workunit.client.0.smithi082.stdout:3/325: truncate d8/d9/d25/d26/f6e 234543 0 2024-04-27T07:33:13.598 INFO:tasks.workunit.client.0.smithi082.stdout:3/326: link d8/d9/d25/f77 d8/d9/d3f/f80 0 2024-04-27T07:33:13.599 INFO:tasks.workunit.client.0.smithi082.stdout:7/143: sync 2024-04-27T07:33:13.602 INFO:tasks.workunit.client.0.smithi082.stdout:7/144: mkdir d3/db/d15/d2a 0 2024-04-27T07:33:13.603 INFO:tasks.workunit.client.0.smithi082.stdout:7/145: chown d3/f6 888 1 2024-04-27T07:33:13.604 INFO:tasks.workunit.client.0.smithi082.stdout:3/327: link d8/d9/d25/d66/d6d/c54 d8/d9/dd/d13/d1b/c81 0 2024-04-27T07:33:13.606 INFO:tasks.workunit.client.0.smithi082.stdout:7/146: creat d3/db/d15/d2a/f2b x:0 0 0 2024-04-27T07:33:13.606 INFO:tasks.workunit.client.0.smithi082.stdout:7/147: chown d3/f11 209983013 1 2024-04-27T07:33:13.607 INFO:tasks.workunit.client.0.smithi082.stdout:3/328: mkdir d8/d9/d25/d26/d4d/d82 0 2024-04-27T07:33:13.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/148: dread - d3/db/d15/d2a/f2b zero size 2024-04-27T07:33:13.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/149: fdatasync d3/db/d15/f21 0 2024-04-27T07:33:13.608 INFO:tasks.workunit.client.0.smithi082.stdout:3/329: truncate d8/ff 4535300 0 2024-04-27T07:33:13.609 INFO:tasks.workunit.client.0.smithi082.stdout:3/330: mknod d8/d9/dd/d13/c83 0 2024-04-27T07:33:13.610 INFO:tasks.workunit.client.0.smithi082.stdout:3/331: chown d8/d9/d1f/f4c 32 1 2024-04-27T07:33:13.613 INFO:tasks.workunit.client.0.smithi082.stdout:7/150: dwrite d3/f5 [4194304,4194304] 0 2024-04-27T07:33:13.614 INFO:tasks.workunit.client.0.smithi082.stdout:7/151: chown d3/de/l1c 1 1 2024-04-27T07:33:13.616 INFO:tasks.workunit.client.0.smithi082.stdout:7/152: write d3/f5 [7726829,55288] 0 2024-04-27T07:33:13.619 INFO:tasks.workunit.client.0.smithi082.stdout:3/332: dwrite d8/f74 [0,4194304] 0 2024-04-27T07:33:13.623 INFO:tasks.workunit.client.0.smithi082.stdout:7/153: dread d3/f11 [0,4194304] 0 2024-04-27T07:33:13.623 INFO:tasks.workunit.client.0.smithi082.stdout:7/154: stat d3/d9/l28 0 2024-04-27T07:33:13.628 INFO:tasks.workunit.client.0.smithi082.stdout:3/333: getdents d8/d9/dd/d13 0 2024-04-27T07:33:13.630 INFO:tasks.workunit.client.0.smithi082.stdout:3/334: rmdir d8/d9/d1f 39 2024-04-27T07:33:13.632 INFO:tasks.workunit.client.0.smithi082.stdout:3/335: read - d8/d9/d25/d66/d6d/f7d zero size 2024-04-27T07:33:13.632 INFO:tasks.workunit.client.0.smithi082.stdout:7/155: dwrite d3/db/d15/f21 [0,4194304] 0 2024-04-27T07:33:13.633 INFO:tasks.workunit.client.0.smithi082.stdout:3/336: write d8/d9/d1d/f79 [622536,90999] 0 2024-04-27T07:33:13.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/156: fdatasync d3/db/ff 0 2024-04-27T07:33:13.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/157: read d3/f6 [76036,58081] 0 2024-04-27T07:33:13.635 INFO:tasks.workunit.client.0.smithi082.stdout:7/158: write d3/f1f [3711739,18526] 0 2024-04-27T07:33:13.636 INFO:tasks.workunit.client.0.smithi082.stdout:3/337: write d8/d9/d1f/f72 [81024,77909] 0 2024-04-27T07:33:13.638 INFO:tasks.workunit.client.0.smithi082.stdout:3/338: write d8/d9/f1c [3311838,84772] 0 2024-04-27T07:33:13.639 INFO:tasks.workunit.client.0.smithi082.stdout:7/159: symlink d3/db/d15/d2a/l2c 0 2024-04-27T07:33:13.640 INFO:tasks.workunit.client.0.smithi082.stdout:7/160: stat c1 0 2024-04-27T07:33:13.641 INFO:tasks.workunit.client.0.smithi082.stdout:3/339: symlink d8/d9/d25/d66/l84 0 2024-04-27T07:33:13.644 INFO:tasks.workunit.client.0.smithi082.stdout:3/340: creat d8/d9/d25/f85 x:0 0 0 2024-04-27T07:33:13.649 INFO:tasks.workunit.client.0.smithi082.stdout:3/341: rename d8/d9/d3f/f62 to d8/d9/f86 0 2024-04-27T07:33:13.650 INFO:tasks.workunit.client.0.smithi082.stdout:7/161: dread d3/db/f18 [0,4194304] 0 2024-04-27T07:33:13.653 INFO:tasks.workunit.client.0.smithi082.stdout:7/162: rename d3/f11 to d3/d9/f2d 0 2024-04-27T07:33:13.655 INFO:tasks.workunit.client.0.smithi082.stdout:3/342: write d8/d9/d3f/f80 [366533,72272] 0 2024-04-27T07:33:13.656 INFO:tasks.workunit.client.0.smithi082.stdout:3/343: stat d8/d9/dd/d13/f48 0 2024-04-27T07:33:13.657 INFO:tasks.workunit.client.0.smithi082.stdout:7/163: link d3/de/f1b d3/db/f2e 0 2024-04-27T07:33:13.657 INFO:tasks.workunit.client.0.smithi082.stdout:3/344: write d8/d9/d25/f85 [1015349,105778] 0 2024-04-27T07:33:13.663 INFO:tasks.workunit.client.0.smithi082.stdout:3/345: truncate d8/d9/d1f/f72 104025 0 2024-04-27T07:33:13.665 INFO:tasks.workunit.client.0.smithi082.stdout:3/346: truncate d8/d9/f70 1674551 0 2024-04-27T07:33:13.667 INFO:tasks.workunit.client.0.smithi082.stdout:3/347: fsync d8/d9/d3f/f80 0 2024-04-27T07:33:13.667 INFO:tasks.workunit.client.0.smithi082.stdout:7/164: dwrite d3/f6 [0,4194304] 0 2024-04-27T07:33:13.668 INFO:tasks.workunit.client.0.smithi082.stdout:3/348: chown d8/d9/dd 0 1 2024-04-27T07:33:13.669 INFO:tasks.workunit.client.0.smithi082.stdout:3/349: chown d8/d9/d25/d66/l84 6471682 1 2024-04-27T07:33:13.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/350: write d8/d9/d25/d4e/f7c [111775,89105] 0 2024-04-27T07:33:13.677 INFO:tasks.workunit.client.0.smithi082.stdout:3/351: chown d8/d9/d1f/f46 1345 1 2024-04-27T07:33:13.679 INFO:tasks.workunit.client.0.smithi082.stdout:3/352: dread - d8/d9/dd/d13/d1b/f5d zero size 2024-04-27T07:33:13.680 INFO:tasks.workunit.client.0.smithi082.stdout:7/165: dwrite d3/db/f18 [0,4194304] 0 2024-04-27T07:33:13.683 INFO:tasks.workunit.client.0.smithi082.stdout:7/166: creat d3/de/f2f x:0 0 0 2024-04-27T07:33:13.686 INFO:tasks.workunit.client.0.smithi082.stdout:3/353: link d8/d9/d25/d26/d3d/l65 d8/d9/d25/d4e/l87 0 2024-04-27T07:33:13.687 INFO:tasks.workunit.client.0.smithi082.stdout:7/167: rmdir d3/db/d15/d29 0 2024-04-27T07:33:13.688 INFO:tasks.workunit.client.0.smithi082.stdout:7/168: chown d3/f20 163332203 1 2024-04-27T07:33:13.689 INFO:tasks.workunit.client.0.smithi082.stdout:7/169: read - d3/de/f2f zero size 2024-04-27T07:33:13.689 INFO:tasks.workunit.client.0.smithi082.stdout:3/354: unlink d8/d9/d25/d66/c7e 0 2024-04-27T07:33:13.690 INFO:tasks.workunit.client.0.smithi082.stdout:7/170: creat d3/db/d15/d2a/f30 x:0 0 0 2024-04-27T07:33:13.691 INFO:tasks.workunit.client.0.smithi082.stdout:3/355: mknod d8/d9/dd/d13/c88 0 2024-04-27T07:33:13.692 INFO:tasks.workunit.client.0.smithi082.stdout:7/171: symlink d3/l31 0 2024-04-27T07:33:13.693 INFO:tasks.workunit.client.0.smithi082.stdout:3/356: symlink d8/d9/d25/d66/l89 0 2024-04-27T07:33:13.694 INFO:tasks.workunit.client.0.smithi082.stdout:3/357: dread - d8/d9/d25/d26/d3d/f51 zero size 2024-04-27T07:33:13.696 INFO:tasks.workunit.client.0.smithi082.stdout:7/172: creat d3/db/f32 x:0 0 0 2024-04-27T07:33:13.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/358: rename d8/d9/dd/d13/f45 to d8/d9/d3f/f8a 0 2024-04-27T07:33:13.704 INFO:tasks.workunit.client.0.smithi082.stdout:7/173: rmdir d3/db 39 2024-04-27T07:33:13.705 INFO:tasks.workunit.client.0.smithi082.stdout:1/145: sync 2024-04-27T07:33:13.706 INFO:tasks.workunit.client.0.smithi082.stdout:6/135: sync 2024-04-27T07:33:13.709 INFO:tasks.workunit.client.0.smithi082.stdout:6/136: mkdir d2/d2d 0 2024-04-27T07:33:13.710 INFO:tasks.workunit.client.0.smithi082.stdout:6/137: dread - d2/de/d13/f1c zero size 2024-04-27T07:33:13.711 INFO:tasks.workunit.client.0.smithi082.stdout:7/174: dwrite d3/db/ff [0,4194304] 0 2024-04-27T07:33:13.712 INFO:tasks.workunit.client.0.smithi082.stdout:7/175: read - d3/f20 zero size 2024-04-27T07:33:13.714 INFO:tasks.workunit.client.0.smithi082.stdout:1/146: write d4/d15/d1c/f24 [3226707,14929] 0 2024-04-27T07:33:13.714 INFO:tasks.workunit.client.0.smithi082.stdout:1/147: dread - d4/d15/f1b zero size 2024-04-27T07:33:13.715 INFO:tasks.workunit.client.0.smithi082.stdout:6/138: mkdir d2/d2e 0 2024-04-27T07:33:13.716 INFO:tasks.workunit.client.0.smithi082.stdout:7/176: mknod d3/de/c33 0 2024-04-27T07:33:13.716 INFO:tasks.workunit.client.0.smithi082.stdout:6/139: dread - d2/de/d13/f1c zero size 2024-04-27T07:33:13.716 INFO:tasks.workunit.client.0.smithi082.stdout:1/148: mknod d4/d15/d1c/c32 0 2024-04-27T07:33:13.717 INFO:tasks.workunit.client.0.smithi082.stdout:6/140: mknod d2/d2d/c2f 0 2024-04-27T07:33:13.718 INFO:tasks.workunit.client.0.smithi082.stdout:1/149: creat d4/d15/d29/f33 x:0 0 0 2024-04-27T07:33:13.719 INFO:tasks.workunit.client.0.smithi082.stdout:1/150: creat d4/f34 x:0 0 0 2024-04-27T07:33:13.725 INFO:tasks.workunit.client.0.smithi082.stdout:1/151: dwrite d4/ff [0,4194304] 0 2024-04-27T07:33:13.812 INFO:tasks.workunit.client.0.smithi082.stdout:1/152: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:13.814 INFO:tasks.workunit.client.0.smithi082.stdout:1/153: creat d4/f35 x:0 0 0 2024-04-27T07:33:13.817 INFO:tasks.workunit.client.0.smithi082.stdout:1/154: link d4/f1d d4/d15/d29/f36 0 2024-04-27T07:33:13.819 INFO:tasks.workunit.client.0.smithi082.stdout:1/155: unlink d4/d15/d1c/f24 0 2024-04-27T07:33:13.819 INFO:tasks.workunit.client.0.smithi082.stdout:1/156: chown d4/d15/f17 3509 1 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:5/170: sync 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:8/82: sync 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:0/269: sync 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:2/152: sync 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:4/91: sync 2024-04-27T07:33:13.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/136: sync 2024-04-27T07:33:13.859 INFO:tasks.workunit.client.0.smithi082.stdout:1/157: write d4/d15/d29/f33 [241896,10528] 0 2024-04-27T07:33:13.860 INFO:tasks.workunit.client.0.smithi082.stdout:2/153: symlink d7/d14/l2f 0 2024-04-27T07:33:13.861 INFO:tasks.workunit.client.0.smithi082.stdout:4/92: mkdir d3/d6/d22 0 2024-04-27T07:33:13.865 INFO:tasks.workunit.client.0.smithi082.stdout:1/158: creat d4/d15/f37 x:0 0 0 2024-04-27T07:33:13.866 INFO:tasks.workunit.client.0.smithi082.stdout:0/270: dwrite da/d28/f66 [0,4194304] 0 2024-04-27T07:33:13.869 INFO:tasks.workunit.client.0.smithi082.stdout:4/93: symlink d3/d10/l23 0 2024-04-27T07:33:13.870 INFO:tasks.workunit.client.0.smithi082.stdout:4/94: read d3/f4 [3331870,119572] 0 2024-04-27T07:33:13.873 INFO:tasks.workunit.client.0.smithi082.stdout:9/137: rename d9/da/dc/c24 to d9/d2d/d2b/c2e 0 2024-04-27T07:33:13.874 INFO:tasks.workunit.client.0.smithi082.stdout:8/83: write d0/d3/fd [4404679,112580] 0 2024-04-27T07:33:13.874 INFO:tasks.workunit.client.0.smithi082.stdout:1/159: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:13.876 INFO:tasks.workunit.client.0.smithi082.stdout:9/138: read d9/da/dc/f1b [3191498,54712] 0 2024-04-27T07:33:13.876 INFO:tasks.workunit.client.0.smithi082.stdout:5/171: link d8/d14/d1b/f27 d8/d14/d1b/d1f/f36 0 2024-04-27T07:33:13.877 INFO:tasks.workunit.client.0.smithi082.stdout:9/139: fdatasync d9/d2d/f23 0 2024-04-27T07:33:13.878 INFO:tasks.workunit.client.0.smithi082.stdout:9/140: dread - d9/da/f26 zero size 2024-04-27T07:33:13.880 INFO:tasks.workunit.client.0.smithi082.stdout:0/271: creat da/f6c x:0 0 0 2024-04-27T07:33:13.885 INFO:tasks.workunit.client.0.smithi082.stdout:2/154: rename d7/d17 to d7/d30 0 2024-04-27T07:33:13.886 INFO:tasks.workunit.client.0.smithi082.stdout:5/172: creat d8/d2e/f37 x:0 0 0 2024-04-27T07:33:13.891 INFO:tasks.workunit.client.0.smithi082.stdout:1/160: dwrite d4/d15/d1c/f2c [0,4194304] 0 2024-04-27T07:33:13.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/173: mknod d8/d15/d22/c38 0 2024-04-27T07:33:13.902 INFO:tasks.workunit.client.0.smithi082.stdout:8/84: getdents d0 0 2024-04-27T07:33:13.903 INFO:tasks.workunit.client.0.smithi082.stdout:9/141: getdents d9/da 0 2024-04-27T07:33:13.906 INFO:tasks.workunit.client.0.smithi082.stdout:2/155: rename d7/d30/d23/d25 to d7/d31 0 2024-04-27T07:33:13.908 INFO:tasks.workunit.client.0.smithi082.stdout:0/272: write da/f19 [518052,11446] 0 2024-04-27T07:33:13.911 INFO:tasks.workunit.client.0.smithi082.stdout:4/95: dwrite d3/d10/f15 [0,4194304] 0 2024-04-27T07:33:13.913 INFO:tasks.workunit.client.0.smithi082.stdout:0/273: read da/d3c/d3f/f41 [3348604,86565] 0 2024-04-27T07:33:13.914 INFO:tasks.workunit.client.0.smithi082.stdout:2/156: dread d7/d8/f19 [0,4194304] 0 2024-04-27T07:33:13.914 INFO:tasks.workunit.client.0.smithi082.stdout:4/96: write d3/d6/f19 [3989140,76297] 0 2024-04-27T07:33:13.915 INFO:tasks.workunit.client.0.smithi082.stdout:0/274: chown da/f42 15562 1 2024-04-27T07:33:13.915 INFO:tasks.workunit.client.0.smithi082.stdout:5/174: write d8/d15/f13 [4179218,128329] 0 2024-04-27T07:33:13.917 INFO:tasks.workunit.client.0.smithi082.stdout:2/157: stat d7/d30/d23/l2c 0 2024-04-27T07:33:13.919 INFO:tasks.workunit.client.0.smithi082.stdout:9/142: dread f7 [0,4194304] 0 2024-04-27T07:33:13.920 INFO:tasks.workunit.client.0.smithi082.stdout:3/359: sync 2024-04-27T07:33:13.923 INFO:tasks.workunit.client.0.smithi082.stdout:9/143: write d9/da/dc/f17 [459605,55511] 0 2024-04-27T07:33:13.926 INFO:tasks.workunit.client.0.smithi082.stdout:0/275: creat da/d2a/d34/d4a/f6d x:0 0 0 2024-04-27T07:33:13.926 INFO:tasks.workunit.client.0.smithi082.stdout:4/97: dread d3/f14 [0,4194304] 0 2024-04-27T07:33:13.926 INFO:tasks.workunit.client.0.smithi082.stdout:8/85: truncate d0/fa 2558440 0 2024-04-27T07:33:13.928 INFO:tasks.workunit.client.0.smithi082.stdout:9/144: fdatasync f3 0 2024-04-27T07:33:13.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/86: dread - d0/f17 zero size 2024-04-27T07:33:13.930 INFO:tasks.workunit.client.0.smithi082.stdout:5/175: dwrite d8/d2e/f33 [0,4194304] 0 2024-04-27T07:33:13.933 INFO:tasks.workunit.client.0.smithi082.stdout:3/360: mkdir d8/d9/d25/d26/d4d/d82/d8b 0 2024-04-27T07:33:13.933 INFO:tasks.workunit.client.0.smithi082.stdout:4/98: read d3/d10/f15 [3620526,9177] 0 2024-04-27T07:33:13.934 INFO:tasks.workunit.client.0.smithi082.stdout:8/87: chown d0 167891 1 2024-04-27T07:33:13.934 INFO:tasks.workunit.client.0.smithi082.stdout:1/161: dread d4/f5 [4194304,4194304] 0 2024-04-27T07:33:13.934 INFO:tasks.workunit.client.0.smithi082.stdout:9/145: symlink d9/l2f 0 2024-04-27T07:33:13.934 INFO:tasks.workunit.client.0.smithi082.stdout:0/276: rmdir da/d3c/d3f/d4c 39 2024-04-27T07:33:13.939 INFO:tasks.workunit.client.0.smithi082.stdout:4/99: truncate d3/d10/f17 739447 0 2024-04-27T07:33:13.939 INFO:tasks.workunit.client.0.smithi082.stdout:5/176: symlink d8/d14/d1b/d1f/l39 0 2024-04-27T07:33:13.939 INFO:tasks.workunit.client.0.smithi082.stdout:5/177: fdatasync f5 0 2024-04-27T07:33:13.939 INFO:tasks.workunit.client.0.smithi082.stdout:1/162: write d4/d15/f2b [452138,12642] 0 2024-04-27T07:33:13.942 INFO:tasks.workunit.client.0.smithi082.stdout:9/146: mknod d9/c30 0 2024-04-27T07:33:13.942 INFO:tasks.workunit.client.0.smithi082.stdout:8/88: chown d0/d3/l12 9370179 1 2024-04-27T07:33:13.943 INFO:tasks.workunit.client.0.smithi082.stdout:5/178: rename d8/d29/l2a to d8/d15/l3a 0 2024-04-27T07:33:13.944 INFO:tasks.workunit.client.0.smithi082.stdout:3/361: read d8/d9/dd/d13/d1b/f28 [981656,118382] 0 2024-04-27T07:33:13.945 INFO:tasks.workunit.client.0.smithi082.stdout:0/277: dwrite f5 [0,4194304] 0 2024-04-27T07:33:13.946 INFO:tasks.workunit.client.0.smithi082.stdout:8/89: rmdir d0 39 2024-04-27T07:33:13.948 INFO:tasks.workunit.client.0.smithi082.stdout:2/158: dread d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:13.949 INFO:tasks.workunit.client.0.smithi082.stdout:2/159: write f3 [7509403,129305] 0 2024-04-27T07:33:13.950 INFO:tasks.workunit.client.0.smithi082.stdout:4/100: rmdir d3/d10/d20 0 2024-04-27T07:33:13.956 INFO:tasks.workunit.client.0.smithi082.stdout:5/179: mkdir d8/d3b 0 2024-04-27T07:33:13.959 INFO:tasks.workunit.client.0.smithi082.stdout:9/147: write f4 [1217176,23037] 0 2024-04-27T07:33:13.961 INFO:tasks.workunit.client.0.smithi082.stdout:8/90: mkdir d0/d3/d1b 0 2024-04-27T07:33:13.961 INFO:tasks.workunit.client.0.smithi082.stdout:8/91: readlink d0/lb 0 2024-04-27T07:33:13.962 INFO:tasks.workunit.client.0.smithi082.stdout:1/163: getdents d4/d2a 0 2024-04-27T07:33:13.963 INFO:tasks.workunit.client.0.smithi082.stdout:7/177: sync 2024-04-27T07:33:13.963 INFO:tasks.workunit.client.0.smithi082.stdout:6/141: sync 2024-04-27T07:33:13.966 INFO:tasks.workunit.client.0.smithi082.stdout:9/148: dread d9/d2d/f23 [0,4194304] 0 2024-04-27T07:33:13.968 INFO:tasks.workunit.client.0.smithi082.stdout:4/101: unlink d3/d6/c7 0 2024-04-27T07:33:13.969 INFO:tasks.workunit.client.0.smithi082.stdout:3/362: link d8/d9/dd/d13/d1b/f28 d8/d9/d3f/f8c 0 2024-04-27T07:33:13.969 INFO:tasks.workunit.client.0.smithi082.stdout:8/92: write d0/d3/f18 [3372563,76499] 0 2024-04-27T07:33:13.970 INFO:tasks.workunit.client.0.smithi082.stdout:1/164: rename d4/c26 to d4/c38 0 2024-04-27T07:33:13.971 INFO:tasks.workunit.client.0.smithi082.stdout:0/278: dwrite da/f12 [0,4194304] 0 2024-04-27T07:33:13.972 INFO:tasks.workunit.client.0.smithi082.stdout:5/180: mkdir d8/d3c 0 2024-04-27T07:33:13.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/363: chown d8/d9/dd/c52 607 1 2024-04-27T07:33:13.976 INFO:tasks.workunit.client.0.smithi082.stdout:7/178: rmdir d3/db/d15/d2a 39 2024-04-27T07:33:13.976 INFO:tasks.workunit.client.0.smithi082.stdout:0/279: write da/d28/f61 [498468,72702] 0 2024-04-27T07:33:13.977 INFO:tasks.workunit.client.0.smithi082.stdout:9/149: creat d9/da/f31 x:0 0 0 2024-04-27T07:33:13.979 INFO:tasks.workunit.client.0.smithi082.stdout:4/102: fsync d3/f4 0 2024-04-27T07:33:13.979 INFO:tasks.workunit.client.0.smithi082.stdout:8/93: mkdir d0/d3/d1c 0 2024-04-27T07:33:13.981 INFO:tasks.workunit.client.0.smithi082.stdout:2/160: link d7/d8/d13/l1e d7/d8/l32 0 2024-04-27T07:33:13.983 INFO:tasks.workunit.client.0.smithi082.stdout:6/142: link d2/d3/f6 d2/d2e/f30 0 2024-04-27T07:33:13.983 INFO:tasks.workunit.client.0.smithi082.stdout:1/165: dread d4/f5 [4194304,4194304] 0 2024-04-27T07:33:13.985 INFO:tasks.workunit.client.0.smithi082.stdout:7/179: write d3/db/d15/f21 [946234,58997] 0 2024-04-27T07:33:13.985 INFO:tasks.workunit.client.0.smithi082.stdout:8/94: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:13.985 INFO:tasks.workunit.client.0.smithi082.stdout:3/364: stat d8/d9/d25/d66/d6d/c54 0 2024-04-27T07:33:13.987 INFO:tasks.workunit.client.0.smithi082.stdout:9/150: mkdir d9/da/d32 0 2024-04-27T07:33:13.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/95: chown d0/d3/f1a 75727 1 2024-04-27T07:33:13.991 INFO:tasks.workunit.client.0.smithi082.stdout:9/151: read d9/d2d/f19 [3733411,36023] 0 2024-04-27T07:33:13.992 INFO:tasks.workunit.client.0.smithi082.stdout:0/280: dwrite da/d38/f3a [0,4194304] 0 2024-04-27T07:33:13.992 INFO:tasks.workunit.client.0.smithi082.stdout:3/365: chown d8/d9/d1d/c61 6 1 2024-04-27T07:33:13.992 INFO:tasks.workunit.client.0.smithi082.stdout:8/96: chown d0 0 1 2024-04-27T07:33:13.995 INFO:tasks.workunit.client.0.smithi082.stdout:6/143: mknod d2/d3/c31 0 2024-04-27T07:33:13.995 INFO:tasks.workunit.client.0.smithi082.stdout:4/103: dread d3/d9/fb [0,4194304] 0 2024-04-27T07:33:13.997 INFO:tasks.workunit.client.0.smithi082.stdout:0/281: fdatasync da/d2a/f46 0 2024-04-27T07:33:13.997 INFO:tasks.workunit.client.0.smithi082.stdout:2/161: dwrite d7/fc [0,4194304] 0 2024-04-27T07:33:13.998 INFO:tasks.workunit.client.0.smithi082.stdout:7/180: symlink d3/d9/l34 0 2024-04-27T07:33:13.999 INFO:tasks.workunit.client.0.smithi082.stdout:8/97: chown d0/d3/f8 814 1 2024-04-27T07:33:14.000 INFO:tasks.workunit.client.0.smithi082.stdout:3/366: chown d8/d9/d1d/c50 125318 1 2024-04-27T07:33:14.002 INFO:tasks.workunit.client.0.smithi082.stdout:2/162: dread - d7/f28 zero size 2024-04-27T07:33:14.002 INFO:tasks.workunit.client.0.smithi082.stdout:9/152: mkdir d9/da/dc/d33 0 2024-04-27T07:33:14.003 INFO:tasks.workunit.client.0.smithi082.stdout:1/166: dwrite d4/f28 [0,4194304] 0 2024-04-27T07:33:14.004 INFO:tasks.workunit.client.0.smithi082.stdout:0/282: truncate da/f12 4400840 0 2024-04-27T07:33:14.006 INFO:tasks.workunit.client.0.smithi082.stdout:1/167: fsync d4/d15/f18 0 2024-04-27T07:33:14.006 INFO:tasks.workunit.client.0.smithi082.stdout:6/144: mkdir d2/d1e/d32 0 2024-04-27T07:33:14.006 INFO:tasks.workunit.client.0.smithi082.stdout:0/283: write f5 [1029373,63057] 0 2024-04-27T07:33:14.009 INFO:tasks.workunit.client.0.smithi082.stdout:0/284: stat da/c21 0 2024-04-27T07:33:14.012 INFO:tasks.workunit.client.0.smithi082.stdout:0/285: fsync da/f62 0 2024-04-27T07:33:14.013 INFO:tasks.workunit.client.0.smithi082.stdout:5/181: dwrite d8/d14/d1b/f27 [0,4194304] 0 2024-04-27T07:33:14.014 INFO:tasks.workunit.client.0.smithi082.stdout:8/98: creat d0/d3/f1d x:0 0 0 2024-04-27T07:33:14.014 INFO:tasks.workunit.client.0.smithi082.stdout:5/182: chown d8/d3b 370 1 2024-04-27T07:33:14.022 INFO:tasks.workunit.client.0.smithi082.stdout:4/104: creat d3/d6/d22/f24 x:0 0 0 2024-04-27T07:33:14.022 INFO:tasks.workunit.client.0.smithi082.stdout:3/367: fsync d8/d9/dd/d13/d1b/f31 0 2024-04-27T07:33:14.022 INFO:tasks.workunit.client.0.smithi082.stdout:5/183: dwrite d8/f25 [0,4194304] 0 2024-04-27T07:33:14.025 INFO:tasks.workunit.client.0.smithi082.stdout:5/184: stat d8/d3b 0 2024-04-27T07:33:14.025 INFO:tasks.workunit.client.0.smithi082.stdout:5/185: readlink d8/d15/d22/l31 0 2024-04-27T07:33:14.028 INFO:tasks.workunit.client.0.smithi082.stdout:6/145: rename d2/d3/f11 to d2/de/d13/f33 0 2024-04-27T07:33:14.029 INFO:tasks.workunit.client.0.smithi082.stdout:7/181: mknod d3/db/c35 0 2024-04-27T07:33:14.035 INFO:tasks.workunit.client.0.smithi082.stdout:1/168: dread d4/f11 [0,4194304] 0 2024-04-27T07:33:14.036 INFO:tasks.workunit.client.0.smithi082.stdout:4/105: dwrite d3/d9/f1d [0,4194304] 0 2024-04-27T07:33:14.036 INFO:tasks.workunit.client.0.smithi082.stdout:3/368: mknod d8/d9/d25/d26/d4d/d82/c8d 0 2024-04-27T07:33:14.037 INFO:tasks.workunit.client.0.smithi082.stdout:4/106: write d3/fd [3640266,50322] 0 2024-04-27T07:33:14.041 INFO:tasks.workunit.client.0.smithi082.stdout:5/186: mkdir d8/d2e/d3d 0 2024-04-27T07:33:14.041 INFO:tasks.workunit.client.0.smithi082.stdout:6/146: unlink d2/d1e/f2c 0 2024-04-27T07:33:14.041 INFO:tasks.workunit.client.0.smithi082.stdout:5/187: write d8/d15/f11 [4169155,60014] 0 2024-04-27T07:33:14.043 INFO:tasks.workunit.client.0.smithi082.stdout:0/286: rename f4 to da/d38/f6e 0 2024-04-27T07:33:14.044 INFO:tasks.workunit.client.0.smithi082.stdout:7/182: creat d3/de/f36 x:0 0 0 2024-04-27T07:33:14.046 INFO:tasks.workunit.client.0.smithi082.stdout:0/287: read da/d28/f61 [48625,51199] 0 2024-04-27T07:33:14.047 INFO:tasks.workunit.client.0.smithi082.stdout:8/99: creat d0/d3/d1b/f1e x:0 0 0 2024-04-27T07:33:14.049 INFO:tasks.workunit.client.0.smithi082.stdout:5/188: dread d8/d14/f21 [0,4194304] 0 2024-04-27T07:33:14.050 INFO:tasks.workunit.client.0.smithi082.stdout:5/189: fdatasync d8/d14/f21 0 2024-04-27T07:33:14.051 INFO:tasks.workunit.client.0.smithi082.stdout:9/153: dread f0 [4194304,4194304] 0 2024-04-27T07:33:14.051 INFO:tasks.workunit.client.0.smithi082.stdout:1/169: mkdir d4/d2a/d39 0 2024-04-27T07:33:14.052 INFO:tasks.workunit.client.0.smithi082.stdout:3/369: mkdir d8/d9/d25/d66/d6d/d8e 0 2024-04-27T07:33:14.053 INFO:tasks.workunit.client.0.smithi082.stdout:3/370: readlink d8/l2c 0 2024-04-27T07:33:14.055 INFO:tasks.workunit.client.0.smithi082.stdout:4/107: unlink d3/d10/f17 0 2024-04-27T07:33:14.057 INFO:tasks.workunit.client.0.smithi082.stdout:6/147: creat d2/d1e/f34 x:0 0 0 2024-04-27T07:33:14.062 INFO:tasks.workunit.client.0.smithi082.stdout:2/163: link d7/d30/d23/c29 d7/d8/c33 0 2024-04-27T07:33:14.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/288: rename da/d3c/d3f/l59 to da/d38/l6f 0 2024-04-27T07:33:14.066 INFO:tasks.workunit.client.0.smithi082.stdout:0/289: chown da/d2a/d34/d4a/l5e 280308911 1 2024-04-27T07:33:14.066 INFO:tasks.workunit.client.0.smithi082.stdout:1/170: rmdir d4/d15/d1c 39 2024-04-27T07:33:14.067 INFO:tasks.workunit.client.0.smithi082.stdout:9/154: creat d9/d2d/d2b/f34 x:0 0 0 2024-04-27T07:33:14.069 INFO:tasks.workunit.client.0.smithi082.stdout:3/371: creat d8/d9/dd/d13/d1b/f8f x:0 0 0 2024-04-27T07:33:14.071 INFO:tasks.workunit.client.0.smithi082.stdout:3/372: write d8/d9/d1f/f63 [2973654,124851] 0 2024-04-27T07:33:14.072 INFO:tasks.workunit.client.0.smithi082.stdout:1/171: dwrite d4/f1e [0,4194304] 0 2024-04-27T07:33:14.073 INFO:tasks.workunit.client.0.smithi082.stdout:7/183: link d3/f8 d3/d9/f37 0 2024-04-27T07:33:14.076 INFO:tasks.workunit.client.0.smithi082.stdout:2/164: creat d7/d31/f34 x:0 0 0 2024-04-27T07:33:14.077 INFO:tasks.workunit.client.0.smithi082.stdout:2/165: chown d7/d8/f2d 126575758 1 2024-04-27T07:33:14.082 INFO:tasks.workunit.client.0.smithi082.stdout:0/290: mknod da/d2a/d34/d4a/c70 0 2024-04-27T07:33:14.086 INFO:tasks.workunit.client.0.smithi082.stdout:3/373: creat d8/d9/d1d/f90 x:0 0 0 2024-04-27T07:33:14.088 INFO:tasks.workunit.client.0.smithi082.stdout:3/374: truncate d8/d9/d25/f77 1052842 0 2024-04-27T07:33:14.088 INFO:tasks.workunit.client.0.smithi082.stdout:1/172: rename d4/d15/f1b to d4/f3a 0 2024-04-27T07:33:14.089 INFO:tasks.workunit.client.0.smithi082.stdout:2/166: rename d7 to d7/d30/d23/d35 22 2024-04-27T07:33:14.089 INFO:tasks.workunit.client.0.smithi082.stdout:3/375: fdatasync d8/d9/d25/d26/d3d/f6b 0 2024-04-27T07:33:14.090 INFO:tasks.workunit.client.0.smithi082.stdout:2/167: fdatasync d7/d8/f1f 0 2024-04-27T07:33:14.090 INFO:tasks.workunit.client.0.smithi082.stdout:8/100: write d0/fa [3253753,97670] 0 2024-04-27T07:33:14.091 INFO:tasks.workunit.client.0.smithi082.stdout:1/173: write d4/d15/f2b [455868,107644] 0 2024-04-27T07:33:14.091 INFO:tasks.workunit.client.0.smithi082.stdout:3/376: stat d8/d9/dd/f1a 0 2024-04-27T07:33:14.093 INFO:tasks.workunit.client.0.smithi082.stdout:3/377: readlink d8/d9/d1f/l3c 0 2024-04-27T07:33:14.094 INFO:tasks.workunit.client.0.smithi082.stdout:5/190: creat d8/f3e x:0 0 0 2024-04-27T07:33:14.096 INFO:tasks.workunit.client.0.smithi082.stdout:4/108: truncate d3/f14 324828 0 2024-04-27T07:33:14.096 INFO:tasks.workunit.client.0.smithi082.stdout:9/155: getdents d9/da/dc/d33 0 2024-04-27T07:33:14.097 INFO:tasks.workunit.client.0.smithi082.stdout:1/174: dread d4/f1e [0,4194304] 0 2024-04-27T07:33:14.110 INFO:tasks.workunit.client.0.smithi082.stdout:3/378: rmdir d8/d9 39 2024-04-27T07:33:14.112 INFO:tasks.workunit.client.0.smithi082.stdout:0/291: mknod da/d3c/d3f/d57/c71 0 2024-04-27T07:33:14.113 INFO:tasks.workunit.client.0.smithi082.stdout:6/148: getdents d2/de 0 2024-04-27T07:33:14.113 INFO:tasks.workunit.client.0.smithi082.stdout:2/168: dwrite d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:14.113 INFO:tasks.workunit.client.0.smithi082.stdout:9/156: mkdir d9/da/dc/d35 0 2024-04-27T07:33:14.114 INFO:tasks.workunit.client.0.smithi082.stdout:9/157: chown d9/d2d 2751980 1 2024-04-27T07:33:14.115 INFO:tasks.workunit.client.0.smithi082.stdout:9/158: chown d9/c22 468557354 1 2024-04-27T07:33:14.115 INFO:tasks.workunit.client.0.smithi082.stdout:7/184: creat d3/db/d15/f38 x:0 0 0 2024-04-27T07:33:14.119 INFO:tasks.workunit.client.0.smithi082.stdout:4/109: mknod d3/d10/d1f/d21/c25 0 2024-04-27T07:33:14.120 INFO:tasks.workunit.client.0.smithi082.stdout:1/175: symlink d4/d15/l3b 0 2024-04-27T07:33:14.122 INFO:tasks.workunit.client.0.smithi082.stdout:8/101: getdents d0 0 2024-04-27T07:33:14.124 INFO:tasks.workunit.client.0.smithi082.stdout:9/159: rename d9/le to d9/d2d/d2b/l36 0 2024-04-27T07:33:14.125 INFO:tasks.workunit.client.0.smithi082.stdout:5/191: link d8/d15/d22/c38 d8/d2e/c3f 0 2024-04-27T07:33:14.127 INFO:tasks.workunit.client.0.smithi082.stdout:6/149: creat d2/d1e/d32/f35 x:0 0 0 2024-04-27T07:33:14.128 INFO:tasks.workunit.client.0.smithi082.stdout:7/185: symlink d3/db/l39 0 2024-04-27T07:33:14.128 INFO:tasks.workunit.client.0.smithi082.stdout:4/110: dwrite d3/fd [0,4194304] 0 2024-04-27T07:33:14.129 INFO:tasks.workunit.client.0.smithi082.stdout:6/150: fsync d2/f18 0 2024-04-27T07:33:14.129 INFO:tasks.workunit.client.0.smithi082.stdout:8/102: rename d0/d3/l12 to d0/d3/d1c/l1f 0 2024-04-27T07:33:14.133 INFO:tasks.workunit.client.0.smithi082.stdout:3/379: dread d8/d9/d1f/d53/f56 [0,4194304] 0 2024-04-27T07:33:14.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/380: stat d8/d9/dd/f5a 0 2024-04-27T07:33:14.135 INFO:tasks.workunit.client.0.smithi082.stdout:6/151: symlink d2/d2d/l36 0 2024-04-27T07:33:14.136 INFO:tasks.workunit.client.0.smithi082.stdout:5/192: symlink d8/d3c/l40 0 2024-04-27T07:33:14.143 INFO:tasks.workunit.client.0.smithi082.stdout:4/111: write d3/d6/f19 [3037014,85953] 0 2024-04-27T07:33:14.143 INFO:tasks.workunit.client.0.smithi082.stdout:5/193: creat d8/d3b/f41 x:0 0 0 2024-04-27T07:33:14.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/160: dread d9/da/dc/f1b [0,4194304] 0 2024-04-27T07:33:14.146 INFO:tasks.workunit.client.0.smithi082.stdout:6/152: dwrite d2/de/f1d [0,4194304] 0 2024-04-27T07:33:14.147 INFO:tasks.workunit.client.0.smithi082.stdout:9/161: readlink d9/da/l27 0 2024-04-27T07:33:14.147 INFO:tasks.workunit.client.0.smithi082.stdout:5/194: mkdir d8/d42 0 2024-04-27T07:33:14.152 INFO:tasks.workunit.client.0.smithi082.stdout:6/153: symlink d2/d1e/d32/l37 0 2024-04-27T07:33:14.152 INFO:tasks.workunit.client.0.smithi082.stdout:6/154: dread - d2/d1e/f34 zero size 2024-04-27T07:33:14.153 INFO:tasks.workunit.client.0.smithi082.stdout:4/112: dread d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:14.153 INFO:tasks.workunit.client.0.smithi082.stdout:7/186: rename d3/db/d15 to d3/de/d3a 0 2024-04-27T07:33:14.155 INFO:tasks.workunit.client.0.smithi082.stdout:5/195: mknod d8/d3b/c43 0 2024-04-27T07:33:14.155 INFO:tasks.workunit.client.0.smithi082.stdout:7/187: write d3/db/f18 [2847977,8684] 0 2024-04-27T07:33:14.156 INFO:tasks.workunit.client.0.smithi082.stdout:7/188: fsync d3/d9/f2d 0 2024-04-27T07:33:14.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/162: creat d9/da/dc/d33/f37 x:0 0 0 2024-04-27T07:33:14.165 INFO:tasks.workunit.client.0.smithi082.stdout:5/196: dwrite d8/fa [8388608,4194304] 0 2024-04-27T07:33:14.167 INFO:tasks.workunit.client.0.smithi082.stdout:7/189: creat d3/de/f3b x:0 0 0 2024-04-27T07:33:14.168 INFO:tasks.workunit.client.0.smithi082.stdout:1/176: truncate d4/f5 870768 0 2024-04-27T07:33:14.170 INFO:tasks.workunit.client.0.smithi082.stdout:6/155: truncate d2/d3/fd 182017 0 2024-04-27T07:33:14.174 INFO:tasks.workunit.client.0.smithi082.stdout:8/103: truncate d0/fa 2820533 0 2024-04-27T07:33:14.174 INFO:tasks.workunit.client.0.smithi082.stdout:8/104: read - d0/f17 zero size 2024-04-27T07:33:14.177 INFO:tasks.workunit.client.0.smithi082.stdout:8/105: write d0/f17 [248774,106284] 0 2024-04-27T07:33:14.178 INFO:tasks.workunit.client.0.smithi082.stdout:3/381: rename d8/d9/d1f/d53 to d8/d9/d25/d91 0 2024-04-27T07:33:14.179 INFO:tasks.workunit.client.0.smithi082.stdout:1/177: mknod d4/d15/d29/c3c 0 2024-04-27T07:33:14.181 INFO:tasks.workunit.client.0.smithi082.stdout:5/197: dwrite f5 [0,4194304] 0 2024-04-27T07:33:14.182 INFO:tasks.workunit.client.0.smithi082.stdout:6/156: mkdir d2/d2e/d38 0 2024-04-27T07:33:14.187 INFO:tasks.workunit.client.0.smithi082.stdout:8/106: truncate d0/d3/d1b/f1e 751380 0 2024-04-27T07:33:14.187 INFO:tasks.workunit.client.0.smithi082.stdout:7/190: dwrite d3/db/f18 [0,4194304] 0 2024-04-27T07:33:14.188 INFO:tasks.workunit.client.0.smithi082.stdout:6/157: dread - d2/f2a zero size 2024-04-27T07:33:14.189 INFO:tasks.workunit.client.0.smithi082.stdout:1/178: truncate d4/d15/f2f 64660 0 2024-04-27T07:33:14.190 INFO:tasks.workunit.client.0.smithi082.stdout:4/113: dread d3/d9/f1d [0,4194304] 0 2024-04-27T07:33:14.191 INFO:tasks.workunit.client.0.smithi082.stdout:1/179: write f2 [673888,78330] 0 2024-04-27T07:33:14.258 INFO:tasks.workunit.client.0.smithi082.stdout:3/382: symlink d8/d9/d25/d26/d4d/d82/l92 0 2024-04-27T07:33:14.259 INFO:tasks.workunit.client.0.smithi082.stdout:8/107: symlink d0/l20 0 2024-04-27T07:33:14.264 INFO:tasks.workunit.client.0.smithi082.stdout:4/114: write d3/d9/f1d [1067644,20039] 0 2024-04-27T07:33:14.265 INFO:tasks.workunit.client.0.smithi082.stdout:1/180: mknod d4/d15/d29/c3d 0 2024-04-27T07:33:14.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/383: creat d8/d9/dd/d13/d1b/f93 x:0 0 0 2024-04-27T07:33:14.281 INFO:tasks.workunit.client.0.smithi082.stdout:9/163: dwrite d9/fb [0,4194304] 0 2024-04-27T07:33:14.285 INFO:tasks.workunit.client.0.smithi082.stdout:8/108: dwrite d0/d3/f8 [4194304,4194304] 0 2024-04-27T07:33:14.285 INFO:tasks.workunit.client.0.smithi082.stdout:9/164: chown c2 13 1 2024-04-27T07:33:14.287 INFO:tasks.workunit.client.0.smithi082.stdout:3/384: dwrite d8/d9/d3f/f80 [0,4194304] 0 2024-04-27T07:33:14.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/158: symlink d2/l39 0 2024-04-27T07:33:14.294 INFO:tasks.workunit.client.0.smithi082.stdout:1/181: mkdir d4/d2a/d3e 0 2024-04-27T07:33:14.298 INFO:tasks.workunit.client.0.smithi082.stdout:8/109: dwrite d0/d3/f1d [0,4194304] 0 2024-04-27T07:33:14.299 INFO:tasks.workunit.client.0.smithi082.stdout:6/159: dread d2/de/f1d [0,4194304] 0 2024-04-27T07:33:14.302 INFO:tasks.workunit.client.0.smithi082.stdout:7/191: write d3/f8 [2862538,100343] 0 2024-04-27T07:33:14.303 INFO:tasks.workunit.client.0.smithi082.stdout:7/192: dread - d3/de/f36 zero size 2024-04-27T07:33:14.305 INFO:tasks.workunit.client.0.smithi082.stdout:3/385: unlink d8/d9/d25/d66/d6d/f73 0 2024-04-27T07:33:14.307 INFO:tasks.workunit.client.0.smithi082.stdout:9/165: dread d9/d2d/f19 [0,4194304] 0 2024-04-27T07:33:14.307 INFO:tasks.workunit.client.0.smithi082.stdout:6/160: symlink d2/d1e/l3a 0 2024-04-27T07:33:14.308 INFO:tasks.workunit.client.0.smithi082.stdout:6/161: chown d2/d2e 920713 1 2024-04-27T07:33:14.309 INFO:tasks.workunit.client.0.smithi082.stdout:8/110: truncate d0/f13 526533 0 2024-04-27T07:33:14.310 INFO:tasks.workunit.client.0.smithi082.stdout:6/162: chown d2/d3/f27 9844830 1 2024-04-27T07:33:14.317 INFO:tasks.workunit.client.0.smithi082.stdout:1/182: mkdir d4/d15/d3f 0 2024-04-27T07:33:14.318 INFO:tasks.workunit.client.0.smithi082.stdout:4/115: rename d3/d9/d1b to d3/d6/d26 0 2024-04-27T07:33:14.318 INFO:tasks.workunit.client.0.smithi082.stdout:7/193: symlink d3/de/d3a/l3c 0 2024-04-27T07:33:14.320 INFO:tasks.workunit.client.0.smithi082.stdout:7/194: write d3/de/d3a/f21 [8999988,94871] 0 2024-04-27T07:33:14.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/166: mkdir d9/da/dc/d35/d38 0 2024-04-27T07:33:14.326 INFO:tasks.workunit.client.0.smithi082.stdout:9/167: dread d9/da/dc/f1b [0,4194304] 0 2024-04-27T07:33:14.326 INFO:tasks.workunit.client.0.smithi082.stdout:1/183: unlink d4/d15/l3b 0 2024-04-27T07:33:14.328 INFO:tasks.workunit.client.0.smithi082.stdout:6/163: link d2/f23 d2/d2e/f3b 0 2024-04-27T07:33:14.331 INFO:tasks.workunit.client.0.smithi082.stdout:6/164: chown d2/de/d13/f16 63602 1 2024-04-27T07:33:14.333 INFO:tasks.workunit.client.0.smithi082.stdout:8/111: link d0/d3/c5 d0/c21 0 2024-04-27T07:33:14.333 INFO:tasks.workunit.client.0.smithi082.stdout:9/168: dwrite d9/da/dc/f2a [0,4194304] 0 2024-04-27T07:33:14.334 INFO:tasks.workunit.client.0.smithi082.stdout:9/169: fsync d9/da/f31 0 2024-04-27T07:33:14.341 INFO:tasks.workunit.client.0.smithi082.stdout:1/184: fsync d4/d15/d1c/f25 0 2024-04-27T07:33:14.346 INFO:tasks.workunit.client.0.smithi082.stdout:9/170: rename d9/da/dc/f16 to d9/da/d32/f39 0 2024-04-27T07:33:14.346 INFO:tasks.workunit.client.0.smithi082.stdout:6/165: dwrite d2/de/f1d [4194304,4194304] 0 2024-04-27T07:33:14.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/171: chown d9/da/d32/f39 1482484 1 2024-04-27T07:33:14.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/195: getdents d3 0 2024-04-27T07:33:14.352 INFO:tasks.workunit.client.0.smithi082.stdout:7/196: readlink d3/d9/l28 0 2024-04-27T07:33:14.353 INFO:tasks.workunit.client.0.smithi082.stdout:1/185: creat d4/d2a/d3e/f40 x:0 0 0 2024-04-27T07:33:14.354 INFO:tasks.workunit.client.0.smithi082.stdout:3/386: dwrite d8/d9/d1f/f72 [0,4194304] 0 2024-04-27T07:33:14.357 INFO:tasks.workunit.client.0.smithi082.stdout:6/166: rename d2/d3/l14 to d2/d2e/l3c 0 2024-04-27T07:33:14.357 INFO:tasks.workunit.client.0.smithi082.stdout:6/167: readlink d2/de/l1a 0 2024-04-27T07:33:14.362 INFO:tasks.workunit.client.0.smithi082.stdout:9/172: unlink d9/da/dc/l28 0 2024-04-27T07:33:14.363 INFO:tasks.workunit.client.0.smithi082.stdout:7/197: creat d3/de/f3d x:0 0 0 2024-04-27T07:33:14.366 INFO:tasks.workunit.client.0.smithi082.stdout:3/387: creat d8/d9/d1f/f94 x:0 0 0 2024-04-27T07:33:14.367 INFO:tasks.workunit.client.0.smithi082.stdout:7/198: chown d3/de/f14 59 1 2024-04-27T07:33:14.367 INFO:tasks.workunit.client.0.smithi082.stdout:4/116: dwrite d3/f4 [0,4194304] 0 2024-04-27T07:33:14.369 INFO:tasks.workunit.client.0.smithi082.stdout:6/168: dread d2/de/f1d [0,4194304] 0 2024-04-27T07:33:14.370 INFO:tasks.workunit.client.0.smithi082.stdout:4/117: chown d3/d10/l23 207 1 2024-04-27T07:33:14.370 INFO:tasks.workunit.client.0.smithi082.stdout:9/173: unlink d9/da/c25 0 2024-04-27T07:33:14.371 INFO:tasks.workunit.client.0.smithi082.stdout:6/169: chown d2/de/d13/f33 2860 1 2024-04-27T07:33:14.375 INFO:tasks.workunit.client.0.smithi082.stdout:3/388: creat d8/d9/d25/d66/d6d/d8e/f95 x:0 0 0 2024-04-27T07:33:14.376 INFO:tasks.workunit.client.0.smithi082.stdout:9/174: truncate f7 5113238 0 2024-04-27T07:33:14.377 INFO:tasks.workunit.client.0.smithi082.stdout:7/199: dwrite d3/db/ff [0,4194304] 0 2024-04-27T07:33:14.378 INFO:tasks.workunit.client.0.smithi082.stdout:4/118: mknod d3/d10/d1f/c27 0 2024-04-27T07:33:14.379 INFO:tasks.workunit.client.0.smithi082.stdout:6/170: mkdir d2/d2d/d3d 0 2024-04-27T07:33:14.380 INFO:tasks.workunit.client.0.smithi082.stdout:7/200: stat d3/db/ff 0 2024-04-27T07:33:14.383 INFO:tasks.workunit.client.0.smithi082.stdout:9/175: unlink d9/d2d/c14 0 2024-04-27T07:33:14.384 INFO:tasks.workunit.client.0.smithi082.stdout:9/176: read - d9/d2d/d2b/f34 zero size 2024-04-27T07:33:14.387 INFO:tasks.workunit.client.0.smithi082.stdout:7/201: chown d3/de/d3a/l23 15945 1 2024-04-27T07:33:14.388 INFO:tasks.workunit.client.0.smithi082.stdout:7/202: dread - d3/de/f2f zero size 2024-04-27T07:33:14.388 INFO:tasks.workunit.client.0.smithi082.stdout:4/119: rmdir d3/d6/d22 39 2024-04-27T07:33:14.389 INFO:tasks.workunit.client.0.smithi082.stdout:7/203: truncate d3/de/d3a/f38 549352 0 2024-04-27T07:33:14.390 INFO:tasks.workunit.client.0.smithi082.stdout:7/204: readlink d3/de/l12 0 2024-04-27T07:33:14.391 INFO:tasks.workunit.client.0.smithi082.stdout:6/171: symlink d2/d2d/d3d/l3e 0 2024-04-27T07:33:14.392 INFO:tasks.workunit.client.0.smithi082.stdout:7/205: chown d3/de/f1b 30781589 1 2024-04-27T07:33:14.394 INFO:tasks.workunit.client.0.smithi082.stdout:9/177: mknod d9/d2d/c3a 0 2024-04-27T07:33:14.397 INFO:tasks.workunit.client.0.smithi082.stdout:4/120: rename d3/f4 to d3/d10/f28 0 2024-04-27T07:33:14.399 INFO:tasks.workunit.client.0.smithi082.stdout:6/172: dread d2/de/d13/f21 [0,4194304] 0 2024-04-27T07:33:14.399 INFO:tasks.workunit.client.0.smithi082.stdout:1/186: dwrite d4/f11 [0,4194304] 0 2024-04-27T07:33:14.400 INFO:tasks.workunit.client.0.smithi082.stdout:7/206: unlink d3/d9/l28 0 2024-04-27T07:33:14.401 INFO:tasks.workunit.client.0.smithi082.stdout:9/178: dread f5 [0,4194304] 0 2024-04-27T07:33:14.405 INFO:tasks.workunit.client.0.smithi082.stdout:4/121: unlink d3/d10/d1f/c27 0 2024-04-27T07:33:14.407 INFO:tasks.workunit.client.0.smithi082.stdout:6/173: rmdir d2/d2d/d3d 39 2024-04-27T07:33:14.410 INFO:tasks.workunit.client.0.smithi082.stdout:7/207: rmdir d3/db 39 2024-04-27T07:33:14.412 INFO:tasks.workunit.client.0.smithi082.stdout:3/389: truncate d8/d9/d1d/f2d 843483 0 2024-04-27T07:33:14.412 INFO:tasks.workunit.client.0.smithi082.stdout:3/390: stat d8/d9/d25/d4e/c76 0 2024-04-27T07:33:14.420 INFO:tasks.workunit.client.0.smithi082.stdout:4/122: dwrite f0 [4194304,4194304] 0 2024-04-27T07:33:14.426 INFO:tasks.workunit.client.0.smithi082.stdout:6/174: link d2/d2d/c2f d2/d1e/d32/c3f 0 2024-04-27T07:33:14.427 INFO:tasks.workunit.client.0.smithi082.stdout:6/175: chown d2/de 652697 1 2024-04-27T07:33:14.427 INFO:tasks.workunit.client.0.smithi082.stdout:6/176: fdatasync d2/f2a 0 2024-04-27T07:33:14.429 INFO:tasks.workunit.client.0.smithi082.stdout:1/187: write d4/f12 [1324106,61386] 0 2024-04-27T07:33:14.431 INFO:tasks.workunit.client.0.smithi082.stdout:7/208: rmdir d3/de/d3a 39 2024-04-27T07:33:14.433 INFO:tasks.workunit.client.0.smithi082.stdout:3/391: getdents d8/d9/d25/d26/d4d/d82 0 2024-04-27T07:33:14.435 INFO:tasks.workunit.client.0.smithi082.stdout:1/188: rename d4/ff to d4/f41 0 2024-04-27T07:33:14.436 INFO:tasks.workunit.client.0.smithi082.stdout:6/177: rmdir d2/d1e 39 2024-04-27T07:33:14.436 INFO:tasks.workunit.client.0.smithi082.stdout:3/392: fdatasync d8/d9/d25/d66/d6d/f7f 0 2024-04-27T07:33:14.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/179: dwrite f7 [4194304,4194304] 0 2024-04-27T07:33:14.437 INFO:tasks.workunit.client.0.smithi082.stdout:1/189: chown d4/d15/d1c/f2c 0 1 2024-04-27T07:33:14.437 INFO:tasks.workunit.client.0.smithi082.stdout:4/123: unlink d3/d6/d16/c18 0 2024-04-27T07:33:14.445 INFO:tasks.workunit.client.0.smithi082.stdout:6/178: write d2/f18 [204613,43033] 0 2024-04-27T07:33:14.445 INFO:tasks.workunit.client.0.smithi082.stdout:4/124: read d3/d10/f28 [2015930,32671] 0 2024-04-27T07:33:14.447 INFO:tasks.workunit.client.0.smithi082.stdout:3/393: dread - d8/d9/dd/d13/d1b/f5d zero size 2024-04-27T07:33:14.448 INFO:tasks.workunit.client.0.smithi082.stdout:9/180: creat d9/da/dc/d33/f3b x:0 0 0 2024-04-27T07:33:14.449 INFO:tasks.workunit.client.0.smithi082.stdout:1/190: dread - d4/d15/f37 zero size 2024-04-27T07:33:14.450 INFO:tasks.workunit.client.0.smithi082.stdout:7/209: mknod d3/c3e 0 2024-04-27T07:33:14.452 INFO:tasks.workunit.client.0.smithi082.stdout:9/181: dread - d9/da/dc/f20 zero size 2024-04-27T07:33:14.454 INFO:tasks.workunit.client.0.smithi082.stdout:9/182: write d9/da/dc/d33/f3b [11646,83492] 0 2024-04-27T07:33:14.455 INFO:tasks.workunit.client.0.smithi082.stdout:4/125: truncate d3/f14 376726 0 2024-04-27T07:33:14.457 INFO:tasks.workunit.client.0.smithi082.stdout:7/210: dread - d3/de/d3a/d2a/f2b zero size 2024-04-27T07:33:14.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/211: readlink d3/db/l16 0 2024-04-27T07:33:14.461 INFO:tasks.workunit.client.0.smithi082.stdout:4/126: chown d3/f14 111366 1 2024-04-27T07:33:14.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/191: dread f2 [0,4194304] 0 2024-04-27T07:33:14.464 INFO:tasks.workunit.client.0.smithi082.stdout:9/183: unlink d9/da/dc/d33/f3b 0 2024-04-27T07:33:14.465 INFO:tasks.workunit.client.0.smithi082.stdout:7/212: write d3/f5 [2397896,127997] 0 2024-04-27T07:33:14.466 INFO:tasks.workunit.client.0.smithi082.stdout:9/184: fdatasync d9/da/dc/d33/f37 0 2024-04-27T07:33:14.466 INFO:tasks.workunit.client.0.smithi082.stdout:1/192: symlink d4/d15/d1c/l42 0 2024-04-27T07:33:14.467 INFO:tasks.workunit.client.0.smithi082.stdout:9/185: chown d9/l1d 1512648 1 2024-04-27T07:33:14.470 INFO:tasks.workunit.client.0.smithi082.stdout:7/213: unlink d3/de/f1d 0 2024-04-27T07:33:14.470 INFO:tasks.workunit.client.0.smithi082.stdout:6/179: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:14.475 INFO:tasks.workunit.client.0.smithi082.stdout:1/193: creat d4/d2a/d39/f43 x:0 0 0 2024-04-27T07:33:14.476 INFO:tasks.workunit.client.0.smithi082.stdout:4/127: truncate d3/d9/f1d 2173723 0 2024-04-27T07:33:14.477 INFO:tasks.workunit.client.0.smithi082.stdout:1/194: write d4/d15/d29/f36 [1534123,13669] 0 2024-04-27T07:33:14.478 INFO:tasks.workunit.client.0.smithi082.stdout:6/180: rename d2/d1e/l3a to d2/d3/d1b/l40 0 2024-04-27T07:33:14.481 INFO:tasks.workunit.client.0.smithi082.stdout:6/181: write d2/de/f1d [2578359,18303] 0 2024-04-27T07:33:14.482 INFO:tasks.workunit.client.0.smithi082.stdout:1/195: symlink d4/d15/d3f/l44 0 2024-04-27T07:33:14.483 INFO:tasks.workunit.client.0.smithi082.stdout:6/182: symlink d2/de/d13/l41 0 2024-04-27T07:33:14.484 INFO:tasks.workunit.client.0.smithi082.stdout:4/128: creat d3/f29 x:0 0 0 2024-04-27T07:33:14.486 INFO:tasks.workunit.client.0.smithi082.stdout:1/196: truncate d4/fc 5524968 0 2024-04-27T07:33:14.489 INFO:tasks.workunit.client.0.smithi082.stdout:7/214: write d3/db/f18 [1517191,100971] 0 2024-04-27T07:33:14.491 INFO:tasks.workunit.client.0.smithi082.stdout:4/129: dwrite f0 [4194304,4194304] 0 2024-04-27T07:33:14.494 INFO:tasks.workunit.client.0.smithi082.stdout:7/215: creat d3/de/d3a/d2a/f3f x:0 0 0 2024-04-27T07:33:14.495 INFO:tasks.workunit.client.0.smithi082.stdout:7/216: chown d3/de/l12 7 1 2024-04-27T07:33:14.497 INFO:tasks.workunit.client.0.smithi082.stdout:4/130: creat d3/d10/d1f/d21/f2a x:0 0 0 2024-04-27T07:33:14.498 INFO:tasks.workunit.client.0.smithi082.stdout:1/197: link d4/l1a d4/d15/l45 0 2024-04-27T07:33:14.499 INFO:tasks.workunit.client.0.smithi082.stdout:7/217: symlink d3/de/d3a/d2a/l40 0 2024-04-27T07:33:14.499 INFO:tasks.workunit.client.0.smithi082.stdout:6/183: getdents d2/d2d/d3d 0 2024-04-27T07:33:14.501 INFO:tasks.workunit.client.0.smithi082.stdout:1/198: dread f1 [0,4194304] 0 2024-04-27T07:33:14.504 INFO:tasks.workunit.client.0.smithi082.stdout:1/199: rmdir d4/d15/d1c 39 2024-04-27T07:33:14.506 INFO:tasks.workunit.client.0.smithi082.stdout:1/200: truncate d4/f35 681637 0 2024-04-27T07:33:14.507 INFO:tasks.workunit.client.0.smithi082.stdout:7/218: link d3/c4 d3/d9/c41 0 2024-04-27T07:33:14.508 INFO:tasks.workunit.client.0.smithi082.stdout:6/184: dwrite d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:14.509 INFO:tasks.workunit.client.0.smithi082.stdout:4/131: dwrite d3/d6/d22/f24 [0,4194304] 0 2024-04-27T07:33:14.510 INFO:tasks.workunit.client.0.smithi082.stdout:4/132: readlink d3/d6/d16/l1c 0 2024-04-27T07:33:14.511 INFO:tasks.workunit.client.0.smithi082.stdout:1/201: mkdir d4/d2a/d3e/d46 0 2024-04-27T07:33:14.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/133: rmdir d3/d10/d1f 39 2024-04-27T07:33:14.518 INFO:tasks.workunit.client.0.smithi082.stdout:7/219: creat d3/de/d3a/f42 x:0 0 0 2024-04-27T07:33:14.520 INFO:tasks.workunit.client.0.smithi082.stdout:7/220: write d3/de/d3a/d2a/f3f [401739,70332] 0 2024-04-27T07:33:14.520 INFO:tasks.workunit.client.0.smithi082.stdout:1/202: dread d4/d15/f17 [0,4194304] 0 2024-04-27T07:33:14.521 INFO:tasks.workunit.client.0.smithi082.stdout:7/221: readlink d3/de/d3a/d2a/l40 0 2024-04-27T07:33:14.523 INFO:tasks.workunit.client.0.smithi082.stdout:6/185: getdents d2 0 2024-04-27T07:33:14.525 INFO:tasks.workunit.client.0.smithi082.stdout:4/134: getdents d3/d6 0 2024-04-27T07:33:14.527 INFO:tasks.workunit.client.0.smithi082.stdout:7/222: mknod d3/db/c43 0 2024-04-27T07:33:14.528 INFO:tasks.workunit.client.0.smithi082.stdout:4/135: write d3/d9/fb [6581142,58047] 0 2024-04-27T07:33:14.528 INFO:tasks.workunit.client.0.smithi082.stdout:7/223: chown d3/db/c35 14 1 2024-04-27T07:33:14.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/136: chown d3/d6/c13 7960182 1 2024-04-27T07:33:14.530 INFO:tasks.workunit.client.0.smithi082.stdout:4/137: fdatasync d3/f29 0 2024-04-27T07:33:14.530 INFO:tasks.workunit.client.0.smithi082.stdout:7/224: mknod d3/c44 0 2024-04-27T07:33:14.537 INFO:tasks.workunit.client.0.smithi082.stdout:7/225: creat d3/f45 x:0 0 0 2024-04-27T07:33:14.538 INFO:tasks.workunit.client.0.smithi082.stdout:7/226: dread - d3/de/f36 zero size 2024-04-27T07:33:14.539 INFO:tasks.workunit.client.0.smithi082.stdout:6/186: write d2/de/d13/f21 [509140,112586] 0 2024-04-27T07:33:14.539 INFO:tasks.workunit.client.0.smithi082.stdout:7/227: write d3/db/ff [3586315,32287] 0 2024-04-27T07:33:14.541 INFO:tasks.workunit.client.0.smithi082.stdout:6/187: write d2/de/d13/f33 [1998894,33199] 0 2024-04-27T07:33:14.550 INFO:tasks.workunit.client.0.smithi082.stdout:4/138: dwrite d3/f14 [0,4194304] 0 2024-04-27T07:33:14.555 INFO:tasks.workunit.client.0.smithi082.stdout:4/139: rename d3/ce to d3/d10/d1f/c2b 0 2024-04-27T07:33:14.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/140: unlink d3/d10/f28 0 2024-04-27T07:33:14.558 INFO:tasks.workunit.client.0.smithi082.stdout:4/141: truncate d3/f29 1019003 0 2024-04-27T07:33:14.562 INFO:tasks.workunit.client.0.smithi082.stdout:4/142: dread d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:14.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/143: symlink d3/d10/d1f/l2c 0 2024-04-27T07:33:14.568 INFO:tasks.workunit.client.0.smithi082.stdout:4/144: symlink d3/d6/d26/l2d 0 2024-04-27T07:33:14.569 INFO:tasks.workunit.client.0.smithi082.stdout:6/188: dread d2/d3/f27 [0,4194304] 0 2024-04-27T07:33:14.571 INFO:tasks.workunit.client.0.smithi082.stdout:4/145: symlink d3/d6/d16/l2e 0 2024-04-27T07:33:14.575 INFO:tasks.workunit.client.0.smithi082.stdout:4/146: rename f0 to d3/d10/d1f/f2f 0 2024-04-27T07:33:14.576 INFO:tasks.workunit.client.0.smithi082.stdout:6/189: dwrite d2/d1e/f22 [0,4194304] 0 2024-04-27T07:33:14.577 INFO:tasks.workunit.client.0.smithi082.stdout:4/147: chown d3/d6/d26/l2d 467563 1 2024-04-27T07:33:14.579 INFO:tasks.workunit.client.0.smithi082.stdout:4/148: symlink d3/d6/l30 0 2024-04-27T07:33:14.583 INFO:tasks.workunit.client.0.smithi082.stdout:6/190: rename d2/de/f1d to d2/d2e/d38/f42 0 2024-04-27T07:33:14.588 INFO:tasks.workunit.client.0.smithi082.stdout:6/191: mknod d2/d2e/d38/c43 0 2024-04-27T07:33:14.590 INFO:tasks.workunit.client.0.smithi082.stdout:4/149: mknod d3/c31 0 2024-04-27T07:33:14.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:14 smithi082 ceph-mon[26613]: pgmap v13: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 26 MiB/s wr, 306 op/s 2024-04-27T07:33:14.593 INFO:tasks.workunit.client.0.smithi082.stdout:6/192: rename d2/l39 to d2/d3/l44 0 2024-04-27T07:33:14.598 INFO:tasks.workunit.client.0.smithi082.stdout:2/169: sync 2024-04-27T07:33:14.599 INFO:tasks.workunit.client.0.smithi082.stdout:0/292: sync 2024-04-27T07:33:14.599 INFO:tasks.workunit.client.0.smithi082.stdout:4/150: rename d3/d6/d16/l1c to d3/l32 0 2024-04-27T07:33:14.600 INFO:tasks.workunit.client.0.smithi082.stdout:4/151: chown d3/f14 0 1 2024-04-27T07:33:14.601 INFO:tasks.workunit.client.0.smithi082.stdout:0/293: mknod da/d28/d36/d40/c72 0 2024-04-27T07:33:14.603 INFO:tasks.workunit.client.0.smithi082.stdout:2/170: rename d7/fc to d7/d30/f36 0 2024-04-27T07:33:14.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/152: creat d3/d6/d26/f33 x:0 0 0 2024-04-27T07:33:14.615 INFO:tasks.workunit.client.0.smithi082.stdout:0/294: dread da/fe [0,4194304] 0 2024-04-27T07:33:14.653 INFO:tasks.workunit.client.0.smithi082.stdout:2/171: rename d7/d30/d23/l27 to d7/d14/l37 0 2024-04-27T07:33:14.653 INFO:tasks.workunit.client.0.smithi082.stdout:2/172: dread - d7/f28 zero size 2024-04-27T07:33:14.653 INFO:tasks.workunit.client.0.smithi082.stdout:4/153: write d3/d10/f15 [1175985,28725] 0 2024-04-27T07:33:14.655 INFO:tasks.workunit.client.0.smithi082.stdout:2/173: write d7/d8/d13/f2b [400437,83381] 0 2024-04-27T07:33:14.655 INFO:tasks.workunit.client.0.smithi082.stdout:4/154: write d3/d10/d1f/f2f [8306842,42475] 0 2024-04-27T07:33:14.657 INFO:tasks.workunit.client.0.smithi082.stdout:2/174: chown d7/d9/le 276752488 1 2024-04-27T07:33:14.660 INFO:tasks.workunit.client.0.smithi082.stdout:6/193: rename d2/d2e/d38 to d2/d45 0 2024-04-27T07:33:14.661 INFO:tasks.workunit.client.0.smithi082.stdout:4/155: mknod d3/d9/c34 0 2024-04-27T07:33:14.661 INFO:tasks.workunit.client.0.smithi082.stdout:2/175: rmdir d7/d14 39 2024-04-27T07:33:14.662 INFO:tasks.workunit.client.0.smithi082.stdout:2/176: write d7/d8/f1f [2271853,51797] 0 2024-04-27T07:33:14.663 INFO:tasks.workunit.client.0.smithi082.stdout:4/156: creat d3/d6/d26/f35 x:0 0 0 2024-04-27T07:33:14.664 INFO:tasks.workunit.client.0.smithi082.stdout:6/194: mknod d2/d1e/d32/c46 0 2024-04-27T07:33:14.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/157: write d3/d6/d26/f33 [845541,129752] 0 2024-04-27T07:33:14.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:14 smithi100 ceph-mon[34183]: pgmap v13: 65 pgs: 65 active+clean; 354 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 26 MiB/s wr, 306 op/s 2024-04-27T07:33:14.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/158: readlink d3/d9/lf 0 2024-04-27T07:33:14.670 INFO:tasks.workunit.client.0.smithi082.stdout:4/159: creat d3/d6/d26/f36 x:0 0 0 2024-04-27T07:33:14.671 INFO:tasks.workunit.client.0.smithi082.stdout:2/177: link d7/d8/d13/l1e d7/d31/l38 0 2024-04-27T07:33:14.672 INFO:tasks.workunit.client.0.smithi082.stdout:6/195: getdents d2/d1e 0 2024-04-27T07:33:14.674 INFO:tasks.workunit.client.0.smithi082.stdout:4/160: creat d3/d10/d1f/f37 x:0 0 0 2024-04-27T07:33:14.675 INFO:tasks.workunit.client.0.smithi082.stdout:4/161: chown d3/d6 3805367 1 2024-04-27T07:33:14.677 INFO:tasks.workunit.client.0.smithi082.stdout:4/162: unlink d3/fd 0 2024-04-27T07:33:14.678 INFO:tasks.workunit.client.0.smithi082.stdout:4/163: stat d3/d6/d26/f36 0 2024-04-27T07:33:14.678 INFO:tasks.workunit.client.0.smithi082.stdout:6/196: write d2/d3/f27 [1913170,3545] 0 2024-04-27T07:33:14.680 INFO:tasks.workunit.client.0.smithi082.stdout:2/178: creat d7/f39 x:0 0 0 2024-04-27T07:33:14.684 INFO:tasks.workunit.client.0.smithi082.stdout:4/164: dwrite d3/d6/d26/f33 [0,4194304] 0 2024-04-27T07:33:14.685 INFO:tasks.workunit.client.0.smithi082.stdout:2/179: symlink d7/l3a 0 2024-04-27T07:33:14.688 INFO:tasks.workunit.client.0.smithi082.stdout:6/197: dread d2/d2e/f30 [0,4194304] 0 2024-04-27T07:33:14.688 INFO:tasks.workunit.client.0.smithi082.stdout:2/180: truncate d7/d8/f19 291560 0 2024-04-27T07:33:14.689 INFO:tasks.workunit.client.0.smithi082.stdout:2/181: chown d7/d8/f1f 0 1 2024-04-27T07:33:14.690 INFO:tasks.workunit.client.0.smithi082.stdout:4/165: dread d3/f14 [0,4194304] 0 2024-04-27T07:33:14.691 INFO:tasks.workunit.client.0.smithi082.stdout:2/182: dread d7/d9/f1d [4194304,4194304] 0 2024-04-27T07:33:14.695 INFO:tasks.workunit.client.0.smithi082.stdout:2/183: creat d7/d8/d13/f3b x:0 0 0 2024-04-27T07:33:14.695 INFO:tasks.workunit.client.0.smithi082.stdout:2/184: chown d7/l3a 377876384 1 2024-04-27T07:33:14.696 INFO:tasks.workunit.client.0.smithi082.stdout:4/166: symlink d3/d10/l38 0 2024-04-27T07:33:14.698 INFO:tasks.workunit.client.0.smithi082.stdout:4/167: creat d3/d6/f39 x:0 0 0 2024-04-27T07:33:14.703 INFO:tasks.workunit.client.0.smithi082.stdout:2/185: dwrite d7/f28 [0,4194304] 0 2024-04-27T07:33:14.705 INFO:tasks.workunit.client.0.smithi082.stdout:2/186: write d7/d9/f18 [3551058,105179] 0 2024-04-27T07:33:14.707 INFO:tasks.workunit.client.0.smithi082.stdout:4/168: dread d3/d10/d1f/f2f [0,4194304] 0 2024-04-27T07:33:14.713 INFO:tasks.workunit.client.0.smithi082.stdout:4/169: creat d3/d10/f3a x:0 0 0 2024-04-27T07:33:14.716 INFO:tasks.workunit.client.0.smithi082.stdout:2/187: dwrite d7/d8/f2d [0,4194304] 0 2024-04-27T07:33:14.716 INFO:tasks.workunit.client.0.smithi082.stdout:4/170: write d3/d9/fb [8087636,54684] 0 2024-04-27T07:33:14.718 INFO:tasks.workunit.client.0.smithi082.stdout:4/171: stat d3/d10/d1f/d21/f2a 0 2024-04-27T07:33:14.719 INFO:tasks.workunit.client.0.smithi082.stdout:4/172: fsync d3/d6/f39 0 2024-04-27T07:33:14.721 INFO:tasks.workunit.client.0.smithi082.stdout:4/173: chown d3/d10/c1e 1013951 1 2024-04-27T07:33:14.721 INFO:tasks.workunit.client.0.smithi082.stdout:4/174: stat d3/d6 0 2024-04-27T07:33:14.724 INFO:tasks.workunit.client.0.smithi082.stdout:2/188: dread d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:14.724 INFO:tasks.workunit.client.0.smithi082.stdout:4/175: mknod d3/d6/d16/c3b 0 2024-04-27T07:33:14.725 INFO:tasks.workunit.client.0.smithi082.stdout:2/189: readlink d7/l20 0 2024-04-27T07:33:14.726 INFO:tasks.workunit.client.0.smithi082.stdout:4/176: rmdir d3/d6/d22 39 2024-04-27T07:33:14.729 INFO:tasks.workunit.client.0.smithi082.stdout:2/190: getdents d7/d30 0 2024-04-27T07:33:14.735 INFO:tasks.workunit.client.0.smithi082.stdout:4/177: truncate d3/d6/d22/f24 479962 0 2024-04-27T07:33:14.736 INFO:tasks.workunit.client.0.smithi082.stdout:2/191: truncate f3 3302666 0 2024-04-27T07:33:14.736 INFO:tasks.workunit.client.0.smithi082.stdout:4/178: fdatasync d3/d9/fb 0 2024-04-27T07:33:14.739 INFO:tasks.workunit.client.0.smithi082.stdout:2/192: creat d7/f3c x:0 0 0 2024-04-27T07:33:14.743 INFO:tasks.workunit.client.0.smithi082.stdout:2/193: dread d7/d30/f36 [0,4194304] 0 2024-04-27T07:33:14.748 INFO:tasks.workunit.client.0.smithi082.stdout:2/194: creat d7/d14/f3d x:0 0 0 2024-04-27T07:33:14.749 INFO:tasks.workunit.client.0.smithi082.stdout:2/195: dread - d7/d8/d13/f3b zero size 2024-04-27T07:33:14.749 INFO:tasks.workunit.client.0.smithi082.stdout:4/179: dread f2 [0,4194304] 0 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:2/196: symlink d7/d31/l3e 0 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:4/180: creat d3/d6/d16/f3c x:0 0 0 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:4/181: dread - d3/d10/d1f/f37 zero size 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:2/197: creat d7/d30/f3f x:0 0 0 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:4/182: stat d3/d9/fb 0 2024-04-27T07:33:14.754 INFO:tasks.workunit.client.0.smithi082.stdout:2/198: write d7/d9/f18 [2852654,122889] 0 2024-04-27T07:33:14.756 INFO:tasks.workunit.client.0.smithi082.stdout:2/199: chown d7/f28 1007162 1 2024-04-27T07:33:14.756 INFO:tasks.workunit.client.0.smithi082.stdout:2/200: chown d7/d8/d13 3915437 1 2024-04-27T07:33:14.758 INFO:tasks.workunit.client.0.smithi082.stdout:4/183: rename d3/d6/d16/f3c to d3/d10/f3d 0 2024-04-27T07:33:14.759 INFO:tasks.workunit.client.0.smithi082.stdout:2/201: symlink d7/d31/l40 0 2024-04-27T07:33:14.761 INFO:tasks.workunit.client.0.smithi082.stdout:2/202: symlink d7/l41 0 2024-04-27T07:33:14.763 INFO:tasks.workunit.client.0.smithi082.stdout:2/203: write d7/d8/f1f [609859,93158] 0 2024-04-27T07:33:14.765 INFO:tasks.workunit.client.0.smithi082.stdout:4/184: dwrite d3/d6/d26/f36 [0,4194304] 0 2024-04-27T07:33:14.765 INFO:tasks.workunit.client.0.smithi082.stdout:2/204: mknod d7/d9/c42 0 2024-04-27T07:33:14.766 INFO:tasks.workunit.client.0.smithi082.stdout:2/205: readlink d7/d31/l3e 0 2024-04-27T07:33:14.770 INFO:tasks.workunit.client.0.smithi082.stdout:4/185: chown d3/d6/c13 127796 1 2024-04-27T07:33:14.770 INFO:tasks.workunit.client.0.smithi082.stdout:4/186: dread - d3/d6/d26/f35 zero size 2024-04-27T07:33:14.776 INFO:tasks.workunit.client.0.smithi082.stdout:4/187: dread d3/d6/d26/f33 [0,4194304] 0 2024-04-27T07:33:14.778 INFO:tasks.workunit.client.0.smithi082.stdout:4/188: dread - d3/d6/d26/f35 zero size 2024-04-27T07:33:14.780 INFO:tasks.workunit.client.0.smithi082.stdout:5/198: sync 2024-04-27T07:33:14.780 INFO:tasks.workunit.client.0.smithi082.stdout:4/189: write d3/d10/f3a [646198,22592] 0 2024-04-27T07:33:14.781 INFO:tasks.workunit.client.0.smithi082.stdout:2/206: dwrite d7/d30/f36 [0,4194304] 0 2024-04-27T07:33:14.781 INFO:tasks.workunit.client.0.smithi082.stdout:5/199: chown d8/d2e/c32 2892 1 2024-04-27T07:33:14.783 INFO:tasks.workunit.client.0.smithi082.stdout:2/207: truncate d7/d8/d13/f2b 1055335 0 2024-04-27T07:33:14.785 INFO:tasks.workunit.client.0.smithi082.stdout:5/200: mkdir d8/d15/d44 0 2024-04-27T07:33:14.785 INFO:tasks.workunit.client.0.smithi082.stdout:4/190: dread d3/d6/d26/f36 [0,4194304] 0 2024-04-27T07:33:14.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/191: write d3/d10/d1f/f37 [453490,126627] 0 2024-04-27T07:33:14.796 INFO:tasks.workunit.client.0.smithi082.stdout:5/201: creat d8/f45 x:0 0 0 2024-04-27T07:33:14.798 INFO:tasks.workunit.client.0.smithi082.stdout:5/202: creat d8/d14/d1b/f46 x:0 0 0 2024-04-27T07:33:14.799 INFO:tasks.workunit.client.0.smithi082.stdout:4/192: creat d3/d6/f3e x:0 0 0 2024-04-27T07:33:14.800 INFO:tasks.workunit.client.0.smithi082.stdout:4/193: write d3/d10/d1f/f37 [393935,19151] 0 2024-04-27T07:33:14.800 INFO:tasks.workunit.client.0.smithi082.stdout:4/194: chown d3/d6/d16 19 1 2024-04-27T07:33:14.802 INFO:tasks.workunit.client.0.smithi082.stdout:4/195: creat d3/d6/d16/f3f x:0 0 0 2024-04-27T07:33:14.803 INFO:tasks.workunit.client.0.smithi082.stdout:5/203: getdents d8/d14/d1b/d1f 0 2024-04-27T07:33:14.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/196: unlink d3/d10/c1e 0 2024-04-27T07:33:14.808 INFO:tasks.workunit.client.0.smithi082.stdout:4/197: creat d3/d6/d22/f40 x:0 0 0 2024-04-27T07:33:14.810 INFO:tasks.workunit.client.0.smithi082.stdout:4/198: mknod d3/d6/d16/c41 0 2024-04-27T07:33:14.812 INFO:tasks.workunit.client.0.smithi082.stdout:5/204: write d8/f2d [39558,28751] 0 2024-04-27T07:33:14.812 INFO:tasks.workunit.client.0.smithi082.stdout:4/199: mknod d3/d6/c42 0 2024-04-27T07:33:14.813 INFO:tasks.workunit.client.0.smithi082.stdout:4/200: readlink d3/d6/d16/l2e 0 2024-04-27T07:33:14.815 INFO:tasks.workunit.client.0.smithi082.stdout:5/205: rmdir d8/d15/d44 0 2024-04-27T07:33:14.816 INFO:tasks.workunit.client.0.smithi082.stdout:4/201: creat d3/f43 x:0 0 0 2024-04-27T07:33:14.817 INFO:tasks.workunit.client.0.smithi082.stdout:4/202: chown d3/d6/d22/f40 2 1 2024-04-27T07:33:14.817 INFO:tasks.workunit.client.0.smithi082.stdout:4/203: chown d3/d10/c1a 5468 1 2024-04-27T07:33:14.819 INFO:tasks.workunit.client.0.smithi082.stdout:4/204: dread d3/f29 [0,4194304] 0 2024-04-27T07:33:14.824 INFO:tasks.workunit.client.0.smithi082.stdout:4/205: creat d3/d9/f44 x:0 0 0 2024-04-27T07:33:14.824 INFO:tasks.workunit.client.0.smithi082.stdout:4/206: chown d3/d6/c13 1894 1 2024-04-27T07:33:14.826 INFO:tasks.workunit.client.0.smithi082.stdout:5/206: truncate d8/d15/f11 2041131 0 2024-04-27T07:33:14.829 INFO:tasks.workunit.client.0.smithi082.stdout:4/207: creat d3/d9/f45 x:0 0 0 2024-04-27T07:33:14.831 INFO:tasks.workunit.client.0.smithi082.stdout:5/207: dwrite f5 [0,4194304] 0 2024-04-27T07:33:14.832 INFO:tasks.workunit.client.0.smithi082.stdout:5/208: dread - d8/d3b/f41 zero size 2024-04-27T07:33:14.833 INFO:tasks.workunit.client.0.smithi082.stdout:4/208: dread d3/d9/f1d [0,4194304] 0 2024-04-27T07:33:14.840 INFO:tasks.workunit.client.0.smithi082.stdout:5/209: dwrite d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:14.843 INFO:tasks.workunit.client.0.smithi082.stdout:4/209: dwrite d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:14.846 INFO:tasks.workunit.client.0.smithi082.stdout:5/210: rename d8/d14/d1b to d8/d3c/d47 0 2024-04-27T07:33:14.851 INFO:tasks.workunit.client.0.smithi082.stdout:4/210: creat d3/f46 x:0 0 0 2024-04-27T07:33:14.853 INFO:tasks.workunit.client.0.smithi082.stdout:4/211: write d3/d6/d16/f3f [210947,28039] 0 2024-04-27T07:33:14.856 INFO:tasks.workunit.client.0.smithi082.stdout:4/212: creat d3/d6/d16/f47 x:0 0 0 2024-04-27T07:33:14.856 INFO:tasks.workunit.client.0.smithi082.stdout:4/213: chown d3/f29 37 1 2024-04-27T07:33:14.858 INFO:tasks.workunit.client.0.smithi082.stdout:4/214: creat d3/d10/d1f/f48 x:0 0 0 2024-04-27T07:33:14.863 INFO:tasks.workunit.client.0.smithi082.stdout:4/215: rename d3/f46 to d3/d6/d26/f49 0 2024-04-27T07:33:14.866 INFO:tasks.workunit.client.0.smithi082.stdout:5/211: dwrite d8/d15/f11 [0,4194304] 0 2024-04-27T07:33:14.867 INFO:tasks.workunit.client.0.smithi082.stdout:4/216: symlink d3/d10/d1f/d21/l4a 0 2024-04-27T07:33:14.868 INFO:tasks.workunit.client.0.smithi082.stdout:5/212: fdatasync d8/d14/f16 0 2024-04-27T07:33:14.869 INFO:tasks.workunit.client.0.smithi082.stdout:5/213: readlink d8/d14/l28 0 2024-04-27T07:33:14.872 INFO:tasks.workunit.client.0.smithi082.stdout:4/217: rmdir d3/d6/d22 39 2024-04-27T07:33:14.875 INFO:tasks.workunit.client.0.smithi082.stdout:5/214: mkdir d8/d2e/d48 0 2024-04-27T07:33:14.879 INFO:tasks.workunit.client.0.smithi082.stdout:5/215: creat d8/d14/f49 x:0 0 0 2024-04-27T07:33:14.880 INFO:tasks.workunit.client.0.smithi082.stdout:4/218: dwrite d3/f14 [0,4194304] 0 2024-04-27T07:33:14.881 INFO:tasks.workunit.client.0.smithi082.stdout:4/219: readlink d3/d10/l38 0 2024-04-27T07:33:14.888 INFO:tasks.workunit.client.0.smithi082.stdout:5/216: dwrite f4 [4194304,4194304] 0 2024-04-27T07:33:14.892 INFO:tasks.workunit.client.0.smithi082.stdout:4/220: dwrite d3/d10/f3d [0,4194304] 0 2024-04-27T07:33:14.896 INFO:tasks.workunit.client.0.smithi082.stdout:4/221: symlink d3/d6/d16/l4b 0 2024-04-27T07:33:14.897 INFO:tasks.workunit.client.0.smithi082.stdout:5/217: dread d8/d3c/d47/d1f/f36 [0,4194304] 0 2024-04-27T07:33:14.900 INFO:tasks.workunit.client.0.smithi082.stdout:4/222: mknod d3/d10/d1f/c4c 0 2024-04-27T07:33:14.904 INFO:tasks.workunit.client.0.smithi082.stdout:5/218: dwrite d8/d15/f13 [0,4194304] 0 2024-04-27T07:33:14.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/219: mkdir d8/d3c/d4a 0 2024-04-27T07:33:14.909 INFO:tasks.workunit.client.0.smithi082.stdout:4/223: creat d3/f4d x:0 0 0 2024-04-27T07:33:14.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/220: symlink d8/d42/l4b 0 2024-04-27T07:33:14.913 INFO:tasks.workunit.client.0.smithi082.stdout:5/221: dread d8/f2d [0,4194304] 0 2024-04-27T07:33:14.915 INFO:tasks.workunit.client.0.smithi082.stdout:5/222: stat d8/d3c/d47/d1f/f26 0 2024-04-27T07:33:14.918 INFO:tasks.workunit.client.0.smithi082.stdout:4/224: dwrite d3/d6/d16/f3f [0,4194304] 0 2024-04-27T07:33:14.923 INFO:tasks.workunit.client.0.smithi082.stdout:5/223: dwrite d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:14.928 INFO:tasks.workunit.client.0.smithi082.stdout:4/225: rename d3/f4d to d3/f4e 0 2024-04-27T07:33:14.928 INFO:tasks.workunit.client.0.smithi082.stdout:5/224: rename d8/d15/l2c to d8/d15/d22/l4c 0 2024-04-27T07:33:14.932 INFO:tasks.workunit.client.0.smithi082.stdout:5/225: rename d8/d2e/f33 to d8/d14/f4d 0 2024-04-27T07:33:14.935 INFO:tasks.workunit.client.0.smithi082.stdout:5/226: rename d8/d2e/d48 to d8/d29/d4e 0 2024-04-27T07:33:14.936 INFO:tasks.workunit.client.0.smithi082.stdout:5/227: symlink d8/d2e/d3d/l4f 0 2024-04-27T07:33:14.938 INFO:tasks.workunit.client.0.smithi082.stdout:5/228: unlink d8/d2e/l2b 0 2024-04-27T07:33:14.949 INFO:tasks.workunit.client.0.smithi082.stdout:5/229: rename d8/d15/d22/l4c to d8/d15/l50 0 2024-04-27T07:33:14.951 INFO:tasks.workunit.client.0.smithi082.stdout:5/230: dread f7 [0,4194304] 0 2024-04-27T07:33:14.952 INFO:tasks.workunit.client.0.smithi082.stdout:5/231: chown d8/d2e/c32 105936 1 2024-04-27T07:33:14.973 INFO:tasks.workunit.client.0.smithi082.stdout:5/232: mknod d8/d15/d22/c51 0 2024-04-27T07:33:14.979 INFO:tasks.workunit.client.0.smithi082.stdout:5/233: dwrite d8/d15/f24 [0,4194304] 0 2024-04-27T07:33:14.982 INFO:tasks.workunit.client.0.smithi082.stdout:5/234: creat d8/d29/d4e/f52 x:0 0 0 2024-04-27T07:33:14.983 INFO:tasks.workunit.client.0.smithi082.stdout:5/235: write d8/d3c/d47/f46 [877027,6421] 0 2024-04-27T07:33:14.987 INFO:tasks.workunit.client.0.smithi082.stdout:5/236: dread d8/fa [4194304,4194304] 0 2024-04-27T07:33:14.991 INFO:tasks.workunit.client.0.smithi082.stdout:5/237: creat d8/d15/d22/f53 x:0 0 0 2024-04-27T07:33:14.993 INFO:tasks.workunit.client.0.smithi082.stdout:5/238: creat d8/d42/f54 x:0 0 0 2024-04-27T07:33:14.994 INFO:tasks.workunit.client.0.smithi082.stdout:5/239: truncate d8/f3e 670370 0 2024-04-27T07:33:14.996 INFO:tasks.workunit.client.0.smithi082.stdout:8/112: sync 2024-04-27T07:33:14.996 INFO:tasks.workunit.client.0.smithi082.stdout:5/240: write d8/d14/f23 [140419,23827] 0 2024-04-27T07:33:15.001 INFO:tasks.workunit.client.0.smithi082.stdout:5/241: dread d8/d15/ff [0,4194304] 0 2024-04-27T07:33:15.001 INFO:tasks.workunit.client.0.smithi082.stdout:5/242: stat d8/d2e 0 2024-04-27T07:33:15.002 INFO:tasks.workunit.client.0.smithi082.stdout:8/113: dwrite d0/d3/fd [0,4194304] 0 2024-04-27T07:33:15.002 INFO:tasks.workunit.client.0.smithi082.stdout:8/114: chown d0/d3/f18 804710 1 2024-04-27T07:33:15.031 INFO:tasks.workunit.client.0.smithi082.stdout:5/243: rename d8/d3c/d47/d1f/f26 to d8/d3c/d4a/f55 0 2024-04-27T07:33:15.035 INFO:tasks.workunit.client.0.smithi082.stdout:5/244: creat d8/d29/f56 x:0 0 0 2024-04-27T07:33:15.036 INFO:tasks.workunit.client.0.smithi082.stdout:5/245: fdatasync d8/f25 0 2024-04-27T07:33:15.038 INFO:tasks.workunit.client.0.smithi082.stdout:5/246: mkdir d8/d15/d57 0 2024-04-27T07:33:15.040 INFO:tasks.workunit.client.0.smithi082.stdout:5/247: chown d8/d15/l3a 1623416 1 2024-04-27T07:33:15.042 INFO:tasks.workunit.client.0.smithi082.stdout:8/115: dread d0/fa [0,4194304] 0 2024-04-27T07:33:15.042 INFO:tasks.workunit.client.0.smithi082.stdout:8/116: rename d0/d3 to d0/d3/d22 22 2024-04-27T07:33:15.043 INFO:tasks.workunit.client.0.smithi082.stdout:8/117: write d0/d3/f18 [3886358,82133] 0 2024-04-27T07:33:15.045 INFO:tasks.workunit.client.0.smithi082.stdout:5/248: rmdir d8/d15/d57 0 2024-04-27T07:33:15.046 INFO:tasks.workunit.client.0.smithi082.stdout:8/118: dread d0/f17 [0,4194304] 0 2024-04-27T07:33:15.048 INFO:tasks.workunit.client.0.smithi082.stdout:5/249: write d8/f2d [948461,1079] 0 2024-04-27T07:33:15.050 INFO:tasks.workunit.client.0.smithi082.stdout:5/250: chown d8/l19 186 1 2024-04-27T07:33:15.050 INFO:tasks.workunit.client.0.smithi082.stdout:8/119: symlink d0/d3/l23 0 2024-04-27T07:33:15.051 INFO:tasks.workunit.client.0.smithi082.stdout:8/120: mkdir d0/d3/d1b/d24 0 2024-04-27T07:33:15.053 INFO:tasks.workunit.client.0.smithi082.stdout:5/251: truncate d8/d3c/d47/d1f/f36 11011400 0 2024-04-27T07:33:15.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/121: rename d0/d3/f8 to d0/d3/d1b/f25 0 2024-04-27T07:33:15.060 INFO:tasks.workunit.client.0.smithi082.stdout:8/122: creat d0/d3/f26 x:0 0 0 2024-04-27T07:33:15.074 INFO:tasks.workunit.client.0.smithi082.stdout:5/252: dwrite d8/d14/f21 [0,4194304] 0 2024-04-27T07:33:15.075 INFO:tasks.workunit.client.0.smithi082.stdout:8/123: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:15.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/253: creat d8/d15/f58 x:0 0 0 2024-04-27T07:33:15.078 INFO:tasks.workunit.client.0.smithi082.stdout:8/124: chown d0/d3 3 1 2024-04-27T07:33:15.078 INFO:tasks.workunit.client.0.smithi082.stdout:8/125: chown d0/d3/f1a 0 1 2024-04-27T07:33:15.085 INFO:tasks.workunit.client.0.smithi082.stdout:8/126: write d0/f17 [509261,669] 0 2024-04-27T07:33:15.085 INFO:tasks.workunit.client.0.smithi082.stdout:5/254: truncate d8/d14/f23 3347728 0 2024-04-27T07:33:15.086 INFO:tasks.workunit.client.0.smithi082.stdout:8/127: chown d0/d3/d1b/d24 7 1 2024-04-27T07:33:15.086 INFO:tasks.workunit.client.0.smithi082.stdout:8/128: dread - d0/d3/f26 zero size 2024-04-27T07:33:15.088 INFO:tasks.workunit.client.0.smithi082.stdout:5/255: symlink d8/d3c/d47/l59 0 2024-04-27T07:33:15.093 INFO:tasks.workunit.client.0.smithi082.stdout:8/129: dwrite d0/d3/f18 [0,4194304] 0 2024-04-27T07:33:15.097 INFO:tasks.workunit.client.0.smithi082.stdout:8/130: unlink d0/l20 0 2024-04-27T07:33:15.100 INFO:tasks.workunit.client.0.smithi082.stdout:8/131: creat d0/d3/d1b/d24/f27 x:0 0 0 2024-04-27T07:33:15.103 INFO:tasks.workunit.client.0.smithi082.stdout:8/132: link d0/d3/d1b/f25 d0/d3/d1b/d24/f28 0 2024-04-27T07:33:15.105 INFO:tasks.workunit.client.0.smithi082.stdout:8/133: mkdir d0/d3/d1b/d29 0 2024-04-27T07:33:15.107 INFO:tasks.workunit.client.0.smithi082.stdout:8/134: creat d0/d3/d1c/f2a x:0 0 0 2024-04-27T07:33:15.114 INFO:tasks.workunit.client.0.smithi082.stdout:5/256: dread d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:15.115 INFO:tasks.workunit.client.0.smithi082.stdout:8/135: dwrite d0/d3/f26 [0,4194304] 0 2024-04-27T07:33:15.124 INFO:tasks.workunit.client.0.smithi082.stdout:5/257: read d8/d3c/d47/f27 [5154395,122205] 0 2024-04-27T07:33:15.125 INFO:tasks.workunit.client.0.smithi082.stdout:5/258: chown f5 0 1 2024-04-27T07:33:15.125 INFO:tasks.workunit.client.0.smithi082.stdout:5/259: chown d8/d15 0 1 2024-04-27T07:33:15.126 INFO:tasks.workunit.client.0.smithi082.stdout:8/136: fdatasync d0/d3/d1b/d24/f28 0 2024-04-27T07:33:15.129 INFO:tasks.workunit.client.0.smithi082.stdout:5/260: write d8/d3c/d4a/f55 [3880642,113820] 0 2024-04-27T07:33:15.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/261: stat d8/l19 0 2024-04-27T07:33:15.132 INFO:tasks.workunit.client.0.smithi082.stdout:8/137: unlink d0/d3/c5 0 2024-04-27T07:33:15.132 INFO:tasks.workunit.client.0.smithi082.stdout:8/138: stat d0/d3/d1c 0 2024-04-27T07:33:15.132 INFO:tasks.workunit.client.0.smithi082.stdout:5/262: truncate d8/d3c/d47/f27 9949928 0 2024-04-27T07:33:15.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/139: unlink d0/d3/fd 0 2024-04-27T07:33:15.135 INFO:tasks.workunit.client.0.smithi082.stdout:8/140: chown d0/fa 2129103268 1 2024-04-27T07:33:15.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/263: dwrite d8/d3b/f41 [0,4194304] 0 2024-04-27T07:33:15.162 INFO:tasks.workunit.client.0.smithi082.stdout:3/394: sync 2024-04-27T07:33:15.183 INFO:tasks.workunit.client.0.smithi082.stdout:5/264: mkdir d8/d3c/d5a 0 2024-04-27T07:33:15.184 INFO:tasks.workunit.client.0.smithi082.stdout:3/395: creat d8/d9/d25/d4e/f96 x:0 0 0 2024-04-27T07:33:15.190 INFO:tasks.workunit.client.0.smithi082.stdout:3/396: creat d8/d9/d25/d26/d4d/f97 x:0 0 0 2024-04-27T07:33:15.195 INFO:tasks.workunit.client.0.smithi082.stdout:3/397: truncate d8/d9/d1f/f41 1249582 0 2024-04-27T07:33:15.199 INFO:tasks.workunit.client.0.smithi082.stdout:8/141: dwrite d0/d3/d1b/d24/f28 [4194304,4194304] 0 2024-04-27T07:33:15.200 INFO:tasks.workunit.client.0.smithi082.stdout:3/398: truncate d8/d9/d25/d26/d3d/f51 909397 0 2024-04-27T07:33:15.201 INFO:tasks.workunit.client.0.smithi082.stdout:3/399: chown d8/d9/d25/d66/d6d/f7d 7594873 1 2024-04-27T07:33:15.205 INFO:tasks.workunit.client.0.smithi082.stdout:3/400: creat d8/d9/d25/d26/f98 x:0 0 0 2024-04-27T07:33:15.206 INFO:tasks.workunit.client.0.smithi082.stdout:8/142: rmdir d0/d3/d1b 39 2024-04-27T07:33:15.206 INFO:tasks.workunit.client.0.smithi082.stdout:3/401: write d8/d9/dd/d13/d1b/f8f [420157,129197] 0 2024-04-27T07:33:15.208 INFO:tasks.workunit.client.0.smithi082.stdout:8/143: readlink d0/lb 0 2024-04-27T07:33:15.212 INFO:tasks.workunit.client.0.smithi082.stdout:8/144: dread d0/d3/f18 [0,4194304] 0 2024-04-27T07:33:15.214 INFO:tasks.workunit.client.0.smithi082.stdout:8/145: mkdir d0/d2b 0 2024-04-27T07:33:15.215 INFO:tasks.workunit.client.0.smithi082.stdout:8/146: chown d0/d3/c15 575814 1 2024-04-27T07:33:15.217 INFO:tasks.workunit.client.0.smithi082.stdout:8/147: unlink d0/cf 0 2024-04-27T07:33:15.219 INFO:tasks.workunit.client.0.smithi082.stdout:8/148: rename d0/d3/d1b/d24 to d0/d3/d1b/d24/d2c 22 2024-04-27T07:33:15.230 INFO:tasks.workunit.client.0.smithi082.stdout:8/149: dread d0/d3/d1b/d24/f28 [0,4194304] 0 2024-04-27T07:33:15.236 INFO:tasks.workunit.client.0.smithi082.stdout:8/150: dwrite d0/f17 [0,4194304] 0 2024-04-27T07:33:15.237 INFO:tasks.workunit.client.0.smithi082.stdout:8/151: truncate d0/d3/f1a 128191 0 2024-04-27T07:33:15.243 INFO:tasks.workunit.client.0.smithi082.stdout:8/152: dwrite d0/d3/d1c/f2a [0,4194304] 0 2024-04-27T07:33:15.318 INFO:tasks.workunit.client.0.smithi082.stdout:9/186: sync 2024-04-27T07:33:15.320 INFO:tasks.workunit.client.0.smithi082.stdout:9/187: symlink d9/da/dc/d35/d38/l3c 0 2024-04-27T07:33:15.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/188: write d9/f21 [1923534,39633] 0 2024-04-27T07:33:15.323 INFO:tasks.workunit.client.0.smithi082.stdout:9/189: mkdir d9/da/dc/d33/d3d 0 2024-04-27T07:33:15.325 INFO:tasks.workunit.client.0.smithi082.stdout:9/190: creat d9/da/dc/f3e x:0 0 0 2024-04-27T07:33:15.326 INFO:tasks.workunit.client.0.smithi082.stdout:9/191: chown d9/d2d/d2b/l36 243 1 2024-04-27T07:33:15.329 INFO:tasks.workunit.client.0.smithi082.stdout:9/192: creat d9/da/dc/f3f x:0 0 0 2024-04-27T07:33:15.329 INFO:tasks.workunit.client.0.smithi082.stdout:9/193: readlink d9/l1d 0 2024-04-27T07:33:15.402 INFO:tasks.workunit.client.0.smithi082.stdout:1/203: sync 2024-04-27T07:33:15.402 INFO:tasks.workunit.client.0.smithi082.stdout:7/228: sync 2024-04-27T07:33:15.402 INFO:tasks.workunit.client.0.smithi082.stdout:1/204: readlink d4/d15/l2e 0 2024-04-27T07:33:15.404 INFO:tasks.workunit.client.0.smithi082.stdout:7/229: creat d3/db/f46 x:0 0 0 2024-04-27T07:33:15.405 INFO:tasks.workunit.client.0.smithi082.stdout:7/230: truncate d3/db/f32 25731 0 2024-04-27T07:33:15.406 INFO:tasks.workunit.client.0.smithi082.stdout:7/231: chown d3/de/f1e 737576398 1 2024-04-27T07:33:15.406 INFO:tasks.workunit.client.0.smithi082.stdout:1/205: link d4/f41 d4/d15/d29/f47 0 2024-04-27T07:33:15.409 INFO:tasks.workunit.client.0.smithi082.stdout:7/232: dread d3/db/ff [0,4194304] 0 2024-04-27T07:33:15.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/233: symlink d3/de/d3a/d2a/l47 0 2024-04-27T07:33:15.418 INFO:tasks.workunit.client.0.smithi082.stdout:7/234: dwrite d3/de/f14 [0,4194304] 0 2024-04-27T07:33:15.422 INFO:tasks.workunit.client.0.smithi082.stdout:1/206: dwrite d4/d15/f17 [0,4194304] 0 2024-04-27T07:33:15.425 INFO:tasks.workunit.client.0.smithi082.stdout:1/207: fsync d4/f1e 0 2024-04-27T07:33:15.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/235: link d3/c3e d3/de/d3a/c48 0 2024-04-27T07:33:15.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/236: chown d3/f45 139 1 2024-04-27T07:33:15.429 INFO:tasks.workunit.client.0.smithi082.stdout:7/237: stat d3/db/f27 0 2024-04-27T07:33:15.429 INFO:tasks.workunit.client.0.smithi082.stdout:7/238: read - d3/de/f2f zero size 2024-04-27T07:33:15.430 INFO:tasks.workunit.client.0.smithi082.stdout:7/239: truncate d3/db/f27 79223 0 2024-04-27T07:33:15.431 INFO:tasks.workunit.client.0.smithi082.stdout:1/208: creat d4/d2a/d3e/d46/f48 x:0 0 0 2024-04-27T07:33:15.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/209: read d4/f28 [418619,129962] 0 2024-04-27T07:33:15.435 INFO:tasks.workunit.client.0.smithi082.stdout:7/240: mkdir d3/d49 0 2024-04-27T07:33:15.436 INFO:tasks.workunit.client.0.smithi082.stdout:7/241: write d3/f20 [563272,24948] 0 2024-04-27T07:33:15.437 INFO:tasks.workunit.client.0.smithi082.stdout:1/210: dread f2 [0,4194304] 0 2024-04-27T07:33:15.439 INFO:tasks.workunit.client.0.smithi082.stdout:1/211: mkdir d4/d15/d49 0 2024-04-27T07:33:15.445 INFO:tasks.workunit.client.0.smithi082.stdout:1/212: dread d4/d15/f2b [0,4194304] 0 2024-04-27T07:33:15.447 INFO:tasks.workunit.client.0.smithi082.stdout:1/213: creat d4/d2a/d39/f4a x:0 0 0 2024-04-27T07:33:15.448 INFO:tasks.workunit.client.0.smithi082.stdout:1/214: dread d4/f35 [0,4194304] 0 2024-04-27T07:33:15.454 INFO:tasks.workunit.client.0.smithi082.stdout:1/215: truncate d4/d15/f17 1893946 0 2024-04-27T07:33:15.455 INFO:tasks.workunit.client.0.smithi082.stdout:1/216: dread d4/d15/f2f [0,4194304] 0 2024-04-27T07:33:15.457 INFO:tasks.workunit.client.0.smithi082.stdout:1/217: unlink d4/d2a/c31 0 2024-04-27T07:33:15.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/218: mknod d4/d15/d3f/c4b 0 2024-04-27T07:33:15.461 INFO:tasks.workunit.client.0.smithi082.stdout:1/219: dread d4/d15/d29/f33 [0,4194304] 0 2024-04-27T07:33:15.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/220: mkdir d4/d2a/d4c 0 2024-04-27T07:33:15.464 INFO:tasks.workunit.client.0.smithi082.stdout:1/221: creat d4/d15/d29/f4d x:0 0 0 2024-04-27T07:33:15.465 INFO:tasks.workunit.client.0.smithi082.stdout:1/222: fsync d4/f1d 0 2024-04-27T07:33:15.470 INFO:tasks.workunit.client.0.smithi082.stdout:1/223: dwrite d4/f1d [0,4194304] 0 2024-04-27T07:33:15.476 INFO:tasks.workunit.client.0.smithi082.stdout:1/224: getdents d4 0 2024-04-27T07:33:15.480 INFO:tasks.workunit.client.0.smithi082.stdout:1/225: mkdir d4/d15/d49/d4e 0 2024-04-27T07:33:15.484 INFO:tasks.workunit.client.0.smithi082.stdout:1/226: creat d4/d15/f4f x:0 0 0 2024-04-27T07:33:15.486 INFO:tasks.workunit.client.0.smithi082.stdout:1/227: creat d4/d2a/d3e/d46/f50 x:0 0 0 2024-04-27T07:33:15.487 INFO:tasks.workunit.client.0.smithi082.stdout:1/228: write d4/f1d [3603898,85425] 0 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:1/229: write d4/d15/d29/f33 [268323,99230] 0 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/198: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/153: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:3/402: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:2/208: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:5/265: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:9/194: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:4/226: sync 2024-04-27T07:33:15.490 INFO:tasks.workunit.client.0.smithi082.stdout:0/295: sync 2024-04-27T07:33:15.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/296: stat f7 0 2024-04-27T07:33:15.493 INFO:tasks.workunit.client.0.smithi082.stdout:9/195: write f4 [2015906,55666] 0 2024-04-27T07:33:15.494 INFO:tasks.workunit.client.0.smithi082.stdout:5/266: fdatasync d8/d29/d4e/f52 0 2024-04-27T07:33:15.496 INFO:tasks.workunit.client.0.smithi082.stdout:2/209: read d7/d8/f19 [128990,95459] 0 2024-04-27T07:33:15.496 INFO:tasks.workunit.client.0.smithi082.stdout:1/230: mknod d4/d15/d3f/c51 0 2024-04-27T07:33:15.497 INFO:tasks.workunit.client.0.smithi082.stdout:0/297: mknod da/d2a/d34/c73 0 2024-04-27T07:33:15.499 INFO:tasks.workunit.client.0.smithi082.stdout:4/227: dread d3/d6/d22/f24 [0,4194304] 0 2024-04-27T07:33:15.504 INFO:tasks.workunit.client.0.smithi082.stdout:9/196: write d9/da/dc/f1b [601281,16270] 0 2024-04-27T07:33:15.505 INFO:tasks.workunit.client.0.smithi082.stdout:9/197: write f7 [8216091,130174] 0 2024-04-27T07:33:15.506 INFO:tasks.workunit.client.0.smithi082.stdout:5/267: mkdir d8/d3c/d5a/d5b 0 2024-04-27T07:33:15.507 INFO:tasks.workunit.client.0.smithi082.stdout:5/268: fdatasync d8/d14/f49 0 2024-04-27T07:33:15.508 INFO:tasks.workunit.client.0.smithi082.stdout:5/269: stat f4 0 2024-04-27T07:33:15.509 INFO:tasks.workunit.client.0.smithi082.stdout:8/154: truncate d0/d3/f1d 3115178 0 2024-04-27T07:33:15.511 INFO:tasks.workunit.client.0.smithi082.stdout:0/298: mkdir da/d3c/d3f/d4c/d74 0 2024-04-27T07:33:15.512 INFO:tasks.workunit.client.0.smithi082.stdout:0/299: readlink da/l11 0 2024-04-27T07:33:15.513 INFO:tasks.workunit.client.0.smithi082.stdout:9/198: dwrite d9/fb [4194304,4194304] 0 2024-04-27T07:33:15.514 INFO:tasks.workunit.client.0.smithi082.stdout:9/199: fdatasync d9/da/dc/f3f 0 2024-04-27T07:33:15.514 INFO:tasks.workunit.client.0.smithi082.stdout:0/300: readlink da/d2a/d34/l48 0 2024-04-27T07:33:15.517 INFO:tasks.workunit.client.0.smithi082.stdout:6/199: link d2/c25 d2/d45/c47 0 2024-04-27T07:33:15.520 INFO:tasks.workunit.client.0.smithi082.stdout:2/210: link d7/l3a d7/d30/d23/l43 0 2024-04-27T07:33:15.522 INFO:tasks.workunit.client.0.smithi082.stdout:3/403: getdents d8/d9/d25/d26 0 2024-04-27T07:33:15.522 INFO:tasks.workunit.client.0.smithi082.stdout:9/200: dwrite d9/fb [4194304,4194304] 0 2024-04-27T07:33:15.523 INFO:tasks.workunit.client.0.smithi082.stdout:2/211: write d7/d30/f36 [409439,69456] 0 2024-04-27T07:33:15.523 INFO:tasks.workunit.client.0.smithi082.stdout:8/155: symlink d0/d3/d1b/d24/l2d 0 2024-04-27T07:33:15.525 INFO:tasks.workunit.client.0.smithi082.stdout:4/228: creat d3/d10/f4f x:0 0 0 2024-04-27T07:33:15.527 INFO:tasks.workunit.client.0.smithi082.stdout:4/229: fsync f2 0 2024-04-27T07:33:15.527 INFO:tasks.workunit.client.0.smithi082.stdout:5/270: mknod d8/d14/c5c 0 2024-04-27T07:33:15.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/230: truncate d3/d6/f3e 356005 0 2024-04-27T07:33:15.529 INFO:tasks.workunit.client.0.smithi082.stdout:2/212: chown c5 21 1 2024-04-27T07:33:15.529 INFO:tasks.workunit.client.0.smithi082.stdout:8/156: creat d0/d3/d1b/f2e x:0 0 0 2024-04-27T07:33:15.530 INFO:tasks.workunit.client.0.smithi082.stdout:9/201: mknod d9/da/dc/c40 0 2024-04-27T07:33:15.530 INFO:tasks.workunit.client.0.smithi082.stdout:2/213: chown d7/d9/c42 1034425148 1 2024-04-27T07:33:15.531 INFO:tasks.workunit.client.0.smithi082.stdout:2/214: dread - d7/f3c zero size 2024-04-27T07:33:15.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/301: symlink da/d28/l75 0 2024-04-27T07:33:15.532 INFO:tasks.workunit.client.0.smithi082.stdout:9/202: write d9/da/dc/f2a [4487858,81120] 0 2024-04-27T07:33:15.532 INFO:tasks.workunit.client.0.smithi082.stdout:3/404: chown d8/d9/dd/d13/d1b/f28 237151 1 2024-04-27T07:33:15.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/271: creat d8/d3c/d47/f5d x:0 0 0 2024-04-27T07:33:15.539 INFO:tasks.workunit.client.0.smithi082.stdout:0/302: unlink da/l11 0 2024-04-27T07:33:15.539 INFO:tasks.workunit.client.0.smithi082.stdout:8/157: fsync d0/fa 0 2024-04-27T07:33:15.539 INFO:tasks.workunit.client.0.smithi082.stdout:9/203: creat d9/da/d32/f41 x:0 0 0 2024-04-27T07:33:15.540 INFO:tasks.workunit.client.0.smithi082.stdout:8/158: chown d0/d3/d1b/d24/l2d 1623027349 1 2024-04-27T07:33:15.541 INFO:tasks.workunit.client.0.smithi082.stdout:3/405: creat d8/d9/d1f/f99 x:0 0 0 2024-04-27T07:33:15.541 INFO:tasks.workunit.client.0.smithi082.stdout:5/272: creat d8/d29/d4e/f5e x:0 0 0 2024-04-27T07:33:15.543 INFO:tasks.workunit.client.0.smithi082.stdout:9/204: fsync f5 0 2024-04-27T07:33:15.544 INFO:tasks.workunit.client.0.smithi082.stdout:9/205: stat d9/da/dc 0 2024-04-27T07:33:15.545 INFO:tasks.workunit.client.0.smithi082.stdout:0/303: creat da/d3c/d3f/d57/f76 x:0 0 0 2024-04-27T07:33:15.548 INFO:tasks.workunit.client.0.smithi082.stdout:9/206: mkdir d9/da/dc/d35/d42 0 2024-04-27T07:33:15.550 INFO:tasks.workunit.client.0.smithi082.stdout:0/304: unlink da/d2a/d34/f45 0 2024-04-27T07:33:15.552 INFO:tasks.workunit.client.0.smithi082.stdout:5/273: mkdir d8/d3c/d5a/d5b/d5f 0 2024-04-27T07:33:15.555 INFO:tasks.workunit.client.0.smithi082.stdout:9/207: dread d9/f21 [0,4194304] 0 2024-04-27T07:33:15.556 INFO:tasks.workunit.client.0.smithi082.stdout:9/208: readlink l8 0 2024-04-27T07:33:15.557 INFO:tasks.workunit.client.0.smithi082.stdout:5/274: dread d8/d15/f13 [0,4194304] 0 2024-04-27T07:33:15.557 INFO:tasks.workunit.client.0.smithi082.stdout:9/209: write d9/da/dc/f3f [681865,52894] 0 2024-04-27T07:33:15.559 INFO:tasks.workunit.client.0.smithi082.stdout:8/159: rename d0/c21 to d0/d3/c2f 0 2024-04-27T07:33:15.560 INFO:tasks.workunit.client.0.smithi082.stdout:0/305: mknod da/d3c/d3f/c77 0 2024-04-27T07:33:15.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/200: truncate d2/de/d13/f33 2036906 0 2024-04-27T07:33:15.562 INFO:tasks.workunit.client.0.smithi082.stdout:0/306: truncate da/f12 4789531 0 2024-04-27T07:33:15.563 INFO:tasks.workunit.client.0.smithi082.stdout:0/307: chown da/d1d/f2d 58173110 1 2024-04-27T07:33:15.563 INFO:tasks.workunit.client.0.smithi082.stdout:5/275: symlink d8/d29/d4e/l60 0 2024-04-27T07:33:15.564 INFO:tasks.workunit.client.0.smithi082.stdout:0/308: dread - da/d2a/f5d zero size 2024-04-27T07:33:15.564 INFO:tasks.workunit.client.0.smithi082.stdout:8/160: dread d0/d3/d1c/f2a [0,4194304] 0 2024-04-27T07:33:15.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/201: fsync d2/d45/f42 0 2024-04-27T07:33:15.569 INFO:tasks.workunit.client.0.smithi082.stdout:5/276: creat d8/d29/d4e/f61 x:0 0 0 2024-04-27T07:33:15.574 INFO:tasks.workunit.client.0.smithi082.stdout:6/202: symlink d2/d1e/d32/l48 0 2024-04-27T07:33:15.574 INFO:tasks.workunit.client.0.smithi082.stdout:9/210: link d9/da/dc/c40 d9/c43 0 2024-04-27T07:33:15.575 INFO:tasks.workunit.client.0.smithi082.stdout:7/242: sync 2024-04-27T07:33:15.576 INFO:tasks.workunit.client.0.smithi082.stdout:7/243: dread - d3/de/d3a/f42 zero size 2024-04-27T07:33:15.577 INFO:tasks.workunit.client.0.smithi082.stdout:8/161: symlink d0/d2b/l30 0 2024-04-27T07:33:15.578 INFO:tasks.workunit.client.0.smithi082.stdout:6/203: fsync d2/d2e/f3b 0 2024-04-27T07:33:15.579 INFO:tasks.workunit.client.0.smithi082.stdout:6/204: chown d2/d1e/f22 67 1 2024-04-27T07:33:15.580 INFO:tasks.workunit.client.0.smithi082.stdout:6/205: write d2/de/f17 [1058662,88750] 0 2024-04-27T07:33:15.581 INFO:tasks.workunit.client.0.smithi082.stdout:9/211: mknod d9/da/d32/c44 0 2024-04-27T07:33:15.582 INFO:tasks.workunit.client.0.smithi082.stdout:9/212: stat d9/d2d/d2b 0 2024-04-27T07:33:15.583 INFO:tasks.workunit.client.0.smithi082.stdout:9/213: truncate d9/da/f26 570530 0 2024-04-27T07:33:15.584 INFO:tasks.workunit.client.0.smithi082.stdout:8/162: symlink d0/d3/d1b/l31 0 2024-04-27T07:33:15.590 INFO:tasks.workunit.client.0.smithi082.stdout:6/206: unlink d2/d3/la 0 2024-04-27T07:33:15.591 INFO:tasks.workunit.client.0.smithi082.stdout:6/207: write d2/de/d13/f1c [559898,67276] 0 2024-04-27T07:33:15.592 INFO:tasks.workunit.client.0.smithi082.stdout:6/208: fsync d2/d3/d1b/f28 0 2024-04-27T07:33:15.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/209: write d2/d3/d1b/f28 [806784,25165] 0 2024-04-27T07:33:15.594 INFO:tasks.workunit.client.0.smithi082.stdout:9/214: rename d9/da/c1e to d9/da/dc/d33/d3d/c45 0 2024-04-27T07:33:15.596 INFO:tasks.workunit.client.0.smithi082.stdout:5/277: getdents d8/d3c 0 2024-04-27T07:33:15.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/215: read d9/d2d/f19 [2567466,33444] 0 2024-04-27T07:33:15.597 INFO:tasks.workunit.client.0.smithi082.stdout:0/309: link da/d38/l6f da/d28/l78 0 2024-04-27T07:33:15.598 INFO:tasks.workunit.client.0.smithi082.stdout:5/278: chown d8/d29/d4e/f52 52111 1 2024-04-27T07:33:15.600 INFO:tasks.workunit.client.0.smithi082.stdout:7/244: link d3/c44 d3/de/d3a/d2a/c4a 0 2024-04-27T07:33:15.601 INFO:tasks.workunit.client.0.smithi082.stdout:9/216: mkdir d9/d2d/d2b/d46 0 2024-04-27T07:33:15.602 INFO:tasks.workunit.client.0.smithi082.stdout:9/217: dread - d9/da/d32/f39 zero size 2024-04-27T07:33:15.602 INFO:tasks.workunit.client.0.smithi082.stdout:5/279: write f7 [4170010,27] 0 2024-04-27T07:33:15.604 INFO:tasks.workunit.client.0.smithi082.stdout:9/218: write d9/da/f31 [756381,91135] 0 2024-04-27T07:33:15.606 INFO:tasks.workunit.client.0.smithi082.stdout:7/245: symlink d3/de/d3a/d2a/l4b 0 2024-04-27T07:33:15.609 INFO:tasks.workunit.client.0.smithi082.stdout:9/219: creat d9/da/dc/d33/f47 x:0 0 0 2024-04-27T07:33:15.610 INFO:tasks.workunit.client.0.smithi082.stdout:9/220: write d9/da/dc/d33/f47 [325230,87213] 0 2024-04-27T07:33:15.610 INFO:tasks.workunit.client.0.smithi082.stdout:6/210: mknod d2/d2d/c49 0 2024-04-27T07:33:15.613 INFO:tasks.workunit.client.0.smithi082.stdout:9/221: fdatasync d9/da/f31 0 2024-04-27T07:33:15.614 INFO:tasks.workunit.client.0.smithi082.stdout:9/222: stat d9/da/dc 0 2024-04-27T07:33:15.614 INFO:tasks.workunit.client.0.smithi082.stdout:5/280: symlink d8/d14/l62 0 2024-04-27T07:33:15.615 INFO:tasks.workunit.client.0.smithi082.stdout:9/223: fsync d9/da/dc/f3f 0 2024-04-27T07:33:15.615 INFO:tasks.workunit.client.0.smithi082.stdout:5/281: chown d8/d14/l28 2392660 1 2024-04-27T07:33:15.618 INFO:tasks.workunit.client.0.smithi082.stdout:6/211: dread d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:15.618 INFO:tasks.workunit.client.0.smithi082.stdout:6/212: stat d2 0 2024-04-27T07:33:15.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/224: rmdir d9 39 2024-04-27T07:33:15.621 INFO:tasks.workunit.client.0.smithi082.stdout:5/282: mknod d8/d3c/d5a/d5b/c63 0 2024-04-27T07:33:15.624 INFO:tasks.workunit.client.0.smithi082.stdout:5/283: rmdir d8/d42 39 2024-04-27T07:33:15.625 INFO:tasks.workunit.client.0.smithi082.stdout:8/163: dwrite d0/f13 [0,4194304] 0 2024-04-27T07:33:15.630 INFO:tasks.workunit.client.0.smithi082.stdout:9/225: mkdir d9/d48 0 2024-04-27T07:33:15.632 INFO:tasks.workunit.client.0.smithi082.stdout:9/226: fdatasync d9/da/f26 0 2024-04-27T07:33:15.633 INFO:tasks.workunit.client.0.smithi082.stdout:9/227: write f7 [2196840,130878] 0 2024-04-27T07:33:15.634 INFO:tasks.workunit.client.0.smithi082.stdout:6/213: getdents d2/d3/d1b 0 2024-04-27T07:33:15.636 INFO:tasks.workunit.client.0.smithi082.stdout:8/164: mkdir d0/d3/d1c/d32 0 2024-04-27T07:33:15.642 INFO:tasks.workunit.client.0.smithi082.stdout:6/214: dwrite d2/d3/d1b/f28 [0,4194304] 0 2024-04-27T07:33:15.647 INFO:tasks.workunit.client.0.smithi082.stdout:6/215: mkdir d2/d2d/d4a 0 2024-04-27T07:33:15.649 INFO:tasks.workunit.client.0.smithi082.stdout:8/165: write d0/d3/d1c/f2a [3366690,93717] 0 2024-04-27T07:33:15.654 INFO:tasks.workunit.client.0.smithi082.stdout:5/284: dwrite d8/d14/f16 [0,4194304] 0 2024-04-27T07:33:15.655 INFO:tasks.workunit.client.0.smithi082.stdout:8/166: symlink d0/d2b/l33 0 2024-04-27T07:33:15.658 INFO:tasks.workunit.client.0.smithi082.stdout:6/216: dread d2/d3/f27 [0,4194304] 0 2024-04-27T07:33:15.659 INFO:tasks.workunit.client.0.smithi082.stdout:6/217: readlink d2/d3/d1b/l40 0 2024-04-27T07:33:15.660 INFO:tasks.workunit.client.0.smithi082.stdout:6/218: chown d2/d2d/d4a 1594884 1 2024-04-27T07:33:15.661 INFO:tasks.workunit.client.0.smithi082.stdout:5/285: rename d8/d3c/d47/d1f to d8/d3c/d64 0 2024-04-27T07:33:15.665 INFO:tasks.workunit.client.0.smithi082.stdout:6/219: creat d2/d3/d1b/f4b x:0 0 0 2024-04-27T07:33:15.666 INFO:tasks.workunit.client.0.smithi082.stdout:5/286: mkdir d8/d15/d65 0 2024-04-27T07:33:15.666 INFO:tasks.workunit.client.0.smithi082.stdout:5/287: readlink d8/l34 0 2024-04-27T07:33:15.666 INFO:tasks.workunit.client.0.smithi082.stdout:6/220: truncate d2/d3/d1b/f4b 323917 0 2024-04-27T07:33:15.671 INFO:tasks.workunit.client.0.smithi082.stdout:6/221: dread d2/d2e/f30 [0,4194304] 0 2024-04-27T07:33:15.673 INFO:tasks.workunit.client.0.smithi082.stdout:5/288: dwrite d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:15.674 INFO:tasks.workunit.client.0.smithi082.stdout:5/289: stat d8/d15/f58 0 2024-04-27T07:33:15.675 INFO:tasks.workunit.client.0.smithi082.stdout:6/222: symlink d2/l4c 0 2024-04-27T07:33:15.676 INFO:tasks.workunit.client.0.smithi082.stdout:5/290: mknod d8/d29/d4e/c66 0 2024-04-27T07:33:15.677 INFO:tasks.workunit.client.0.smithi082.stdout:6/223: readlink d2/d3/l12 0 2024-04-27T07:33:15.678 INFO:tasks.workunit.client.0.smithi082.stdout:5/291: chown d8/d29/d4e/c66 1553 1 2024-04-27T07:33:15.679 INFO:tasks.workunit.client.0.smithi082.stdout:8/167: dwrite d0/d3/f1d [0,4194304] 0 2024-04-27T07:33:15.680 INFO:tasks.workunit.client.0.smithi082.stdout:8/168: dread - d0/d3/d1b/d24/f27 zero size 2024-04-27T07:33:15.681 INFO:tasks.workunit.client.0.smithi082.stdout:5/292: symlink d8/d3c/d64/l67 0 2024-04-27T07:33:15.682 INFO:tasks.workunit.client.0.smithi082.stdout:5/293: chown d8/d29/d4e/f61 4171 1 2024-04-27T07:33:15.684 INFO:tasks.workunit.client.0.smithi082.stdout:8/169: write d0/d3/d1b/d24/f28 [3993566,108795] 0 2024-04-27T07:33:15.685 INFO:tasks.workunit.client.0.smithi082.stdout:6/224: rename d2/d2d/c2f to d2/d2d/c4d 0 2024-04-27T07:33:15.689 INFO:tasks.workunit.client.0.smithi082.stdout:6/225: write d2/f18 [961510,71680] 0 2024-04-27T07:33:15.690 INFO:tasks.workunit.client.0.smithi082.stdout:8/170: creat d0/d3/d1c/d32/f34 x:0 0 0 2024-04-27T07:33:15.693 INFO:tasks.workunit.client.0.smithi082.stdout:6/226: write d2/d3/d1b/f28 [55293,103937] 0 2024-04-27T07:33:15.694 INFO:tasks.workunit.client.0.smithi082.stdout:5/294: dwrite d8/d14/f21 [4194304,4194304] 0 2024-04-27T07:33:15.697 INFO:tasks.workunit.client.0.smithi082.stdout:5/295: truncate d8/d3c/d47/f2f 1645165 0 2024-04-27T07:33:15.697 INFO:tasks.workunit.client.0.smithi082.stdout:8/171: mkdir d0/d3/d1c/d32/d35 0 2024-04-27T07:33:15.698 INFO:tasks.workunit.client.0.smithi082.stdout:5/296: write d8/f3e [993154,15603] 0 2024-04-27T07:33:15.699 INFO:tasks.workunit.client.0.smithi082.stdout:5/297: fsync d8/d29/f35 0 2024-04-27T07:33:15.700 INFO:tasks.workunit.client.0.smithi082.stdout:6/227: creat d2/d1e/d32/f4e x:0 0 0 2024-04-27T07:33:15.701 INFO:tasks.workunit.client.0.smithi082.stdout:6/228: dread - d2/d1e/d32/f4e zero size 2024-04-27T07:33:15.703 INFO:tasks.workunit.client.0.smithi082.stdout:8/172: dread d0/fa [0,4194304] 0 2024-04-27T07:33:15.704 INFO:tasks.workunit.client.0.smithi082.stdout:5/298: creat d8/d29/f68 x:0 0 0 2024-04-27T07:33:15.706 INFO:tasks.workunit.client.0.smithi082.stdout:5/299: readlink d8/d15/l50 0 2024-04-27T07:33:15.707 INFO:tasks.workunit.client.0.smithi082.stdout:6/229: getdents d2/d2d/d4a 0 2024-04-27T07:33:15.712 INFO:tasks.workunit.client.0.smithi082.stdout:6/230: symlink d2/de/d13/l4f 0 2024-04-27T07:33:15.713 INFO:tasks.workunit.client.0.smithi082.stdout:5/300: dwrite d8/d14/f21 [4194304,4194304] 0 2024-04-27T07:33:15.714 INFO:tasks.workunit.client.0.smithi082.stdout:5/301: chown d8/d3c/d47 4941918 1 2024-04-27T07:33:15.715 INFO:tasks.workunit.client.0.smithi082.stdout:5/302: fsync d8/d15/f11 0 2024-04-27T07:33:15.718 INFO:tasks.workunit.client.0.smithi082.stdout:5/303: mknod d8/d3b/c69 0 2024-04-27T07:33:15.720 INFO:tasks.workunit.client.0.smithi082.stdout:6/231: truncate d2/d2e/f30 2579389 0 2024-04-27T07:33:15.721 INFO:tasks.workunit.client.0.smithi082.stdout:5/304: creat d8/d3c/d4a/f6a x:0 0 0 2024-04-27T07:33:15.723 INFO:tasks.workunit.client.0.smithi082.stdout:6/232: creat d2/d2d/d4a/f50 x:0 0 0 2024-04-27T07:33:15.723 INFO:tasks.workunit.client.0.smithi082.stdout:5/305: symlink d8/d15/d65/l6b 0 2024-04-27T07:33:15.724 INFO:tasks.workunit.client.0.smithi082.stdout:5/306: fsync d8/d15/f24 0 2024-04-27T07:33:15.725 INFO:tasks.workunit.client.0.smithi082.stdout:6/233: chown d2/d2e/l3c 18 1 2024-04-27T07:33:15.725 INFO:tasks.workunit.client.0.smithi082.stdout:5/307: fsync d8/d3c/d47/f5d 0 2024-04-27T07:33:15.726 INFO:tasks.workunit.client.0.smithi082.stdout:5/308: dread - d8/d29/d4e/f61 zero size 2024-04-27T07:33:15.726 INFO:tasks.workunit.client.0.smithi082.stdout:5/309: fdatasync f7 0 2024-04-27T07:33:15.727 INFO:tasks.workunit.client.0.smithi082.stdout:6/234: getdents d2/d1e 0 2024-04-27T07:33:15.727 INFO:tasks.workunit.client.0.smithi082.stdout:5/310: dread - d8/d15/d22/f53 zero size 2024-04-27T07:33:15.728 INFO:tasks.workunit.client.0.smithi082.stdout:6/235: chown d2/d3/d1b/f4b 1476689 1 2024-04-27T07:33:15.731 INFO:tasks.workunit.client.0.smithi082.stdout:6/236: creat d2/d2d/f51 x:0 0 0 2024-04-27T07:33:15.738 INFO:tasks.workunit.client.0.smithi082.stdout:6/237: dwrite d2/de/d13/f21 [0,4194304] 0 2024-04-27T07:33:15.770 INFO:tasks.workunit.client.0.smithi082.stdout:1/231: sync 2024-04-27T07:33:15.771 INFO:tasks.workunit.client.0.smithi082.stdout:1/232: chown d4/d15/d29 88057465 1 2024-04-27T07:33:15.774 INFO:tasks.workunit.client.0.smithi082.stdout:1/233: chown d4/d15/d1c/f2c 401 1 2024-04-27T07:33:15.776 INFO:tasks.workunit.client.0.smithi082.stdout:1/234: mknod d4/c52 0 2024-04-27T07:33:15.776 INFO:tasks.workunit.client.0.smithi082.stdout:5/311: write d8/d3c/d64/f36 [9255806,48085] 0 2024-04-27T07:33:15.782 INFO:tasks.workunit.client.0.smithi082.stdout:1/235: mkdir d4/d2a/d3e/d53 0 2024-04-27T07:33:15.784 INFO:tasks.workunit.client.0.smithi082.stdout:5/312: dwrite d8/fa [8388608,4194304] 0 2024-04-27T07:33:15.784 INFO:tasks.workunit.client.0.smithi082.stdout:1/236: rename f1 to d4/d2a/d3e/d53/f54 0 2024-04-27T07:33:15.785 INFO:tasks.workunit.client.0.smithi082.stdout:5/313: write d8/d14/f16 [3809799,62424] 0 2024-04-27T07:33:15.792 INFO:tasks.workunit.client.0.smithi082.stdout:6/238: dread d2/d2e/f30 [0,4194304] 0 2024-04-27T07:33:15.793 INFO:tasks.workunit.client.0.smithi082.stdout:5/314: dwrite d8/f45 [0,4194304] 0 2024-04-27T07:33:15.794 INFO:tasks.workunit.client.0.smithi082.stdout:6/239: chown d2/d1e/d32/f4e 618992 1 2024-04-27T07:33:15.797 INFO:tasks.workunit.client.0.smithi082.stdout:6/240: creat d2/d2d/d4a/f52 x:0 0 0 2024-04-27T07:33:15.800 INFO:tasks.workunit.client.0.smithi082.stdout:5/315: dread d8/f3e [0,4194304] 0 2024-04-27T07:33:15.802 INFO:tasks.workunit.client.0.smithi082.stdout:5/316: creat d8/d15/d22/f6c x:0 0 0 2024-04-27T07:33:15.804 INFO:tasks.workunit.client.0.smithi082.stdout:5/317: fdatasync d8/d29/f56 0 2024-04-27T07:33:15.806 INFO:tasks.workunit.client.0.smithi082.stdout:6/241: dwrite d2/d1e/d32/f4e [0,4194304] 0 2024-04-27T07:33:15.812 INFO:tasks.workunit.client.0.smithi082.stdout:5/318: link d8/d29/f56 d8/f6d 0 2024-04-27T07:33:15.812 INFO:tasks.workunit.client.0.smithi082.stdout:5/319: stat f5 0 2024-04-27T07:33:15.813 INFO:tasks.workunit.client.0.smithi082.stdout:5/320: creat d8/d29/f6e x:0 0 0 2024-04-27T07:33:15.813 INFO:tasks.workunit.client.0.smithi082.stdout:6/242: link d2/d1e/d32/l48 d2/d2d/d4a/l53 0 2024-04-27T07:33:15.815 INFO:tasks.workunit.client.0.smithi082.stdout:5/321: truncate d8/d29/f68 772285 0 2024-04-27T07:33:15.816 INFO:tasks.workunit.client.0.smithi082.stdout:5/322: chown d8/d15/d22/c38 24389 1 2024-04-27T07:33:15.819 INFO:tasks.workunit.client.0.smithi082.stdout:5/323: creat d8/d3c/f6f x:0 0 0 2024-04-27T07:33:15.820 INFO:tasks.workunit.client.0.smithi082.stdout:5/324: truncate d8/f6d 836351 0 2024-04-27T07:33:15.821 INFO:tasks.workunit.client.0.smithi082.stdout:5/325: creat d8/d3c/d5a/d5b/d5f/f70 x:0 0 0 2024-04-27T07:33:15.827 INFO:tasks.workunit.client.0.smithi082.stdout:5/326: write d8/f6d [1089650,44458] 0 2024-04-27T07:33:15.827 INFO:tasks.workunit.client.0.smithi082.stdout:5/327: readlink d8/l19 0 2024-04-27T07:33:15.830 INFO:tasks.workunit.client.0.smithi082.stdout:5/328: symlink d8/l71 0 2024-04-27T07:33:15.830 INFO:tasks.workunit.client.0.smithi082.stdout:6/243: dwrite d2/de/d13/f33 [0,4194304] 0 2024-04-27T07:33:15.832 INFO:tasks.workunit.client.0.smithi082.stdout:6/244: symlink d2/d1e/l54 0 2024-04-27T07:33:15.835 INFO:tasks.workunit.client.0.smithi082.stdout:6/245: write d2/d1e/d32/f35 [39263,52801] 0 2024-04-27T07:33:15.836 INFO:tasks.workunit.client.0.smithi082.stdout:5/329: rename d8/f6d to d8/d15/d22/f72 0 2024-04-27T07:33:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:15 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:15 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:15.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:15 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:15.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:15 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:15.980 INFO:tasks.workunit.client.0.smithi082.stdout:4/231: sync 2024-04-27T07:33:15.982 INFO:tasks.workunit.client.0.smithi082.stdout:4/232: unlink d3/f14 0 2024-04-27T07:33:15.986 INFO:tasks.workunit.client.0.smithi082.stdout:4/233: mknod d3/d10/d1f/d21/c50 0 2024-04-27T07:33:15.990 INFO:tasks.workunit.client.0.smithi082.stdout:4/234: write d3/d6/d16/f3f [5216478,18096] 0 2024-04-27T07:33:15.991 INFO:tasks.workunit.client.0.smithi082.stdout:4/235: dread - d3/d6/d26/f49 zero size 2024-04-27T07:33:16.085 INFO:tasks.workunit.client.0.smithi082.stdout:2/215: sync 2024-04-27T07:33:16.094 INFO:tasks.workunit.client.0.smithi082.stdout:2/216: dread d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:16.094 INFO:tasks.workunit.client.0.smithi082.stdout:2/217: readlink d7/d30/d23/l2c 0 2024-04-27T07:33:16.096 INFO:tasks.workunit.client.0.smithi082.stdout:2/218: truncate d7/d8/f19 958270 0 2024-04-27T07:33:16.098 INFO:tasks.workunit.client.0.smithi082.stdout:2/219: mkdir d7/d14/d44 0 2024-04-27T07:33:16.098 INFO:tasks.workunit.client.0.smithi082.stdout:2/220: stat d7/l20 0 2024-04-27T07:33:16.098 INFO:tasks.workunit.client.0.smithi082.stdout:2/221: fdatasync d7/f28 0 2024-04-27T07:33:16.104 INFO:tasks.workunit.client.0.smithi082.stdout:2/222: dwrite d7/d14/f3d [0,4194304] 0 2024-04-27T07:33:16.107 INFO:tasks.workunit.client.0.smithi082.stdout:2/223: mknod d7/c45 0 2024-04-27T07:33:16.112 INFO:tasks.workunit.client.0.smithi082.stdout:2/224: link d7/d8/l32 d7/l46 0 2024-04-27T07:33:16.115 INFO:tasks.workunit.client.0.smithi082.stdout:2/225: rename d7/d9/c42 to d7/d30/c47 0 2024-04-27T07:33:16.115 INFO:tasks.workunit.client.0.smithi082.stdout:2/226: read - d7/f39 zero size 2024-04-27T07:33:16.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/227: dread - d7/d8/d13/f3b zero size 2024-04-27T07:33:16.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/228: chown d7/d9/c11 908060647 1 2024-04-27T07:33:16.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/229: chown d7/d9/c12 350748 1 2024-04-27T07:33:16.117 INFO:tasks.workunit.client.0.smithi082.stdout:2/230: dread - d7/f39 zero size 2024-04-27T07:33:16.120 INFO:tasks.workunit.client.0.smithi082.stdout:2/231: rename d7/l41 to d7/d30/l48 0 2024-04-27T07:33:16.120 INFO:tasks.workunit.client.0.smithi082.stdout:2/232: truncate d7/d9/f1d 5285058 0 2024-04-27T07:33:16.123 INFO:tasks.workunit.client.0.smithi082.stdout:2/233: rename d7/d8/d13/f3b to d7/d30/d23/f49 0 2024-04-27T07:33:16.127 INFO:tasks.workunit.client.0.smithi082.stdout:2/234: link d7/l10 d7/d8/l4a 0 2024-04-27T07:33:16.127 INFO:tasks.workunit.client.0.smithi082.stdout:4/236: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:5/330: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:6/246: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:8/173: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:1/237: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:0/310: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:9/228: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:7/246: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:3/406: sync 2024-04-27T07:33:16.128 INFO:tasks.workunit.client.0.smithi082.stdout:2/235: fdatasync d7/d31/f34 0 2024-04-27T07:33:16.129 INFO:tasks.workunit.client.0.smithi082.stdout:7/247: stat d3/c1a 0 2024-04-27T07:33:16.130 INFO:tasks.workunit.client.0.smithi082.stdout:1/238: write d4/f22 [919697,75890] 0 2024-04-27T07:33:16.131 INFO:tasks.workunit.client.0.smithi082.stdout:4/237: write d3/d10/f4f [197620,43702] 0 2024-04-27T07:33:16.131 INFO:tasks.workunit.client.0.smithi082.stdout:5/331: write d8/d29/f35 [1534202,120865] 0 2024-04-27T07:33:16.132 INFO:tasks.workunit.client.0.smithi082.stdout:9/229: chown d9/d2d/l2c 55927789 1 2024-04-27T07:33:16.136 INFO:tasks.workunit.client.0.smithi082.stdout:5/332: write d8/d14/f16 [1943318,23541] 0 2024-04-27T07:33:16.136 INFO:tasks.workunit.client.0.smithi082.stdout:1/239: chown d4/f16 35 1 2024-04-27T07:33:16.136 INFO:tasks.workunit.client.0.smithi082.stdout:9/230: write d9/d2d/f23 [2227718,119610] 0 2024-04-27T07:33:16.138 INFO:tasks.workunit.client.0.smithi082.stdout:1/240: readlink d4/d15/l2e 0 2024-04-27T07:33:16.139 INFO:tasks.workunit.client.0.smithi082.stdout:0/311: creat da/d3c/d3f/d4c/d74/f79 x:0 0 0 2024-04-27T07:33:16.139 INFO:tasks.workunit.client.0.smithi082.stdout:2/236: creat d7/d8/d13/f4b x:0 0 0 2024-04-27T07:33:16.141 INFO:tasks.workunit.client.0.smithi082.stdout:6/247: getdents d2/d2d 0 2024-04-27T07:33:16.141 INFO:tasks.workunit.client.0.smithi082.stdout:1/241: truncate d4/f35 1030489 0 2024-04-27T07:33:16.143 INFO:tasks.workunit.client.0.smithi082.stdout:8/174: dread d0/d3/d1b/f25 [4194304,4194304] 0 2024-04-27T07:33:16.144 INFO:tasks.workunit.client.0.smithi082.stdout:7/248: mknod d3/de/d3a/c4c 0 2024-04-27T07:33:16.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/333: mknod d8/d3c/d5a/c73 0 2024-04-27T07:33:16.148 INFO:tasks.workunit.client.0.smithi082.stdout:0/312: dwrite da/d2a/d34/f4f [0,4194304] 0 2024-04-27T07:33:16.149 INFO:tasks.workunit.client.0.smithi082.stdout:3/407: link d8/d9/dd/f1a d8/d9/d25/d26/d4d/f9a 0 2024-04-27T07:33:16.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/175: dwrite d0/d3/d1b/d24/f27 [0,4194304] 0 2024-04-27T07:33:16.157 INFO:tasks.workunit.client.0.smithi082.stdout:8/176: dread - d0/d3/d1c/d32/f34 zero size 2024-04-27T07:33:16.160 INFO:tasks.workunit.client.0.smithi082.stdout:4/238: creat d3/d6/f51 x:0 0 0 2024-04-27T07:33:16.165 INFO:tasks.workunit.client.0.smithi082.stdout:0/313: creat da/d1d/d6a/f7a x:0 0 0 2024-04-27T07:33:16.167 INFO:tasks.workunit.client.0.smithi082.stdout:7/249: symlink d3/de/l4d 0 2024-04-27T07:33:16.167 INFO:tasks.workunit.client.0.smithi082.stdout:8/177: dwrite d0/d3/d1c/d32/f34 [0,4194304] 0 2024-04-27T07:33:16.170 INFO:tasks.workunit.client.0.smithi082.stdout:1/242: dread d4/d15/d1c/f2c [0,4194304] 0 2024-04-27T07:33:16.171 INFO:tasks.workunit.client.0.smithi082.stdout:1/243: fsync d4/f11 0 2024-04-27T07:33:16.172 INFO:tasks.workunit.client.0.smithi082.stdout:9/231: truncate d9/d2d/f23 1478049 0 2024-04-27T07:33:16.173 INFO:tasks.workunit.client.0.smithi082.stdout:1/244: chown d4/d2a/d3e/d53 11 1 2024-04-27T07:33:16.175 INFO:tasks.workunit.client.0.smithi082.stdout:0/314: creat da/d28/d36/f7b x:0 0 0 2024-04-27T07:33:16.176 INFO:tasks.workunit.client.0.smithi082.stdout:3/408: write d8/d9/dd/d13/d1b/f28 [1656435,20266] 0 2024-04-27T07:33:16.176 INFO:tasks.workunit.client.0.smithi082.stdout:2/237: getdents d7/d8/d13 0 2024-04-27T07:33:16.177 INFO:tasks.workunit.client.0.smithi082.stdout:1/245: truncate d4/d15/d29/f4d 648317 0 2024-04-27T07:33:16.178 INFO:tasks.workunit.client.0.smithi082.stdout:6/248: truncate d2/d1e/f22 3843701 0 2024-04-27T07:33:16.180 INFO:tasks.workunit.client.0.smithi082.stdout:6/249: write d2/de/d13/f21 [2594266,8232] 0 2024-04-27T07:33:16.183 INFO:tasks.workunit.client.0.smithi082.stdout:2/238: symlink d7/d14/l4c 0 2024-04-27T07:33:16.185 INFO:tasks.workunit.client.0.smithi082.stdout:3/409: mknod d8/d9/d25/d66/c9b 0 2024-04-27T07:33:16.190 INFO:tasks.workunit.client.0.smithi082.stdout:1/246: rename d4/d15/d1c/f25 to d4/d2a/d3e/f55 0 2024-04-27T07:33:16.190 INFO:tasks.workunit.client.0.smithi082.stdout:7/250: dwrite d3/db/ff [0,4194304] 0 2024-04-27T07:33:16.190 INFO:tasks.workunit.client.0.smithi082.stdout:2/239: write d7/d8/d13/f2b [241655,130714] 0 2024-04-27T07:33:16.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/178: link d0/d3/f26 d0/d3/d1b/d24/f36 0 2024-04-27T07:33:16.191 INFO:tasks.workunit.client.0.smithi082.stdout:6/250: mkdir d2/d2e/d55 0 2024-04-27T07:33:16.192 INFO:tasks.workunit.client.0.smithi082.stdout:9/232: chown d9/d2d/f23 51489 1 2024-04-27T07:33:16.193 INFO:tasks.workunit.client.0.smithi082.stdout:9/233: write f4 [2650471,113381] 0 2024-04-27T07:33:16.195 INFO:tasks.workunit.client.0.smithi082.stdout:9/234: readlink d9/da/dc/d35/d38/l3c 0 2024-04-27T07:33:16.195 INFO:tasks.workunit.client.0.smithi082.stdout:3/410: dread - d8/d9/d25/d66/d6d/f44 zero size 2024-04-27T07:33:16.196 INFO:tasks.workunit.client.0.smithi082.stdout:4/239: dread d3/d10/f15 [4194304,4194304] 0 2024-04-27T07:33:16.199 INFO:tasks.workunit.client.0.smithi082.stdout:4/240: chown d3/d6/f19 54983523 1 2024-04-27T07:33:16.200 INFO:tasks.workunit.client.0.smithi082.stdout:7/251: rmdir d3/de 39 2024-04-27T07:33:16.202 INFO:tasks.workunit.client.0.smithi082.stdout:2/240: rmdir d7 39 2024-04-27T07:33:16.205 INFO:tasks.workunit.client.0.smithi082.stdout:3/411: dread d8/f5e [0,4194304] 0 2024-04-27T07:33:16.205 INFO:tasks.workunit.client.0.smithi082.stdout:6/251: unlink d2/de/d13/l41 0 2024-04-27T07:33:16.206 INFO:tasks.workunit.client.0.smithi082.stdout:6/252: stat d2/d3/d1b/f28 0 2024-04-27T07:33:16.208 INFO:tasks.workunit.client.0.smithi082.stdout:9/235: creat d9/da/dc/d35/d38/f49 x:0 0 0 2024-04-27T07:33:16.210 INFO:tasks.workunit.client.0.smithi082.stdout:4/241: symlink d3/d6/d22/l52 0 2024-04-27T07:33:16.212 INFO:tasks.workunit.client.0.smithi082.stdout:7/252: read - d3/de/f3b zero size 2024-04-27T07:33:16.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/253: dwrite d2/d45/f42 [4194304,4194304] 0 2024-04-27T07:33:16.213 INFO:tasks.workunit.client.0.smithi082.stdout:2/241: fsync d7/f28 0 2024-04-27T07:33:16.215 INFO:tasks.workunit.client.0.smithi082.stdout:8/179: mknod d0/d3/d1b/d29/c37 0 2024-04-27T07:33:16.217 INFO:tasks.workunit.client.0.smithi082.stdout:4/242: mknod d3/d6/d22/c53 0 2024-04-27T07:33:16.220 INFO:tasks.workunit.client.0.smithi082.stdout:2/242: mknod d7/d14/c4d 0 2024-04-27T07:33:16.220 INFO:tasks.workunit.client.0.smithi082.stdout:1/247: link d4/l6 d4/d15/d49/d4e/l56 0 2024-04-27T07:33:16.222 INFO:tasks.workunit.client.0.smithi082.stdout:8/180: creat d0/d2b/f38 x:0 0 0 2024-04-27T07:33:16.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/243: rmdir d3/d6/d16 39 2024-04-27T07:33:16.227 INFO:tasks.workunit.client.0.smithi082.stdout:8/181: dread d0/d3/f1d [0,4194304] 0 2024-04-27T07:33:16.229 INFO:tasks.workunit.client.0.smithi082.stdout:2/243: creat d7/d9/f4e x:0 0 0 2024-04-27T07:33:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:1/248: mkdir d4/d2a/d3e/d57 0 2024-04-27T07:33:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:1/249: stat d4/d15/d3f/c4b 0 2024-04-27T07:33:16.237 INFO:tasks.workunit.client.0.smithi082.stdout:8/182: rmdir d0/d3/d1c 39 2024-04-27T07:33:16.237 INFO:tasks.workunit.client.0.smithi082.stdout:8/183: dread - d0/d3/d1b/f2e zero size 2024-04-27T07:33:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:3/412: link d8/d9/dd/l71 d8/d9/d25/l9c 0 2024-04-27T07:33:16.241 INFO:tasks.workunit.client.0.smithi082.stdout:9/236: getdents d9/da/dc/d33/d3d 0 2024-04-27T07:33:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:7/253: truncate d3/db/ff 341304 0 2024-04-27T07:33:16.244 INFO:tasks.workunit.client.0.smithi082.stdout:9/237: fsync d9/da/dc/d33/f47 0 2024-04-27T07:33:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:6/254: dwrite d2/d2e/f3b [0,4194304] 0 2024-04-27T07:33:16.247 INFO:tasks.workunit.client.0.smithi082.stdout:1/250: symlink d4/d15/l58 0 2024-04-27T07:33:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:8/184: chown d0/l10 549320 1 2024-04-27T07:33:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:7/254: chown d3/de/l12 10 1 2024-04-27T07:33:16.250 INFO:tasks.workunit.client.0.smithi082.stdout:4/244: write d3/d9/f1d [1680962,119376] 0 2024-04-27T07:33:16.251 INFO:tasks.workunit.client.0.smithi082.stdout:1/251: write d4/d15/d29/f33 [332449,16741] 0 2024-04-27T07:33:16.253 INFO:tasks.workunit.client.0.smithi082.stdout:2/244: rmdir d7/d14/d44 0 2024-04-27T07:33:16.253 INFO:tasks.workunit.client.0.smithi082.stdout:3/413: dwrite d8/d9/dd/d13/f48 [0,4194304] 0 2024-04-27T07:33:16.254 INFO:tasks.workunit.client.0.smithi082.stdout:9/238: mkdir d9/da/dc/d35/d4a 0 2024-04-27T07:33:16.254 INFO:tasks.workunit.client.0.smithi082.stdout:6/255: read d2/d1e/d32/f35 [27292,71148] 0 2024-04-27T07:33:16.255 INFO:tasks.workunit.client.0.smithi082.stdout:2/245: write d7/f28 [89007,55206] 0 2024-04-27T07:33:16.256 INFO:tasks.workunit.client.0.smithi082.stdout:3/414: readlink d8/d9/d25/d66/l84 0 2024-04-27T07:33:16.261 INFO:tasks.workunit.client.0.smithi082.stdout:9/239: read - d9/da/dc/f3e zero size 2024-04-27T07:33:16.264 INFO:tasks.workunit.client.0.smithi082.stdout:8/185: rename d0/fa to d0/d3/d1b/d24/f39 0 2024-04-27T07:33:16.266 INFO:tasks.workunit.client.0.smithi082.stdout:1/252: dwrite d4/d2a/d3e/f40 [0,4194304] 0 2024-04-27T07:33:16.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/256: creat d2/d2d/d3d/f56 x:0 0 0 2024-04-27T07:33:16.275 INFO:tasks.workunit.client.0.smithi082.stdout:2/246: unlink d7/c45 0 2024-04-27T07:33:16.277 INFO:tasks.workunit.client.0.smithi082.stdout:2/247: write d7/d8/d13/f2b [1976912,42652] 0 2024-04-27T07:33:16.279 INFO:tasks.workunit.client.0.smithi082.stdout:9/240: mkdir d9/da/dc/d35/d4b 0 2024-04-27T07:33:16.281 INFO:tasks.workunit.client.0.smithi082.stdout:4/245: write d3/f29 [258448,64062] 0 2024-04-27T07:33:16.283 INFO:tasks.workunit.client.0.smithi082.stdout:4/246: truncate d3/d6/f3e 1293011 0 2024-04-27T07:33:16.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/247: readlink d3/d6/d22/l52 0 2024-04-27T07:33:16.285 INFO:tasks.workunit.client.0.smithi082.stdout:4/248: write d3/d10/f3a [823648,110877] 0 2024-04-27T07:33:16.286 INFO:tasks.workunit.client.0.smithi082.stdout:4/249: chown d3/d10/f3a 7 1 2024-04-27T07:33:16.290 INFO:tasks.workunit.client.0.smithi082.stdout:9/241: unlink f3 0 2024-04-27T07:33:16.294 INFO:tasks.workunit.client.0.smithi082.stdout:7/255: dread d3/f6 [0,4194304] 0 2024-04-27T07:33:16.295 INFO:tasks.workunit.client.0.smithi082.stdout:9/242: creat d9/f4c x:0 0 0 2024-04-27T07:33:16.296 INFO:tasks.workunit.client.0.smithi082.stdout:8/186: mknod d0/d3/d1c/d32/d35/c3a 0 2024-04-27T07:33:16.296 INFO:tasks.workunit.client.0.smithi082.stdout:3/415: dread d8/f74 [0,4194304] 0 2024-04-27T07:33:16.297 INFO:tasks.workunit.client.0.smithi082.stdout:2/248: dwrite d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:16.298 INFO:tasks.workunit.client.0.smithi082.stdout:1/253: rename d4/d15/d3f/l44 to d4/d15/l59 0 2024-04-27T07:33:16.300 INFO:tasks.workunit.client.0.smithi082.stdout:7/256: mknod d3/d49/c4e 0 2024-04-27T07:33:16.300 INFO:tasks.workunit.client.0.smithi082.stdout:3/416: chown d8/d9/d1f/l5c 73839 1 2024-04-27T07:33:16.300 INFO:tasks.workunit.client.0.smithi082.stdout:9/243: truncate d9/da/dc/f3e 58226 0 2024-04-27T07:33:16.303 INFO:tasks.workunit.client.0.smithi082.stdout:8/187: mknod d0/c3b 0 2024-04-27T07:33:16.305 INFO:tasks.workunit.client.0.smithi082.stdout:7/257: rmdir d3/de 39 2024-04-27T07:33:16.308 INFO:tasks.workunit.client.0.smithi082.stdout:3/417: mknod d8/d9/d25/d66/c9d 0 2024-04-27T07:33:16.309 INFO:tasks.workunit.client.0.smithi082.stdout:3/418: dread - d8/d9/d1f/f94 zero size 2024-04-27T07:33:16.309 INFO:tasks.workunit.client.0.smithi082.stdout:1/254: creat d4/d15/d49/d4e/f5a x:0 0 0 2024-04-27T07:33:16.310 INFO:tasks.workunit.client.0.smithi082.stdout:6/257: truncate d2/de/d13/f33 477483 0 2024-04-27T07:33:16.312 INFO:tasks.workunit.client.0.smithi082.stdout:9/244: mknod d9/da/dc/c4d 0 2024-04-27T07:33:16.312 INFO:tasks.workunit.client.0.smithi082.stdout:7/258: dread - d3/de/f3d zero size 2024-04-27T07:33:16.314 INFO:tasks.workunit.client.0.smithi082.stdout:4/250: rename d3/d10/d1f/d21/c50 to d3/d10/c54 0 2024-04-27T07:33:16.314 INFO:tasks.workunit.client.0.smithi082.stdout:7/259: fdatasync d3/de/d3a/d2a/f30 0 2024-04-27T07:33:16.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/255: mknod d4/d15/d1c/c5b 0 2024-04-27T07:33:16.316 INFO:tasks.workunit.client.0.smithi082.stdout:7/260: write d3/de/f2f [622604,80124] 0 2024-04-27T07:33:16.316 INFO:tasks.workunit.client.0.smithi082.stdout:3/419: chown d8/d9/dd/l71 319737 1 2024-04-27T07:33:16.317 INFO:tasks.workunit.client.0.smithi082.stdout:6/258: fsync d2/de/f24 0 2024-04-27T07:33:16.319 INFO:tasks.workunit.client.0.smithi082.stdout:2/249: getdents d7/d8 0 2024-04-27T07:33:16.320 INFO:tasks.workunit.client.0.smithi082.stdout:9/245: rename d9/da/c13 to d9/d48/c4e 0 2024-04-27T07:33:16.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/246: chown d9/d2d/d2b 127361335 1 2024-04-27T07:33:16.322 INFO:tasks.workunit.client.0.smithi082.stdout:4/251: mkdir d3/d6/d26/d55 0 2024-04-27T07:33:16.325 INFO:tasks.workunit.client.0.smithi082.stdout:3/420: symlink d8/d9/d25/d91/l9e 0 2024-04-27T07:33:16.328 INFO:tasks.workunit.client.0.smithi082.stdout:8/188: write d0/d3/f9 [3898375,49256] 0 2024-04-27T07:33:16.328 INFO:tasks.workunit.client.0.smithi082.stdout:6/259: symlink d2/d1e/d32/l57 0 2024-04-27T07:33:16.337 INFO:tasks.workunit.client.0.smithi082.stdout:3/421: mkdir d8/d9/d25/d26/d4d/d9f 0 2024-04-27T07:33:16.338 INFO:tasks.workunit.client.0.smithi082.stdout:5/334: sync 2024-04-27T07:33:16.339 INFO:tasks.workunit.client.0.smithi082.stdout:7/261: dwrite d3/f6 [4194304,4194304] 0 2024-04-27T07:33:16.341 INFO:tasks.workunit.client.0.smithi082.stdout:9/247: dwrite d9/da/f26 [0,4194304] 0 2024-04-27T07:33:16.342 INFO:tasks.workunit.client.0.smithi082.stdout:8/189: read d0/d3/f1d [186637,37271] 0 2024-04-27T07:33:16.345 INFO:tasks.workunit.client.0.smithi082.stdout:4/252: dwrite d3/d10/f3d [0,4194304] 0 2024-04-27T07:33:16.348 INFO:tasks.workunit.client.0.smithi082.stdout:1/256: truncate d4/f1d 3536222 0 2024-04-27T07:33:16.349 INFO:tasks.workunit.client.0.smithi082.stdout:7/262: mkdir d3/d9/d4f 0 2024-04-27T07:33:16.355 INFO:tasks.workunit.client.0.smithi082.stdout:9/248: write d9/da/dc/d35/d38/f49 [125586,7306] 0 2024-04-27T07:33:16.355 INFO:tasks.workunit.client.0.smithi082.stdout:5/335: truncate d8/d29/f56 2148487 0 2024-04-27T07:33:16.355 INFO:tasks.workunit.client.0.smithi082.stdout:2/250: dwrite d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:16.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/422: mkdir d8/d9/d25/d26/d4d/d82/d8b/da0 0 2024-04-27T07:33:16.358 INFO:tasks.workunit.client.0.smithi082.stdout:2/251: read - d7/d31/f34 zero size 2024-04-27T07:33:16.359 INFO:tasks.workunit.client.0.smithi082.stdout:7/263: symlink d3/de/d3a/d2a/l50 0 2024-04-27T07:33:16.361 INFO:tasks.workunit.client.0.smithi082.stdout:8/190: dread d0/d3/f26 [0,4194304] 0 2024-04-27T07:33:16.363 INFO:tasks.workunit.client.0.smithi082.stdout:1/257: rename d4/d15/d3f/c51 to d4/d2a/d39/c5c 0 2024-04-27T07:33:16.363 INFO:tasks.workunit.client.0.smithi082.stdout:6/260: dwrite d2/f18 [0,4194304] 0 2024-04-27T07:33:16.364 INFO:tasks.workunit.client.0.smithi082.stdout:7/264: chown d3/f1f 46 1 2024-04-27T07:33:16.365 INFO:tasks.workunit.client.0.smithi082.stdout:2/252: mkdir d7/d9/d4f 0 2024-04-27T07:33:16.365 INFO:tasks.workunit.client.0.smithi082.stdout:8/191: chown d0/d3/d1b/d24/f36 7 1 2024-04-27T07:33:16.366 INFO:tasks.workunit.client.0.smithi082.stdout:3/423: creat d8/d9/d1d/fa1 x:0 0 0 2024-04-27T07:33:16.370 INFO:tasks.workunit.client.0.smithi082.stdout:9/249: symlink d9/da/dc/d33/l4f 0 2024-04-27T07:33:16.371 INFO:tasks.workunit.client.0.smithi082.stdout:9/250: chown d9/c22 7 1 2024-04-27T07:33:16.372 INFO:tasks.workunit.client.0.smithi082.stdout:1/258: unlink d4/d15/d1c/c21 0 2024-04-27T07:33:16.373 INFO:tasks.workunit.client.0.smithi082.stdout:1/259: fsync d4/d15/f37 0 2024-04-27T07:33:16.374 INFO:tasks.workunit.client.0.smithi082.stdout:1/260: stat d4/d15/l58 0 2024-04-27T07:33:16.374 INFO:tasks.workunit.client.0.smithi082.stdout:7/265: creat d3/d49/f51 x:0 0 0 2024-04-27T07:33:16.374 INFO:tasks.workunit.client.0.smithi082.stdout:1/261: dread - d4/f34 zero size 2024-04-27T07:33:16.381 INFO:tasks.workunit.client.0.smithi082.stdout:8/192: rename d0/d3/d1b/d24/f27 to d0/d3/d1b/f3c 0 2024-04-27T07:33:16.383 INFO:tasks.workunit.client.0.smithi082.stdout:1/262: symlink d4/d15/d49/l5d 0 2024-04-27T07:33:16.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/315: sync 2024-04-27T07:33:16.385 INFO:tasks.workunit.client.0.smithi082.stdout:3/424: dwrite d8/d9/d3f/f8a [0,4194304] 0 2024-04-27T07:33:16.387 INFO:tasks.workunit.client.0.smithi082.stdout:9/251: mkdir d9/da/dc/d35/d4a/d50 0 2024-04-27T07:33:16.388 INFO:tasks.workunit.client.0.smithi082.stdout:1/263: write d4/d15/f37 [117402,22886] 0 2024-04-27T07:33:16.390 INFO:tasks.workunit.client.0.smithi082.stdout:4/253: dread d3/d6/d26/f33 [0,4194304] 0 2024-04-27T07:33:16.392 INFO:tasks.workunit.client.0.smithi082.stdout:4/254: write d3/d10/f15 [443757,61081] 0 2024-04-27T07:33:16.394 INFO:tasks.workunit.client.0.smithi082.stdout:4/255: fdatasync d3/d6/f19 0 2024-04-27T07:33:16.394 INFO:tasks.workunit.client.0.smithi082.stdout:0/316: mknod da/d3c/d3f/d57/c7c 0 2024-04-27T07:33:16.395 INFO:tasks.workunit.client.0.smithi082.stdout:2/253: rmdir d7 39 2024-04-27T07:33:16.396 INFO:tasks.workunit.client.0.smithi082.stdout:5/336: getdents d8/d42 0 2024-04-27T07:33:16.397 INFO:tasks.workunit.client.0.smithi082.stdout:4/256: truncate d3/d9/f44 76052 0 2024-04-27T07:33:16.398 INFO:tasks.workunit.client.0.smithi082.stdout:7/266: creat d3/de/d3a/f52 x:0 0 0 2024-04-27T07:33:16.400 INFO:tasks.workunit.client.0.smithi082.stdout:9/252: creat d9/f51 x:0 0 0 2024-04-27T07:33:16.401 INFO:tasks.workunit.client.0.smithi082.stdout:3/425: symlink d8/d9/dd/d13/la2 0 2024-04-27T07:33:16.484 INFO:tasks.workunit.client.0.smithi082.stdout:1/264: creat d4/d15/d49/d4e/f5e x:0 0 0 2024-04-27T07:33:16.486 INFO:tasks.workunit.client.0.smithi082.stdout:6/261: truncate d2/de/d13/f16 165487 0 2024-04-27T07:33:16.487 INFO:tasks.workunit.client.0.smithi082.stdout:0/317: dwrite da/d1d/f20 [4194304,4194304] 0 2024-04-27T07:33:16.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/262: dread - d2/d2d/d4a/f50 zero size 2024-04-27T07:33:16.491 INFO:tasks.workunit.client.0.smithi082.stdout:7/267: dread d3/db/f18 [0,4194304] 0 2024-04-27T07:33:16.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/318: write da/d1d/d6a/f7a [55845,116668] 0 2024-04-27T07:33:16.493 INFO:tasks.workunit.client.0.smithi082.stdout:3/426: write d8/d9/d1f/f46 [2144057,54853] 0 2024-04-27T07:33:16.494 INFO:tasks.workunit.client.0.smithi082.stdout:8/193: dwrite d0/d3/f26 [4194304,4194304] 0 2024-04-27T07:33:16.494 INFO:tasks.workunit.client.0.smithi082.stdout:4/257: mknod d3/d6/d16/c56 0 2024-04-27T07:33:16.495 INFO:tasks.workunit.client.0.smithi082.stdout:2/254: creat d7/d14/f50 x:0 0 0 2024-04-27T07:33:16.497 INFO:tasks.workunit.client.0.smithi082.stdout:2/255: chown d7/d31/l40 23990 1 2024-04-27T07:33:16.497 INFO:tasks.workunit.client.0.smithi082.stdout:3/427: read d8/d9/d25/d26/d3d/f51 [252708,100403] 0 2024-04-27T07:33:16.499 INFO:tasks.workunit.client.0.smithi082.stdout:6/263: rename d2/d45/c47 to d2/d3/d1b/c58 0 2024-04-27T07:33:16.499 INFO:tasks.workunit.client.0.smithi082.stdout:8/194: write d0/d3/d1c/d32/f34 [2062416,65513] 0 2024-04-27T07:33:16.500 INFO:tasks.workunit.client.0.smithi082.stdout:1/265: symlink d4/d2a/d4c/l5f 0 2024-04-27T07:33:16.502 INFO:tasks.workunit.client.0.smithi082.stdout:9/253: write d9/d2d/f23 [1463661,1814] 0 2024-04-27T07:33:16.503 INFO:tasks.workunit.client.0.smithi082.stdout:2/256: rmdir d7/d30/d23 39 2024-04-27T07:33:16.503 INFO:tasks.workunit.client.0.smithi082.stdout:2/257: dread - d7/d31/f34 zero size 2024-04-27T07:33:16.504 INFO:tasks.workunit.client.0.smithi082.stdout:0/319: mknod da/d28/c7d 0 2024-04-27T07:33:16.506 INFO:tasks.workunit.client.0.smithi082.stdout:6/264: symlink d2/d45/l59 0 2024-04-27T07:33:16.506 INFO:tasks.workunit.client.0.smithi082.stdout:3/428: write d8/d9/d25/d91/f56 [2003746,69396] 0 2024-04-27T07:33:16.507 INFO:tasks.workunit.client.0.smithi082.stdout:4/258: symlink d3/d6/l57 0 2024-04-27T07:33:16.508 INFO:tasks.workunit.client.0.smithi082.stdout:1/266: write d4/f3a [631736,67625] 0 2024-04-27T07:33:16.508 INFO:tasks.workunit.client.0.smithi082.stdout:8/195: mkdir d0/d3/d1c/d32/d3d 0 2024-04-27T07:33:16.510 INFO:tasks.workunit.client.0.smithi082.stdout:7/268: creat d3/f53 x:0 0 0 2024-04-27T07:33:16.510 INFO:tasks.workunit.client.0.smithi082.stdout:1/267: chown d4/d15/f2b 8072968 1 2024-04-27T07:33:16.512 INFO:tasks.workunit.client.0.smithi082.stdout:9/254: truncate d9/d2d/f19 3622902 0 2024-04-27T07:33:16.513 INFO:tasks.workunit.client.0.smithi082.stdout:9/255: chown d9/f4c 12 1 2024-04-27T07:33:16.514 INFO:tasks.workunit.client.0.smithi082.stdout:0/320: rename da/d1d/f35 to da/d3c/d3f/d57/f7e 0 2024-04-27T07:33:16.515 INFO:tasks.workunit.client.0.smithi082.stdout:9/256: readlink d9/da/l1c 0 2024-04-27T07:33:16.518 INFO:tasks.workunit.client.0.smithi082.stdout:9/257: stat d9/d2d/f23 0 2024-04-27T07:33:16.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/429: fsync d8/d9/d25/d66/d6d/f44 0 2024-04-27T07:33:16.520 INFO:tasks.workunit.client.0.smithi082.stdout:8/196: dwrite d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:16.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/265: fsync d2/d1e/f22 0 2024-04-27T07:33:16.523 INFO:tasks.workunit.client.0.smithi082.stdout:2/258: creat d7/f51 x:0 0 0 2024-04-27T07:33:16.525 INFO:tasks.workunit.client.0.smithi082.stdout:1/268: dwrite d4/d2a/d3e/d46/f48 [0,4194304] 0 2024-04-27T07:33:16.527 INFO:tasks.workunit.client.0.smithi082.stdout:8/197: write d0/d3/d1b/f1e [1597509,100838] 0 2024-04-27T07:33:16.532 INFO:tasks.workunit.client.0.smithi082.stdout:4/259: creat d3/d6/f58 x:0 0 0 2024-04-27T07:33:16.533 INFO:tasks.workunit.client.0.smithi082.stdout:0/321: dwrite da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:16.537 INFO:tasks.workunit.client.0.smithi082.stdout:8/198: dread d0/d3/d1b/d24/f36 [4194304,4194304] 0 2024-04-27T07:33:16.539 INFO:tasks.workunit.client.0.smithi082.stdout:8/199: write d0/f13 [4189385,100913] 0 2024-04-27T07:33:16.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/269: symlink d4/d15/d49/d4e/l60 0 2024-04-27T07:33:16.543 INFO:tasks.workunit.client.0.smithi082.stdout:6/266: write d2/d1e/f22 [4385274,128421] 0 2024-04-27T07:33:16.545 INFO:tasks.workunit.client.0.smithi082.stdout:9/258: mknod d9/da/dc/d35/d42/c52 0 2024-04-27T07:33:16.545 INFO:tasks.workunit.client.0.smithi082.stdout:3/430: mkdir d8/d9/dd/da3 0 2024-04-27T07:33:16.545 INFO:tasks.workunit.client.0.smithi082.stdout:8/200: stat d0/d3/f18 0 2024-04-27T07:33:16.546 INFO:tasks.workunit.client.0.smithi082.stdout:0/322: rename da/d2a/d34 to da/d38/d7f 0 2024-04-27T07:33:16.546 INFO:tasks.workunit.client.0.smithi082.stdout:6/267: chown d2/d3/d1b/l40 36 1 2024-04-27T07:33:16.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/259: mknod d7/d30/c52 0 2024-04-27T07:33:16.548 INFO:tasks.workunit.client.0.smithi082.stdout:6/268: truncate d2/d1e/f34 939145 0 2024-04-27T07:33:16.553 INFO:tasks.workunit.client.0.smithi082.stdout:1/270: creat d4/d2a/d3e/f61 x:0 0 0 2024-04-27T07:33:16.555 INFO:tasks.workunit.client.0.smithi082.stdout:2/260: dwrite d7/d30/f36 [0,4194304] 0 2024-04-27T07:33:16.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/323: mkdir da/d38/d7f/d4a/d80 0 2024-04-27T07:33:16.561 INFO:tasks.workunit.client.0.smithi082.stdout:6/269: unlink d2/d45/l59 0 2024-04-27T07:33:16.563 INFO:tasks.workunit.client.0.smithi082.stdout:6/270: write d2/d3/d1b/f28 [3980235,41120] 0 2024-04-27T07:33:16.564 INFO:tasks.workunit.client.0.smithi082.stdout:1/271: mknod d4/d2a/d39/c62 0 2024-04-27T07:33:16.566 INFO:tasks.workunit.client.0.smithi082.stdout:1/272: readlink d4/d15/l58 0 2024-04-27T07:33:16.569 INFO:tasks.workunit.client.0.smithi082.stdout:0/324: mkdir da/d3c/d3f/d4c/d74/d81 0 2024-04-27T07:33:16.571 INFO:tasks.workunit.client.0.smithi082.stdout:3/431: dread d8/f2e [0,4194304] 0 2024-04-27T07:33:16.571 INFO:tasks.workunit.client.0.smithi082.stdout:2/261: symlink d7/d31/l53 0 2024-04-27T07:33:16.572 INFO:tasks.workunit.client.0.smithi082.stdout:0/325: dread da/d1d/d6a/f7a [0,4194304] 0 2024-04-27T07:33:16.574 INFO:tasks.workunit.client.0.smithi082.stdout:6/271: dread d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:16.575 INFO:tasks.workunit.client.0.smithi082.stdout:1/273: truncate d4/fc 4887912 0 2024-04-27T07:33:16.576 INFO:tasks.workunit.client.0.smithi082.stdout:3/432: chown d8/c37 174306252 1 2024-04-27T07:33:16.579 INFO:tasks.workunit.client.0.smithi082.stdout:0/326: truncate da/f1f 1630243 0 2024-04-27T07:33:16.579 INFO:tasks.workunit.client.0.smithi082.stdout:3/433: read d8/d9/d25/d91/f56 [276045,69346] 0 2024-04-27T07:33:16.579 INFO:tasks.workunit.client.0.smithi082.stdout:0/327: readlink da/d1d/l29 0 2024-04-27T07:33:16.580 INFO:tasks.workunit.client.0.smithi082.stdout:9/259: getdents d9/d2d/d2b 0 2024-04-27T07:33:16.580 INFO:tasks.workunit.client.0.smithi082.stdout:3/434: fdatasync d8/d9/f1c 0 2024-04-27T07:33:16.581 INFO:tasks.workunit.client.0.smithi082.stdout:6/272: creat d2/d1e/f5a x:0 0 0 2024-04-27T07:33:16.583 INFO:tasks.workunit.client.0.smithi082.stdout:6/273: dread d2/d3/d1b/f4b [0,4194304] 0 2024-04-27T07:33:16.584 INFO:tasks.workunit.client.0.smithi082.stdout:6/274: truncate d2/de/d13/f21 4866410 0 2024-04-27T07:33:16.585 INFO:tasks.workunit.client.0.smithi082.stdout:6/275: write d2/de/d13/f1c [1480787,17205] 0 2024-04-27T07:33:16.586 INFO:tasks.workunit.client.0.smithi082.stdout:2/262: unlink d7/d30/c47 0 2024-04-27T07:33:16.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/328: creat da/d3c/f82 x:0 0 0 2024-04-27T07:33:16.590 INFO:tasks.workunit.client.0.smithi082.stdout:8/201: truncate d0/d3/d1c/f2a 4008424 0 2024-04-27T07:33:16.591 INFO:tasks.workunit.client.0.smithi082.stdout:9/260: symlink d9/da/dc/d33/l53 0 2024-04-27T07:33:16.592 INFO:tasks.workunit.client.0.smithi082.stdout:3/435: mkdir d8/d9/d25/d4e/da4 0 2024-04-27T07:33:16.597 INFO:tasks.workunit.client.0.smithi082.stdout:2/263: mkdir d7/d31/d54 0 2024-04-27T07:33:16.597 INFO:tasks.workunit.client.0.smithi082.stdout:6/276: symlink d2/d2e/l5b 0 2024-04-27T07:33:16.598 INFO:tasks.workunit.client.0.smithi082.stdout:8/202: dread d0/d3/d1b/f25 [0,4194304] 0 2024-04-27T07:33:16.600 INFO:tasks.workunit.client.0.smithi082.stdout:3/436: unlink d8/d9/d25/f85 0 2024-04-27T07:33:16.601 INFO:tasks.workunit.client.0.smithi082.stdout:1/274: link d4/d2a/d39/c62 d4/d2a/d3e/d57/c63 0 2024-04-27T07:33:16.602 INFO:tasks.workunit.client.0.smithi082.stdout:2/264: mknod d7/d8/d13/c55 0 2024-04-27T07:33:16.603 INFO:tasks.workunit.client.0.smithi082.stdout:2/265: dread - d7/d8/d13/f4b zero size 2024-04-27T07:33:16.604 INFO:tasks.workunit.client.0.smithi082.stdout:2/266: write d7/f28 [2279893,109565] 0 2024-04-27T07:33:16.605 INFO:tasks.workunit.client.0.smithi082.stdout:6/277: rename d2/d2d/d3d/f56 to d2/d3/d1b/f5c 0 2024-04-27T07:33:16.608 INFO:tasks.workunit.client.0.smithi082.stdout:9/261: truncate d9/d2d/f19 760635 0 2024-04-27T07:33:16.609 INFO:tasks.workunit.client.0.smithi082.stdout:8/203: creat d0/d3/d1b/d24/f3e x:0 0 0 2024-04-27T07:33:16.611 INFO:tasks.workunit.client.0.smithi082.stdout:1/275: write d4/f28 [4648570,40892] 0 2024-04-27T07:33:16.611 INFO:tasks.workunit.client.0.smithi082.stdout:3/437: mkdir d8/d9/d1d/da5 0 2024-04-27T07:33:16.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/262: rename c2 to d9/da/dc/d35/d38/c54 0 2024-04-27T07:33:16.620 INFO:tasks.workunit.client.0.smithi082.stdout:8/204: creat d0/d3/d1b/d24/f3f x:0 0 0 2024-04-27T07:33:16.623 INFO:tasks.workunit.client.0.smithi082.stdout:3/438: dwrite d8/d9/d3f/f8a [0,4194304] 0 2024-04-27T07:33:16.628 INFO:tasks.workunit.client.0.smithi082.stdout:2/267: creat d7/f56 x:0 0 0 2024-04-27T07:33:16.629 INFO:tasks.workunit.client.0.smithi082.stdout:6/278: dwrite d2/f23 [0,4194304] 0 2024-04-27T07:33:16.629 INFO:tasks.workunit.client.0.smithi082.stdout:8/205: rmdir d0/d2b 39 2024-04-27T07:33:16.634 INFO:tasks.workunit.client.0.smithi082.stdout:6/279: mkdir d2/d45/d5d 0 2024-04-27T07:33:16.636 INFO:tasks.workunit.client.0.smithi082.stdout:6/280: readlink d2/d3/l12 0 2024-04-27T07:33:16.637 INFO:tasks.workunit.client.0.smithi082.stdout:8/206: symlink d0/d3/d1c/d32/l40 0 2024-04-27T07:33:16.637 INFO:tasks.workunit.client.0.smithi082.stdout:0/329: truncate da/d28/d36/f65 3131322 0 2024-04-27T07:33:16.638 INFO:tasks.workunit.client.0.smithi082.stdout:2/268: dwrite d7/d30/f3f [0,4194304] 0 2024-04-27T07:33:16.641 INFO:tasks.workunit.client.0.smithi082.stdout:8/207: write d0/d3/d1b/f2e [417928,82567] 0 2024-04-27T07:33:16.642 INFO:tasks.workunit.client.0.smithi082.stdout:1/276: dread d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:16.645 INFO:tasks.workunit.client.0.smithi082.stdout:3/439: creat d8/d9/d25/fa6 x:0 0 0 2024-04-27T07:33:16.646 INFO:tasks.workunit.client.0.smithi082.stdout:8/208: readlink d0/d2b/l33 0 2024-04-27T07:33:16.649 INFO:tasks.workunit.client.0.smithi082.stdout:1/277: symlink d4/d15/d29/l64 0 2024-04-27T07:33:16.650 INFO:tasks.workunit.client.0.smithi082.stdout:2/269: truncate f3 960513 0 2024-04-27T07:33:16.652 INFO:tasks.workunit.client.0.smithi082.stdout:2/270: dread - d7/f56 zero size 2024-04-27T07:33:16.653 INFO:tasks.workunit.client.0.smithi082.stdout:1/278: dread d4/d15/f37 [0,4194304] 0 2024-04-27T07:33:16.654 INFO:tasks.workunit.client.0.smithi082.stdout:3/440: dwrite d8/d9/d25/d4e/f96 [0,4194304] 0 2024-04-27T07:33:16.655 INFO:tasks.workunit.client.0.smithi082.stdout:3/441: chown d8/d9/d1d/c6c 1087 1 2024-04-27T07:33:16.657 INFO:tasks.workunit.client.0.smithi082.stdout:3/442: write d8/d9/d3f/f80 [3540685,111780] 0 2024-04-27T07:33:16.659 INFO:tasks.workunit.client.0.smithi082.stdout:3/443: chown d8/d9/d1f/f4c 499 1 2024-04-27T07:33:16.659 INFO:tasks.workunit.client.0.smithi082.stdout:8/209: dread d0/d3/f26 [0,4194304] 0 2024-04-27T07:33:16.660 INFO:tasks.workunit.client.0.smithi082.stdout:2/271: mknod d7/d8/c57 0 2024-04-27T07:33:16.661 INFO:tasks.workunit.client.0.smithi082.stdout:1/279: fsync d4/d15/d1c/f2c 0 2024-04-27T07:33:16.664 INFO:tasks.workunit.client.0.smithi082.stdout:1/280: truncate d4/d2a/d39/f43 959963 0 2024-04-27T07:33:16.664 INFO:tasks.workunit.client.0.smithi082.stdout:1/281: chown d4/d15 35723345 1 2024-04-27T07:33:16.665 INFO:tasks.workunit.client.0.smithi082.stdout:9/263: dwrite f0 [4194304,4194304] 0 2024-04-27T07:33:16.669 INFO:tasks.workunit.client.0.smithi082.stdout:3/444: unlink d8/d9/d1f/l57 0 2024-04-27T07:33:16.672 INFO:tasks.workunit.client.0.smithi082.stdout:8/210: creat d0/d3/d1c/d32/f41 x:0 0 0 2024-04-27T07:33:16.673 INFO:tasks.workunit.client.0.smithi082.stdout:9/264: rmdir d9/da/dc/d35/d42 39 2024-04-27T07:33:16.674 INFO:tasks.workunit.client.0.smithi082.stdout:3/445: write d8/d9/dd/d13/f48 [3909628,92908] 0 2024-04-27T07:33:16.677 INFO:tasks.workunit.client.0.smithi082.stdout:1/282: dwrite d4/d2a/d39/f4a [0,4194304] 0 2024-04-27T07:33:16.677 INFO:tasks.workunit.client.0.smithi082.stdout:8/211: mkdir d0/d3/d1b/d24/d42 0 2024-04-27T07:33:16.678 INFO:tasks.workunit.client.0.smithi082.stdout:8/212: chown d0/d3/d1b/f1e 435543693 1 2024-04-27T07:33:16.680 INFO:tasks.workunit.client.0.smithi082.stdout:9/265: creat d9/d48/f55 x:0 0 0 2024-04-27T07:33:16.681 INFO:tasks.workunit.client.0.smithi082.stdout:9/266: truncate d9/f51 325176 0 2024-04-27T07:33:16.685 INFO:tasks.workunit.client.0.smithi082.stdout:9/267: read f0 [1216187,50376] 0 2024-04-27T07:33:16.686 INFO:tasks.workunit.client.0.smithi082.stdout:0/330: write f9 [1847514,80770] 0 2024-04-27T07:33:16.690 INFO:tasks.workunit.client.0.smithi082.stdout:1/283: mknod d4/d2a/d3e/d57/c65 0 2024-04-27T07:33:16.690 INFO:tasks.workunit.client.0.smithi082.stdout:1/284: stat d4/f34 0 2024-04-27T07:33:16.693 INFO:tasks.workunit.client.0.smithi082.stdout:0/331: mkdir da/d28/d36/d40/d83 0 2024-04-27T07:33:16.701 INFO:tasks.workunit.client.0.smithi082.stdout:1/285: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:16.703 INFO:tasks.workunit.client.0.smithi082.stdout:9/268: rename d9/d2d/d2b/l36 to d9/da/dc/d35/d42/l56 0 2024-04-27T07:33:16.707 INFO:tasks.workunit.client.0.smithi082.stdout:0/332: dwrite da/d28/d36/f4e [4194304,4194304] 0 2024-04-27T07:33:16.710 INFO:tasks.workunit.client.0.smithi082.stdout:9/269: creat d9/d2d/f57 x:0 0 0 2024-04-27T07:33:16.711 INFO:tasks.workunit.client.0.smithi082.stdout:3/446: write d8/d9/d25/d26/d3d/f51 [62438,33505] 0 2024-04-27T07:33:16.712 INFO:tasks.workunit.client.0.smithi082.stdout:2/272: dwrite d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:16.715 INFO:tasks.workunit.client.0.smithi082.stdout:2/273: write d7/d14/f50 [671705,68843] 0 2024-04-27T07:33:16.718 INFO:tasks.workunit.client.0.smithi082.stdout:8/213: dread d0/d3/f18 [0,4194304] 0 2024-04-27T07:33:16.718 INFO:tasks.workunit.client.0.smithi082.stdout:0/333: rename da/d3c/d3f/d57/c71 to da/d3c/c84 0 2024-04-27T07:33:16.718 INFO:tasks.workunit.client.0.smithi082.stdout:3/447: truncate d8/f2e 2836834 0 2024-04-27T07:33:16.721 INFO:tasks.workunit.client.0.smithi082.stdout:0/334: truncate da/d28/d36/d40/f49 31937 0 2024-04-27T07:33:16.728 INFO:tasks.workunit.client.0.smithi082.stdout:0/335: dread da/d28/f4d [0,4194304] 0 2024-04-27T07:33:16.729 INFO:tasks.workunit.client.0.smithi082.stdout:1/286: dread f2 [0,4194304] 0 2024-04-27T07:33:16.730 INFO:tasks.workunit.client.0.smithi082.stdout:3/448: truncate d8/d9/d25/d26/d3d/f6b 613364 0 2024-04-27T07:33:16.730 INFO:tasks.workunit.client.0.smithi082.stdout:8/214: creat d0/f43 x:0 0 0 2024-04-27T07:33:16.730 INFO:tasks.workunit.client.0.smithi082.stdout:9/270: getdents d9/da/dc/d35/d42 0 2024-04-27T07:33:16.731 INFO:tasks.workunit.client.0.smithi082.stdout:9/271: chown l8 54466 1 2024-04-27T07:33:16.732 INFO:tasks.workunit.client.0.smithi082.stdout:9/272: read - d9/da/dc/d33/f37 zero size 2024-04-27T07:33:16.733 INFO:tasks.workunit.client.0.smithi082.stdout:1/287: symlink d4/d2a/d3e/d46/l66 0 2024-04-27T07:33:16.734 INFO:tasks.workunit.client.0.smithi082.stdout:3/449: creat d8/d9/dd/d13/fa7 x:0 0 0 2024-04-27T07:33:16.735 INFO:tasks.workunit.client.0.smithi082.stdout:8/215: rmdir d0/d3/d1c 39 2024-04-27T07:33:16.736 INFO:tasks.workunit.client.0.smithi082.stdout:1/288: rename d4/f41 to d4/d15/d3f/f67 0 2024-04-27T07:33:16.744 INFO:tasks.workunit.client.0.smithi082.stdout:2/274: write d7/d8/f19 [1351190,83993] 0 2024-04-27T07:33:16.751 INFO:tasks.workunit.client.0.smithi082.stdout:2/275: dwrite d7/f51 [0,4194304] 0 2024-04-27T07:33:16.753 INFO:tasks.workunit.client.0.smithi082.stdout:0/336: dread da/d1d/f24 [0,4194304] 0 2024-04-27T07:33:16.753 INFO:tasks.workunit.client.0.smithi082.stdout:2/276: read d7/d30/f3f [3508876,47788] 0 2024-04-27T07:33:16.757 INFO:tasks.workunit.client.0.smithi082.stdout:8/216: dread d0/f17 [0,4194304] 0 2024-04-27T07:33:16.757 INFO:tasks.workunit.client.0.smithi082.stdout:2/277: write d7/d30/f36 [1141072,22652] 0 2024-04-27T07:33:16.758 INFO:tasks.workunit.client.0.smithi082.stdout:3/450: truncate d8/d9/d3f/f80 3404210 0 2024-04-27T07:33:16.761 INFO:tasks.workunit.client.0.smithi082.stdout:1/289: write d4/fc [4087459,5692] 0 2024-04-27T07:33:16.764 INFO:tasks.workunit.client.0.smithi082.stdout:0/337: dwrite da/f1c [4194304,4194304] 0 2024-04-27T07:33:16.766 INFO:tasks.workunit.client.0.smithi082.stdout:3/451: mkdir d8/d9/dd/d13/d1b/da8 0 2024-04-27T07:33:16.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/217: dread d0/f17 [0,4194304] 0 2024-04-27T07:33:16.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/218: chown d0 2408 1 2024-04-27T07:33:16.770 INFO:tasks.workunit.client.0.smithi082.stdout:1/290: mknod d4/d2a/d4c/c68 0 2024-04-27T07:33:16.771 INFO:tasks.workunit.client.0.smithi082.stdout:1/291: read d4/f35 [101636,113617] 0 2024-04-27T07:33:16.772 INFO:tasks.workunit.client.0.smithi082.stdout:2/278: creat d7/f58 x:0 0 0 2024-04-27T07:33:16.774 INFO:tasks.workunit.client.0.smithi082.stdout:0/338: creat da/d28/d36/d40/d83/f85 x:0 0 0 2024-04-27T07:33:16.775 INFO:tasks.workunit.client.0.smithi082.stdout:2/279: fdatasync d7/d30/f36 0 2024-04-27T07:33:16.778 INFO:tasks.workunit.client.0.smithi082.stdout:0/339: stat da/l22 0 2024-04-27T07:33:16.780 INFO:tasks.workunit.client.0.smithi082.stdout:8/219: dwrite d0/d3/d1b/d24/f3f [0,4194304] 0 2024-04-27T07:33:16.782 INFO:tasks.workunit.client.0.smithi082.stdout:1/292: rename d4/d15/l59 to d4/d2a/d3e/d57/l69 0 2024-04-27T07:33:16.784 INFO:tasks.workunit.client.0.smithi082.stdout:2/280: dread d7/d14/f3d [0,4194304] 0 2024-04-27T07:33:16.786 INFO:tasks.workunit.client.0.smithi082.stdout:0/340: creat da/d3c/d3f/d57/f86 x:0 0 0 2024-04-27T07:33:16.787 INFO:tasks.workunit.client.0.smithi082.stdout:0/341: chown da/d1d/d6a 3460 1 2024-04-27T07:33:16.788 INFO:tasks.workunit.client.0.smithi082.stdout:8/220: mknod d0/d3/d1b/d29/c44 0 2024-04-27T07:33:16.791 INFO:tasks.workunit.client.0.smithi082.stdout:2/281: rmdir d7 39 2024-04-27T07:33:16.791 INFO:tasks.workunit.client.0.smithi082.stdout:0/342: read da/f26 [3293758,100276] 0 2024-04-27T07:33:16.794 INFO:tasks.workunit.client.0.smithi082.stdout:1/293: rename d4/d15/d29/f4d to d4/d2a/d4c/f6a 0 2024-04-27T07:33:16.800 INFO:tasks.workunit.client.0.smithi082.stdout:3/452: dread d8/d9/dd/f1a [0,4194304] 0 2024-04-27T07:33:16.802 INFO:tasks.workunit.client.0.smithi082.stdout:0/343: dwrite da/d2a/f46 [0,4194304] 0 2024-04-27T07:33:16.804 INFO:tasks.workunit.client.0.smithi082.stdout:8/221: rename d0/d3/f26 to d0/d3/d1c/d32/d35/f45 0 2024-04-27T07:33:16.807 INFO:tasks.workunit.client.0.smithi082.stdout:1/294: dwrite d4/d15/d49/d4e/f5a [0,4194304] 0 2024-04-27T07:33:16.807 INFO:tasks.workunit.client.0.smithi082.stdout:2/282: mknod d7/d31/c59 0 2024-04-27T07:33:16.811 INFO:tasks.workunit.client.0.smithi082.stdout:0/344: rename da/d1d/f5c to da/d2a/f87 0 2024-04-27T07:33:16.815 INFO:tasks.workunit.client.0.smithi082.stdout:0/345: chown da/d38/d7f/f4f 2321 1 2024-04-27T07:33:16.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/346: chown da/d1d/f2d 8127 1 2024-04-27T07:33:16.818 INFO:tasks.workunit.client.0.smithi082.stdout:3/453: dwrite d8/d9/d1f/f94 [0,4194304] 0 2024-04-27T07:33:16.820 INFO:tasks.workunit.client.0.smithi082.stdout:0/347: readlink da/d28/l75 0 2024-04-27T07:33:16.823 INFO:tasks.workunit.client.0.smithi082.stdout:2/283: dwrite d7/d8/f1f [0,4194304] 0 2024-04-27T07:33:16.823 INFO:tasks.workunit.client.0.smithi082.stdout:3/454: write d8/d9/d25/d66/d6d/d8e/f95 [175655,75063] 0 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: pgmap v14: 65 pgs: 65 active+clean; 610 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 65 MiB/s wr, 498 op/s 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:33:16.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:16 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:33:16.906 INFO:tasks.workunit.client.0.smithi082.stdout:5/337: sync 2024-04-27T07:33:16.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/338: write d8/d15/d22/f53 [174648,39137] 0 2024-04-27T07:33:16.910 INFO:tasks.workunit.client.0.smithi082.stdout:1/295: getdents d4 0 2024-04-27T07:33:16.911 INFO:tasks.workunit.client.0.smithi082.stdout:0/348: rename da/d3c/c84 to da/d28/d36/d40/c88 0 2024-04-27T07:33:16.913 INFO:tasks.workunit.client.0.smithi082.stdout:3/455: creat d8/d9/dd/da3/fa9 x:0 0 0 2024-04-27T07:33:16.913 INFO:tasks.workunit.client.0.smithi082.stdout:0/349: chown da/lc 301178506 1 2024-04-27T07:33:16.914 INFO:tasks.workunit.client.0.smithi082.stdout:2/284: creat d7/d9/d4f/f5a x:0 0 0 2024-04-27T07:33:16.915 INFO:tasks.workunit.client.0.smithi082.stdout:5/339: creat d8/d3b/f74 x:0 0 0 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: pgmap v14: 65 pgs: 65 active+clean; 610 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 65 MiB/s wr, 498 op/s 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:33:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:16 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:33:16.918 INFO:tasks.workunit.client.0.smithi082.stdout:8/222: dwrite d0/d3/f1d [4194304,4194304] 0 2024-04-27T07:33:16.918 INFO:tasks.workunit.client.0.smithi082.stdout:1/296: link d4/d2a/d39/f4a d4/d2a/f6b 0 2024-04-27T07:33:16.922 INFO:tasks.workunit.client.0.smithi082.stdout:3/456: rename d8/d9/d1f/c40 to d8/d9/d25/d66/d6d/caa 0 2024-04-27T07:33:16.924 INFO:tasks.workunit.client.0.smithi082.stdout:5/340: symlink d8/d3c/d5a/d5b/l75 0 2024-04-27T07:33:16.925 INFO:tasks.workunit.client.0.smithi082.stdout:8/223: chown d0/d3/d1c/l1f 6083487 1 2024-04-27T07:33:16.926 INFO:tasks.workunit.client.0.smithi082.stdout:0/350: write da/fe [1402092,115264] 0 2024-04-27T07:33:16.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/224: mkdir d0/d3/d1b/d24/d46 0 2024-04-27T07:33:16.931 INFO:tasks.workunit.client.0.smithi082.stdout:1/297: truncate d4/fd 89716 0 2024-04-27T07:33:16.934 INFO:tasks.workunit.client.0.smithi082.stdout:1/298: creat d4/d2a/d4c/f6c x:0 0 0 2024-04-27T07:33:16.935 INFO:tasks.workunit.client.0.smithi082.stdout:0/351: dwrite da/d28/f66 [0,4194304] 0 2024-04-27T07:33:16.936 INFO:tasks.workunit.client.0.smithi082.stdout:3/457: link d8/d9/d25/d66/l84 d8/d9/d25/d66/d6d/d8e/lab 0 2024-04-27T07:33:16.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/299: mkdir d4/d15/d3f/d6d 0 2024-04-27T07:33:16.943 INFO:tasks.workunit.client.0.smithi082.stdout:1/300: chown d4/d2a/d4c/l5f 46114 1 2024-04-27T07:33:16.944 INFO:tasks.workunit.client.0.smithi082.stdout:5/341: dread d8/d15/f11 [0,4194304] 0 2024-04-27T07:33:16.944 INFO:tasks.workunit.client.0.smithi082.stdout:1/301: stat d4/d15/d1c/c5b 0 2024-04-27T07:33:16.945 INFO:tasks.workunit.client.0.smithi082.stdout:0/352: rename da/d28/d36/d40/c72 to da/d3c/d3f/d4c/c89 0 2024-04-27T07:33:16.947 INFO:tasks.workunit.client.0.smithi082.stdout:3/458: mknod d8/d9/d25/d91/cac 0 2024-04-27T07:33:16.949 INFO:tasks.workunit.client.0.smithi082.stdout:8/225: truncate d0/d3/f9 3438169 0 2024-04-27T07:33:16.951 INFO:tasks.workunit.client.0.smithi082.stdout:5/342: mkdir d8/d15/d65/d76 0 2024-04-27T07:33:16.953 INFO:tasks.workunit.client.0.smithi082.stdout:3/459: mkdir d8/d9/d25/d26/d3d/dad 0 2024-04-27T07:33:16.956 INFO:tasks.workunit.client.0.smithi082.stdout:0/353: mknod da/d38/d7f/d4a/d80/c8a 0 2024-04-27T07:33:16.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/354: write da/d1d/f25 [421362,85621] 0 2024-04-27T07:33:16.962 INFO:tasks.workunit.client.0.smithi082.stdout:5/343: dwrite d8/d3c/d64/f36 [0,4194304] 0 2024-04-27T07:33:16.964 INFO:tasks.workunit.client.0.smithi082.stdout:0/355: readlink da/d28/l78 0 2024-04-27T07:33:16.967 INFO:tasks.workunit.client.0.smithi082.stdout:1/302: dread d4/d15/f17 [0,4194304] 0 2024-04-27T07:33:16.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/460: dwrite d8/d9/dd/d13/d1b/f28 [0,4194304] 0 2024-04-27T07:33:16.973 INFO:tasks.workunit.client.0.smithi082.stdout:8/226: dwrite d0/f7 [0,4194304] 0 2024-04-27T07:33:16.976 INFO:tasks.workunit.client.0.smithi082.stdout:3/461: dread - d8/d9/dd/d13/d1b/f31 zero size 2024-04-27T07:33:16.979 INFO:tasks.workunit.client.0.smithi082.stdout:5/344: dwrite f5 [0,4194304] 0 2024-04-27T07:33:16.981 INFO:tasks.workunit.client.0.smithi082.stdout:8/227: creat d0/d3/d1b/f47 x:0 0 0 2024-04-27T07:33:16.982 INFO:tasks.workunit.client.0.smithi082.stdout:1/303: write d4/d2a/d39/f4a [3218232,103462] 0 2024-04-27T07:33:16.985 INFO:tasks.workunit.client.0.smithi082.stdout:5/345: chown d8/d3c/d5a/d5b/d5f/f70 34657 1 2024-04-27T07:33:16.986 INFO:tasks.workunit.client.0.smithi082.stdout:0/356: link da/l22 da/d38/d7f/d4a/d80/l8b 0 2024-04-27T07:33:16.988 INFO:tasks.workunit.client.0.smithi082.stdout:0/357: write da/d3c/d3f/d4c/d74/f79 [693244,57877] 0 2024-04-27T07:33:16.989 INFO:tasks.workunit.client.0.smithi082.stdout:0/358: readlink da/ld 0 2024-04-27T07:33:16.989 INFO:tasks.workunit.client.0.smithi082.stdout:1/304: fdatasync d4/f16 0 2024-04-27T07:33:16.992 INFO:tasks.workunit.client.0.smithi082.stdout:5/346: mkdir d8/d77 0 2024-04-27T07:33:16.996 INFO:tasks.workunit.client.0.smithi082.stdout:5/347: rename d8/d3c/f6f to d8/d77/f78 0 2024-04-27T07:33:16.997 INFO:tasks.workunit.client.0.smithi082.stdout:0/359: symlink da/d3c/d3f/d4c/d74/d81/l8c 0 2024-04-27T07:33:16.998 INFO:tasks.workunit.client.0.smithi082.stdout:8/228: getdents d0/d3/d1c/d32/d35 0 2024-04-27T07:33:16.999 INFO:tasks.workunit.client.0.smithi082.stdout:5/348: symlink d8/d3c/d5a/d5b/d5f/l79 0 2024-04-27T07:33:17.000 INFO:tasks.workunit.client.0.smithi082.stdout:0/360: write da/d28/d36/d40/f64 [1190859,67535] 0 2024-04-27T07:33:17.001 INFO:tasks.workunit.client.0.smithi082.stdout:8/229: symlink d0/d3/d1b/d24/l48 0 2024-04-27T07:33:17.002 INFO:tasks.workunit.client.0.smithi082.stdout:5/349: mkdir d8/d77/d7a 0 2024-04-27T07:33:17.004 INFO:tasks.workunit.client.0.smithi082.stdout:3/462: truncate d8/d9/dd/d13/f6f 1098246 0 2024-04-27T07:33:17.005 INFO:tasks.workunit.client.0.smithi082.stdout:8/230: creat d0/d3/d1c/d32/d35/f49 x:0 0 0 2024-04-27T07:33:17.006 INFO:tasks.workunit.client.0.smithi082.stdout:5/350: write d8/d77/f78 [688957,29806] 0 2024-04-27T07:33:17.007 INFO:tasks.workunit.client.0.smithi082.stdout:0/361: symlink da/d28/l8d 0 2024-04-27T07:33:17.008 INFO:tasks.workunit.client.0.smithi082.stdout:5/351: write d8/d3c/d4a/f55 [4828553,87513] 0 2024-04-27T07:33:17.014 INFO:tasks.workunit.client.0.smithi082.stdout:8/231: unlink d0/d3/d1b/d24/f36 0 2024-04-27T07:33:17.015 INFO:tasks.workunit.client.0.smithi082.stdout:1/305: dwrite d4/f35 [0,4194304] 0 2024-04-27T07:33:17.017 INFO:tasks.workunit.client.0.smithi082.stdout:8/232: dread - d0/d3/d1b/d24/f3e zero size 2024-04-27T07:33:17.018 INFO:tasks.workunit.client.0.smithi082.stdout:5/352: mkdir d8/d14/d7b 0 2024-04-27T07:33:17.023 INFO:tasks.workunit.client.0.smithi082.stdout:8/233: rmdir d0/d3/d1b/d29 39 2024-04-27T07:33:17.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/306: dwrite d4/d15/d1c/f2c [0,4194304] 0 2024-04-27T07:33:17.026 INFO:tasks.workunit.client.0.smithi082.stdout:8/234: write d0/f17 [4461146,105770] 0 2024-04-27T07:33:17.028 INFO:tasks.workunit.client.0.smithi082.stdout:5/353: creat d8/d3c/d5a/d5b/d5f/f7c x:0 0 0 2024-04-27T07:33:17.030 INFO:tasks.workunit.client.0.smithi082.stdout:5/354: truncate d8/d3c/d47/f2f 2393173 0 2024-04-27T07:33:17.030 INFO:tasks.workunit.client.0.smithi082.stdout:8/235: dread d0/d3/d1b/f2e [0,4194304] 0 2024-04-27T07:33:17.030 INFO:tasks.workunit.client.0.smithi082.stdout:1/307: unlink d4/d15/f4f 0 2024-04-27T07:33:17.032 INFO:tasks.workunit.client.0.smithi082.stdout:5/355: readlink d8/d3c/d5a/d5b/d5f/l79 0 2024-04-27T07:33:17.032 INFO:tasks.workunit.client.0.smithi082.stdout:1/308: write d4/d15/d1c/f2c [2117134,37039] 0 2024-04-27T07:33:17.037 INFO:tasks.workunit.client.0.smithi082.stdout:8/236: write d0/d3/d1b/d24/f28 [7841489,57368] 0 2024-04-27T07:33:17.040 INFO:tasks.workunit.client.0.smithi082.stdout:5/356: rename d8/d2e/c3f to d8/d3c/d47/c7d 0 2024-04-27T07:33:17.040 INFO:tasks.workunit.client.0.smithi082.stdout:0/362: dwrite da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:17.041 INFO:tasks.workunit.client.0.smithi082.stdout:5/357: chown d8/d14 95 1 2024-04-27T07:33:17.043 INFO:tasks.workunit.client.0.smithi082.stdout:3/463: dwrite d8/d9/dd/d13/f6f [0,4194304] 0 2024-04-27T07:33:17.048 INFO:tasks.workunit.client.0.smithi082.stdout:0/363: creat da/d28/d36/d40/d83/f8e x:0 0 0 2024-04-27T07:33:17.053 INFO:tasks.workunit.client.0.smithi082.stdout:3/464: readlink d8/d9/d25/d66/d6d/d8e/lab 0 2024-04-27T07:33:17.053 INFO:tasks.workunit.client.0.smithi082.stdout:8/237: dread d0/d3/d1b/d24/f3f [0,4194304] 0 2024-04-27T07:33:17.055 INFO:tasks.workunit.client.0.smithi082.stdout:5/358: dwrite d8/d42/f54 [0,4194304] 0 2024-04-27T07:33:17.061 INFO:tasks.workunit.client.0.smithi082.stdout:0/364: rename da/d3c/d3f/d4c/d74/d81/l8c to da/d3c/d3f/d4c/d74/l8f 0 2024-04-27T07:33:17.063 INFO:tasks.workunit.client.0.smithi082.stdout:5/359: creat d8/d3c/d64/f7e x:0 0 0 2024-04-27T07:33:17.066 INFO:tasks.workunit.client.0.smithi082.stdout:0/365: creat da/d28/d36/d40/f90 x:0 0 0 2024-04-27T07:33:17.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/360: unlink d8/d3c/d47/c7d 0 2024-04-27T07:33:17.071 INFO:tasks.workunit.client.0.smithi082.stdout:0/366: chown da/d28/d36/d40/c88 64386634 1 2024-04-27T07:33:17.073 INFO:tasks.workunit.client.0.smithi082.stdout:5/361: symlink d8/d3c/d5a/d5b/l7f 0 2024-04-27T07:33:17.074 INFO:tasks.workunit.client.0.smithi082.stdout:8/238: dwrite d0/d3/d1b/f2e [0,4194304] 0 2024-04-27T07:33:17.075 INFO:tasks.workunit.client.0.smithi082.stdout:0/367: chown da/d3c/d3f/d4c/d74/d81 9568 1 2024-04-27T07:33:17.076 INFO:tasks.workunit.client.0.smithi082.stdout:3/465: dwrite d8/d9/d25/d66/d6d/f44 [0,4194304] 0 2024-04-27T07:33:17.076 INFO:tasks.workunit.client.0.smithi082.stdout:8/239: dread - d0/f43 zero size 2024-04-27T07:33:17.078 INFO:tasks.workunit.client.0.smithi082.stdout:1/309: dread d4/d15/d3f/f67 [0,4194304] 0 2024-04-27T07:33:17.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/362: write d8/d29/f6e [570700,128959] 0 2024-04-27T07:33:17.083 INFO:tasks.workunit.client.0.smithi082.stdout:0/368: unlink da/d3c/d3f/d4c/d74/f79 0 2024-04-27T07:33:17.085 INFO:tasks.workunit.client.0.smithi082.stdout:0/369: truncate da/d3c/f82 948780 0 2024-04-27T07:33:17.086 INFO:tasks.workunit.client.0.smithi082.stdout:5/363: mknod d8/d15/c80 0 2024-04-27T07:33:17.086 INFO:tasks.workunit.client.0.smithi082.stdout:0/370: dread - da/d28/d36/d40/d83/f85 zero size 2024-04-27T07:33:17.087 INFO:tasks.workunit.client.0.smithi082.stdout:1/310: symlink d4/d2a/d3e/d57/l6e 0 2024-04-27T07:33:17.087 INFO:tasks.workunit.client.0.smithi082.stdout:5/364: chown d8/d29/f56 199 1 2024-04-27T07:33:17.088 INFO:tasks.workunit.client.0.smithi082.stdout:0/371: write da/fe [2763553,45378] 0 2024-04-27T07:33:17.088 INFO:tasks.workunit.client.0.smithi082.stdout:3/466: read d8/d9/d3f/f80 [3100556,71772] 0 2024-04-27T07:33:17.090 INFO:tasks.workunit.client.0.smithi082.stdout:3/467: stat d8/d9/d25/d66/c9d 0 2024-04-27T07:33:17.091 INFO:tasks.workunit.client.0.smithi082.stdout:0/372: write da/d28/d36/d40/f44 [35395,68727] 0 2024-04-27T07:33:17.093 INFO:tasks.workunit.client.0.smithi082.stdout:3/468: write d8/d9/dd/f35 [159731,119067] 0 2024-04-27T07:33:17.093 INFO:tasks.workunit.client.0.smithi082.stdout:7/269: sync 2024-04-27T07:33:17.095 INFO:tasks.workunit.client.0.smithi082.stdout:1/311: dread d4/d15/d29/f33 [0,4194304] 0 2024-04-27T07:33:17.096 INFO:tasks.workunit.client.0.smithi082.stdout:7/270: readlink d3/d9/l25 0 2024-04-27T07:33:17.097 INFO:tasks.workunit.client.0.smithi082.stdout:5/365: dwrite f4 [8388608,4194304] 0 2024-04-27T07:33:17.099 INFO:tasks.workunit.client.0.smithi082.stdout:7/271: write d3/de/f3d [1031855,52719] 0 2024-04-27T07:33:17.102 INFO:tasks.workunit.client.0.smithi082.stdout:5/366: mknod d8/d29/c81 0 2024-04-27T07:33:17.103 INFO:tasks.workunit.client.0.smithi082.stdout:0/373: dread da/d2a/f46 [0,4194304] 0 2024-04-27T07:33:17.104 INFO:tasks.workunit.client.0.smithi082.stdout:5/367: write d8/d77/f78 [1532003,70774] 0 2024-04-27T07:33:17.106 INFO:tasks.workunit.client.0.smithi082.stdout:0/374: dread - da/d3c/d3f/d57/f86 zero size 2024-04-27T07:33:17.106 INFO:tasks.workunit.client.0.smithi082.stdout:7/272: creat d3/d9/d4f/f54 x:0 0 0 2024-04-27T07:33:17.108 INFO:tasks.workunit.client.0.smithi082.stdout:1/312: dread d4/f16 [0,4194304] 0 2024-04-27T07:33:17.110 INFO:tasks.workunit.client.0.smithi082.stdout:3/469: link d8/d9/dd/d13/d1b/f28 d8/d9/fae 0 2024-04-27T07:33:17.111 INFO:tasks.workunit.client.0.smithi082.stdout:1/313: creat d4/d2a/d3e/d53/f6f x:0 0 0 2024-04-27T07:33:17.112 INFO:tasks.workunit.client.0.smithi082.stdout:3/470: chown d8/d9/dd/d13/d1b 3 1 2024-04-27T07:33:17.112 INFO:tasks.workunit.client.0.smithi082.stdout:7/273: mknod d3/db/c55 0 2024-04-27T07:33:17.115 INFO:tasks.workunit.client.0.smithi082.stdout:0/375: dread da/d2a/f46 [0,4194304] 0 2024-04-27T07:33:17.116 INFO:tasks.workunit.client.0.smithi082.stdout:3/471: getdents d8/d9/dd/d13/d1b/da8 0 2024-04-27T07:33:17.117 INFO:tasks.workunit.client.0.smithi082.stdout:5/368: dwrite d8/f25 [0,4194304] 0 2024-04-27T07:33:17.119 INFO:tasks.workunit.client.0.smithi082.stdout:7/274: getdents d3/d49 0 2024-04-27T07:33:17.120 INFO:tasks.workunit.client.0.smithi082.stdout:5/369: write d8/d14/f23 [5474905,84063] 0 2024-04-27T07:33:17.126 INFO:tasks.workunit.client.0.smithi082.stdout:3/472: symlink d8/d9/d1f/laf 0 2024-04-27T07:33:17.126 INFO:tasks.workunit.client.0.smithi082.stdout:0/376: read da/d3c/d3f/f5b [1854951,14902] 0 2024-04-27T07:33:17.130 INFO:tasks.workunit.client.0.smithi082.stdout:3/473: fdatasync d8/d9/dd/f1a 0 2024-04-27T07:33:17.130 INFO:tasks.workunit.client.0.smithi082.stdout:7/275: dwrite d3/de/d3a/f21 [0,4194304] 0 2024-04-27T07:33:17.132 INFO:tasks.workunit.client.0.smithi082.stdout:0/377: symlink da/d38/d7f/d4a/d80/l91 0 2024-04-27T07:33:17.135 INFO:tasks.workunit.client.0.smithi082.stdout:7/276: creat d3/d9/f56 x:0 0 0 2024-04-27T07:33:17.137 INFO:tasks.workunit.client.0.smithi082.stdout:1/314: dread d4/f1e [0,4194304] 0 2024-04-27T07:33:17.138 INFO:tasks.workunit.client.0.smithi082.stdout:0/378: mknod da/d38/c92 0 2024-04-27T07:33:17.142 INFO:tasks.workunit.client.0.smithi082.stdout:1/315: write d4/d15/d29/f33 [117932,115010] 0 2024-04-27T07:33:17.143 INFO:tasks.workunit.client.0.smithi082.stdout:0/379: symlink da/d38/d7f/d4a/l93 0 2024-04-27T07:33:17.144 INFO:tasks.workunit.client.0.smithi082.stdout:3/474: dread d8/d9/dd/f35 [0,4194304] 0 2024-04-27T07:33:17.146 INFO:tasks.workunit.client.0.smithi082.stdout:1/316: write d4/d2a/d3e/d46/f50 [147754,63270] 0 2024-04-27T07:33:17.147 INFO:tasks.workunit.client.0.smithi082.stdout:7/277: dwrite d3/de/d3a/f21 [4194304,4194304] 0 2024-04-27T07:33:17.147 INFO:tasks.workunit.client.0.smithi082.stdout:0/380: mknod da/d28/d36/d40/c94 0 2024-04-27T07:33:17.149 INFO:tasks.workunit.client.0.smithi082.stdout:0/381: fsync da/d3c/d3f/d4c/f54 0 2024-04-27T07:33:17.150 INFO:tasks.workunit.client.0.smithi082.stdout:3/475: fdatasync d8/d9/d3f/f8c 0 2024-04-27T07:33:17.151 INFO:tasks.workunit.client.0.smithi082.stdout:1/317: write d4/d2a/d4c/f6c [271993,25014] 0 2024-04-27T07:33:17.155 INFO:tasks.workunit.client.0.smithi082.stdout:0/382: mkdir da/d3c/d3f/d4c/d95 0 2024-04-27T07:33:17.157 INFO:tasks.workunit.client.0.smithi082.stdout:7/278: dread d3/db/ff [0,4194304] 0 2024-04-27T07:33:17.160 INFO:tasks.workunit.client.0.smithi082.stdout:1/318: link d4/d15/d1c/c5b d4/d15/d49/d4e/c70 0 2024-04-27T07:33:17.162 INFO:tasks.workunit.client.0.smithi082.stdout:7/279: rename d3/db/f27 to d3/de/d3a/d2a/f57 0 2024-04-27T07:33:17.163 INFO:tasks.workunit.client.0.smithi082.stdout:1/319: chown d4/d2a/d3e/d57/c65 997801 1 2024-04-27T07:33:17.164 INFO:tasks.workunit.client.0.smithi082.stdout:7/280: readlink d3/db/l16 0 2024-04-27T07:33:17.164 INFO:tasks.workunit.client.0.smithi082.stdout:0/383: dwrite da/d2a/f87 [0,4194304] 0 2024-04-27T07:33:17.166 INFO:tasks.workunit.client.0.smithi082.stdout:0/384: stat da/d28/c7d 0 2024-04-27T07:33:17.170 INFO:tasks.workunit.client.0.smithi082.stdout:1/320: write d4/d15/d3f/f67 [2243208,124129] 0 2024-04-27T07:33:17.170 INFO:tasks.workunit.client.0.smithi082.stdout:0/385: write da/d28/d36/d40/f44 [350659,84069] 0 2024-04-27T07:33:17.172 INFO:tasks.workunit.client.0.smithi082.stdout:0/386: fsync da/f62 0 2024-04-27T07:33:17.172 INFO:tasks.workunit.client.0.smithi082.stdout:3/476: dread d8/d9/d25/f77 [0,4194304] 0 2024-04-27T07:33:17.173 INFO:tasks.workunit.client.0.smithi082.stdout:7/281: mknod d3/de/c58 0 2024-04-27T07:33:17.174 INFO:tasks.workunit.client.0.smithi082.stdout:1/321: mknod d4/d15/d29/c71 0 2024-04-27T07:33:17.175 INFO:tasks.workunit.client.0.smithi082.stdout:7/282: dread - d3/de/d3a/f52 zero size 2024-04-27T07:33:17.176 INFO:tasks.workunit.client.0.smithi082.stdout:0/387: rename da/c17 to da/d1d/d6a/c96 0 2024-04-27T07:33:17.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/283: mkdir d3/db/d59 0 2024-04-27T07:33:17.180 INFO:tasks.workunit.client.0.smithi082.stdout:7/284: chown d3/db/f2e 592 1 2024-04-27T07:33:17.181 INFO:tasks.workunit.client.0.smithi082.stdout:1/322: getdents d4/d15/d1c 0 2024-04-27T07:33:17.183 INFO:tasks.workunit.client.0.smithi082.stdout:3/477: dwrite d8/d9/dd/d13/fa7 [0,4194304] 0 2024-04-27T07:33:17.186 INFO:tasks.workunit.client.0.smithi082.stdout:1/323: write d4/d15/d29/f47 [1505247,62106] 0 2024-04-27T07:33:17.186 INFO:tasks.workunit.client.0.smithi082.stdout:0/388: getdents da/d28 0 2024-04-27T07:33:17.189 INFO:tasks.workunit.client.0.smithi082.stdout:7/285: dread d3/d9/f2d [4194304,4194304] 0 2024-04-27T07:33:17.190 INFO:tasks.workunit.client.0.smithi082.stdout:3/478: mkdir d8/d9/db0 0 2024-04-27T07:33:17.191 INFO:tasks.workunit.client.0.smithi082.stdout:3/479: read - d8/d9/d25/fa6 zero size 2024-04-27T07:33:17.192 INFO:tasks.workunit.client.0.smithi082.stdout:0/389: symlink da/d3c/d3f/d4c/d74/l97 0 2024-04-27T07:33:17.194 INFO:tasks.workunit.client.0.smithi082.stdout:0/390: mknod da/c98 0 2024-04-27T07:33:17.196 INFO:tasks.workunit.client.0.smithi082.stdout:3/480: creat d8/d9/d25/d26/fb1 x:0 0 0 2024-04-27T07:33:17.197 INFO:tasks.workunit.client.0.smithi082.stdout:3/481: write d8/d9/f70 [891893,44805] 0 2024-04-27T07:33:17.198 INFO:tasks.workunit.client.0.smithi082.stdout:7/286: link d3/d9/d4f/f54 d3/de/f5a 0 2024-04-27T07:33:17.200 INFO:tasks.workunit.client.0.smithi082.stdout:3/482: dread - d8/d9/d25/d66/d6d/f7d zero size 2024-04-27T07:33:17.200 INFO:tasks.workunit.client.0.smithi082.stdout:0/391: write da/f42 [3464311,57118] 0 2024-04-27T07:33:17.200 INFO:tasks.workunit.client.0.smithi082.stdout:0/392: fdatasync da/f19 0 2024-04-27T07:33:17.201 INFO:tasks.workunit.client.0.smithi082.stdout:7/287: unlink d3/de/d3a/c4c 0 2024-04-27T07:33:17.204 INFO:tasks.workunit.client.0.smithi082.stdout:0/393: mknod da/d3c/c99 0 2024-04-27T07:33:17.205 INFO:tasks.workunit.client.0.smithi082.stdout:0/394: write da/d28/f66 [1371763,91873] 0 2024-04-27T07:33:17.209 INFO:tasks.workunit.client.0.smithi082.stdout:7/288: symlink d3/l5b 0 2024-04-27T07:33:17.210 INFO:tasks.workunit.client.0.smithi082.stdout:0/395: rename da/d2a/c33 to da/d38/d7f/c9a 0 2024-04-27T07:33:17.211 INFO:tasks.workunit.client.0.smithi082.stdout:7/289: mknod d3/db/d59/c5c 0 2024-04-27T07:33:17.212 INFO:tasks.workunit.client.0.smithi082.stdout:1/324: dread d4/f28 [0,4194304] 0 2024-04-27T07:33:17.215 INFO:tasks.workunit.client.0.smithi082.stdout:0/396: rename da/d28/l8d to da/d28/d36/d40/l9b 0 2024-04-27T07:33:17.216 INFO:tasks.workunit.client.0.smithi082.stdout:1/325: mkdir d4/d2a/d3e/d53/d72 0 2024-04-27T07:33:17.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/290: creat d3/db/f5d x:0 0 0 2024-04-27T07:33:17.221 INFO:tasks.workunit.client.0.smithi082.stdout:7/291: truncate d3/f20 797685 0 2024-04-27T07:33:17.223 INFO:tasks.workunit.client.0.smithi082.stdout:0/397: dwrite da/d2a/f46 [0,4194304] 0 2024-04-27T07:33:17.223 INFO:tasks.workunit.client.0.smithi082.stdout:3/483: write d8/d9/d1d/f23 [295874,90650] 0 2024-04-27T07:33:17.225 INFO:tasks.workunit.client.0.smithi082.stdout:1/326: dread d4/d2a/f6b [0,4194304] 0 2024-04-27T07:33:17.228 INFO:tasks.workunit.client.0.smithi082.stdout:7/292: rename d3/de/d3a/d2a/l4b to d3/d9/l5e 0 2024-04-27T07:33:17.229 INFO:tasks.workunit.client.0.smithi082.stdout:7/293: chown d3/de/c58 1 1 2024-04-27T07:33:17.230 INFO:tasks.workunit.client.0.smithi082.stdout:0/398: creat da/d3c/d3f/d4c/f9c x:0 0 0 2024-04-27T07:33:17.231 INFO:tasks.workunit.client.0.smithi082.stdout:0/399: write da/d3c/f82 [591450,91053] 0 2024-04-27T07:33:17.235 INFO:tasks.workunit.client.0.smithi082.stdout:1/327: link d4/f35 d4/d2a/d3e/d53/d72/f73 0 2024-04-27T07:33:17.237 INFO:tasks.workunit.client.0.smithi082.stdout:7/294: dwrite d3/f45 [0,4194304] 0 2024-04-27T07:33:17.242 INFO:tasks.workunit.client.0.smithi082.stdout:7/295: mknod d3/d49/c5f 0 2024-04-27T07:33:17.245 INFO:tasks.workunit.client.0.smithi082.stdout:1/328: dread d4/f35 [0,4194304] 0 2024-04-27T07:33:17.247 INFO:tasks.workunit.client.0.smithi082.stdout:0/400: truncate f9 19972 0 2024-04-27T07:33:17.250 INFO:tasks.workunit.client.0.smithi082.stdout:1/329: creat d4/d15/d3f/f74 x:0 0 0 2024-04-27T07:33:17.251 INFO:tasks.workunit.client.0.smithi082.stdout:3/484: dwrite d8/d9/d3f/f4a [0,4194304] 0 2024-04-27T07:33:17.254 INFO:tasks.workunit.client.0.smithi082.stdout:7/296: dwrite d3/de/f2f [0,4194304] 0 2024-04-27T07:33:17.258 INFO:tasks.workunit.client.0.smithi082.stdout:0/401: write da/d28/d36/d40/f64 [4903003,38666] 0 2024-04-27T07:33:17.261 INFO:tasks.workunit.client.0.smithi082.stdout:7/297: chown d3/l19 839234476 1 2024-04-27T07:33:17.262 INFO:tasks.workunit.client.0.smithi082.stdout:7/298: fsync d3/de/f3b 0 2024-04-27T07:33:17.264 INFO:tasks.workunit.client.0.smithi082.stdout:1/330: write d4/d15/d29/f36 [754097,22522] 0 2024-04-27T07:33:17.265 INFO:tasks.workunit.client.0.smithi082.stdout:3/485: dread d8/d9/dd/d13/d1b/f28 [0,4194304] 0 2024-04-27T07:33:17.266 INFO:tasks.workunit.client.0.smithi082.stdout:1/331: chown d4/d15/d49/d4e/f5e 20440 1 2024-04-27T07:33:17.322 INFO:tasks.workunit.client.0.smithi082.stdout:4/260: sync 2024-04-27T07:33:17.322 INFO:tasks.workunit.client.0.smithi082.stdout:6/281: sync 2024-04-27T07:33:17.322 INFO:tasks.workunit.client.0.smithi082.stdout:6/282: fdatasync d2/d3/d1b/f28 0 2024-04-27T07:33:17.323 INFO:tasks.workunit.client.0.smithi082.stdout:6/283: chown d2/f18 205 1 2024-04-27T07:33:17.366 INFO:tasks.workunit.client.0.smithi082.stdout:7/299: creat d3/de/f60 x:0 0 0 2024-04-27T07:33:17.367 INFO:tasks.workunit.client.0.smithi082.stdout:7/300: stat d3/db/ff 0 2024-04-27T07:33:17.368 INFO:tasks.workunit.client.0.smithi082.stdout:4/261: creat d3/d6/d22/f59 x:0 0 0 2024-04-27T07:33:17.369 INFO:tasks.workunit.client.0.smithi082.stdout:6/284: write d2/de/f17 [4644671,112150] 0 2024-04-27T07:33:17.370 INFO:tasks.workunit.client.0.smithi082.stdout:7/301: truncate d3/db/f32 505863 0 2024-04-27T07:33:17.371 INFO:tasks.workunit.client.0.smithi082.stdout:4/262: symlink d3/d6/d26/l5a 0 2024-04-27T07:33:17.373 INFO:tasks.workunit.client.0.smithi082.stdout:7/302: read d3/db/f18 [4126756,123659] 0 2024-04-27T07:33:17.373 INFO:tasks.workunit.client.0.smithi082.stdout:6/285: mknod d2/d2d/d4a/c5e 0 2024-04-27T07:33:17.376 INFO:tasks.workunit.client.0.smithi082.stdout:4/263: rename d3/d10/f3a to d3/d10/d1f/f5b 0 2024-04-27T07:33:17.378 INFO:tasks.workunit.client.0.smithi082.stdout:7/303: mkdir d3/d9/d4f/d61 0 2024-04-27T07:33:17.381 INFO:tasks.workunit.client.0.smithi082.stdout:7/304: chown d3/de/d3a/l3c 97 1 2024-04-27T07:33:17.383 INFO:tasks.workunit.client.0.smithi082.stdout:1/332: truncate d4/d15/d49/d4e/f5a 835148 0 2024-04-27T07:33:17.386 INFO:tasks.workunit.client.0.smithi082.stdout:6/286: dread - d2/f2a zero size 2024-04-27T07:33:17.388 INFO:tasks.workunit.client.0.smithi082.stdout:4/264: dwrite d3/f43 [0,4194304] 0 2024-04-27T07:33:17.391 INFO:tasks.workunit.client.0.smithi082.stdout:6/287: chown d2/de/d13/f16 18 1 2024-04-27T07:33:17.391 INFO:tasks.workunit.client.0.smithi082.stdout:1/333: link d4/c13 d4/d2a/d3e/c75 0 2024-04-27T07:33:17.392 INFO:tasks.workunit.client.0.smithi082.stdout:6/288: fsync d2/f23 0 2024-04-27T07:33:17.396 INFO:tasks.workunit.client.0.smithi082.stdout:7/305: dwrite d3/f45 [4194304,4194304] 0 2024-04-27T07:33:17.396 INFO:tasks.workunit.client.0.smithi082.stdout:1/334: rmdir d4/d2a/d4c 39 2024-04-27T07:33:17.396 INFO:tasks.workunit.client.0.smithi082.stdout:6/289: write d2/d2e/f3b [5039725,123611] 0 2024-04-27T07:33:17.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/265: dwrite d3/d6/d26/f35 [0,4194304] 0 2024-04-27T07:33:17.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/290: truncate d2/d2d/d4a/f50 944809 0 2024-04-27T07:33:17.403 INFO:tasks.workunit.client.0.smithi082.stdout:7/306: rmdir d3/db/d59 39 2024-04-27T07:33:17.404 INFO:tasks.workunit.client.0.smithi082.stdout:7/307: stat d3/de/f1b 0 2024-04-27T07:33:17.406 INFO:tasks.workunit.client.0.smithi082.stdout:4/266: getdents d3/d6/d26/d55 0 2024-04-27T07:33:17.414 INFO:tasks.workunit.client.0.smithi082.stdout:4/267: dwrite d3/d9/f45 [0,4194304] 0 2024-04-27T07:33:17.420 INFO:tasks.workunit.client.0.smithi082.stdout:4/268: mknod d3/d6/d26/d55/c5c 0 2024-04-27T07:33:17.420 INFO:tasks.workunit.client.0.smithi082.stdout:7/308: truncate d3/f6 4275659 0 2024-04-27T07:33:17.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/291: dwrite d2/de/d13/f16 [0,4194304] 0 2024-04-27T07:33:17.427 INFO:tasks.workunit.client.0.smithi082.stdout:1/335: dwrite d4/d15/d49/d4e/f5a [0,4194304] 0 2024-04-27T07:33:17.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/309: getdents d3/d9/d4f 0 2024-04-27T07:33:17.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/292: mknod d2/d2e/c5f 0 2024-04-27T07:33:17.432 INFO:tasks.workunit.client.0.smithi082.stdout:4/269: link d3/d6/d26/f36 d3/d6/f5d 0 2024-04-27T07:33:17.433 INFO:tasks.workunit.client.0.smithi082.stdout:7/310: unlink d3/de/l4d 0 2024-04-27T07:33:17.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/336: unlink d4/d2a/d3e/d53/d72/f73 0 2024-04-27T07:33:17.440 INFO:tasks.workunit.client.0.smithi082.stdout:4/270: truncate d3/d6/d26/f49 293292 0 2024-04-27T07:33:17.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/337: dwrite d4/fc [4194304,4194304] 0 2024-04-27T07:33:17.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/338: readlink d4/d2a/d3e/d57/l6e 0 2024-04-27T07:33:17.449 INFO:tasks.workunit.client.0.smithi082.stdout:4/271: rename d3/d10/d1f to d3/d6/d26/d5e 0 2024-04-27T07:33:17.450 INFO:tasks.workunit.client.0.smithi082.stdout:7/311: creat d3/de/f62 x:0 0 0 2024-04-27T07:33:17.453 INFO:tasks.workunit.client.0.smithi082.stdout:7/312: unlink d3/de/d3a/f42 0 2024-04-27T07:33:17.454 INFO:tasks.workunit.client.0.smithi082.stdout:7/313: chown d3/d9/d4f/d61 0 1 2024-04-27T07:33:17.454 INFO:tasks.workunit.client.0.smithi082.stdout:7/314: readlink d3/l19 0 2024-04-27T07:33:17.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/339: link d4/d15/d49/d4e/c70 d4/d15/d1c/c76 0 2024-04-27T07:33:17.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/340: dread - d4/d15/d49/d4e/f5e zero size 2024-04-27T07:33:17.460 INFO:tasks.workunit.client.0.smithi082.stdout:1/341: creat d4/d2a/d3e/d57/f77 x:0 0 0 2024-04-27T07:33:17.467 INFO:tasks.workunit.client.0.smithi082.stdout:1/342: dread d4/f1d [0,4194304] 0 2024-04-27T07:33:17.468 INFO:tasks.workunit.client.0.smithi082.stdout:1/343: stat d4/d15/f2b 0 2024-04-27T07:33:17.470 INFO:tasks.workunit.client.0.smithi082.stdout:1/344: rmdir d4/d2a/d4c 39 2024-04-27T07:33:17.473 INFO:tasks.workunit.client.0.smithi082.stdout:4/272: truncate d3/d6/d26/f49 20311 0 2024-04-27T07:33:17.475 INFO:tasks.workunit.client.0.smithi082.stdout:6/293: truncate d2/d45/f42 1484419 0 2024-04-27T07:33:17.476 INFO:tasks.workunit.client.0.smithi082.stdout:4/273: creat d3/d6/d26/d55/f5f x:0 0 0 2024-04-27T07:33:17.477 INFO:tasks.workunit.client.0.smithi082.stdout:4/274: chown d3/d6/d26/l5a 129125379 1 2024-04-27T07:33:17.481 INFO:tasks.workunit.client.0.smithi082.stdout:1/345: rename d4/d2a/d4c/l5f to d4/d15/l78 0 2024-04-27T07:33:17.482 INFO:tasks.workunit.client.0.smithi082.stdout:4/275: dread d3/f29 [0,4194304] 0 2024-04-27T07:33:17.482 INFO:tasks.workunit.client.0.smithi082.stdout:1/346: stat d4/d15/d49/d4e/f5a 0 2024-04-27T07:33:17.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/276: readlink d3/d6/d26/l2d 0 2024-04-27T07:33:17.483 INFO:tasks.workunit.client.0.smithi082.stdout:7/315: write d3/d9/d4f/f54 [636928,93556] 0 2024-04-27T07:33:17.484 INFO:tasks.workunit.client.0.smithi082.stdout:4/277: chown d3/d9/f45 9982412 1 2024-04-27T07:33:17.487 INFO:tasks.workunit.client.0.smithi082.stdout:6/294: creat d2/f60 x:0 0 0 2024-04-27T07:33:17.488 INFO:tasks.workunit.client.0.smithi082.stdout:7/316: mknod d3/d9/d4f/c63 0 2024-04-27T07:33:17.488 INFO:tasks.workunit.client.0.smithi082.stdout:6/295: chown d2/de/f17 7368042 1 2024-04-27T07:33:17.488 INFO:tasks.workunit.client.0.smithi082.stdout:7/317: fdatasync d3/d49/f51 0 2024-04-27T07:33:17.489 INFO:tasks.workunit.client.0.smithi082.stdout:1/347: rename d4/d15/d49/l5d to d4/d2a/d4c/l79 0 2024-04-27T07:33:17.490 INFO:tasks.workunit.client.0.smithi082.stdout:4/278: fsync d3/d6/d26/d5e/f5b 0 2024-04-27T07:33:17.491 INFO:tasks.workunit.client.0.smithi082.stdout:1/348: write d4/d2a/d3e/f40 [4469218,71311] 0 2024-04-27T07:33:17.492 INFO:tasks.workunit.client.0.smithi082.stdout:4/279: write d3/d9/f44 [93720,112258] 0 2024-04-27T07:33:17.495 INFO:tasks.workunit.client.0.smithi082.stdout:1/349: dread f2 [0,4194304] 0 2024-04-27T07:33:17.496 INFO:tasks.workunit.client.0.smithi082.stdout:7/318: rename d3/f20 to d3/db/d59/f64 0 2024-04-27T07:33:17.502 INFO:tasks.workunit.client.0.smithi082.stdout:1/350: dwrite d4/d2a/d4c/f6c [0,4194304] 0 2024-04-27T07:33:17.505 INFO:tasks.workunit.client.0.smithi082.stdout:4/280: rename d3/d6/d26/f49 to d3/d6/d26/f60 0 2024-04-27T07:33:17.507 INFO:tasks.workunit.client.0.smithi082.stdout:4/281: dread - d3/d6/d26/d5e/f48 zero size 2024-04-27T07:33:17.510 INFO:tasks.workunit.client.0.smithi082.stdout:1/351: dwrite d4/d15/d3f/f74 [0,4194304] 0 2024-04-27T07:33:17.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/282: symlink d3/l61 0 2024-04-27T07:33:17.513 INFO:tasks.workunit.client.0.smithi082.stdout:1/352: mkdir d4/d2a/d4c/d7a 0 2024-04-27T07:33:17.515 INFO:tasks.workunit.client.0.smithi082.stdout:4/283: mknod d3/d6/d26/c62 0 2024-04-27T07:33:17.517 INFO:tasks.workunit.client.0.smithi082.stdout:1/353: write d4/d2a/f6b [874208,81509] 0 2024-04-27T07:33:17.521 INFO:tasks.workunit.client.0.smithi082.stdout:4/284: rename d3/d6/l30 to d3/d6/d22/l63 0 2024-04-27T07:33:17.521 INFO:tasks.workunit.client.0.smithi082.stdout:4/285: write d3/f43 [3739788,65294] 0 2024-04-27T07:33:17.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/354: mknod d4/d2a/d3e/c7b 0 2024-04-27T07:33:17.524 INFO:tasks.workunit.client.0.smithi082.stdout:1/355: write d4/d15/d49/d4e/f5a [4122695,62833] 0 2024-04-27T07:33:17.524 INFO:tasks.workunit.client.0.smithi082.stdout:4/286: truncate d3/d6/f51 950840 0 2024-04-27T07:33:17.526 INFO:tasks.workunit.client.0.smithi082.stdout:6/296: write d2/d45/f42 [174565,84801] 0 2024-04-27T07:33:17.527 INFO:tasks.workunit.client.0.smithi082.stdout:4/287: chown d3/d10/f15 14 1 2024-04-27T07:33:17.531 INFO:tasks.workunit.client.0.smithi082.stdout:6/297: creat d2/d2e/f61 x:0 0 0 2024-04-27T07:33:17.531 INFO:tasks.workunit.client.0.smithi082.stdout:4/288: write d3/d10/f4f [629977,129766] 0 2024-04-27T07:33:17.533 INFO:tasks.workunit.client.0.smithi082.stdout:4/289: write d3/d6/f3e [1858030,5705] 0 2024-04-27T07:33:17.535 INFO:tasks.workunit.client.0.smithi082.stdout:1/356: dwrite d4/f1d [0,4194304] 0 2024-04-27T07:33:17.536 INFO:tasks.workunit.client.0.smithi082.stdout:4/290: readlink d3/d6/d22/l63 0 2024-04-27T07:33:17.537 INFO:tasks.workunit.client.0.smithi082.stdout:1/357: write d4/f12 [2526064,17049] 0 2024-04-27T07:33:17.538 INFO:tasks.workunit.client.0.smithi082.stdout:1/358: fdatasync d4/d2a/d3e/f40 0 2024-04-27T07:33:17.539 INFO:tasks.workunit.client.0.smithi082.stdout:4/291: mknod d3/c64 0 2024-04-27T07:33:17.540 INFO:tasks.workunit.client.0.smithi082.stdout:1/359: fsync d4/d2a/f6b 0 2024-04-27T07:33:17.541 INFO:tasks.workunit.client.0.smithi082.stdout:2/285: sync 2024-04-27T07:33:17.541 INFO:tasks.workunit.client.0.smithi082.stdout:9/273: sync 2024-04-27T07:33:17.548 INFO:tasks.workunit.client.0.smithi082.stdout:9/274: write d9/da/f26 [549511,55777] 0 2024-04-27T07:33:17.549 INFO:tasks.workunit.client.0.smithi082.stdout:4/292: creat d3/d9/f65 x:0 0 0 2024-04-27T07:33:17.552 INFO:tasks.workunit.client.0.smithi082.stdout:2/286: link d7/d30/f36 d7/f5b 0 2024-04-27T07:33:17.554 INFO:tasks.workunit.client.0.smithi082.stdout:4/293: rmdir d3/d6 39 2024-04-27T07:33:17.555 INFO:tasks.workunit.client.0.smithi082.stdout:2/287: write d7/f5b [333133,57023] 0 2024-04-27T07:33:17.559 INFO:tasks.workunit.client.0.smithi082.stdout:2/288: creat d7/d14/f5c x:0 0 0 2024-04-27T07:33:17.559 INFO:tasks.workunit.client.0.smithi082.stdout:1/360: write d4/f10 [745473,77388] 0 2024-04-27T07:33:17.559 INFO:tasks.workunit.client.0.smithi082.stdout:4/294: mknod d3/d6/d26/d5e/c66 0 2024-04-27T07:33:17.560 INFO:tasks.workunit.client.0.smithi082.stdout:2/289: write d7/f56 [157949,28869] 0 2024-04-27T07:33:17.562 INFO:tasks.workunit.client.0.smithi082.stdout:1/361: creat d4/d2a/d3e/f7c x:0 0 0 2024-04-27T07:33:17.562 INFO:tasks.workunit.client.0.smithi082.stdout:4/295: rmdir d3/d6/d16 39 2024-04-27T07:33:17.565 INFO:tasks.workunit.client.0.smithi082.stdout:2/290: rename d7/f58 to d7/d9/d4f/f5d 0 2024-04-27T07:33:17.566 INFO:tasks.workunit.client.0.smithi082.stdout:2/291: chown d7/d14/f3d 509984 1 2024-04-27T07:33:17.569 INFO:tasks.workunit.client.0.smithi082.stdout:1/362: rename d4/d15/d3f/f74 to d4/d15/d29/f7d 0 2024-04-27T07:33:17.571 INFO:tasks.workunit.client.0.smithi082.stdout:4/296: getdents d3/d6/d26/d55 0 2024-04-27T07:33:17.573 INFO:tasks.workunit.client.0.smithi082.stdout:4/297: write d3/d6/d26/d5e/f5b [1885857,72117] 0 2024-04-27T07:33:17.573 INFO:tasks.workunit.client.0.smithi082.stdout:1/363: dread d4/f10 [0,4194304] 0 2024-04-27T07:33:17.576 INFO:tasks.workunit.client.0.smithi082.stdout:1/364: rename d4/d15/d1c/c32 to d4/d2a/d39/c7e 0 2024-04-27T07:33:17.577 INFO:tasks.workunit.client.0.smithi082.stdout:1/365: dread - d4/f34 zero size 2024-04-27T07:33:17.578 INFO:tasks.workunit.client.0.smithi082.stdout:4/298: dread d3/d6/d22/f24 [0,4194304] 0 2024-04-27T07:33:17.578 INFO:tasks.workunit.client.0.smithi082.stdout:1/366: readlink d4/l1a 0 2024-04-27T07:33:17.579 INFO:tasks.workunit.client.0.smithi082.stdout:4/299: fsync d3/d6/d26/d5e/f2f 0 2024-04-27T07:33:17.581 INFO:tasks.workunit.client.0.smithi082.stdout:4/300: mkdir d3/d6/d26/d55/d67 0 2024-04-27T07:33:17.584 INFO:tasks.workunit.client.0.smithi082.stdout:4/301: creat d3/d9/f68 x:0 0 0 2024-04-27T07:33:17.587 INFO:tasks.workunit.client.0.smithi082.stdout:4/302: mkdir d3/d6/d22/d69 0 2024-04-27T07:33:17.589 INFO:tasks.workunit.client.0.smithi082.stdout:1/367: dwrite d4/f1e [4194304,4194304] 0 2024-04-27T07:33:17.590 INFO:tasks.workunit.client.0.smithi082.stdout:1/368: truncate d4/d15/f2b 1564086 0 2024-04-27T07:33:17.592 INFO:tasks.workunit.client.0.smithi082.stdout:4/303: creat d3/d9/f6a x:0 0 0 2024-04-27T07:33:17.597 INFO:tasks.workunit.client.0.smithi082.stdout:4/304: rename d3/d6/d26/d5e/f37 to d3/d6/d26/d55/f6b 0 2024-04-27T07:33:17.598 INFO:tasks.workunit.client.0.smithi082.stdout:4/305: chown d3/d6/d22 33124 1 2024-04-27T07:33:17.599 INFO:tasks.workunit.client.0.smithi082.stdout:1/369: dwrite d4/d2a/d3e/f7c [0,4194304] 0 2024-04-27T07:33:17.603 INFO:tasks.workunit.client.0.smithi082.stdout:1/370: rename d4/f1d to d4/d2a/d39/f7f 0 2024-04-27T07:33:17.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/306: creat d3/d10/f6c x:0 0 0 2024-04-27T07:33:17.606 INFO:tasks.workunit.client.0.smithi082.stdout:4/307: write d3/d9/f6a [247329,122465] 0 2024-04-27T07:33:17.614 INFO:tasks.workunit.client.0.smithi082.stdout:1/371: dwrite d4/d2a/d39/f43 [0,4194304] 0 2024-04-27T07:33:17.622 INFO:tasks.workunit.client.0.smithi082.stdout:1/372: dwrite d4/d2a/d39/f4a [0,4194304] 0 2024-04-27T07:33:17.624 INFO:tasks.workunit.client.0.smithi082.stdout:4/308: dread d3/d10/f15 [4194304,4194304] 0 2024-04-27T07:33:17.629 INFO:tasks.workunit.client.0.smithi082.stdout:1/373: getdents d4/d15/d29 0 2024-04-27T07:33:17.629 INFO:tasks.workunit.client.0.smithi082.stdout:1/374: stat d4/d2a/d3e/d57/l6e 0 2024-04-27T07:33:17.633 INFO:tasks.workunit.client.0.smithi082.stdout:1/375: dread d4/f35 [0,4194304] 0 2024-04-27T07:33:17.635 INFO:tasks.workunit.client.0.smithi082.stdout:4/309: truncate d3/d6/d26/d55/f6b 331954 0 2024-04-27T07:33:17.636 INFO:tasks.workunit.client.0.smithi082.stdout:1/376: dread d4/f28 [0,4194304] 0 2024-04-27T07:33:17.637 INFO:tasks.workunit.client.0.smithi082.stdout:4/310: dread d3/f29 [0,4194304] 0 2024-04-27T07:33:17.638 INFO:tasks.workunit.client.0.smithi082.stdout:4/311: fdatasync d3/d6/d26/d5e/d21/f2a 0 2024-04-27T07:33:17.639 INFO:tasks.workunit.client.0.smithi082.stdout:4/312: fsync d3/d6/d22/f40 0 2024-04-27T07:33:17.643 INFO:tasks.workunit.client.0.smithi082.stdout:1/377: dwrite d4/fd [0,4194304] 0 2024-04-27T07:33:17.644 INFO:tasks.workunit.client.0.smithi082.stdout:1/378: readlink d4/d15/d1c/l42 0 2024-04-27T07:33:17.648 INFO:tasks.workunit.client.0.smithi082.stdout:1/379: link d4/f12 d4/d2a/d4c/d7a/f80 0 2024-04-27T07:33:17.658 INFO:tasks.workunit.client.0.smithi082.stdout:1/380: dread d4/f11 [0,4194304] 0 2024-04-27T07:33:17.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/381: link d4/d2a/d39/c62 d4/d15/d49/d4e/c81 0 2024-04-27T07:33:17.664 INFO:tasks.workunit.client.0.smithi082.stdout:1/382: readlink d4/d2a/d3e/d57/l6e 0 2024-04-27T07:33:17.669 INFO:tasks.workunit.client.0.smithi082.stdout:1/383: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:17.676 INFO:tasks.workunit.client.0.smithi082.stdout:1/384: rmdir d4/d2a/d39 39 2024-04-27T07:33:17.677 INFO:tasks.workunit.client.0.smithi082.stdout:1/385: chown d4/d15/l27 0 1 2024-04-27T07:33:17.679 INFO:tasks.workunit.client.0.smithi082.stdout:1/386: dread d4/d15/f17 [0,4194304] 0 2024-04-27T07:33:17.681 INFO:tasks.workunit.client.0.smithi082.stdout:1/387: dread d4/d2a/d3e/d53/f54 [0,4194304] 0 2024-04-27T07:33:17.729 INFO:tasks.workunit.client.0.smithi082.stdout:1/388: creat d4/d2a/f82 x:0 0 0 2024-04-27T07:33:17.730 INFO:tasks.workunit.client.0.smithi082.stdout:8/240: sync 2024-04-27T07:33:17.732 INFO:tasks.workunit.client.0.smithi082.stdout:8/241: write d0/d3/d1b/d24/f3f [3418453,66143] 0 2024-04-27T07:33:17.735 INFO:tasks.workunit.client.0.smithi082.stdout:8/242: creat d0/d2b/f4a x:0 0 0 2024-04-27T07:33:17.737 INFO:tasks.workunit.client.0.smithi082.stdout:8/243: mknod d0/c4b 0 2024-04-27T07:33:17.738 INFO:tasks.workunit.client.0.smithi082.stdout:8/244: chown d0/d3/d1b 6097 1 2024-04-27T07:33:17.752 INFO:tasks.workunit.client.0.smithi082.stdout:8/245: dwrite d0/d3/d1b/f25 [0,4194304] 0 2024-04-27T07:33:17.752 INFO:tasks.workunit.client.0.smithi082.stdout:1/389: dread d4/fc [0,4194304] 0 2024-04-27T07:33:17.759 INFO:tasks.workunit.client.0.smithi082.stdout:8/246: rename d0/d3/d1b/f25 to d0/d2b/f4c 0 2024-04-27T07:33:17.760 INFO:tasks.workunit.client.0.smithi082.stdout:1/390: symlink d4/d2a/d4c/l83 0 2024-04-27T07:33:17.760 INFO:tasks.workunit.client.0.smithi082.stdout:1/391: chown d4/d15/d3f 1162 1 2024-04-27T07:33:17.763 INFO:tasks.workunit.client.0.smithi082.stdout:1/392: mknod d4/d15/d3f/d6d/c84 0 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: Adjusting osd_memory_target on smithi082 to 1557M 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:17.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:17 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: Adjusting osd_memory_target on smithi082 to 1557M 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:17 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.014 INFO:tasks.workunit.client.0.smithi082.stdout:5/370: sync 2024-04-27T07:33:18.014 INFO:tasks.workunit.client.0.smithi082.stdout:5/371: fsync d8/d14/f16 0 2024-04-27T07:33:18.020 INFO:tasks.workunit.client.0.smithi082.stdout:5/372: dwrite d8/d14/f4d [0,4194304] 0 2024-04-27T07:33:18.020 INFO:tasks.workunit.client.0.smithi082.stdout:5/373: chown d8/d29/f6e 1089858042 1 2024-04-27T07:33:18.029 INFO:tasks.workunit.client.0.smithi082.stdout:5/374: dwrite d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:18.030 INFO:tasks.workunit.client.0.smithi082.stdout:5/375: chown d8/d29/d4e/f5e 1151 1 2024-04-27T07:33:18.030 INFO:tasks.workunit.client.0.smithi082.stdout:5/376: fdatasync f7 0 2024-04-27T07:33:18.066 INFO:tasks.workunit.client.0.smithi082.stdout:5/377: chown d8/d3c/d5a/d5b/d5f/l79 2 1 2024-04-27T07:33:18.070 INFO:tasks.workunit.client.0.smithi082.stdout:5/378: link d8/d15/l50 d8/d42/l82 0 2024-04-27T07:33:18.073 INFO:tasks.workunit.client.0.smithi082.stdout:5/379: dread f5 [0,4194304] 0 2024-04-27T07:33:18.073 INFO:tasks.workunit.client.0.smithi082.stdout:5/380: write d8/d3b/f41 [841427,45539] 0 2024-04-27T07:33:18.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/381: truncate d8/d15/d22/f72 598835 0 2024-04-27T07:33:18.079 INFO:tasks.workunit.client.0.smithi082.stdout:5/382: chown d8/d3c/d47/f27 254745543 1 2024-04-27T07:33:18.080 INFO:tasks.workunit.client.0.smithi082.stdout:5/383: write d8/d2e/f37 [127879,114485] 0 2024-04-27T07:33:18.083 INFO:tasks.workunit.client.0.smithi082.stdout:5/384: unlink d8/d29/c81 0 2024-04-27T07:33:18.084 INFO:tasks.workunit.client.0.smithi082.stdout:5/385: truncate d8/d3c/d64/f7e 974528 0 2024-04-27T07:33:18.092 INFO:tasks.workunit.client.0.smithi082.stdout:5/386: dread d8/d29/f56 [0,4194304] 0 2024-04-27T07:33:18.097 INFO:tasks.workunit.client.0.smithi082.stdout:5/387: dwrite d8/d15/ff [0,4194304] 0 2024-04-27T07:33:18.105 INFO:tasks.workunit.client.0.smithi082.stdout:5/388: truncate d8/f45 3620314 0 2024-04-27T07:33:18.107 INFO:tasks.workunit.client.0.smithi082.stdout:5/389: mknod d8/d14/c83 0 2024-04-27T07:33:18.108 INFO:tasks.workunit.client.0.smithi082.stdout:5/390: chown d8/f25 9 1 2024-04-27T07:33:18.110 INFO:tasks.workunit.client.0.smithi082.stdout:5/391: creat d8/d3c/d5a/d5b/d5f/f84 x:0 0 0 2024-04-27T07:33:18.111 INFO:tasks.workunit.client.0.smithi082.stdout:5/392: fsync d8/d3b/f41 0 2024-04-27T07:33:18.112 INFO:tasks.workunit.client.0.smithi082.stdout:5/393: write d8/d14/f23 [6345000,128187] 0 2024-04-27T07:33:18.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/394: dread d8/f25 [8388608,4194304] 0 2024-04-27T07:33:18.133 INFO:tasks.workunit.client.0.smithi082.stdout:5/395: getdents d8/d3c 0 2024-04-27T07:33:18.136 INFO:tasks.workunit.client.0.smithi082.stdout:5/396: mkdir d8/d2e/d85 0 2024-04-27T07:33:18.137 INFO:tasks.workunit.client.0.smithi082.stdout:5/397: dread - d8/d3c/d5a/d5b/d5f/f84 zero size 2024-04-27T07:33:18.138 INFO:tasks.workunit.client.0.smithi082.stdout:5/398: chown d8/d14/c83 3435665 1 2024-04-27T07:33:18.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/399: creat d8/d2e/f86 x:0 0 0 2024-04-27T07:33:18.140 INFO:tasks.workunit.client.0.smithi082.stdout:5/400: chown d8/d77 0 1 2024-04-27T07:33:18.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/401: truncate f4 1185645 0 2024-04-27T07:33:18.150 INFO:tasks.workunit.client.0.smithi082.stdout:0/402: sync 2024-04-27T07:33:18.151 INFO:tasks.workunit.client.0.smithi082.stdout:5/402: dwrite d8/d3c/d47/f5d [0,4194304] 0 2024-04-27T07:33:18.151 INFO:tasks.workunit.client.0.smithi082.stdout:0/403: chown da/d1d/f2d 1308 1 2024-04-27T07:33:18.152 INFO:tasks.workunit.client.0.smithi082.stdout:5/403: chown d8/d14/f21 52160 1 2024-04-27T07:33:18.153 INFO:tasks.workunit.client.0.smithi082.stdout:5/404: fdatasync d8/d3c/d47/f46 0 2024-04-27T07:33:18.155 INFO:tasks.workunit.client.0.smithi082.stdout:0/404: readlink da/d1d/l39 0 2024-04-27T07:33:18.156 INFO:tasks.workunit.client.0.smithi082.stdout:0/405: fsync da/d2a/f87 0 2024-04-27T07:33:18.159 INFO:tasks.workunit.client.0.smithi082.stdout:5/405: link d8/d15/f13 d8/d3c/f87 0 2024-04-27T07:33:18.160 INFO:tasks.workunit.client.0.smithi082.stdout:0/406: mknod da/d3c/d3f/d4c/c9d 0 2024-04-27T07:33:18.161 INFO:tasks.workunit.client.0.smithi082.stdout:0/407: fsync da/d3c/d3f/d4c/f9c 0 2024-04-27T07:33:18.161 INFO:tasks.workunit.client.0.smithi082.stdout:5/406: creat d8/d3c/d4a/f88 x:0 0 0 2024-04-27T07:33:18.165 INFO:tasks.workunit.client.0.smithi082.stdout:5/407: symlink d8/d77/d7a/l89 0 2024-04-27T07:33:18.168 INFO:tasks.workunit.client.0.smithi082.stdout:0/408: dwrite da/d28/d36/d40/f64 [0,4194304] 0 2024-04-27T07:33:18.170 INFO:tasks.workunit.client.0.smithi082.stdout:0/409: write da/d3c/d3f/f41 [3074742,24765] 0 2024-04-27T07:33:18.172 INFO:tasks.workunit.client.0.smithi082.stdout:5/408: dread d8/d42/f54 [0,4194304] 0 2024-04-27T07:33:18.172 INFO:tasks.workunit.client.0.smithi082.stdout:5/409: stat d8/d14/d7b 0 2024-04-27T07:33:18.174 INFO:tasks.workunit.client.0.smithi082.stdout:0/410: mknod da/d2a/c9e 0 2024-04-27T07:33:18.177 INFO:tasks.workunit.client.0.smithi082.stdout:0/411: symlink da/d3c/d3f/d4c/d74/d81/l9f 0 2024-04-27T07:33:18.181 INFO:tasks.workunit.client.0.smithi082.stdout:5/410: dwrite d8/d3c/d64/f36 [0,4194304] 0 2024-04-27T07:33:18.184 INFO:tasks.workunit.client.0.smithi082.stdout:5/411: symlink d8/d42/l8a 0 2024-04-27T07:33:18.186 INFO:tasks.workunit.client.0.smithi082.stdout:5/412: readlink d8/d3c/d64/l39 0 2024-04-27T07:33:18.186 INFO:tasks.workunit.client.0.smithi082.stdout:0/412: dwrite da/d28/d36/d40/f52 [0,4194304] 0 2024-04-27T07:33:18.190 INFO:tasks.workunit.client.0.smithi082.stdout:0/413: mkdir da/d38/d7f/d4a/d80/da0 0 2024-04-27T07:33:18.207 INFO:tasks.workunit.client.0.smithi082.stdout:7/319: sync 2024-04-27T07:33:18.207 INFO:tasks.workunit.client.0.smithi082.stdout:3/486: sync 2024-04-27T07:33:18.207 INFO:tasks.workunit.client.0.smithi082.stdout:6/298: sync 2024-04-27T07:33:18.208 INFO:tasks.workunit.client.0.smithi082.stdout:7/320: stat d3/d9 0 2024-04-27T07:33:18.208 INFO:tasks.workunit.client.0.smithi082.stdout:0/414: write da/d1d/d6a/f7a [533801,83761] 0 2024-04-27T07:33:18.212 INFO:tasks.workunit.client.0.smithi082.stdout:6/299: rename d2/d1e/f5a to d2/d2d/d3d/f62 0 2024-04-27T07:33:18.212 INFO:tasks.workunit.client.0.smithi082.stdout:3/487: stat d8/d9/d25/d26/f98 0 2024-04-27T07:33:18.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/300: chown d2/d2d/d4a 448 1 2024-04-27T07:33:18.215 INFO:tasks.workunit.client.0.smithi082.stdout:7/321: creat d3/de/d3a/f65 x:0 0 0 2024-04-27T07:33:18.216 INFO:tasks.workunit.client.0.smithi082.stdout:0/415: dread da/d28/d36/d40/f44 [0,4194304] 0 2024-04-27T07:33:18.216 INFO:tasks.workunit.client.0.smithi082.stdout:6/301: truncate d2/d3/f6 1602860 0 2024-04-27T07:33:18.217 INFO:tasks.workunit.client.0.smithi082.stdout:7/322: write d3/db/f5d [1006807,10377] 0 2024-04-27T07:33:18.217 INFO:tasks.workunit.client.0.smithi082.stdout:6/302: chown d2/d3/d1b/l40 3700375 1 2024-04-27T07:33:18.218 INFO:tasks.workunit.client.0.smithi082.stdout:3/488: creat d8/d9/d25/d26/d3d/fb2 x:0 0 0 2024-04-27T07:33:18.220 INFO:tasks.workunit.client.0.smithi082.stdout:0/416: dread - da/d28/f43 zero size 2024-04-27T07:33:18.221 INFO:tasks.workunit.client.0.smithi082.stdout:7/323: symlink d3/de/l66 0 2024-04-27T07:33:18.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/417: mknod da/d3c/d3f/d4c/d74/ca1 0 2024-04-27T07:33:18.223 INFO:tasks.workunit.client.0.smithi082.stdout:7/324: read d3/de/d3a/d2a/f3f [17282,96320] 0 2024-04-27T07:33:18.224 INFO:tasks.workunit.client.0.smithi082.stdout:3/489: mkdir d8/d9/d1d/da5/db3 0 2024-04-27T07:33:18.224 INFO:tasks.workunit.client.0.smithi082.stdout:3/490: readlink d8/d9/d1d/l20 0 2024-04-27T07:33:18.226 INFO:tasks.workunit.client.0.smithi082.stdout:0/418: creat da/d3c/fa2 x:0 0 0 2024-04-27T07:33:18.226 INFO:tasks.workunit.client.0.smithi082.stdout:6/303: link d2/de/d13/l2b d2/d2e/l63 0 2024-04-27T07:33:18.227 INFO:tasks.workunit.client.0.smithi082.stdout:0/419: truncate da/d38/f3a 4613216 0 2024-04-27T07:33:18.229 INFO:tasks.workunit.client.0.smithi082.stdout:6/304: dread d2/d1e/f34 [0,4194304] 0 2024-04-27T07:33:18.229 INFO:tasks.workunit.client.0.smithi082.stdout:6/305: stat d2/d1e/d32/f4e 0 2024-04-27T07:33:18.231 INFO:tasks.workunit.client.0.smithi082.stdout:3/491: creat d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 x:0 0 0 2024-04-27T07:33:18.233 INFO:tasks.workunit.client.0.smithi082.stdout:6/306: symlink d2/d2d/d3d/l64 0 2024-04-27T07:33:18.236 INFO:tasks.workunit.client.0.smithi082.stdout:3/492: mkdir d8/d9/d1d/db5 0 2024-04-27T07:33:18.239 INFO:tasks.workunit.client.0.smithi082.stdout:6/307: dread d2/de/d13/f1c [0,4194304] 0 2024-04-27T07:33:18.239 INFO:tasks.workunit.client.0.smithi082.stdout:3/493: truncate d8/d9/d1f/f4c 2835731 0 2024-04-27T07:33:18.240 INFO:tasks.workunit.client.0.smithi082.stdout:6/308: readlink d2/l4c 0 2024-04-27T07:33:18.241 INFO:tasks.workunit.client.0.smithi082.stdout:3/494: write d8/d9/d25/d66/d6d/f7f [323754,51906] 0 2024-04-27T07:33:18.243 INFO:tasks.workunit.client.0.smithi082.stdout:6/309: mknod d2/d2d/d4a/c65 0 2024-04-27T07:33:18.245 INFO:tasks.workunit.client.0.smithi082.stdout:3/495: symlink d8/lb6 0 2024-04-27T07:33:18.247 INFO:tasks.workunit.client.0.smithi082.stdout:6/310: write d2/de/d13/f1c [2270909,66305] 0 2024-04-27T07:33:18.249 INFO:tasks.workunit.client.0.smithi082.stdout:0/420: dwrite da/d3c/d3f/f5b [0,4194304] 0 2024-04-27T07:33:18.250 INFO:tasks.workunit.client.0.smithi082.stdout:6/311: truncate d2/d2d/d3d/f62 54782 0 2024-04-27T07:33:18.251 INFO:tasks.workunit.client.0.smithi082.stdout:6/312: dread - d2/d2d/f51 zero size 2024-04-27T07:33:18.257 INFO:tasks.workunit.client.0.smithi082.stdout:3/496: write d8/d9/d1f/f63 [4144278,115132] 0 2024-04-27T07:33:18.258 INFO:tasks.workunit.client.0.smithi082.stdout:6/313: mknod d2/d45/d5d/c66 0 2024-04-27T07:33:18.264 INFO:tasks.workunit.client.0.smithi082.stdout:3/497: rename d8/d9/dd/d13/f48 to d8/d9/d25/d91/fb7 0 2024-04-27T07:33:18.269 INFO:tasks.workunit.client.0.smithi082.stdout:3/498: rename d8/d9/d1f/l69 to d8/d9/d25/d26/d4d/lb8 0 2024-04-27T07:33:18.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/499: write d8/d9/d25/d4e/f96 [553971,77545] 0 2024-04-27T07:33:18.277 INFO:tasks.workunit.client.0.smithi082.stdout:0/421: dread da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:18.278 INFO:tasks.workunit.client.0.smithi082.stdout:6/314: dread d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:18.280 INFO:tasks.workunit.client.0.smithi082.stdout:0/422: write da/d2a/f5d [755000,103408] 0 2024-04-27T07:33:18.281 INFO:tasks.workunit.client.0.smithi082.stdout:3/500: dwrite d8/d9/d1f/f63 [0,4194304] 0 2024-04-27T07:33:18.284 INFO:tasks.workunit.client.0.smithi082.stdout:6/315: creat d2/de/d13/f67 x:0 0 0 2024-04-27T07:33:18.285 INFO:tasks.workunit.client.0.smithi082.stdout:3/501: mkdir d8/d9/d25/d26/d4d/d82/db9 0 2024-04-27T07:33:18.287 INFO:tasks.workunit.client.0.smithi082.stdout:0/423: dwrite da/f6c [0,4194304] 0 2024-04-27T07:33:18.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/316: dread d2/d3/d1b/f4b [0,4194304] 0 2024-04-27T07:33:18.290 INFO:tasks.workunit.client.0.smithi082.stdout:6/317: write d2/de/d13/f67 [26060,23214] 0 2024-04-27T07:33:18.298 INFO:tasks.workunit.client.0.smithi082.stdout:6/318: dwrite d2/de/d13/f21 [0,4194304] 0 2024-04-27T07:33:18.299 INFO:tasks.workunit.client.0.smithi082.stdout:3/502: dread d8/f2e [0,4194304] 0 2024-04-27T07:33:18.303 INFO:tasks.workunit.client.0.smithi082.stdout:3/503: write d8/d9/dd/d13/f7b [2874621,51187] 0 2024-04-27T07:33:18.305 INFO:tasks.workunit.client.0.smithi082.stdout:3/504: fsync d8/d9/d25/d66/d6d/f7d 0 2024-04-27T07:33:18.306 INFO:tasks.workunit.client.0.smithi082.stdout:6/319: link d2/de/l29 d2/d1e/d32/l68 0 2024-04-27T07:33:18.306 INFO:tasks.workunit.client.0.smithi082.stdout:3/505: read - d8/d9/dd/d13/d1b/f93 zero size 2024-04-27T07:33:18.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/424: truncate da/d2a/f46 4015560 0 2024-04-27T07:33:18.309 INFO:tasks.workunit.client.0.smithi082.stdout:0/425: dread - da/d38/d7f/d4a/f6d zero size 2024-04-27T07:33:18.311 INFO:tasks.workunit.client.0.smithi082.stdout:3/506: rename d8/l10 to d8/d9/d25/d26/d4d/d82/d8b/da0/lba 0 2024-04-27T07:33:18.312 INFO:tasks.workunit.client.0.smithi082.stdout:0/426: write da/d28/d36/d40/f90 [179626,124291] 0 2024-04-27T07:33:18.314 INFO:tasks.workunit.client.0.smithi082.stdout:6/320: dwrite d2/f60 [0,4194304] 0 2024-04-27T07:33:18.316 INFO:tasks.workunit.client.0.smithi082.stdout:3/507: symlink d8/d9/d25/d26/d4d/d82/lbb 0 2024-04-27T07:33:18.317 INFO:tasks.workunit.client.0.smithi082.stdout:6/321: creat d2/d2d/f69 x:0 0 0 2024-04-27T07:33:18.318 INFO:tasks.workunit.client.0.smithi082.stdout:0/427: creat da/d38/d7f/d4a/d80/da0/fa3 x:0 0 0 2024-04-27T07:33:18.319 INFO:tasks.workunit.client.0.smithi082.stdout:0/428: chown da/d28/d36/d40/d83 154 1 2024-04-27T07:33:18.319 INFO:tasks.workunit.client.0.smithi082.stdout:6/322: mkdir d2/d2e/d6a 0 2024-04-27T07:33:18.320 INFO:tasks.workunit.client.0.smithi082.stdout:3/508: symlink d8/d9/dd/d13/d1b/da8/lbc 0 2024-04-27T07:33:18.321 INFO:tasks.workunit.client.0.smithi082.stdout:6/323: chown d2/d45/c43 248328 1 2024-04-27T07:33:18.323 INFO:tasks.workunit.client.0.smithi082.stdout:6/324: write d2/d3/f27 [2814045,102580] 0 2024-04-27T07:33:18.324 INFO:tasks.workunit.client.0.smithi082.stdout:0/429: rename da/d38/d7f/f4f to da/d38/d7f/d4a/fa4 0 2024-04-27T07:33:18.329 INFO:tasks.workunit.client.0.smithi082.stdout:3/509: rename d8/d9/d25/d66/d6d to d8/d9/dd/d13/d1b/dbd 0 2024-04-27T07:33:18.331 INFO:tasks.workunit.client.0.smithi082.stdout:3/510: truncate d8/d9/dd/d13/d1b/f93 312019 0 2024-04-27T07:33:18.331 INFO:tasks.workunit.client.0.smithi082.stdout:0/430: chown da/d38/d7f/c9a 45 1 2024-04-27T07:33:18.333 INFO:tasks.workunit.client.0.smithi082.stdout:3/511: dread - d8/d9/dd/d13/d1b/f31 zero size 2024-04-27T07:33:18.337 INFO:tasks.workunit.client.0.smithi082.stdout:3/512: creat d8/d9/d25/d26/fbe x:0 0 0 2024-04-27T07:33:18.341 INFO:tasks.workunit.client.0.smithi082.stdout:3/513: fsync d8/d9/dd/d13/d1b/f31 0 2024-04-27T07:33:18.344 INFO:tasks.workunit.client.0.smithi082.stdout:3/514: truncate d8/d9/dd/d13/d1b/dbd/f44 4637748 0 2024-04-27T07:33:18.344 INFO:tasks.workunit.client.0.smithi082.stdout:6/325: unlink d2/d2d/d3d/f62 0 2024-04-27T07:33:18.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/275: sync 2024-04-27T07:33:18.351 INFO:tasks.workunit.client.0.smithi082.stdout:8/247: sync 2024-04-27T07:33:18.351 INFO:tasks.workunit.client.0.smithi082.stdout:4/313: sync 2024-04-27T07:33:18.351 INFO:tasks.workunit.client.0.smithi082.stdout:2/292: sync 2024-04-27T07:33:18.351 INFO:tasks.workunit.client.0.smithi082.stdout:1/393: sync 2024-04-27T07:33:18.352 INFO:tasks.workunit.client.0.smithi082.stdout:1/394: stat d4/f10 0 2024-04-27T07:33:18.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/326: link d2/d1e/d32/f35 d2/d45/f6b 0 2024-04-27T07:33:18.355 INFO:tasks.workunit.client.0.smithi082.stdout:1/395: fdatasync d4/d2a/f82 0 2024-04-27T07:33:18.355 INFO:tasks.workunit.client.0.smithi082.stdout:2/293: mknod d7/d14/c5e 0 2024-04-27T07:33:18.356 INFO:tasks.workunit.client.0.smithi082.stdout:0/431: dread f7 [0,4194304] 0 2024-04-27T07:33:18.356 INFO:tasks.workunit.client.0.smithi082.stdout:9/276: write d9/d48/f55 [591467,59069] 0 2024-04-27T07:33:18.356 INFO:tasks.workunit.client.0.smithi082.stdout:3/515: dwrite d8/d9/d25/d26/d3d/f51 [0,4194304] 0 2024-04-27T07:33:18.356 INFO:tasks.workunit.client.0.smithi082.stdout:6/327: mkdir d2/d2e/d6c 0 2024-04-27T07:33:18.361 INFO:tasks.workunit.client.0.smithi082.stdout:2/294: mknod d7/d14/c5f 0 2024-04-27T07:33:18.364 INFO:tasks.workunit.client.0.smithi082.stdout:1/396: creat d4/d15/d3f/d6d/f85 x:0 0 0 2024-04-27T07:33:18.366 INFO:tasks.workunit.client.0.smithi082.stdout:9/277: creat d9/d2d/d2b/d46/f58 x:0 0 0 2024-04-27T07:33:18.369 INFO:tasks.workunit.client.0.smithi082.stdout:0/432: dwrite da/f6c [0,4194304] 0 2024-04-27T07:33:18.371 INFO:tasks.workunit.client.0.smithi082.stdout:0/433: fsync da/f19 0 2024-04-27T07:33:18.371 INFO:tasks.workunit.client.0.smithi082.stdout:1/397: creat d4/f86 x:0 0 0 2024-04-27T07:33:18.372 INFO:tasks.workunit.client.0.smithi082.stdout:9/278: rmdir d9/da/dc/d35 39 2024-04-27T07:33:18.376 INFO:tasks.workunit.client.0.smithi082.stdout:2/295: creat d7/d8/d13/f60 x:0 0 0 2024-04-27T07:33:18.378 INFO:tasks.workunit.client.0.smithi082.stdout:3/516: link d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 d8/d9/dd/d13/fbf 0 2024-04-27T07:33:18.380 INFO:tasks.workunit.client.0.smithi082.stdout:1/398: chown d4/d2a/d3e/d57/c63 1005 1 2024-04-27T07:33:18.380 INFO:tasks.workunit.client.0.smithi082.stdout:3/517: write d8/d9/d25/d26/fbe [986445,42348] 0 2024-04-27T07:33:18.381 INFO:tasks.workunit.client.0.smithi082.stdout:0/434: symlink da/d28/d36/d40/d83/la5 0 2024-04-27T07:33:18.382 INFO:tasks.workunit.client.0.smithi082.stdout:9/279: creat d9/d2d/f59 x:0 0 0 2024-04-27T07:33:18.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/435: truncate da/d2a/f5d 1781508 0 2024-04-27T07:33:18.385 INFO:tasks.workunit.client.0.smithi082.stdout:6/328: truncate d2/d1e/d32/f4e 1844500 0 2024-04-27T07:33:18.388 INFO:tasks.workunit.client.0.smithi082.stdout:2/296: mkdir d7/d30/d61 0 2024-04-27T07:33:18.390 INFO:tasks.workunit.client.0.smithi082.stdout:1/399: stat d4/d2a/d39/c5c 0 2024-04-27T07:33:18.390 INFO:tasks.workunit.client.0.smithi082.stdout:0/436: dwrite da/fe [0,4194304] 0 2024-04-27T07:33:18.392 INFO:tasks.workunit.client.0.smithi082.stdout:3/518: fsync d8/d9/d25/d26/d3d/f6b 0 2024-04-27T07:33:18.392 INFO:tasks.workunit.client.0.smithi082.stdout:1/400: write d4/f22 [140307,77120] 0 2024-04-27T07:33:18.396 INFO:tasks.workunit.client.0.smithi082.stdout:0/437: rmdir da/d38 39 2024-04-27T07:33:18.397 INFO:tasks.workunit.client.0.smithi082.stdout:0/438: stat da/d3c/d3f/d57/c7c 0 2024-04-27T07:33:18.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/439: write da/d28/d36/d40/f52 [3548676,78376] 0 2024-04-27T07:33:18.401 INFO:tasks.workunit.client.0.smithi082.stdout:9/280: symlink d9/da/dc/d35/l5a 0 2024-04-27T07:33:18.402 INFO:tasks.workunit.client.0.smithi082.stdout:9/281: write d9/da/dc/f2a [2147127,43076] 0 2024-04-27T07:33:18.405 INFO:tasks.workunit.client.0.smithi082.stdout:9/282: truncate d9/f4c 599258 0 2024-04-27T07:33:18.407 INFO:tasks.workunit.client.0.smithi082.stdout:3/519: mkdir d8/d9/dd/d13/dc0 0 2024-04-27T07:33:18.410 INFO:tasks.workunit.client.0.smithi082.stdout:1/401: dread d4/d15/f37 [0,4194304] 0 2024-04-27T07:33:18.410 INFO:tasks.workunit.client.0.smithi082.stdout:2/297: truncate d7/d14/f3d 3661795 0 2024-04-27T07:33:18.413 INFO:tasks.workunit.client.0.smithi082.stdout:9/283: unlink d9/c30 0 2024-04-27T07:33:18.413 INFO:tasks.workunit.client.0.smithi082.stdout:1/402: dread d4/d2a/d3e/d53/f54 [0,4194304] 0 2024-04-27T07:33:18.415 INFO:tasks.workunit.client.0.smithi082.stdout:3/520: readlink d8/d9/d25/d4e/l87 0 2024-04-27T07:33:18.416 INFO:tasks.workunit.client.0.smithi082.stdout:0/440: dwrite f7 [0,4194304] 0 2024-04-27T07:33:18.419 INFO:tasks.workunit.client.0.smithi082.stdout:2/298: truncate d7/d30/d23/f49 376266 0 2024-04-27T07:33:18.420 INFO:tasks.workunit.client.0.smithi082.stdout:3/521: write d8/d9/d1d/f79 [831658,105717] 0 2024-04-27T07:33:18.420 INFO:tasks.workunit.client.0.smithi082.stdout:9/284: unlink d9/da/c18 0 2024-04-27T07:33:18.424 INFO:tasks.workunit.client.0.smithi082.stdout:9/285: chown d9/da/dc/d35/l5a 150 1 2024-04-27T07:33:18.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/329: dwrite d2/d1e/d32/f35 [0,4194304] 0 2024-04-27T07:33:18.434 INFO:tasks.workunit.client.0.smithi082.stdout:9/286: read f4 [1569479,102189] 0 2024-04-27T07:33:18.434 INFO:tasks.workunit.client.0.smithi082.stdout:3/522: link d8/d9/d25/d26/d3d/f51 d8/d9/d25/d26/d4d/fc1 0 2024-04-27T07:33:18.434 INFO:tasks.workunit.client.0.smithi082.stdout:6/330: mknod d2/d2e/d6a/c6d 0 2024-04-27T07:33:18.434 INFO:tasks.workunit.client.0.smithi082.stdout:6/331: fdatasync d2/de/d13/f67 0 2024-04-27T07:33:18.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/287: symlink d9/da/dc/d35/d42/l5b 0 2024-04-27T07:33:18.442 INFO:tasks.workunit.client.0.smithi082.stdout:6/332: stat d2/d2d/d4a/f50 0 2024-04-27T07:33:18.442 INFO:tasks.workunit.client.0.smithi082.stdout:1/403: write d4/d2a/d3e/d53/f54 [1088221,86353] 0 2024-04-27T07:33:18.443 INFO:tasks.workunit.client.0.smithi082.stdout:9/288: mknod d9/c5c 0 2024-04-27T07:33:18.445 INFO:tasks.workunit.client.0.smithi082.stdout:6/333: symlink d2/d1e/d32/l6e 0 2024-04-27T07:33:18.445 INFO:tasks.workunit.client.0.smithi082.stdout:6/334: readlink d2/d1e/d32/l6e 0 2024-04-27T07:33:18.446 INFO:tasks.workunit.client.0.smithi082.stdout:1/404: creat d4/d2a/d3e/f87 x:0 0 0 2024-04-27T07:33:18.448 INFO:tasks.workunit.client.0.smithi082.stdout:9/289: mkdir d9/d2d/d2b/d46/d5d 0 2024-04-27T07:33:18.449 INFO:tasks.workunit.client.0.smithi082.stdout:6/335: creat d2/d45/f6f x:0 0 0 2024-04-27T07:33:18.450 INFO:tasks.workunit.client.0.smithi082.stdout:2/299: truncate d7/d30/f36 17570 0 2024-04-27T07:33:18.451 INFO:tasks.workunit.client.0.smithi082.stdout:6/336: write d2/d1e/d32/f35 [2674104,4819] 0 2024-04-27T07:33:18.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/290: mkdir d9/da/dc/d33/d5e 0 2024-04-27T07:33:18.455 INFO:tasks.workunit.client.0.smithi082.stdout:0/441: dread f5 [0,4194304] 0 2024-04-27T07:33:18.457 INFO:tasks.workunit.client.0.smithi082.stdout:2/300: unlink d7/d8/c57 0 2024-04-27T07:33:18.458 INFO:tasks.workunit.client.0.smithi082.stdout:9/291: write f4 [1901209,66061] 0 2024-04-27T07:33:18.462 INFO:tasks.workunit.client.0.smithi082.stdout:2/301: unlink d7/d9/f4e 0 2024-04-27T07:33:18.464 INFO:tasks.workunit.client.0.smithi082.stdout:2/302: write d7/f39 [906984,54686] 0 2024-04-27T07:33:18.465 INFO:tasks.workunit.client.0.smithi082.stdout:0/442: rename da/d2a/l3e to da/d38/d7f/d4a/d80/da0/la6 0 2024-04-27T07:33:18.466 INFO:tasks.workunit.client.0.smithi082.stdout:3/523: dwrite d8/d9/d1f/f41 [0,4194304] 0 2024-04-27T07:33:18.471 INFO:tasks.workunit.client.0.smithi082.stdout:2/303: read d7/d9/f18 [4083205,789] 0 2024-04-27T07:33:18.477 INFO:tasks.workunit.client.0.smithi082.stdout:2/304: rename d7/d14/c5f to d7/d30/d61/c62 0 2024-04-27T07:33:18.480 INFO:tasks.workunit.client.0.smithi082.stdout:3/524: dread d8/d9/d3f/f80 [0,4194304] 0 2024-04-27T07:33:18.480 INFO:tasks.workunit.client.0.smithi082.stdout:1/405: dwrite d4/d15/f37 [0,4194304] 0 2024-04-27T07:33:18.483 INFO:tasks.workunit.client.0.smithi082.stdout:1/406: write d4/d2a/f82 [822183,116051] 0 2024-04-27T07:33:18.485 INFO:tasks.workunit.client.0.smithi082.stdout:1/407: dread - d4/d2a/d3e/d57/f77 zero size 2024-04-27T07:33:18.486 INFO:tasks.workunit.client.0.smithi082.stdout:0/443: dread da/d1d/f2d [0,4194304] 0 2024-04-27T07:33:18.487 INFO:tasks.workunit.client.1.smithi100.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-27T07:33:18.492 INFO:tasks.workunit.client.0.smithi082.stdout:3/525: getdents d8/d9/d3f 0 2024-04-27T07:33:18.494 INFO:tasks.workunit.client.0.smithi082.stdout:1/408: dwrite d4/d15/d3f/f67 [0,4194304] 0 2024-04-27T07:33:18.498 INFO:tasks.workunit.client.0.smithi082.stdout:1/409: symlink d4/d15/d49/l88 0 2024-04-27T07:33:18.499 INFO:tasks.workunit.client.0.smithi082.stdout:3/526: creat d8/d9/d25/d26/d3d/dad/fc2 x:0 0 0 2024-04-27T07:33:18.502 INFO:tasks.workunit.client.0.smithi082.stdout:1/410: write d4/d2a/d4c/d7a/f80 [3522768,121380] 0 2024-04-27T07:33:18.504 INFO:tasks.workunit.client.0.smithi082.stdout:0/444: dwrite da/f15 [0,4194304] 0 2024-04-27T07:33:18.505 INFO:tasks.workunit.client.0.smithi082.stdout:3/527: symlink d8/d9/d25/d26/lc3 0 2024-04-27T07:33:18.507 INFO:tasks.workunit.client.0.smithi082.stdout:2/305: dread d7/d14/f3d [0,4194304] 0 2024-04-27T07:33:18.508 INFO:tasks.workunit.client.1.smithi100.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-27T07:33:18.508 INFO:tasks.workunit.client.1.smithi100.stderr:+ make 2024-04-27T07:33:18.511 INFO:tasks.workunit.client.0.smithi082.stdout:0/445: dwrite da/d1d/d6a/f7a [0,4194304] 0 2024-04-27T07:33:18.514 INFO:tasks.workunit.client.0.smithi082.stdout:1/411: rmdir d4 39 2024-04-27T07:33:18.518 INFO:tasks.workunit.client.0.smithi082.stdout:0/446: creat da/d3c/fa7 x:0 0 0 2024-04-27T07:33:18.521 INFO:tasks.workunit.client.0.smithi082.stdout:0/447: truncate da/d3c/d3f/d57/f76 304393 0 2024-04-27T07:33:18.522 INFO:tasks.workunit.client.0.smithi082.stdout:2/306: rename d7/d8/d13/c2a to d7/d14/c63 0 2024-04-27T07:33:18.522 INFO:tasks.workunit.client.0.smithi082.stdout:0/448: readlink da/d3c/d3f/d4c/d74/l97 0 2024-04-27T07:33:18.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/412: symlink d4/d2a/d39/l89 0 2024-04-27T07:33:18.525 INFO:tasks.workunit.client.0.smithi082.stdout:0/449: mkdir da/d28/d36/d40/d83/da8 0 2024-04-27T07:33:18.526 INFO:tasks.workunit.client.0.smithi082.stdout:2/307: fdatasync d7/f5b 0 2024-04-27T07:33:18.527 INFO:tasks.workunit.client.0.smithi082.stdout:1/413: mknod d4/d15/d29/c8a 0 2024-04-27T07:33:18.528 INFO:tasks.workunit.client.0.smithi082.stdout:0/450: rmdir da/d38/d7f 39 2024-04-27T07:33:18.529 INFO:tasks.workunit.client.0.smithi082.stdout:0/451: write da/f12 [2090538,19814] 0 2024-04-27T07:33:18.530 INFO:tasks.workunit.client.0.smithi082.stdout:2/308: chown d7/l10 0 1 2024-04-27T07:33:18.531 INFO:tasks.workunit.client.0.smithi082.stdout:3/528: write d8/d9/dd/d13/d1b/f31 [820548,63673] 0 2024-04-27T07:33:18.533 INFO:tasks.workunit.client.0.smithi082.stdout:3/529: chown d8/d9/d25/d26/d4d/d9f 1213286455 1 2024-04-27T07:33:18.534 INFO:tasks.workunit.client.0.smithi082.stdout:1/414: rename d4/d15/d49/d4e/c81 to d4/d2a/d3e/c8b 0 2024-04-27T07:33:18.536 INFO:tasks.workunit.client.0.smithi082.stdout:2/309: rmdir d7 39 2024-04-27T07:33:18.538 INFO:tasks.workunit.client.0.smithi082.stdout:3/530: mkdir d8/d9/d1d/da5/dc4 0 2024-04-27T07:33:18.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/452: mkdir da/d38/da9 0 2024-04-27T07:33:18.540 INFO:tasks.workunit.client.0.smithi082.stdout:5/413: sync 2024-04-27T07:33:18.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/415: mkdir d4/d2a/d4c/d7a/d8c 0 2024-04-27T07:33:18.543 INFO:tasks.workunit.client.0.smithi082.stdout:1/416: truncate d4/f12 4832848 0 2024-04-27T07:33:18.545 INFO:tasks.workunit.client.0.smithi082.stdout:5/414: unlink d8/d15/d22/f53 0 2024-04-27T07:33:18.545 INFO:tasks.workunit.client.0.smithi082.stdout:2/310: truncate d7/d30/f36 788596 0 2024-04-27T07:33:18.574 INFO:tasks.workunit.client.1.smithi100.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-27T07:33:18.580 INFO:tasks.workunit.client.0.smithi082.stdout:5/415: mkdir d8/d14/d7b/d8b 0 2024-04-27T07:33:18.581 INFO:tasks.workunit.client.0.smithi082.stdout:3/531: dread d8/d9/d1d/f2d [0,4194304] 0 2024-04-27T07:33:18.582 INFO:tasks.workunit.client.0.smithi082.stdout:2/311: unlink d7/l10 0 2024-04-27T07:33:18.583 INFO:tasks.workunit.client.0.smithi082.stdout:5/416: chown d8/d3c/f87 25 1 2024-04-27T07:33:18.583 INFO:tasks.workunit.client.0.smithi082.stdout:0/453: dwrite da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:18.584 INFO:tasks.workunit.client.0.smithi082.stdout:3/532: chown d8/d9/d3f/f8c 1814211749 1 2024-04-27T07:33:18.585 INFO:tasks.workunit.client.0.smithi082.stdout:1/417: dwrite d4/d15/d1c/f2c [4194304,4194304] 0 2024-04-27T07:33:18.586 INFO:tasks.workunit.client.0.smithi082.stdout:3/533: stat d8/d9/dd/d13/l4f 0 2024-04-27T07:33:18.589 INFO:tasks.workunit.client.0.smithi082.stdout:5/417: rename d8/d15/f11 to d8/d15/f8c 0 2024-04-27T07:33:18.591 INFO:tasks.workunit.client.0.smithi082.stdout:1/418: creat d4/d2a/d4c/f8d x:0 0 0 2024-04-27T07:33:18.591 INFO:tasks.workunit.client.0.smithi082.stdout:1/419: chown d4/d2a/d3e/d53/d72 165314 1 2024-04-27T07:33:18.593 INFO:tasks.workunit.client.0.smithi082.stdout:1/420: truncate d4/f28 5492797 0 2024-04-27T07:33:18.593 INFO:tasks.workunit.client.0.smithi082.stdout:3/534: mknod d8/d9/dd/d13/d1b/dbd/cc5 0 2024-04-27T07:33:18.595 INFO:tasks.workunit.client.0.smithi082.stdout:5/418: rename d8/d3c/d64/l39 to d8/d77/d7a/l8d 0 2024-04-27T07:33:18.599 INFO:tasks.workunit.client.0.smithi082.stdout:1/421: unlink d4/fc 0 2024-04-27T07:33:18.599 INFO:tasks.workunit.client.0.smithi082.stdout:3/535: rmdir d8/d9/dd/d13/d1b/dbd/d8e 39 2024-04-27T07:33:18.600 INFO:tasks.workunit.client.0.smithi082.stdout:2/312: getdents d7/d8/d13 0 2024-04-27T07:33:18.603 INFO:tasks.workunit.client.0.smithi082.stdout:0/454: getdents da/d3c/d3f/d4c/d74 0 2024-04-27T07:33:18.604 INFO:tasks.workunit.client.0.smithi082.stdout:5/419: dread d8/d3c/d47/f2f [0,4194304] 0 2024-04-27T07:33:18.605 INFO:tasks.workunit.client.0.smithi082.stdout:2/313: symlink d7/d31/l64 0 2024-04-27T07:33:18.607 INFO:tasks.workunit.client.0.smithi082.stdout:1/422: dread d4/d2a/d4c/d7a/f80 [0,4194304] 0 2024-04-27T07:33:18.608 INFO:tasks.workunit.client.0.smithi082.stdout:0/455: unlink da/d28/d36/d40/f52 0 2024-04-27T07:33:18.612 INFO:tasks.workunit.client.0.smithi082.stdout:1/423: creat d4/d15/d1c/f8e x:0 0 0 2024-04-27T07:33:18.613 INFO:tasks.workunit.client.0.smithi082.stdout:1/424: chown d4/d15/d29/c3c 102633 1 2024-04-27T07:33:18.616 INFO:tasks.workunit.client.0.smithi082.stdout:2/314: link d7/d9/f1d d7/d30/d61/f65 0 2024-04-27T07:33:18.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/420: rename d8/d3c/d5a/c73 to d8/d14/c8e 0 2024-04-27T07:33:18.620 INFO:tasks.workunit.client.0.smithi082.stdout:0/456: symlink da/d38/d7f/d4a/d80/da0/laa 0 2024-04-27T07:33:18.622 INFO:tasks.workunit.client.0.smithi082.stdout:2/315: mkdir d7/d9/d4f/d66 0 2024-04-27T07:33:18.623 INFO:tasks.workunit.client.0.smithi082.stdout:1/425: symlink d4/d2a/l8f 0 2024-04-27T07:33:18.624 INFO:tasks.workunit.client.0.smithi082.stdout:5/421: mknod d8/d29/d4e/c8f 0 2024-04-27T07:33:18.625 INFO:tasks.workunit.client.0.smithi082.stdout:5/422: fdatasync d8/d29/d4e/f5e 0 2024-04-27T07:33:18.626 INFO:tasks.workunit.client.0.smithi082.stdout:0/457: rename da/d3c/c99 to da/d28/d36/d40/d83/cab 0 2024-04-27T07:33:18.628 INFO:tasks.workunit.client.0.smithi082.stdout:0/458: write da/d38/d7f/d4a/f6d [146146,26220] 0 2024-04-27T07:33:18.628 INFO:tasks.workunit.client.0.smithi082.stdout:2/316: rmdir d7/d31 39 2024-04-27T07:33:18.629 INFO:tasks.workunit.client.0.smithi082.stdout:2/317: write d7/d14/f5c [888865,69876] 0 2024-04-27T07:33:18.630 INFO:tasks.workunit.client.0.smithi082.stdout:0/459: truncate da/d3c/d3f/d57/f76 505389 0 2024-04-27T07:33:18.632 INFO:tasks.workunit.client.0.smithi082.stdout:1/426: symlink d4/d15/d49/l90 0 2024-04-27T07:33:18.633 INFO:tasks.workunit.client.0.smithi082.stdout:1/427: fsync d4/f86 0 2024-04-27T07:33:18.634 INFO:tasks.workunit.client.0.smithi082.stdout:1/428: fsync d4/d15/d49/d4e/f5e 0 2024-04-27T07:33:18.635 INFO:tasks.workunit.client.0.smithi082.stdout:5/423: mkdir d8/d29/d4e/d90 0 2024-04-27T07:33:18.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/424: read d8/d15/f8c [1920327,92572] 0 2024-04-27T07:33:18.638 INFO:tasks.workunit.client.0.smithi082.stdout:0/460: dwrite da/d28/f43 [0,4194304] 0 2024-04-27T07:33:18.638 INFO:tasks.workunit.client.0.smithi082.stdout:5/425: chown d8/d14/f16 979203 1 2024-04-27T07:33:18.640 INFO:tasks.workunit.client.0.smithi082.stdout:5/426: chown d8/l34 123 1 2024-04-27T07:33:18.646 INFO:tasks.workunit.client.0.smithi082.stdout:2/318: creat d7/d31/f67 x:0 0 0 2024-04-27T07:33:18.653 INFO:tasks.workunit.client.0.smithi082.stdout:2/319: mknod d7/d30/d61/c68 0 2024-04-27T07:33:18.656 INFO:tasks.workunit.client.0.smithi082.stdout:5/427: dread d8/d14/f23 [4194304,4194304] 0 2024-04-27T07:33:18.657 INFO:tasks.workunit.client.0.smithi082.stdout:5/428: truncate d8/d14/f16 5056094 0 2024-04-27T07:33:18.658 INFO:tasks.workunit.client.0.smithi082.stdout:1/429: link d4/d15/l20 d4/l91 0 2024-04-27T07:33:18.658 INFO:tasks.workunit.client.0.smithi082.stdout:5/429: chown d8/f3e 384535 1 2024-04-27T07:33:18.660 INFO:tasks.workunit.client.0.smithi082.stdout:0/461: creat da/d3c/d3f/fac x:0 0 0 2024-04-27T07:33:18.662 INFO:tasks.workunit.client.0.smithi082.stdout:1/430: creat d4/d2a/d4c/f92 x:0 0 0 2024-04-27T07:33:18.666 INFO:tasks.workunit.client.0.smithi082.stdout:5/430: mknod d8/d29/d4e/d90/c91 0 2024-04-27T07:33:18.667 INFO:tasks.workunit.client.0.smithi082.stdout:5/431: fsync d8/d3c/d47/f46 0 2024-04-27T07:33:18.668 INFO:tasks.workunit.client.0.smithi082.stdout:1/431: unlink d4/d15/d29/f36 0 2024-04-27T07:33:18.672 INFO:tasks.workunit.client.0.smithi082.stdout:5/432: symlink d8/d14/d7b/l92 0 2024-04-27T07:33:18.674 INFO:tasks.workunit.client.0.smithi082.stdout:0/462: write da/f26 [1693877,49439] 0 2024-04-27T07:33:18.676 INFO:tasks.workunit.client.0.smithi082.stdout:2/320: rename d7/d8/d13/l21 to d7/d9/d4f/l69 0 2024-04-27T07:33:18.678 INFO:tasks.workunit.client.0.smithi082.stdout:2/321: dread - d7/d31/f34 zero size 2024-04-27T07:33:18.681 INFO:tasks.workunit.client.0.smithi082.stdout:5/433: dwrite d8/d3c/d4a/f88 [0,4194304] 0 2024-04-27T07:33:18.683 INFO:tasks.workunit.client.0.smithi082.stdout:0/463: dwrite da/f12 [0,4194304] 0 2024-04-27T07:33:18.684 INFO:tasks.workunit.client.0.smithi082.stdout:0/464: chown da/d28/d36/f7b 44223173 1 2024-04-27T07:33:18.689 INFO:tasks.workunit.client.0.smithi082.stdout:2/322: symlink d7/d8/l6a 0 2024-04-27T07:33:18.689 INFO:tasks.workunit.client.0.smithi082.stdout:5/434: dwrite d8/d14/f4d [0,4194304] 0 2024-04-27T07:33:18.692 INFO:tasks.workunit.client.0.smithi082.stdout:0/465: write f5 [1930824,117822] 0 2024-04-27T07:33:18.693 INFO:tasks.workunit.client.0.smithi082.stdout:5/435: truncate d8/d29/f68 1723012 0 2024-04-27T07:33:18.698 INFO:tasks.workunit.client.0.smithi082.stdout:5/436: symlink d8/d3c/d47/l93 0 2024-04-27T07:33:18.699 INFO:tasks.workunit.client.0.smithi082.stdout:0/466: symlink da/d28/d36/d40/d83/lad 0 2024-04-27T07:33:18.700 INFO:tasks.workunit.client.0.smithi082.stdout:1/432: dwrite d4/d2a/d39/f7f [0,4194304] 0 2024-04-27T07:33:18.701 INFO:tasks.workunit.client.0.smithi082.stdout:0/467: chown da/d2a/f87 93687575 1 2024-04-27T07:33:18.702 INFO:tasks.workunit.client.0.smithi082.stdout:5/437: truncate f4 452214 0 2024-04-27T07:33:18.704 INFO:tasks.workunit.client.0.smithi082.stdout:1/433: mkdir d4/d15/d3f/d6d/d93 0 2024-04-27T07:33:18.704 INFO:tasks.workunit.client.0.smithi082.stdout:0/468: chown da/lc 0 1 2024-04-27T07:33:18.711 INFO:tasks.workunit.client.0.smithi082.stdout:5/438: dwrite d8/d3b/f74 [0,4194304] 0 2024-04-27T07:33:18.716 INFO:tasks.workunit.client.0.smithi082.stdout:0/469: dwrite da/d3c/d3f/d4c/f54 [0,4194304] 0 2024-04-27T07:33:18.716 INFO:tasks.workunit.client.0.smithi082.stdout:1/434: dwrite d4/f28 [0,4194304] 0 2024-04-27T07:33:18.720 INFO:tasks.workunit.client.0.smithi082.stdout:0/470: write f5 [4097099,85144] 0 2024-04-27T07:33:18.722 INFO:tasks.workunit.client.0.smithi082.stdout:1/435: symlink d4/d2a/d4c/d7a/l94 0 2024-04-27T07:33:18.723 INFO:tasks.workunit.client.0.smithi082.stdout:2/323: dwrite d7/d30/f36 [0,4194304] 0 2024-04-27T07:33:18.726 INFO:tasks.workunit.client.0.smithi082.stdout:5/439: dwrite d8/d42/f54 [0,4194304] 0 2024-04-27T07:33:18.730 INFO:tasks.workunit.client.0.smithi082.stdout:7/325: sync 2024-04-27T07:33:18.731 INFO:tasks.workunit.client.0.smithi082.stdout:0/471: dread da/d28/d36/d40/f90 [0,4194304] 0 2024-04-27T07:33:18.733 INFO:tasks.workunit.client.0.smithi082.stdout:0/472: fsync da/d3c/d3f/f5b 0 2024-04-27T07:33:18.736 INFO:tasks.workunit.client.0.smithi082.stdout:1/436: mknod d4/d15/d49/d4e/c95 0 2024-04-27T07:33:18.738 INFO:tasks.workunit.client.0.smithi082.stdout:5/440: creat d8/d15/d65/f94 x:0 0 0 2024-04-27T07:33:18.741 INFO:tasks.workunit.client.0.smithi082.stdout:7/326: creat d3/db/d59/f67 x:0 0 0 2024-04-27T07:33:18.743 INFO:tasks.workunit.client.0.smithi082.stdout:5/441: dread d8/d42/f54 [0,4194304] 0 2024-04-27T07:33:18.746 INFO:tasks.workunit.client.0.smithi082.stdout:7/327: write d3/de/f14 [4047742,80484] 0 2024-04-27T07:33:18.747 INFO:tasks.workunit.client.0.smithi082.stdout:0/473: link da/d1d/d6a/f7a da/d2a/fae 0 2024-04-27T07:33:18.749 INFO:tasks.workunit.client.0.smithi082.stdout:2/324: rename d7/d8/d13/l1e to d7/d30/d23/l6b 0 2024-04-27T07:33:18.751 INFO:tasks.workunit.client.0.smithi082.stdout:0/474: dread da/d3c/d3f/d57/f7e [0,4194304] 0 2024-04-27T07:33:18.752 INFO:tasks.workunit.client.0.smithi082.stdout:5/442: link d8/d14/c5c d8/d3c/d47/c95 0 2024-04-27T07:33:18.752 INFO:tasks.workunit.client.0.smithi082.stdout:0/475: dread - da/d3c/d3f/d57/f86 zero size 2024-04-27T07:33:18.752 INFO:tasks.workunit.client.0.smithi082.stdout:5/443: chown d8/f2d 1029370 1 2024-04-27T07:33:18.753 INFO:tasks.workunit.client.0.smithi082.stdout:2/325: symlink d7/l6c 0 2024-04-27T07:33:18.753 INFO:tasks.workunit.client.0.smithi082.stdout:0/476: write da/d3c/f82 [1196288,80649] 0 2024-04-27T07:33:18.754 INFO:tasks.workunit.client.0.smithi082.stdout:7/328: creat d3/de/d3a/f68 x:0 0 0 2024-04-27T07:33:18.754 INFO:tasks.workunit.client.0.smithi082.stdout:2/326: write d7/d31/f34 [89440,31538] 0 2024-04-27T07:33:18.757 INFO:tasks.workunit.client.0.smithi082.stdout:0/477: dread da/d28/f4d [0,4194304] 0 2024-04-27T07:33:18.758 INFO:tasks.workunit.client.0.smithi082.stdout:2/327: rename d7/f39 to d7/d31/d54/f6d 0 2024-04-27T07:33:18.762 INFO:tasks.workunit.client.0.smithi082.stdout:2/328: mkdir d7/d9/d4f/d6e 0 2024-04-27T07:33:18.763 INFO:tasks.workunit.client.0.smithi082.stdout:0/478: creat da/d3c/d3f/d4c/d95/faf x:0 0 0 2024-04-27T07:33:18.764 INFO:tasks.workunit.client.0.smithi082.stdout:7/329: getdents d3/de/d3a/d2a 0 2024-04-27T07:33:18.765 INFO:tasks.workunit.client.0.smithi082.stdout:2/329: mkdir d7/d31/d6f 0 2024-04-27T07:33:18.767 INFO:tasks.workunit.client.0.smithi082.stdout:0/479: creat da/d2a/fb0 x:0 0 0 2024-04-27T07:33:18.768 INFO:tasks.workunit.client.0.smithi082.stdout:7/330: fsync d3/f8 0 2024-04-27T07:33:18.769 INFO:tasks.workunit.client.0.smithi082.stdout:2/330: symlink d7/d31/d54/l70 0 2024-04-27T07:33:18.770 INFO:tasks.workunit.client.0.smithi082.stdout:0/480: symlink da/d2a/lb1 0 2024-04-27T07:33:18.772 INFO:tasks.workunit.client.0.smithi082.stdout:0/481: chown da/d28/d36/d40/f90 1191942 1 2024-04-27T07:33:18.773 INFO:tasks.workunit.client.0.smithi082.stdout:1/437: dwrite d4/d15/f17 [0,4194304] 0 2024-04-27T07:33:18.773 INFO:tasks.workunit.client.0.smithi082.stdout:0/482: chown da/d3c/d3f/c77 14004 1 2024-04-27T07:33:18.774 INFO:tasks.workunit.client.0.smithi082.stdout:0/483: write da/f26 [1632131,32358] 0 2024-04-27T07:33:18.778 INFO:tasks.workunit.client.0.smithi082.stdout:0/484: rmdir da/d28 39 2024-04-27T07:33:18.784 INFO:tasks.workunit.client.0.smithi082.stdout:0/485: rename da/f15 to da/d28/d36/d40/d83/da8/fb2 0 2024-04-27T07:33:18.785 INFO:tasks.workunit.client.0.smithi082.stdout:0/486: chown da/d28/d36/d40/c88 1023774274 1 2024-04-27T07:33:18.786 INFO:tasks.workunit.client.0.smithi082.stdout:7/331: dread d3/de/f1b [0,4194304] 0 2024-04-27T07:33:18.787 INFO:tasks.workunit.client.0.smithi082.stdout:2/331: rmdir d7/d9 39 2024-04-27T07:33:18.789 INFO:tasks.workunit.client.0.smithi082.stdout:7/332: fdatasync d3/db/ff 0 2024-04-27T07:33:18.791 INFO:tasks.workunit.client.0.smithi082.stdout:0/487: mkdir da/db3 0 2024-04-27T07:33:18.795 INFO:tasks.workunit.client.0.smithi082.stdout:2/332: dwrite d7/d14/f5c [0,4194304] 0 2024-04-27T07:33:18.796 INFO:tasks.workunit.client.0.smithi082.stdout:0/488: mknod da/d3c/d3f/d4c/cb4 0 2024-04-27T07:33:18.799 INFO:tasks.workunit.client.0.smithi082.stdout:7/333: link d3/f8 d3/d9/d4f/d61/f69 0 2024-04-27T07:33:18.803 INFO:tasks.workunit.client.0.smithi082.stdout:2/333: dwrite d7/f3c [0,4194304] 0 2024-04-27T07:33:18.805 INFO:tasks.workunit.client.0.smithi082.stdout:0/489: dread da/d1d/f24 [0,4194304] 0 2024-04-27T07:33:18.806 INFO:tasks.workunit.client.0.smithi082.stdout:7/334: getdents d3/d49 0 2024-04-27T07:33:18.808 INFO:tasks.workunit.client.0.smithi082.stdout:7/335: fsync d3/de/f1e 0 2024-04-27T07:33:18.815 INFO:tasks.workunit.client.0.smithi082.stdout:0/490: dwrite da/d3c/d3f/fac [0,4194304] 0 2024-04-27T07:33:18.821 INFO:tasks.workunit.client.0.smithi082.stdout:7/336: rename d3/f6 to d3/de/f6a 0 2024-04-27T07:33:18.823 INFO:tasks.workunit.client.0.smithi082.stdout:7/337: write d3/de/f3d [1139758,44426] 0 2024-04-27T07:33:18.825 INFO:tasks.workunit.client.0.smithi082.stdout:7/338: read d3/db/d59/f64 [337621,19406] 0 2024-04-27T07:33:18.828 INFO:tasks.workunit.client.0.smithi082.stdout:7/339: getdents d3/db 0 2024-04-27T07:33:18.843 INFO:tasks.workunit.client.0.smithi082.stdout:0/491: dread da/d1d/f20 [4194304,4194304] 0 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: pgmap v15: 65 pgs: 65 active+clean; 610 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 62 MiB/s wr, 336 op/s 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.845 INFO:tasks.workunit.client.0.smithi082.stdout:0/492: symlink da/d28/lb5 0 2024-04-27T07:33:18.848 INFO:tasks.workunit.client.0.smithi082.stdout:0/493: getdents da/d2a 0 2024-04-27T07:33:18.848 INFO:tasks.workunit.client.0.smithi082.stdout:7/340: dread d3/de/f1e [0,4194304] 0 2024-04-27T07:33:18.850 INFO:tasks.workunit.client.0.smithi082.stdout:7/341: truncate d3/d9/d4f/f54 1025980 0 2024-04-27T07:33:18.851 INFO:tasks.workunit.client.0.smithi082.stdout:0/494: rename da/d38/d7f/c9a to da/db3/cb6 0 2024-04-27T07:33:18.851 INFO:tasks.workunit.client.0.smithi082.stdout:7/342: dread d3/de/d3a/d2a/f57 [0,4194304] 0 2024-04-27T07:33:18.851 INFO:tasks.workunit.client.0.smithi082.stdout:7/343: fsync d3/d49/f51 0 2024-04-27T07:33:18.853 INFO:tasks.workunit.client.0.smithi082.stdout:0/495: symlink da/d38/d7f/d4a/d80/da0/lb7 0 2024-04-27T07:33:18.854 INFO:tasks.workunit.client.0.smithi082.stdout:7/344: rename d3/de/f3b to d3/d9/d4f/f6b 0 2024-04-27T07:33:18.855 INFO:tasks.workunit.client.0.smithi082.stdout:0/496: creat da/d38/d7f/d4a/d80/fb8 x:0 0 0 2024-04-27T07:33:18.857 INFO:tasks.workunit.client.0.smithi082.stdout:0/497: symlink da/db3/lb9 0 2024-04-27T07:33:18.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/345: dwrite d3/de/f3d [0,4194304] 0 2024-04-27T07:33:18.861 INFO:tasks.workunit.client.0.smithi082.stdout:7/346: chown d3/de/d3a/d2a/f2b 235 1 2024-04-27T07:33:18.864 INFO:tasks.workunit.client.0.smithi082.stdout:0/498: write da/d28/d36/d40/f90 [1093489,15365] 0 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: pgmap v15: 65 pgs: 65 active+clean; 610 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 62 MiB/s wr, 336 op/s 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:18.920 INFO:tasks.workunit.client.0.smithi082.stdout:4/314: sync 2024-04-27T07:33:18.921 INFO:tasks.workunit.client.0.smithi082.stdout:8/248: sync 2024-04-27T07:33:18.923 INFO:tasks.workunit.client.0.smithi082.stdout:7/347: dwrite d3/de/d3a/f52 [0,4194304] 0 2024-04-27T07:33:18.924 INFO:tasks.workunit.client.0.smithi082.stdout:8/249: write d0/d3/d1c/d32/f34 [1718241,47676] 0 2024-04-27T07:33:18.924 INFO:tasks.workunit.client.0.smithi082.stdout:7/348: chown d3/de/f2f 512 1 2024-04-27T07:33:18.925 INFO:tasks.workunit.client.0.smithi082.stdout:0/499: rename da/c31 to da/d28/d36/d40/d83/da8/cba 0 2024-04-27T07:33:18.929 INFO:tasks.workunit.client.0.smithi082.stdout:0/500: write da/d3c/d3f/fac [106414,14947] 0 2024-04-27T07:33:18.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/250: read d0/d3/d1c/d32/d35/f45 [6786840,507] 0 2024-04-27T07:33:18.931 INFO:tasks.workunit.client.0.smithi082.stdout:7/349: mkdir d3/de/d6c 0 2024-04-27T07:33:18.932 INFO:tasks.workunit.client.0.smithi082.stdout:7/350: fdatasync d3/f53 0 2024-04-27T07:33:18.933 INFO:tasks.workunit.client.0.smithi082.stdout:4/315: getdents d3/d6/d26/d5e/d21 0 2024-04-27T07:33:18.935 INFO:tasks.workunit.client.0.smithi082.stdout:7/351: symlink d3/d9/l6d 0 2024-04-27T07:33:18.936 INFO:tasks.workunit.client.0.smithi082.stdout:7/352: stat d3/d9/d4f/c63 0 2024-04-27T07:33:18.937 INFO:tasks.workunit.client.0.smithi082.stdout:8/251: dwrite d0/f17 [4194304,4194304] 0 2024-04-27T07:33:18.939 INFO:tasks.workunit.client.0.smithi082.stdout:4/316: creat d3/d6/d26/d5e/f6d x:0 0 0 2024-04-27T07:33:18.940 INFO:tasks.workunit.client.0.smithi082.stdout:7/353: mknod d3/d9/c6e 0 2024-04-27T07:33:18.941 INFO:tasks.workunit.client.0.smithi082.stdout:8/252: stat d0/cc 0 2024-04-27T07:33:18.941 INFO:tasks.workunit.client.0.smithi082.stdout:4/317: symlink d3/d6/d22/l6e 0 2024-04-27T07:33:18.942 INFO:tasks.workunit.client.0.smithi082.stdout:0/501: write da/d38/d7f/d4a/f58 [691266,16243] 0 2024-04-27T07:33:18.943 INFO:tasks.workunit.client.0.smithi082.stdout:8/253: write d0/d3/f18 [202084,26526] 0 2024-04-27T07:33:18.946 INFO:tasks.workunit.client.0.smithi082.stdout:4/318: unlink d3/d6/d26/d5e/f6d 0 2024-04-27T07:33:18.947 INFO:tasks.workunit.client.0.smithi082.stdout:0/502: rmdir da/d3c/d3f/d4c/d74/d81 39 2024-04-27T07:33:18.947 INFO:tasks.workunit.client.0.smithi082.stdout:4/319: write d3/d9/f6a [873792,27590] 0 2024-04-27T07:33:18.948 INFO:tasks.workunit.client.0.smithi082.stdout:4/320: chown d3/d6/d26/l5a 2625 1 2024-04-27T07:33:18.948 INFO:tasks.workunit.client.0.smithi082.stdout:8/254: mknod d0/d3/d1b/d24/c4d 0 2024-04-27T07:33:18.950 INFO:tasks.workunit.client.0.smithi082.stdout:8/255: write d0/d3/f1d [6931788,55414] 0 2024-04-27T07:33:18.950 INFO:tasks.workunit.client.0.smithi082.stdout:0/503: fsync da/d28/f4d 0 2024-04-27T07:33:18.951 INFO:tasks.workunit.client.0.smithi082.stdout:8/256: fdatasync d0/d3/d1b/f2e 0 2024-04-27T07:33:18.952 INFO:tasks.workunit.client.0.smithi082.stdout:4/321: symlink d3/d6/d26/d5e/d21/l6f 0 2024-04-27T07:33:18.955 INFO:tasks.workunit.client.0.smithi082.stdout:0/504: mkdir da/d3c/d3f/dbb 0 2024-04-27T07:33:18.957 INFO:tasks.workunit.client.0.smithi082.stdout:4/322: link d3/d9/f45 d3/d6/d22/d69/f70 0 2024-04-27T07:33:18.958 INFO:tasks.workunit.client.0.smithi082.stdout:4/323: chown d3/d6/c13 0 1 2024-04-27T07:33:18.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/505: mknod da/d28/d36/cbc 0 2024-04-27T07:33:18.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/506: chown da/d38/d7f/d4a/fa4 95241 1 2024-04-27T07:33:18.961 INFO:tasks.workunit.client.0.smithi082.stdout:4/324: dread d3/d9/f44 [0,4194304] 0 2024-04-27T07:33:18.962 INFO:tasks.workunit.client.0.smithi082.stdout:0/507: creat da/d3c/fbd x:0 0 0 2024-04-27T07:33:18.963 INFO:tasks.workunit.client.0.smithi082.stdout:0/508: mknod da/d1d/cbe 0 2024-04-27T07:33:18.969 INFO:tasks.workunit.client.0.smithi082.stdout:4/325: dwrite d3/d6/d26/f35 [0,4194304] 0 2024-04-27T07:33:18.969 INFO:tasks.workunit.client.0.smithi082.stdout:8/257: dread d0/d3/f1d [0,4194304] 0 2024-04-27T07:33:18.970 INFO:tasks.workunit.client.0.smithi082.stdout:4/326: truncate d3/d6/d22/f40 14190 0 2024-04-27T07:33:18.972 INFO:tasks.workunit.client.0.smithi082.stdout:0/509: getdents da 0 2024-04-27T07:33:18.974 INFO:tasks.workunit.client.0.smithi082.stdout:4/327: mknod d3/d10/c71 0 2024-04-27T07:33:18.975 INFO:tasks.workunit.client.0.smithi082.stdout:0/510: chown da/d28/d36/d40/d83/cab 2919844 1 2024-04-27T07:33:18.978 INFO:tasks.workunit.client.0.smithi082.stdout:4/328: rename d3/d6/d26/d5e/f5b to d3/d6/d26/d55/f72 0 2024-04-27T07:33:18.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/511: dwrite da/d3c/d3f/d4c/f54 [4194304,4194304] 0 2024-04-27T07:33:18.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/512: chown da/d38 274058 1 2024-04-27T07:33:18.993 INFO:tasks.workunit.client.0.smithi082.stdout:0/513: dwrite da/d28/f61 [0,4194304] 0 2024-04-27T07:33:18.995 INFO:tasks.workunit.client.0.smithi082.stdout:0/514: creat da/d1d/d6a/fbf x:0 0 0 2024-04-27T07:33:18.996 INFO:tasks.workunit.client.0.smithi082.stdout:0/515: write da/d3c/fbd [789018,110269] 0 2024-04-27T07:33:18.999 INFO:tasks.workunit.client.0.smithi082.stdout:0/516: creat da/d28/d36/d40/d83/fc0 x:0 0 0 2024-04-27T07:33:19.003 INFO:tasks.workunit.client.0.smithi082.stdout:0/517: write da/d38/f47 [1035287,51129] 0 2024-04-27T07:33:19.035 INFO:tasks.workunit.client.1.smithi100.stderr:++ readlink -f fsstress 2024-04-27T07:33:19.036 INFO:tasks.workunit.client.1.smithi100.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-27T07:33:19.036 INFO:tasks.workunit.client.1.smithi100.stderr:+ popd 2024-04-27T07:33:19.037 INFO:tasks.workunit.client.1.smithi100.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-27T07:33:19.037 INFO:tasks.workunit.client.1.smithi100.stderr:+ popd 2024-04-27T07:33:19.038 INFO:tasks.workunit.client.1.smithi100.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-27T07:33:19.038 INFO:tasks.workunit.client.1.smithi100.stderr:++ mktemp -d -p . 2024-04-27T07:33:19.040 INFO:tasks.workunit.client.1.smithi100.stderr:+ T=./tmp.4f0QCSUhzJ 2024-04-27T07:33:19.041 INFO:tasks.workunit.client.1.smithi100.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.4f0QCSUhzJ -l 1 -n 1000 -p 10 -v 2024-04-27T07:33:19.047 INFO:tasks.workunit.client.1.smithi100.stdout:seed = 1714160283 2024-04-27T07:33:19.047 INFO:tasks.workunit.client.1.smithi100.stdout:1/0: stat - no entries 2024-04-27T07:33:19.048 INFO:tasks.workunit.client.1.smithi100.stdout:1/1: write - no filename 2024-04-27T07:33:19.048 INFO:tasks.workunit.client.1.smithi100.stdout:1/2: chown . 12502 1 2024-04-27T07:33:19.048 INFO:tasks.workunit.client.1.smithi100.stdout:1/3: write - no filename 2024-04-27T07:33:19.048 INFO:tasks.workunit.client.1.smithi100.stdout:0/0: symlink l0 0 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/0: link - no file 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/1: read - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/2: write - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/3: dread - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/4: truncate - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/5: write - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/6: write - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/7: truncate - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/8: fdatasync - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/9: dread - no filename 2024-04-27T07:33:19.049 INFO:tasks.workunit.client.1.smithi100.stdout:2/10: readlink - no filename 2024-04-27T07:33:19.050 INFO:tasks.workunit.client.1.smithi100.stdout:0/1: mkdir d1 0 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:0/2: dwrite - no filename 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/4: mkdir d0 0 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/5: dread - no filename 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/6: link - no file 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/7: truncate - no filename 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/8: fdatasync - no filename 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/9: link - no file 2024-04-27T07:33:19.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/10: dread - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:3/0: fdatasync - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:3/1: rmdir - no directory 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:3/2: dwrite - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:3/3: chown . 78108 1 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:3/4: dread - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/11: getdents . 0 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/12: dread - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/13: rmdir - no directory 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/14: readlink - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/15: readlink - no filename 2024-04-27T07:33:19.052 INFO:tasks.workunit.client.1.smithi100.stdout:2/16: fsync - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:2/17: dread - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:2/18: rename - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:2/19: fdatasync - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/0: chown . 120 1 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/1: truncate - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/2: write - no filename 2024-04-27T07:33:19.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/3: fdatasync - no filename 2024-04-27T07:33:19.054 INFO:tasks.workunit.client.1.smithi100.stdout:1/11: creat d0/f1 x:0 0 0 2024-04-27T07:33:19.054 INFO:tasks.workunit.client.1.smithi100.stdout:1/12: truncate d0/f1 475135 0 2024-04-27T07:33:19.055 INFO:tasks.workunit.client.1.smithi100.stdout:1/13: read d0/f1 [263403,106778] 0 2024-04-27T07:33:19.056 INFO:tasks.workunit.client.1.smithi100.stdout:5/0: truncate - no filename 2024-04-27T07:33:19.056 INFO:tasks.workunit.client.1.smithi100.stdout:0/3: link l0 d1/l2 0 2024-04-27T07:33:19.056 INFO:tasks.workunit.client.1.smithi100.stdout:3/5: mknod c0 0 2024-04-27T07:33:19.056 INFO:tasks.workunit.client.1.smithi100.stdout:3/6: fsync - no filename 2024-04-27T07:33:19.057 INFO:tasks.workunit.client.1.smithi100.stdout:2/20: mkdir d0 0 2024-04-27T07:33:19.057 INFO:tasks.workunit.client.1.smithi100.stdout:2/21: write - no filename 2024-04-27T07:33:19.057 INFO:tasks.workunit.client.1.smithi100.stdout:2/22: dread - no filename 2024-04-27T07:33:19.057 INFO:tasks.workunit.client.1.smithi100.stdout:2/23: dread - no filename 2024-04-27T07:33:19.057 INFO:tasks.workunit.client.1.smithi100.stdout:2/24: write - no filename 2024-04-27T07:33:19.058 INFO:tasks.workunit.client.1.smithi100.stdout:4/4: creat f0 x:0 0 0 2024-04-27T07:33:19.059 INFO:tasks.workunit.client.1.smithi100.stdout:6/0: read - no filename 2024-04-27T07:33:19.059 INFO:tasks.workunit.client.1.smithi100.stdout:6/1: read - no filename 2024-04-27T07:33:19.059 INFO:tasks.workunit.client.1.smithi100.stdout:6/2: chown . 11468 1 2024-04-27T07:33:19.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/7: rename c0 to c1 0 2024-04-27T07:33:19.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/8: dwrite - no filename 2024-04-27T07:33:19.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/9: fsync - no filename 2024-04-27T07:33:19.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/10: fsync - no filename 2024-04-27T07:33:19.061 INFO:tasks.workunit.client.1.smithi100.stdout:4/5: creat f1 x:0 0 0 2024-04-27T07:33:19.062 INFO:tasks.workunit.client.1.smithi100.stdout:5/1: mkdir d0 0 2024-04-27T07:33:19.064 INFO:tasks.workunit.client.1.smithi100.stdout:1/14: rename d0/f1 to d0/f2 0 2024-04-27T07:33:19.064 INFO:tasks.workunit.client.1.smithi100.stdout:1/15: chown d0/f2 22845 1 2024-04-27T07:33:19.065 INFO:tasks.workunit.client.1.smithi100.stdout:2/25: creat d0/f1 x:0 0 0 2024-04-27T07:33:19.065 INFO:tasks.workunit.client.1.smithi100.stdout:1/16: chown d0 5591775 1 2024-04-27T07:33:19.065 INFO:tasks.workunit.client.1.smithi100.stdout:4/6: mknod c2 0 2024-04-27T07:33:19.068 INFO:tasks.workunit.client.1.smithi100.stdout:6/3: getdents . 0 2024-04-27T07:33:19.068 INFO:tasks.workunit.client.1.smithi100.stdout:6/4: rmdir - no directory 2024-04-27T07:33:19.068 INFO:tasks.workunit.client.1.smithi100.stdout:6/5: write - no filename 2024-04-27T07:33:19.069 INFO:tasks.workunit.client.1.smithi100.stdout:6/6: dwrite - no filename 2024-04-27T07:33:19.069 INFO:tasks.workunit.client.1.smithi100.stdout:8/0: dwrite - no filename 2024-04-27T07:33:19.070 INFO:tasks.workunit.client.1.smithi100.stdout:1/17: symlink d0/l3 0 2024-04-27T07:33:19.070 INFO:tasks.workunit.client.1.smithi100.stdout:5/2: mknod d0/c1 0 2024-04-27T07:33:19.070 INFO:tasks.workunit.client.1.smithi100.stdout:5/3: dwrite - no filename 2024-04-27T07:33:19.071 INFO:tasks.workunit.client.1.smithi100.stdout:5/4: chown d0/c1 95 1 2024-04-27T07:33:19.071 INFO:tasks.workunit.client.1.smithi100.stdout:5/5: dread - no filename 2024-04-27T07:33:19.073 INFO:tasks.workunit.client.1.smithi100.stdout:7/0: creat f0 x:0 0 0 2024-04-27T07:33:19.074 INFO:tasks.workunit.client.1.smithi100.stdout:9/0: dread - no filename 2024-04-27T07:33:19.075 INFO:tasks.workunit.client.1.smithi100.stdout:7/1: truncate f0 184689 0 2024-04-27T07:33:19.076 INFO:tasks.workunit.client.1.smithi100.stdout:6/7: creat f0 x:0 0 0 2024-04-27T07:33:19.077 INFO:tasks.workunit.client.1.smithi100.stdout:2/26: dwrite d0/f1 [0,4194304] 0 2024-04-27T07:33:19.078 INFO:tasks.workunit.client.1.smithi100.stdout:8/1: creat f0 x:0 0 0 2024-04-27T07:33:19.081 INFO:tasks.workunit.client.1.smithi100.stdout:7/2: mkdir d1 0 2024-04-27T07:33:19.085 INFO:tasks.workunit.client.1.smithi100.stdout:2/27: dread d0/f1 [0,4194304] 0 2024-04-27T07:33:19.085 INFO:tasks.workunit.client.1.smithi100.stdout:9/1: creat f0 x:0 0 0 2024-04-27T07:33:19.087 INFO:tasks.workunit.client.1.smithi100.stdout:9/2: read - f0 zero size 2024-04-27T07:33:19.088 INFO:tasks.workunit.client.1.smithi100.stdout:5/6: link d0/c1 d0/c2 0 2024-04-27T07:33:19.088 INFO:tasks.workunit.client.1.smithi100.stdout:9/3: stat f0 0 2024-04-27T07:33:19.090 INFO:tasks.workunit.client.1.smithi100.stdout:5/7: mknod d0/c3 0 2024-04-27T07:33:19.090 INFO:tasks.workunit.client.1.smithi100.stdout:5/8: write - no filename 2024-04-27T07:33:19.091 INFO:tasks.workunit.client.1.smithi100.stdout:8/2: dwrite f0 [0,4194304] 0 2024-04-27T07:33:19.094 INFO:tasks.workunit.client.1.smithi100.stdout:5/9: mkdir d0/d4 0 2024-04-27T07:33:19.098 INFO:tasks.workunit.client.1.smithi100.stdout:8/3: dread f0 [0,4194304] 0 2024-04-27T07:33:19.099 INFO:tasks.workunit.client.1.smithi100.stdout:5/10: chown d0/c1 44 1 2024-04-27T07:33:19.099 INFO:tasks.workunit.client.1.smithi100.stdout:5/11: truncate - no filename 2024-04-27T07:33:19.100 INFO:tasks.workunit.client.1.smithi100.stdout:8/4: rename f0 to f1 0 2024-04-27T07:33:19.101 INFO:tasks.workunit.client.1.smithi100.stdout:8/5: creat f2 x:0 0 0 2024-04-27T07:33:19.102 INFO:tasks.workunit.client.0.smithi082.stdout:3/536: sync 2024-04-27T07:33:19.102 INFO:tasks.workunit.client.0.smithi082.stdout:9/292: sync 2024-04-27T07:33:19.102 INFO:tasks.workunit.client.0.smithi082.stdout:6/337: sync 2024-04-27T07:33:19.102 INFO:tasks.workunit.client.1.smithi100.stdout:5/12: creat d0/d4/f5 x:0 0 0 2024-04-27T07:33:19.103 INFO:tasks.workunit.client.0.smithi082.stdout:3/537: rename d8/d9/d3f to d8/d9/d3f/dc6 22 2024-04-27T07:33:19.104 INFO:tasks.workunit.client.1.smithi100.stdout:8/6: unlink f2 0 2024-04-27T07:33:19.104 INFO:tasks.workunit.client.1.smithi100.stdout:8/7: stat f1 0 2024-04-27T07:33:19.104 INFO:tasks.workunit.client.0.smithi082.stdout:9/293: fdatasync d9/d2d/f1a 0 2024-04-27T07:33:19.106 INFO:tasks.workunit.client.1.smithi100.stdout:8/8: symlink l3 0 2024-04-27T07:33:19.107 INFO:tasks.workunit.client.1.smithi100.stdout:8/9: creat f4 x:0 0 0 2024-04-27T07:33:19.110 INFO:tasks.workunit.client.0.smithi082.stdout:6/338: dwrite d2/f60 [0,4194304] 0 2024-04-27T07:33:19.111 INFO:tasks.workunit.client.1.smithi100.stdout:8/10: write f1 [1858071,129513] 0 2024-04-27T07:33:19.111 INFO:tasks.workunit.client.0.smithi082.stdout:6/339: stat d2/f18 0 2024-04-27T07:33:19.112 INFO:tasks.workunit.client.1.smithi100.stdout:5/13: dwrite d0/d4/f5 [0,4194304] 0 2024-04-27T07:33:19.113 INFO:tasks.workunit.client.0.smithi082.stdout:3/538: dwrite d8/d9/d25/d26/fb1 [0,4194304] 0 2024-04-27T07:33:19.114 INFO:tasks.workunit.client.1.smithi100.stdout:8/11: mknod c5 0 2024-04-27T07:33:19.115 INFO:tasks.workunit.client.1.smithi100.stdout:5/14: rmdir d0 39 2024-04-27T07:33:19.115 INFO:tasks.workunit.client.1.smithi100.stdout:8/12: dread - f4 zero size 2024-04-27T07:33:19.117 INFO:tasks.workunit.client.0.smithi082.stdout:9/294: dwrite d9/da/f26 [4194304,4194304] 0 2024-04-27T07:33:19.118 INFO:tasks.workunit.client.1.smithi100.stdout:8/13: mkdir d6 0 2024-04-27T07:33:19.118 INFO:tasks.workunit.client.1.smithi100.stdout:8/14: dread - f4 zero size 2024-04-27T07:33:19.119 INFO:tasks.workunit.client.1.smithi100.stdout:8/15: fdatasync f4 0 2024-04-27T07:33:19.120 INFO:tasks.workunit.client.1.smithi100.stdout:8/16: dread - f4 zero size 2024-04-27T07:33:19.124 INFO:tasks.workunit.client.0.smithi082.stdout:3/539: dwrite d8/d9/d25/d91/f56 [4194304,4194304] 0 2024-04-27T07:33:19.125 INFO:tasks.workunit.client.0.smithi082.stdout:6/340: dwrite d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:19.127 INFO:tasks.workunit.client.0.smithi082.stdout:9/295: rename d9/d48/f55 to d9/da/dc/d35/d4b/f5f 0 2024-04-27T07:33:19.127 INFO:tasks.workunit.client.0.smithi082.stdout:6/341: write d2/de/d13/f21 [3887205,62118] 0 2024-04-27T07:33:19.127 INFO:tasks.workunit.client.1.smithi100.stdout:8/17: dread f1 [0,4194304] 0 2024-04-27T07:33:19.128 INFO:tasks.workunit.client.1.smithi100.stdout:8/18: fdatasync f4 0 2024-04-27T07:33:19.128 INFO:tasks.workunit.client.0.smithi082.stdout:3/540: chown d8/d9/dd/d13/d1b/dbd/c6a 32364909 1 2024-04-27T07:33:19.130 INFO:tasks.workunit.client.0.smithi082.stdout:9/296: chown d9/da/dc/f3f 1 1 2024-04-27T07:33:19.130 INFO:tasks.workunit.client.1.smithi100.stdout:8/19: creat d6/f7 x:0 0 0 2024-04-27T07:33:19.130 INFO:tasks.workunit.client.1.smithi100.stdout:8/20: stat l3 0 2024-04-27T07:33:19.131 INFO:tasks.workunit.client.1.smithi100.stdout:8/21: dread - f4 zero size 2024-04-27T07:33:19.131 INFO:tasks.workunit.client.1.smithi100.stdout:8/22: stat f1 0 2024-04-27T07:33:19.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/541: mkdir d8/d9/d1d/db5/dc7 0 2024-04-27T07:33:19.136 INFO:tasks.workunit.client.0.smithi082.stdout:3/542: mknod d8/d9/d1d/cc8 0 2024-04-27T07:33:19.139 INFO:tasks.workunit.client.1.smithi100.stdout:8/23: dwrite d6/f7 [0,4194304] 0 2024-04-27T07:33:19.141 INFO:tasks.workunit.client.0.smithi082.stdout:3/543: rename d8/d9/dd/d13/d1b/dbd/d8e/f95 to d8/d9/d25/fc9 0 2024-04-27T07:33:19.142 INFO:tasks.workunit.client.0.smithi082.stdout:3/544: dread - d8/d9/d25/d26/d4d/f97 zero size 2024-04-27T07:33:19.146 INFO:tasks.workunit.client.1.smithi100.stdout:8/24: dwrite f4 [0,4194304] 0 2024-04-27T07:33:19.148 INFO:tasks.workunit.client.0.smithi082.stdout:3/545: dwrite d8/d9/d3f/f8a [0,4194304] 0 2024-04-27T07:33:19.151 INFO:tasks.workunit.client.0.smithi082.stdout:3/546: fdatasync d8/d9/d25/d91/fb7 0 2024-04-27T07:33:19.153 INFO:tasks.workunit.client.0.smithi082.stdout:3/547: creat d8/d9/d1f/fca x:0 0 0 2024-04-27T07:33:19.159 INFO:tasks.workunit.client.0.smithi082.stdout:3/548: dwrite d8/d9/d1d/f23 [0,4194304] 0 2024-04-27T07:33:19.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/342: read d2/de/d13/f16 [2919385,66418] 0 2024-04-27T07:33:19.183 INFO:tasks.workunit.client.0.smithi082.stdout:9/297: write d9/d2d/f1a [2078257,94039] 0 2024-04-27T07:33:19.186 INFO:tasks.workunit.client.0.smithi082.stdout:6/343: mknod d2/d3/d1b/c70 0 2024-04-27T07:33:19.188 INFO:tasks.workunit.client.0.smithi082.stdout:6/344: mknod d2/de/d13/c71 0 2024-04-27T07:33:19.189 INFO:tasks.workunit.client.0.smithi082.stdout:6/345: write d2/de/d13/f67 [85102,116552] 0 2024-04-27T07:33:19.190 INFO:tasks.workunit.client.0.smithi082.stdout:9/298: dwrite d9/da/dc/f1b [0,4194304] 0 2024-04-27T07:33:19.193 INFO:tasks.workunit.client.0.smithi082.stdout:6/346: rename d2/d1e/d32/f35 to d2/de/f72 0 2024-04-27T07:33:19.201 INFO:tasks.workunit.client.1.smithi100.stdout:0/4: getdents d1 0 2024-04-27T07:33:19.205 INFO:tasks.workunit.client.1.smithi100.stdout:4/7: fsync f1 0 2024-04-27T07:33:19.208 INFO:tasks.workunit.client.1.smithi100.stdout:4/8: unlink c2 0 2024-04-27T07:33:19.208 INFO:tasks.workunit.client.1.smithi100.stdout:4/9: truncate f1 307751 0 2024-04-27T07:33:19.209 INFO:tasks.workunit.client.1.smithi100.stdout:5/15: creat d0/f6 x:0 0 0 2024-04-27T07:33:19.209 INFO:tasks.workunit.client.1.smithi100.stdout:5/16: readlink - no filename 2024-04-27T07:33:19.209 INFO:tasks.workunit.client.1.smithi100.stdout:5/17: chown d0/f6 7251 1 2024-04-27T07:33:19.210 INFO:tasks.workunit.client.1.smithi100.stdout:4/10: mknod c3 0 2024-04-27T07:33:19.212 INFO:tasks.workunit.client.1.smithi100.stdout:1/18: unlink d0/f2 0 2024-04-27T07:33:19.213 INFO:tasks.workunit.client.1.smithi100.stdout:1/19: readlink d0/l3 0 2024-04-27T07:33:19.213 INFO:tasks.workunit.client.1.smithi100.stdout:2/28: fsync d0/f1 0 2024-04-27T07:33:19.214 INFO:tasks.workunit.client.1.smithi100.stdout:4/11: creat f4 x:0 0 0 2024-04-27T07:33:19.215 INFO:tasks.workunit.client.1.smithi100.stdout:1/20: symlink d0/l4 0 2024-04-27T07:33:19.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/21: dwrite - no filename 2024-04-27T07:33:19.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/22: fdatasync - no filename 2024-04-27T07:33:19.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/23: fsync - no filename 2024-04-27T07:33:19.217 INFO:tasks.workunit.client.1.smithi100.stdout:1/24: chown d0/l4 1031488427 1 2024-04-27T07:33:19.218 INFO:tasks.workunit.client.1.smithi100.stdout:5/18: dwrite d0/d4/f5 [0,4194304] 0 2024-04-27T07:33:19.218 INFO:tasks.workunit.client.1.smithi100.stdout:2/29: mknod d0/c2 0 2024-04-27T07:33:19.218 INFO:tasks.workunit.client.1.smithi100.stdout:2/30: rename d0 to d0/d3 22 2024-04-27T07:33:19.219 INFO:tasks.workunit.client.0.smithi082.stdout:5/444: sync 2024-04-27T07:33:19.220 INFO:tasks.workunit.client.1.smithi100.stdout:4/12: mkdir d5 0 2024-04-27T07:33:19.222 INFO:tasks.workunit.client.1.smithi100.stdout:7/3: fsync f0 0 2024-04-27T07:33:19.224 INFO:tasks.workunit.client.1.smithi100.stdout:5/19: rename d0/f6 to d0/d4/f7 0 2024-04-27T07:33:19.226 INFO:tasks.workunit.client.1.smithi100.stdout:2/31: symlink d0/l4 0 2024-04-27T07:33:19.229 INFO:tasks.workunit.client.1.smithi100.stdout:4/13: dwrite f4 [0,4194304] 0 2024-04-27T07:33:19.229 INFO:tasks.workunit.client.1.smithi100.stdout:4/14: chown f4 8084080 1 2024-04-27T07:33:19.230 INFO:tasks.workunit.client.1.smithi100.stdout:4/15: write f0 [795689,86716] 0 2024-04-27T07:33:19.231 INFO:tasks.workunit.client.1.smithi100.stdout:4/16: truncate f0 1856315 0 2024-04-27T07:33:19.234 INFO:tasks.workunit.client.1.smithi100.stdout:2/32: truncate d0/f1 2800741 0 2024-04-27T07:33:19.234 INFO:tasks.workunit.client.1.smithi100.stdout:9/4: getdents . 0 2024-04-27T07:33:19.235 INFO:tasks.workunit.client.1.smithi100.stdout:9/5: write f0 [70535,12252] 0 2024-04-27T07:33:19.237 INFO:tasks.workunit.client.1.smithi100.stdout:9/6: write f0 [335714,106959] 0 2024-04-27T07:33:19.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/17: creat d5/f6 x:0 0 0 2024-04-27T07:33:19.241 INFO:tasks.workunit.client.1.smithi100.stdout:9/7: mkdir d1 0 2024-04-27T07:33:19.243 INFO:tasks.workunit.client.1.smithi100.stdout:9/8: write f0 [1803,6815] 0 2024-04-27T07:33:19.244 INFO:tasks.workunit.client.0.smithi082.stdout:9/299: rename d9/da/dc/c40 to d9/da/dc/d35/d4a/c60 0 2024-04-27T07:33:19.246 INFO:tasks.workunit.client.0.smithi082.stdout:5/445: chown d8/d3b/f41 257 1 2024-04-27T07:33:19.246 INFO:tasks.workunit.client.0.smithi082.stdout:3/549: write d8/d9/d3f/f8c [4130303,64718] 0 2024-04-27T07:33:19.251 INFO:tasks.workunit.client.1.smithi100.stdout:4/18: dwrite d5/f6 [0,4194304] 0 2024-04-27T07:33:19.251 INFO:tasks.workunit.client.0.smithi082.stdout:6/347: write d2/d3/d1b/f4b [116737,99279] 0 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.1.smithi100.stdout:9/9: creat d1/f2 x:0 0 0 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.1.smithi100.stdout:9/10: mknod d1/c3 0 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.1.smithi100.stdout:9/11: readlink - no filename 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.0.smithi082.stdout:5/446: chown d8/d15/f58 27274 1 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.0.smithi082.stdout:5/447: readlink d8/d14/l62 0 2024-04-27T07:33:19.252 INFO:tasks.workunit.client.0.smithi082.stdout:6/348: symlink d2/d2e/l73 0 2024-04-27T07:33:19.253 INFO:tasks.workunit.client.0.smithi082.stdout:3/550: rename d8/d9/d1d/f23 to d8/d9/d25/d4e/fcb 0 2024-04-27T07:33:19.253 INFO:tasks.workunit.client.0.smithi082.stdout:9/300: dwrite d9/da/dc/f3f [0,4194304] 0 2024-04-27T07:33:19.254 INFO:tasks.workunit.client.1.smithi100.stdout:9/12: unlink d1/f2 0 2024-04-27T07:33:19.258 INFO:tasks.workunit.client.1.smithi100.stdout:9/13: rename f0 to d1/f4 0 2024-04-27T07:33:19.259 INFO:tasks.workunit.client.1.smithi100.stdout:8/25: truncate d6/f7 1506085 0 2024-04-27T07:33:19.263 INFO:tasks.workunit.client.1.smithi100.stdout:9/14: creat d1/f5 x:0 0 0 2024-04-27T07:33:19.263 INFO:tasks.workunit.client.0.smithi082.stdout:5/448: dwrite d8/f3e [0,4194304] 0 2024-04-27T07:33:19.264 INFO:tasks.workunit.client.1.smithi100.stdout:8/26: dread f1 [0,4194304] 0 2024-04-27T07:33:19.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/301: dwrite d9/d2d/f1a [0,4194304] 0 2024-04-27T07:33:19.265 INFO:tasks.workunit.client.0.smithi082.stdout:3/551: dread d8/d9/d3f/f8a [0,4194304] 0 2024-04-27T07:33:19.265 INFO:tasks.workunit.client.1.smithi100.stdout:9/15: creat d1/f6 x:0 0 0 2024-04-27T07:33:19.266 INFO:tasks.workunit.client.0.smithi082.stdout:9/302: fsync d9/da/dc/f3e 0 2024-04-27T07:33:19.267 INFO:tasks.workunit.client.1.smithi100.stdout:8/27: creat d6/f8 x:0 0 0 2024-04-27T07:33:19.267 INFO:tasks.workunit.client.0.smithi082.stdout:9/303: fsync d9/da/dc/f17 0 2024-04-27T07:33:19.268 INFO:tasks.workunit.client.1.smithi100.stdout:9/16: creat d1/f7 x:0 0 0 2024-04-27T07:33:19.269 INFO:tasks.workunit.client.1.smithi100.stdout:1/25: rmdir d0 39 2024-04-27T07:33:19.269 INFO:tasks.workunit.client.1.smithi100.stdout:1/26: truncate - no filename 2024-04-27T07:33:19.269 INFO:tasks.workunit.client.1.smithi100.stdout:1/27: truncate - no filename 2024-04-27T07:33:19.271 INFO:tasks.workunit.client.1.smithi100.stdout:5/20: rmdir d0/d4 39 2024-04-27T07:33:19.271 INFO:tasks.workunit.client.1.smithi100.stdout:5/21: readlink - no filename 2024-04-27T07:33:19.271 INFO:tasks.workunit.client.0.smithi082.stdout:3/552: fdatasync d8/d9/dd/f5a 0 2024-04-27T07:33:19.272 INFO:tasks.workunit.client.1.smithi100.stdout:1/28: readlink d0/l4 0 2024-04-27T07:33:19.273 INFO:tasks.workunit.client.0.smithi082.stdout:9/304: mkdir d9/da/dc/d35/d4a/d61 0 2024-04-27T07:33:19.274 INFO:tasks.workunit.client.0.smithi082.stdout:6/349: truncate d2/d45/f42 3412098 0 2024-04-27T07:33:19.275 INFO:tasks.workunit.client.1.smithi100.stdout:1/29: chown d0/l3 104462251 1 2024-04-27T07:33:19.275 INFO:tasks.workunit.client.1.smithi100.stdout:1/30: read - no filename 2024-04-27T07:33:19.275 INFO:tasks.workunit.client.1.smithi100.stdout:1/31: fsync - no filename 2024-04-27T07:33:19.278 INFO:tasks.workunit.client.1.smithi100.stdout:8/28: dwrite d6/f8 [0,4194304] 0 2024-04-27T07:33:19.278 INFO:tasks.workunit.client.1.smithi100.stdout:1/32: mknod d0/c5 0 2024-04-27T07:33:19.279 INFO:tasks.workunit.client.1.smithi100.stdout:1/33: readlink d0/l3 0 2024-04-27T07:33:19.279 INFO:tasks.workunit.client.1.smithi100.stdout:1/34: fsync - no filename 2024-04-27T07:33:19.279 INFO:tasks.workunit.client.1.smithi100.stdout:1/35: fsync - no filename 2024-04-27T07:33:19.280 INFO:tasks.workunit.client.1.smithi100.stdout:8/29: chown l3 21366458 1 2024-04-27T07:33:19.280 INFO:tasks.workunit.client.1.smithi100.stdout:4/19: getdents d5 0 2024-04-27T07:33:19.280 INFO:tasks.workunit.client.0.smithi082.stdout:5/449: link d8/fa d8/d14/d7b/f96 0 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:8/30: stat c5 0 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/36: chown d0 0 1 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/37: write - no filename 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/38: write - no filename 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/39: truncate - no filename 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:8/31: rename d6 to d6/d9 22 2024-04-27T07:33:19.281 INFO:tasks.workunit.client.1.smithi100.stdout:5/22: creat d0/f8 x:0 0 0 2024-04-27T07:33:19.282 INFO:tasks.workunit.client.0.smithi082.stdout:3/553: mknod d8/d9/d1d/da5/db3/ccc 0 2024-04-27T07:33:19.282 INFO:tasks.workunit.client.0.smithi082.stdout:9/305: dwrite d9/d2d/d2b/d46/f58 [0,4194304] 0 2024-04-27T07:33:19.283 INFO:tasks.workunit.client.1.smithi100.stdout:1/40: symlink d0/l6 0 2024-04-27T07:33:19.283 INFO:tasks.workunit.client.1.smithi100.stdout:1/41: dwrite - no filename 2024-04-27T07:33:19.283 INFO:tasks.workunit.client.0.smithi082.stdout:9/306: fdatasync d9/da/dc/f17 0 2024-04-27T07:33:19.285 INFO:tasks.workunit.client.1.smithi100.stdout:8/32: write f1 [3963196,90088] 0 2024-04-27T07:33:19.285 INFO:tasks.workunit.client.0.smithi082.stdout:9/307: write d9/d2d/f59 [710496,47452] 0 2024-04-27T07:33:19.285 INFO:tasks.workunit.client.0.smithi082.stdout:5/450: unlink d8/d3c/f87 0 2024-04-27T07:33:19.286 INFO:tasks.workunit.client.1.smithi100.stdout:5/23: stat d0/d4/f5 0 2024-04-27T07:33:19.288 INFO:tasks.workunit.client.0.smithi082.stdout:5/451: write d8/d3c/d5a/d5b/d5f/f84 [72788,90941] 0 2024-04-27T07:33:19.290 INFO:tasks.workunit.client.1.smithi100.stdout:4/20: dwrite f0 [0,4194304] 0 2024-04-27T07:33:19.290 INFO:tasks.workunit.client.1.smithi100.stdout:1/42: creat d0/f7 x:0 0 0 2024-04-27T07:33:19.292 INFO:tasks.workunit.client.0.smithi082.stdout:5/452: write d8/d3c/d5a/d5b/d5f/f84 [784664,114990] 0 2024-04-27T07:33:19.296 INFO:tasks.workunit.client.0.smithi082.stdout:5/453: unlink d8/d14/d7b/l92 0 2024-04-27T07:33:19.297 INFO:tasks.workunit.client.0.smithi082.stdout:9/308: dwrite d9/da/dc/d35/d4b/f5f [0,4194304] 0 2024-04-27T07:33:19.297 INFO:tasks.workunit.client.1.smithi100.stdout:4/21: rename f4 to d5/f7 0 2024-04-27T07:33:19.300 INFO:tasks.workunit.client.1.smithi100.stdout:1/43: dwrite d0/f7 [0,4194304] 0 2024-04-27T07:33:19.300 INFO:tasks.workunit.client.1.smithi100.stdout:8/33: write d6/f7 [643339,80913] 0 2024-04-27T07:33:19.302 INFO:tasks.workunit.client.1.smithi100.stdout:1/44: write d0/f7 [2259198,85497] 0 2024-04-27T07:33:19.303 INFO:tasks.workunit.client.1.smithi100.stdout:9/17: fsync d1/f5 0 2024-04-27T07:33:19.304 INFO:tasks.workunit.client.1.smithi100.stdout:5/24: creat d0/f9 x:0 0 0 2024-04-27T07:33:19.304 INFO:tasks.workunit.client.0.smithi082.stdout:5/454: mknod d8/d2e/d85/c97 0 2024-04-27T07:33:19.305 INFO:tasks.workunit.client.1.smithi100.stdout:5/25: read - d0/f9 zero size 2024-04-27T07:33:19.305 INFO:tasks.workunit.client.0.smithi082.stdout:9/309: getdents d9/da/dc/d35/d4a/d50 0 2024-04-27T07:33:19.306 INFO:tasks.workunit.client.0.smithi082.stdout:9/310: chown d9/da/f26 30972 1 2024-04-27T07:33:19.309 INFO:tasks.workunit.client.0.smithi082.stdout:5/455: mkdir d8/d98 0 2024-04-27T07:33:19.310 INFO:tasks.workunit.client.1.smithi100.stdout:9/18: rmdir d1 39 2024-04-27T07:33:19.311 INFO:tasks.workunit.client.0.smithi082.stdout:9/311: write d9/f21 [2223409,71901] 0 2024-04-27T07:33:19.312 INFO:tasks.workunit.client.0.smithi082.stdout:5/456: mknod d8/d29/d4e/c99 0 2024-04-27T07:33:19.312 INFO:tasks.workunit.client.1.smithi100.stdout:2/33: truncate d0/f1 1918027 0 2024-04-27T07:33:19.313 INFO:tasks.workunit.client.0.smithi082.stdout:5/457: dread - d8/d29/d4e/f52 zero size 2024-04-27T07:33:19.313 INFO:tasks.workunit.client.0.smithi082.stdout:9/312: unlink d9/d2d/f1a 0 2024-04-27T07:33:19.314 INFO:tasks.workunit.client.0.smithi082.stdout:9/313: fdatasync d9/da/d32/f41 0 2024-04-27T07:33:19.316 INFO:tasks.workunit.client.1.smithi100.stdout:9/19: read d1/f4 [124738,32936] 0 2024-04-27T07:33:19.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/314: unlink d9/da/l27 0 2024-04-27T07:33:19.317 INFO:tasks.workunit.client.1.smithi100.stdout:9/20: read - d1/f7 zero size 2024-04-27T07:33:19.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/315: write d9/da/dc/f3f [1699798,2037] 0 2024-04-27T07:33:19.320 INFO:tasks.workunit.client.1.smithi100.stdout:5/26: rename d0/d4/f5 to d0/fa 0 2024-04-27T07:33:19.321 INFO:tasks.workunit.client.1.smithi100.stdout:8/34: getdents d6 0 2024-04-27T07:33:19.323 INFO:tasks.workunit.client.1.smithi100.stdout:8/35: dread d6/f7 [0,4194304] 0 2024-04-27T07:33:19.325 INFO:tasks.workunit.client.1.smithi100.stdout:8/36: write d6/f8 [212481,9676] 0 2024-04-27T07:33:19.326 INFO:tasks.workunit.client.1.smithi100.stdout:1/45: rmdir d0 39 2024-04-27T07:33:19.330 INFO:tasks.workunit.client.1.smithi100.stdout:9/21: link d1/f4 d1/f8 0 2024-04-27T07:33:19.332 INFO:tasks.workunit.client.1.smithi100.stdout:8/37: symlink d6/la 0 2024-04-27T07:33:19.334 INFO:tasks.workunit.client.1.smithi100.stdout:1/46: write d0/f7 [2530446,39919] 0 2024-04-27T07:33:19.335 INFO:tasks.workunit.client.1.smithi100.stdout:1/47: stat d0 0 2024-04-27T07:33:19.340 INFO:tasks.workunit.client.1.smithi100.stdout:8/38: dread d6/f7 [0,4194304] 0 2024-04-27T07:33:19.342 INFO:tasks.workunit.client.1.smithi100.stdout:1/48: unlink d0/l6 0 2024-04-27T07:33:19.346 INFO:tasks.workunit.client.1.smithi100.stdout:8/39: creat d6/fb x:0 0 0 2024-04-27T07:33:19.348 INFO:tasks.workunit.client.1.smithi100.stdout:5/27: link d0/c1 d0/cb 0 2024-04-27T07:33:19.350 INFO:tasks.workunit.client.1.smithi100.stdout:8/40: symlink d6/lc 0 2024-04-27T07:33:19.350 INFO:tasks.workunit.client.1.smithi100.stdout:1/49: rmdir d0 39 2024-04-27T07:33:19.351 INFO:tasks.workunit.client.1.smithi100.stdout:9/22: dwrite d1/f8 [0,4194304] 0 2024-04-27T07:33:19.351 INFO:tasks.workunit.client.1.smithi100.stdout:8/41: chown c5 7016683 1 2024-04-27T07:33:19.351 INFO:tasks.workunit.client.1.smithi100.stdout:9/23: fdatasync d1/f7 0 2024-04-27T07:33:19.352 INFO:tasks.workunit.client.1.smithi100.stdout:9/24: dread - d1/f6 zero size 2024-04-27T07:33:19.352 INFO:tasks.workunit.client.1.smithi100.stdout:2/34: truncate d0/f1 913953 0 2024-04-27T07:33:19.353 INFO:tasks.workunit.client.1.smithi100.stdout:2/35: rename d0 to d0/d5 22 2024-04-27T07:33:19.353 INFO:tasks.workunit.client.1.smithi100.stdout:9/25: write d1/f7 [135738,74496] 0 2024-04-27T07:33:19.357 INFO:tasks.workunit.client.1.smithi100.stdout:8/42: mknod d6/cd 0 2024-04-27T07:33:19.358 INFO:tasks.workunit.client.1.smithi100.stdout:5/28: chown d0/c1 8648 1 2024-04-27T07:33:19.360 INFO:tasks.workunit.client.1.smithi100.stdout:1/50: symlink d0/l8 0 2024-04-27T07:33:19.361 INFO:tasks.workunit.client.1.smithi100.stdout:8/43: creat d6/fe x:0 0 0 2024-04-27T07:33:19.363 INFO:tasks.workunit.client.1.smithi100.stdout:8/44: dread - d6/fb zero size 2024-04-27T07:33:19.363 INFO:tasks.workunit.client.1.smithi100.stdout:5/29: write d0/fa [2689051,103735] 0 2024-04-27T07:33:19.365 INFO:tasks.workunit.client.1.smithi100.stdout:9/26: dwrite d1/f4 [0,4194304] 0 2024-04-27T07:33:19.366 INFO:tasks.workunit.client.1.smithi100.stdout:9/27: read - d1/f5 zero size 2024-04-27T07:33:19.367 INFO:tasks.workunit.client.1.smithi100.stdout:1/51: creat d0/f9 x:0 0 0 2024-04-27T07:33:19.370 INFO:tasks.workunit.client.1.smithi100.stdout:9/28: mkdir d1/d9 0 2024-04-27T07:33:19.370 INFO:tasks.workunit.client.1.smithi100.stdout:2/36: write d0/f1 [461017,45386] 0 2024-04-27T07:33:19.372 INFO:tasks.workunit.client.1.smithi100.stdout:8/45: link d6/fb d6/ff 0 2024-04-27T07:33:19.374 INFO:tasks.workunit.client.1.smithi100.stdout:2/37: symlink d0/l6 0 2024-04-27T07:33:19.375 INFO:tasks.workunit.client.1.smithi100.stdout:2/38: chown d0/c2 1176288944 1 2024-04-27T07:33:19.376 INFO:tasks.workunit.client.1.smithi100.stdout:8/46: creat d6/f10 x:0 0 0 2024-04-27T07:33:19.377 INFO:tasks.workunit.client.1.smithi100.stdout:9/29: mknod d1/d9/ca 0 2024-04-27T07:33:19.377 INFO:tasks.workunit.client.1.smithi100.stdout:1/52: getdents d0 0 2024-04-27T07:33:19.379 INFO:tasks.workunit.client.1.smithi100.stdout:2/39: creat d0/f7 x:0 0 0 2024-04-27T07:33:19.380 INFO:tasks.workunit.client.1.smithi100.stdout:9/30: mkdir d1/d9/db 0 2024-04-27T07:33:19.381 INFO:tasks.workunit.client.0.smithi082.stdout:6/350: write d2/d45/f42 [1252896,117717] 0 2024-04-27T07:33:19.382 INFO:tasks.workunit.client.0.smithi082.stdout:5/458: write d8/d3c/d64/f36 [923719,48545] 0 2024-04-27T07:33:19.382 INFO:tasks.workunit.client.1.smithi100.stdout:1/53: rename d0/f9 to d0/fa 0 2024-04-27T07:33:19.384 INFO:tasks.workunit.client.0.smithi082.stdout:6/351: write d2/de/f72 [3794679,91473] 0 2024-04-27T07:33:19.385 INFO:tasks.workunit.client.0.smithi082.stdout:5/459: symlink d8/d15/l9a 0 2024-04-27T07:33:19.385 INFO:tasks.workunit.client.1.smithi100.stdout:8/47: dwrite d6/f8 [0,4194304] 0 2024-04-27T07:33:19.388 INFO:tasks.workunit.client.1.smithi100.stdout:8/48: creat d6/f11 x:0 0 0 2024-04-27T07:33:19.389 INFO:tasks.workunit.client.1.smithi100.stdout:2/40: link d0/l4 d0/l8 0 2024-04-27T07:33:19.389 INFO:tasks.workunit.client.0.smithi082.stdout:5/460: link d8/d2e/f86 d8/d15/d65/f9b 0 2024-04-27T07:33:19.389 INFO:tasks.workunit.client.0.smithi082.stdout:6/352: read d2/de/d13/f21 [2008470,107912] 0 2024-04-27T07:33:19.390 INFO:tasks.workunit.client.0.smithi082.stdout:5/461: fdatasync d8/d15/f24 0 2024-04-27T07:33:19.391 INFO:tasks.workunit.client.1.smithi100.stdout:8/49: symlink d6/l12 0 2024-04-27T07:33:19.392 INFO:tasks.workunit.client.0.smithi082.stdout:5/462: rmdir d8/d14 39 2024-04-27T07:33:19.392 INFO:tasks.workunit.client.1.smithi100.stdout:2/41: mknod d0/c9 0 2024-04-27T07:33:19.392 INFO:tasks.workunit.client.1.smithi100.stdout:2/42: dread - d0/f7 zero size 2024-04-27T07:33:19.393 INFO:tasks.workunit.client.1.smithi100.stdout:8/50: mknod d6/c13 0 2024-04-27T07:33:19.394 INFO:tasks.workunit.client.1.smithi100.stdout:2/43: mkdir d0/da 0 2024-04-27T07:33:19.395 INFO:tasks.workunit.client.1.smithi100.stdout:1/54: fsync d0/fa 0 2024-04-27T07:33:19.395 INFO:tasks.workunit.client.0.smithi082.stdout:9/316: dread d9/fb [0,4194304] 0 2024-04-27T07:33:19.397 INFO:tasks.workunit.client.0.smithi082.stdout:6/353: rename d2/f23 to d2/f74 0 2024-04-27T07:33:19.399 INFO:tasks.workunit.client.1.smithi100.stdout:2/44: unlink d0/l8 0 2024-04-27T07:33:19.399 INFO:tasks.workunit.client.0.smithi082.stdout:6/354: write d2/d2d/f51 [66208,55182] 0 2024-04-27T07:33:19.400 INFO:tasks.workunit.client.1.smithi100.stdout:9/31: truncate d1/f8 151572 0 2024-04-27T07:33:19.401 INFO:tasks.workunit.client.0.smithi082.stdout:6/355: read d2/f60 [3129085,18966] 0 2024-04-27T07:33:19.402 INFO:tasks.workunit.client.0.smithi082.stdout:9/317: link d9/cd d9/da/dc/d33/d5e/c62 0 2024-04-27T07:33:19.403 INFO:tasks.workunit.client.1.smithi100.stdout:9/32: write d1/f6 [531413,53075] 0 2024-04-27T07:33:19.403 INFO:tasks.workunit.client.0.smithi082.stdout:9/318: chown d9/c5c 89 1 2024-04-27T07:33:19.404 INFO:tasks.workunit.client.1.smithi100.stdout:2/45: symlink d0/lb 0 2024-04-27T07:33:19.404 INFO:tasks.workunit.client.1.smithi100.stdout:1/55: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:19.405 INFO:tasks.workunit.client.0.smithi082.stdout:5/463: getdents d8/d3c/d4a 0 2024-04-27T07:33:19.405 INFO:tasks.workunit.client.1.smithi100.stdout:1/56: stat d0/l4 0 2024-04-27T07:33:19.406 INFO:tasks.workunit.client.1.smithi100.stdout:9/33: creat d1/d9/fc x:0 0 0 2024-04-27T07:33:19.406 INFO:tasks.workunit.client.1.smithi100.stdout:9/34: readlink - no filename 2024-04-27T07:33:19.406 INFO:tasks.workunit.client.1.smithi100.stdout:9/35: readlink - no filename 2024-04-27T07:33:19.407 INFO:tasks.workunit.client.0.smithi082.stdout:9/319: mknod d9/d48/c63 0 2024-04-27T07:33:19.410 INFO:tasks.workunit.client.1.smithi100.stdout:1/57: dread d0/fa [0,4194304] 0 2024-04-27T07:33:19.411 INFO:tasks.workunit.client.1.smithi100.stdout:9/36: creat d1/fd x:0 0 0 2024-04-27T07:33:19.411 INFO:tasks.workunit.client.0.smithi082.stdout:9/320: creat d9/da/f64 x:0 0 0 2024-04-27T07:33:19.412 INFO:tasks.workunit.client.1.smithi100.stdout:9/37: stat d1/d9/db 0 2024-04-27T07:33:19.413 INFO:tasks.workunit.client.0.smithi082.stdout:5/464: dwrite d8/d15/d65/f94 [0,4194304] 0 2024-04-27T07:33:19.415 INFO:tasks.workunit.client.1.smithi100.stdout:1/58: rename d0/l4 to d0/lb 0 2024-04-27T07:33:19.416 INFO:tasks.workunit.client.0.smithi082.stdout:9/321: mkdir d9/da/dc/d35/d38/d65 0 2024-04-27T07:33:19.416 INFO:tasks.workunit.client.0.smithi082.stdout:9/322: read - d9/da/f64 zero size 2024-04-27T07:33:19.416 INFO:tasks.workunit.client.0.smithi082.stdout:5/465: stat d8/d14/c5c 0 2024-04-27T07:33:19.418 INFO:tasks.workunit.client.1.smithi100.stdout:2/46: link d0/lb d0/da/lc 0 2024-04-27T07:33:19.420 INFO:tasks.workunit.client.1.smithi100.stdout:1/59: mknod d0/cc 0 2024-04-27T07:33:19.422 INFO:tasks.workunit.client.0.smithi082.stdout:6/356: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:19.423 INFO:tasks.workunit.client.1.smithi100.stdout:2/47: creat d0/da/fd x:0 0 0 2024-04-27T07:33:19.423 INFO:tasks.workunit.client.0.smithi082.stdout:5/466: dwrite d8/d14/f4d [4194304,4194304] 0 2024-04-27T07:33:19.425 INFO:tasks.workunit.client.1.smithi100.stdout:1/60: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:19.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/467: write d8/d3b/f74 [4120897,118007] 0 2024-04-27T07:33:19.426 INFO:tasks.workunit.client.1.smithi100.stdout:2/48: mkdir d0/de 0 2024-04-27T07:33:19.426 INFO:tasks.workunit.client.1.smithi100.stdout:1/61: truncate d0/f7 4561453 0 2024-04-27T07:33:19.427 INFO:tasks.workunit.client.1.smithi100.stdout:2/49: dread - d0/da/fd zero size 2024-04-27T07:33:19.428 INFO:tasks.workunit.client.0.smithi082.stdout:5/468: mkdir d8/d98/d9c 0 2024-04-27T07:33:19.429 INFO:tasks.workunit.client.0.smithi082.stdout:5/469: fsync d8/d15/f58 0 2024-04-27T07:33:19.430 INFO:tasks.workunit.client.0.smithi082.stdout:5/470: chown d8/d3b 11655 1 2024-04-27T07:33:19.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/357: rename d2/d45/d5d to d2/d75 0 2024-04-27T07:33:19.431 INFO:tasks.workunit.client.0.smithi082.stdout:5/471: chown d8/d3c/d47/f27 236 1 2024-04-27T07:33:19.431 INFO:tasks.workunit.client.0.smithi082.stdout:5/472: chown d8/d42 20900786 1 2024-04-27T07:33:19.435 INFO:tasks.workunit.client.1.smithi100.stdout:2/50: getdents d0/de 0 2024-04-27T07:33:19.437 INFO:tasks.workunit.client.0.smithi082.stdout:5/473: dread d8/d3c/d4a/f88 [0,4194304] 0 2024-04-27T07:33:19.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/358: dwrite d2/d3/d1b/f28 [0,4194304] 0 2024-04-27T07:33:19.437 INFO:tasks.workunit.client.1.smithi100.stdout:2/51: chown d0/da/lc 1 1 2024-04-27T07:33:19.438 INFO:tasks.workunit.client.1.smithi100.stdout:1/62: dwrite d0/fa [4194304,4194304] 0 2024-04-27T07:33:19.438 INFO:tasks.workunit.client.1.smithi100.stdout:2/52: write d0/f1 [895179,31618] 0 2024-04-27T07:33:19.443 INFO:tasks.workunit.client.1.smithi100.stdout:2/53: creat d0/de/ff x:0 0 0 2024-04-27T07:33:19.444 INFO:tasks.workunit.client.1.smithi100.stdout:2/54: write d0/f7 [252477,52826] 0 2024-04-27T07:33:19.446 INFO:tasks.workunit.client.0.smithi082.stdout:5/474: truncate d8/d14/f23 6436233 0 2024-04-27T07:33:19.447 INFO:tasks.workunit.client.1.smithi100.stdout:9/38: dread d1/f8 [0,4194304] 0 2024-04-27T07:33:19.448 INFO:tasks.workunit.client.1.smithi100.stdout:2/55: mkdir d0/d10 0 2024-04-27T07:33:19.450 INFO:tasks.workunit.client.0.smithi082.stdout:5/475: mknod d8/d14/d7b/c9d 0 2024-04-27T07:33:19.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/323: dread d9/da/dc/f2a [0,4194304] 0 2024-04-27T07:33:19.455 INFO:tasks.workunit.client.1.smithi100.stdout:9/39: creat d1/d9/db/fe x:0 0 0 2024-04-27T07:33:19.455 INFO:tasks.workunit.client.1.smithi100.stdout:9/40: chown d1/d9/db 21267 1 2024-04-27T07:33:19.455 INFO:tasks.workunit.client.1.smithi100.stdout:9/41: read - d1/fd zero size 2024-04-27T07:33:19.456 INFO:tasks.workunit.client.0.smithi082.stdout:6/359: dwrite d2/d1e/f34 [0,4194304] 0 2024-04-27T07:33:19.456 INFO:tasks.workunit.client.0.smithi082.stdout:5/476: unlink d8/l34 0 2024-04-27T07:33:19.456 INFO:tasks.workunit.client.1.smithi100.stdout:9/42: unlink d1/f6 0 2024-04-27T07:33:19.456 INFO:tasks.workunit.client.1.smithi100.stdout:9/43: dread - d1/d9/fc zero size 2024-04-27T07:33:19.457 INFO:tasks.workunit.client.0.smithi082.stdout:6/360: mknod d2/d2d/d4a/c76 0 2024-04-27T07:33:19.459 INFO:tasks.workunit.client.0.smithi082.stdout:9/324: dwrite d9/da/dc/f3f [0,4194304] 0 2024-04-27T07:33:19.459 INFO:tasks.workunit.client.0.smithi082.stdout:6/361: mkdir d2/de/d77 0 2024-04-27T07:33:19.461 INFO:tasks.workunit.client.0.smithi082.stdout:9/325: truncate d9/da/dc/d33/f37 720830 0 2024-04-27T07:33:19.463 INFO:tasks.workunit.client.0.smithi082.stdout:6/362: symlink d2/d2d/l78 0 2024-04-27T07:33:19.467 INFO:tasks.workunit.client.0.smithi082.stdout:6/363: symlink d2/l79 0 2024-04-27T07:33:19.469 INFO:tasks.workunit.client.0.smithi082.stdout:6/364: mkdir d2/d75/d7a 0 2024-04-27T07:33:19.470 INFO:tasks.workunit.client.0.smithi082.stdout:9/326: dwrite d9/d2d/d2b/d46/f58 [0,4194304] 0 2024-04-27T07:33:19.472 INFO:tasks.workunit.client.0.smithi082.stdout:6/365: symlink d2/d2e/d55/l7b 0 2024-04-27T07:33:19.473 INFO:tasks.workunit.client.1.smithi100.stdout:1/63: fsync d0/fa 0 2024-04-27T07:33:19.474 INFO:tasks.workunit.client.1.smithi100.stdout:2/56: fsync d0/f7 0 2024-04-27T07:33:19.474 INFO:tasks.workunit.client.1.smithi100.stdout:2/57: readlink d0/lb 0 2024-04-27T07:33:19.476 INFO:tasks.workunit.client.1.smithi100.stdout:2/58: truncate d0/de/ff 285833 0 2024-04-27T07:33:19.477 INFO:tasks.workunit.client.0.smithi082.stdout:6/366: getdents d2/d3/d1b 0 2024-04-27T07:33:19.477 INFO:tasks.workunit.client.1.smithi100.stdout:2/59: dread - d0/da/fd zero size 2024-04-27T07:33:19.478 INFO:tasks.workunit.client.0.smithi082.stdout:9/327: dwrite d9/da/dc/d33/f37 [0,4194304] 0 2024-04-27T07:33:19.478 INFO:tasks.workunit.client.1.smithi100.stdout:2/60: chown d0/de/ff 1733013 1 2024-04-27T07:33:19.479 INFO:tasks.workunit.client.0.smithi082.stdout:6/367: fdatasync d2/d1e/f22 0 2024-04-27T07:33:19.479 INFO:tasks.workunit.client.1.smithi100.stdout:1/64: creat d0/fd x:0 0 0 2024-04-27T07:33:19.480 INFO:tasks.workunit.client.1.smithi100.stdout:2/61: creat d0/f11 x:0 0 0 2024-04-27T07:33:19.481 INFO:tasks.workunit.client.1.smithi100.stdout:2/62: truncate d0/f7 560777 0 2024-04-27T07:33:19.481 INFO:tasks.workunit.client.1.smithi100.stdout:1/65: creat d0/fe x:0 0 0 2024-04-27T07:33:19.481 INFO:tasks.workunit.client.0.smithi082.stdout:9/328: write d9/da/dc/d35/d4b/f5f [5111506,46502] 0 2024-04-27T07:33:19.482 INFO:tasks.workunit.client.1.smithi100.stdout:2/63: dread - d0/da/fd zero size 2024-04-27T07:33:19.482 INFO:tasks.workunit.client.1.smithi100.stdout:9/44: getdents d1/d9/db 0 2024-04-27T07:33:19.484 INFO:tasks.workunit.client.1.smithi100.stdout:1/66: symlink d0/lf 0 2024-04-27T07:33:19.485 INFO:tasks.workunit.client.1.smithi100.stdout:1/67: write d0/fa [4748428,108309] 0 2024-04-27T07:33:19.486 INFO:tasks.workunit.client.1.smithi100.stdout:1/68: readlink d0/l3 0 2024-04-27T07:33:19.486 INFO:tasks.workunit.client.1.smithi100.stdout:9/45: creat d1/d9/db/ff x:0 0 0 2024-04-27T07:33:19.487 INFO:tasks.workunit.client.1.smithi100.stdout:1/69: write d0/fd [767215,54334] 0 2024-04-27T07:33:19.487 INFO:tasks.workunit.client.1.smithi100.stdout:9/46: chown d1/f8 3 1 2024-04-27T07:33:19.489 INFO:tasks.workunit.client.1.smithi100.stdout:2/64: link d0/f1 d0/f12 0 2024-04-27T07:33:19.489 INFO:tasks.workunit.client.0.smithi082.stdout:5/477: dread d8/d3c/d64/f36 [0,4194304] 0 2024-04-27T07:33:19.489 INFO:tasks.workunit.client.0.smithi082.stdout:5/478: write d8/d14/f21 [4609075,58921] 0 2024-04-27T07:33:19.490 INFO:tasks.workunit.client.1.smithi100.stdout:9/47: dread - d1/d9/db/fe zero size 2024-04-27T07:33:19.490 INFO:tasks.workunit.client.1.smithi100.stdout:1/70: mknod d0/c10 0 2024-04-27T07:33:19.491 INFO:tasks.workunit.client.0.smithi082.stdout:5/479: mknod d8/d15/d22/c9e 0 2024-04-27T07:33:19.492 INFO:tasks.workunit.client.1.smithi100.stdout:1/71: chown d0/fe 0 1 2024-04-27T07:33:19.492 INFO:tasks.workunit.client.0.smithi082.stdout:5/480: write d8/fa [1032172,106180] 0 2024-04-27T07:33:19.494 INFO:tasks.workunit.client.1.smithi100.stdout:9/48: symlink d1/d9/l10 0 2024-04-27T07:33:19.495 INFO:tasks.workunit.client.1.smithi100.stdout:1/72: symlink d0/l11 0 2024-04-27T07:33:19.496 INFO:tasks.workunit.client.0.smithi082.stdout:5/481: dread d8/d3b/f74 [0,4194304] 0 2024-04-27T07:33:19.502 INFO:tasks.workunit.client.1.smithi100.stdout:1/73: fsync d0/fd 0 2024-04-27T07:33:19.506 INFO:tasks.workunit.client.1.smithi100.stdout:2/65: rmdir d0 39 2024-04-27T07:33:19.508 INFO:tasks.workunit.client.0.smithi082.stdout:1/438: sync 2024-04-27T07:33:19.509 INFO:tasks.workunit.client.1.smithi100.stdout:1/74: dwrite d0/fa [4194304,4194304] 0 2024-04-27T07:33:19.509 INFO:tasks.workunit.client.0.smithi082.stdout:5/482: mknod d8/d98/d9c/c9f 0 2024-04-27T07:33:19.510 INFO:tasks.workunit.client.1.smithi100.stdout:9/49: write d1/f8 [373257,17074] 0 2024-04-27T07:33:19.511 INFO:tasks.workunit.client.1.smithi100.stdout:9/50: stat d1/d9/l10 0 2024-04-27T07:33:19.511 INFO:tasks.workunit.client.0.smithi082.stdout:1/439: readlink d4/d15/l27 0 2024-04-27T07:33:19.512 INFO:tasks.workunit.client.1.smithi100.stdout:1/75: symlink d0/l12 0 2024-04-27T07:33:19.513 INFO:tasks.workunit.client.0.smithi082.stdout:1/440: write d4/d15/d49/d4e/f5a [915930,53526] 0 2024-04-27T07:33:19.514 INFO:tasks.workunit.client.0.smithi082.stdout:5/483: rename d8/d3c/d5a/d5b/d5f/f70 to d8/d3c/fa0 0 2024-04-27T07:33:19.516 INFO:tasks.workunit.client.0.smithi082.stdout:1/441: dread d4/d2a/d4c/f6a [0,4194304] 0 2024-04-27T07:33:19.518 INFO:tasks.workunit.client.0.smithi082.stdout:1/442: chown d4/f28 381351 1 2024-04-27T07:33:19.518 INFO:tasks.workunit.client.1.smithi100.stdout:2/66: dwrite d0/f12 [0,4194304] 0 2024-04-27T07:33:19.520 INFO:tasks.workunit.client.0.smithi082.stdout:5/484: dread d8/d3c/d47/f27 [4194304,4194304] 0 2024-04-27T07:33:19.521 INFO:tasks.workunit.client.0.smithi082.stdout:1/443: mknod d4/d2a/d3e/d46/c96 0 2024-04-27T07:33:19.521 INFO:tasks.workunit.client.1.smithi100.stdout:1/76: getdents d0 0 2024-04-27T07:33:19.523 INFO:tasks.workunit.client.0.smithi082.stdout:5/485: read d8/d14/f21 [4825195,49527] 0 2024-04-27T07:33:19.524 INFO:tasks.workunit.client.0.smithi082.stdout:1/444: mkdir d4/d15/d3f/d97 0 2024-04-27T07:33:19.525 INFO:tasks.workunit.client.0.smithi082.stdout:5/486: rmdir d8/d77 39 2024-04-27T07:33:19.526 INFO:tasks.workunit.client.1.smithi100.stdout:1/77: unlink d0/fe 0 2024-04-27T07:33:19.527 INFO:tasks.workunit.client.0.smithi082.stdout:1/445: mkdir d4/d15/d3f/d98 0 2024-04-27T07:33:19.529 INFO:tasks.workunit.client.1.smithi100.stdout:2/67: dwrite d0/f11 [0,4194304] 0 2024-04-27T07:33:19.530 INFO:tasks.workunit.client.0.smithi082.stdout:1/446: read d4/d15/f18 [3084588,79520] 0 2024-04-27T07:33:19.531 INFO:tasks.workunit.client.0.smithi082.stdout:5/487: creat d8/d14/fa1 x:0 0 0 2024-04-27T07:33:19.531 INFO:tasks.workunit.client.1.smithi100.stdout:2/68: chown d0/de/ff 13559 1 2024-04-27T07:33:19.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/447: mkdir d4/d15/d49/d99 0 2024-04-27T07:33:19.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/488: rename d8/d14/f16 to d8/d3c/fa2 0 2024-04-27T07:33:19.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/489: readlink d8/d15/l3a 0 2024-04-27T07:33:19.536 INFO:tasks.workunit.client.0.smithi082.stdout:1/448: mkdir d4/d15/d49/d99/d9a 0 2024-04-27T07:33:19.537 INFO:tasks.workunit.client.1.smithi100.stdout:1/78: dwrite d0/fd [0,4194304] 0 2024-04-27T07:33:19.538 INFO:tasks.workunit.client.1.smithi100.stdout:2/69: rename d0/f1 to d0/d10/f13 0 2024-04-27T07:33:19.539 INFO:tasks.workunit.client.0.smithi082.stdout:5/490: chown d8/d77/d7a/l8d 1026057 1 2024-04-27T07:33:19.541 INFO:tasks.workunit.client.0.smithi082.stdout:5/491: mkdir d8/d3c/d5a/d5b/da3 0 2024-04-27T07:33:19.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/492: dread d8/d3c/d64/f7e [0,4194304] 0 2024-04-27T07:33:19.543 INFO:tasks.workunit.client.1.smithi100.stdout:2/70: link d0/l6 d0/l14 0 2024-04-27T07:33:19.544 INFO:tasks.workunit.client.1.smithi100.stdout:2/71: chown d0/l4 51 1 2024-04-27T07:33:19.545 INFO:tasks.workunit.client.1.smithi100.stdout:2/72: rmdir d0/d10 39 2024-04-27T07:33:19.546 INFO:tasks.workunit.client.0.smithi082.stdout:5/493: creat d8/d3c/d5a/d5b/d5f/fa4 x:0 0 0 2024-04-27T07:33:19.547 INFO:tasks.workunit.client.1.smithi100.stdout:2/73: readlink d0/da/lc 0 2024-04-27T07:33:19.548 INFO:tasks.workunit.client.1.smithi100.stdout:1/79: fsync d0/f7 0 2024-04-27T07:33:19.552 INFO:tasks.workunit.client.0.smithi082.stdout:5/494: dwrite d8/d77/f78 [0,4194304] 0 2024-04-27T07:33:19.552 INFO:tasks.workunit.client.1.smithi100.stdout:1/80: dread d0/fa [0,4194304] 0 2024-04-27T07:33:19.553 INFO:tasks.workunit.client.0.smithi082.stdout:5/495: chown d8/d15/d65/d76 1999472 1 2024-04-27T07:33:19.555 INFO:tasks.workunit.client.1.smithi100.stdout:1/81: unlink d0/fa 0 2024-04-27T07:33:19.555 INFO:tasks.workunit.client.1.smithi100.stdout:1/82: chown d0/l12 391961891 1 2024-04-27T07:33:19.556 INFO:tasks.workunit.client.1.smithi100.stdout:2/74: getdents d0 0 2024-04-27T07:33:19.556 INFO:tasks.workunit.client.1.smithi100.stdout:1/83: stat d0/c10 0 2024-04-27T07:33:19.556 INFO:tasks.workunit.client.0.smithi082.stdout:5/496: creat d8/d2e/fa5 x:0 0 0 2024-04-27T07:33:19.558 INFO:tasks.workunit.client.1.smithi100.stdout:2/75: mkdir d0/da/d15 0 2024-04-27T07:33:19.560 INFO:tasks.workunit.client.1.smithi100.stdout:2/76: mknod d0/de/c16 0 2024-04-27T07:33:19.560 INFO:tasks.workunit.client.0.smithi082.stdout:5/497: rename d8/d2e/fa5 to d8/d2e/fa6 0 2024-04-27T07:33:19.560 INFO:tasks.workunit.client.0.smithi082.stdout:5/498: fdatasync d8/d14/f49 0 2024-04-27T07:33:19.561 INFO:tasks.workunit.client.1.smithi100.stdout:1/84: rmdir d0 39 2024-04-27T07:33:19.562 INFO:tasks.workunit.client.0.smithi082.stdout:5/499: creat d8/d29/fa7 x:0 0 0 2024-04-27T07:33:19.562 INFO:tasks.workunit.client.1.smithi100.stdout:2/77: rename d0/de/c16 to d0/c17 0 2024-04-27T07:33:19.563 INFO:tasks.workunit.client.1.smithi100.stdout:1/85: stat d0/lf 0 2024-04-27T07:33:19.566 INFO:tasks.workunit.client.1.smithi100.stdout:2/78: getdents d0/d10 0 2024-04-27T07:33:19.567 INFO:tasks.workunit.client.1.smithi100.stdout:1/86: dread d0/fd [0,4194304] 0 2024-04-27T07:33:19.568 INFO:tasks.workunit.client.1.smithi100.stdout:1/87: write d0/fd [2715422,17446] 0 2024-04-27T07:33:19.569 INFO:tasks.workunit.client.1.smithi100.stdout:1/88: stat d0/lb 0 2024-04-27T07:33:19.572 INFO:tasks.workunit.client.1.smithi100.stdout:2/79: link d0/l6 d0/l18 0 2024-04-27T07:33:19.575 INFO:tasks.workunit.client.1.smithi100.stdout:1/89: dwrite d0/fd [0,4194304] 0 2024-04-27T07:33:19.575 INFO:tasks.workunit.client.1.smithi100.stdout:2/80: creat d0/da/d15/f19 x:0 0 0 2024-04-27T07:33:19.577 INFO:tasks.workunit.client.1.smithi100.stdout:2/81: symlink d0/da/l1a 0 2024-04-27T07:33:19.578 INFO:tasks.workunit.client.1.smithi100.stdout:2/82: mknod d0/d10/c1b 0 2024-04-27T07:33:19.579 INFO:tasks.workunit.client.1.smithi100.stdout:2/83: dread - d0/da/fd zero size 2024-04-27T07:33:19.579 INFO:tasks.workunit.client.1.smithi100.stdout:2/84: chown d0/da 9937646 1 2024-04-27T07:33:19.581 INFO:tasks.workunit.client.1.smithi100.stdout:2/85: creat d0/da/f1c x:0 0 0 2024-04-27T07:33:19.582 INFO:tasks.workunit.client.1.smithi100.stdout:2/86: symlink d0/da/l1d 0 2024-04-27T07:33:19.583 INFO:tasks.workunit.client.1.smithi100.stdout:2/87: truncate d0/da/fd 418662 0 2024-04-27T07:33:19.584 INFO:tasks.workunit.client.0.smithi082.stdout:5/500: dread f5 [0,4194304] 0 2024-04-27T07:33:19.588 INFO:tasks.workunit.client.0.smithi082.stdout:5/501: getdents d8/d14 0 2024-04-27T07:33:19.589 INFO:tasks.workunit.client.0.smithi082.stdout:5/502: write d8/d3c/d5a/d5b/d5f/f7c [549118,92124] 0 2024-04-27T07:33:19.595 INFO:tasks.workunit.client.0.smithi082.stdout:5/503: dwrite d8/d77/f78 [0,4194304] 0 2024-04-27T07:33:19.596 INFO:tasks.workunit.client.1.smithi100.stdout:2/88: truncate d0/f11 3591461 0 2024-04-27T07:33:19.597 INFO:tasks.workunit.client.1.smithi100.stdout:2/89: rmdir d0/de 39 2024-04-27T07:33:19.597 INFO:tasks.workunit.client.0.smithi082.stdout:5/504: mknod d8/d2e/ca8 0 2024-04-27T07:33:19.598 INFO:tasks.workunit.client.0.smithi082.stdout:5/505: chown d8/d42/l4b 61934 1 2024-04-27T07:33:19.600 INFO:tasks.workunit.client.1.smithi100.stdout:2/90: rename d0/de to d0/d1e 0 2024-04-27T07:33:19.601 INFO:tasks.workunit.client.1.smithi100.stdout:2/91: symlink d0/da/l1f 0 2024-04-27T07:33:19.602 INFO:tasks.workunit.client.0.smithi082.stdout:5/506: getdents d8/d2e/d3d 0 2024-04-27T07:33:19.604 INFO:tasks.workunit.client.0.smithi082.stdout:5/507: write d8/d2e/fa6 [728712,55326] 0 2024-04-27T07:33:19.604 INFO:tasks.workunit.client.1.smithi100.stdout:2/92: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:19.605 INFO:tasks.workunit.client.1.smithi100.stdout:2/93: stat d0/d10/f13 0 2024-04-27T07:33:19.606 INFO:tasks.workunit.client.0.smithi082.stdout:5/508: creat d8/d2e/fa9 x:0 0 0 2024-04-27T07:33:19.607 INFO:tasks.workunit.client.1.smithi100.stdout:2/94: fdatasync d0/f12 0 2024-04-27T07:33:19.607 INFO:tasks.workunit.client.0.smithi082.stdout:5/509: mkdir d8/d2e/d85/daa 0 2024-04-27T07:33:19.608 INFO:tasks.workunit.client.0.smithi082.stdout:5/510: creat d8/d77/d7a/fab x:0 0 0 2024-04-27T07:33:19.609 INFO:tasks.workunit.client.1.smithi100.stdout:2/95: symlink d0/l20 0 2024-04-27T07:33:19.609 INFO:tasks.workunit.client.1.smithi100.stdout:2/96: dread - d0/da/f1c zero size 2024-04-27T07:33:19.610 INFO:tasks.workunit.client.0.smithi082.stdout:5/511: unlink d8/d15/c80 0 2024-04-27T07:33:19.611 INFO:tasks.workunit.client.1.smithi100.stdout:2/97: mknod d0/da/d15/c21 0 2024-04-27T07:33:19.611 INFO:tasks.workunit.client.1.smithi100.stdout:2/98: readlink d0/l18 0 2024-04-27T07:33:19.612 INFO:tasks.workunit.client.0.smithi082.stdout:5/512: creat d8/fac x:0 0 0 2024-04-27T07:33:19.613 INFO:tasks.workunit.client.1.smithi100.stdout:2/99: unlink d0/l4 0 2024-04-27T07:33:19.614 INFO:tasks.workunit.client.0.smithi082.stdout:5/513: mkdir d8/d29/d4e/dad 0 2024-04-27T07:33:19.615 INFO:tasks.workunit.client.0.smithi082.stdout:5/514: mknod d8/d3c/d64/cae 0 2024-04-27T07:33:19.615 INFO:tasks.workunit.client.1.smithi100.stdout:2/100: rename d0/da/l1d to d0/d10/l22 0 2024-04-27T07:33:19.617 INFO:tasks.workunit.client.1.smithi100.stdout:2/101: creat d0/d10/f23 x:0 0 0 2024-04-27T07:33:19.617 INFO:tasks.workunit.client.0.smithi082.stdout:5/515: write d8/d3c/d64/f7e [1729823,66773] 0 2024-04-27T07:33:19.617 INFO:tasks.workunit.client.1.smithi100.stdout:2/102: chown d0/f12 1115241 1 2024-04-27T07:33:19.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/516: read d8/d42/f54 [2403416,54591] 0 2024-04-27T07:33:19.620 INFO:tasks.workunit.client.0.smithi082.stdout:5/517: mknod d8/d3c/d64/caf 0 2024-04-27T07:33:19.620 INFO:tasks.workunit.client.1.smithi100.stdout:2/103: unlink d0/lb 0 2024-04-27T07:33:19.621 INFO:tasks.workunit.client.0.smithi082.stdout:5/518: read d8/d14/d7b/f96 [3577721,54270] 0 2024-04-27T07:33:19.622 INFO:tasks.workunit.client.0.smithi082.stdout:5/519: creat d8/d2e/fb0 x:0 0 0 2024-04-27T07:33:19.623 INFO:tasks.workunit.client.1.smithi100.stdout:2/104: rename d0/da/d15/f19 to d0/f24 0 2024-04-27T07:33:19.624 INFO:tasks.workunit.client.0.smithi082.stdout:5/520: mknod d8/d3c/d47/cb1 0 2024-04-27T07:33:19.624 INFO:tasks.workunit.client.1.smithi100.stdout:2/105: mknod d0/da/d15/c25 0 2024-04-27T07:33:19.625 INFO:tasks.workunit.client.1.smithi100.stdout:2/106: chown d0/da/l1a 4 1 2024-04-27T07:33:19.626 INFO:tasks.workunit.client.0.smithi082.stdout:5/521: unlink d8/d77/d7a/l89 0 2024-04-27T07:33:19.632 INFO:tasks.workunit.client.0.smithi082.stdout:5/522: rmdir d8/d77/d7a 39 2024-04-27T07:33:19.633 INFO:tasks.workunit.client.0.smithi082.stdout:5/523: truncate d8/d15/d65/f9b 737510 0 2024-04-27T07:33:19.634 INFO:tasks.workunit.client.0.smithi082.stdout:5/524: read d8/d3c/d4a/f88 [3127628,39966] 0 2024-04-27T07:33:19.636 INFO:tasks.workunit.client.0.smithi082.stdout:5/525: unlink d8/d14/c5c 0 2024-04-27T07:33:19.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/526: write d8/d3c/d4a/f88 [1245920,104177] 0 2024-04-27T07:33:19.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/527: readlink d8/d42/l4b 0 2024-04-27T07:33:19.639 INFO:tasks.workunit.client.0.smithi082.stdout:5/528: write d8/d3c/fa0 [108379,107885] 0 2024-04-27T07:33:19.640 INFO:tasks.workunit.client.1.smithi100.stdout:2/107: rename d0/da/d15 to d0/d10/d26 0 2024-04-27T07:33:19.642 INFO:tasks.workunit.client.0.smithi082.stdout:5/529: unlink d8/d15/d65/f94 0 2024-04-27T07:33:19.645 INFO:tasks.workunit.client.0.smithi082.stdout:5/530: link d8/d15/f24 d8/d3c/fb2 0 2024-04-27T07:33:19.646 INFO:tasks.workunit.client.0.smithi082.stdout:5/531: getdents d8/d29/d4e/dad 0 2024-04-27T07:33:19.649 INFO:tasks.workunit.client.1.smithi100.stdout:2/108: readlink d0/da/l1a 0 2024-04-27T07:33:19.651 INFO:tasks.workunit.client.1.smithi100.stdout:2/109: creat d0/d1e/f27 x:0 0 0 2024-04-27T07:33:19.651 INFO:tasks.workunit.client.1.smithi100.stdout:2/110: write d0/f12 [1578209,51370] 0 2024-04-27T07:33:19.652 INFO:tasks.workunit.client.0.smithi082.stdout:5/532: chown d8/d14/c83 44 1 2024-04-27T07:33:19.655 INFO:tasks.workunit.client.1.smithi100.stdout:2/111: write d0/f7 [1588676,47222] 0 2024-04-27T07:33:19.658 INFO:tasks.workunit.client.0.smithi082.stdout:5/533: dwrite d8/d3c/d5a/d5b/d5f/f84 [0,4194304] 0 2024-04-27T07:33:19.660 INFO:tasks.workunit.client.1.smithi100.stdout:2/112: creat d0/da/f28 x:0 0 0 2024-04-27T07:33:19.660 INFO:tasks.workunit.client.0.smithi082.stdout:5/534: creat d8/d42/fb3 x:0 0 0 2024-04-27T07:33:19.661 INFO:tasks.workunit.client.0.smithi082.stdout:5/535: chown d8/d3c/l40 6 1 2024-04-27T07:33:19.661 INFO:tasks.workunit.client.1.smithi100.stdout:2/113: unlink d0/d10/c1b 0 2024-04-27T07:33:19.663 INFO:tasks.workunit.client.0.smithi082.stdout:5/536: write f7 [4683582,109336] 0 2024-04-27T07:33:19.664 INFO:tasks.workunit.client.0.smithi082.stdout:5/537: read d8/d15/d22/f72 [567629,81493] 0 2024-04-27T07:33:19.668 INFO:tasks.workunit.client.0.smithi082.stdout:8/258: sync 2024-04-27T07:33:19.668 INFO:tasks.workunit.client.0.smithi082.stdout:7/354: sync 2024-04-27T07:33:19.668 INFO:tasks.workunit.client.0.smithi082.stdout:2/334: sync 2024-04-27T07:33:19.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/329: sync 2024-04-27T07:33:19.669 INFO:tasks.workunit.client.0.smithi082.stdout:8/259: fsync d0/d2b/f4a 0 2024-04-27T07:33:19.670 INFO:tasks.workunit.client.0.smithi082.stdout:2/335: read d7/d30/f36 [905147,107702] 0 2024-04-27T07:33:19.671 INFO:tasks.workunit.client.0.smithi082.stdout:5/538: dwrite d8/d3c/d5a/d5b/d5f/f84 [0,4194304] 0 2024-04-27T07:33:19.676 INFO:tasks.workunit.client.1.smithi100.stdout:2/114: rename d0/d10 to d0/da/d29 0 2024-04-27T07:33:19.677 INFO:tasks.workunit.client.1.smithi100.stdout:2/115: write d0/f24 [92498,9827] 0 2024-04-27T07:33:19.677 INFO:tasks.workunit.client.0.smithi082.stdout:2/336: creat d7/d30/d61/f71 x:0 0 0 2024-04-27T07:33:19.678 INFO:tasks.workunit.client.0.smithi082.stdout:7/355: dwrite d3/de/f5a [0,4194304] 0 2024-04-27T07:33:19.682 INFO:tasks.workunit.client.0.smithi082.stdout:5/539: creat d8/d15/d22/fb4 x:0 0 0 2024-04-27T07:33:19.682 INFO:tasks.workunit.client.0.smithi082.stdout:8/260: mkdir d0/d3/d1b/d24/d46/d4e 0 2024-04-27T07:33:19.682 INFO:tasks.workunit.client.0.smithi082.stdout:4/330: rename d3/d6/d26/d5e/c66 to d3/d6/d16/c73 0 2024-04-27T07:33:19.683 INFO:tasks.workunit.client.0.smithi082.stdout:7/356: mknod d3/db/d59/c6f 0 2024-04-27T07:33:19.684 INFO:tasks.workunit.client.0.smithi082.stdout:4/331: creat d3/d6/d26/f74 x:0 0 0 2024-04-27T07:33:19.685 INFO:tasks.workunit.client.0.smithi082.stdout:7/357: truncate d3/db/f32 1248426 0 2024-04-27T07:33:19.686 INFO:tasks.workunit.client.0.smithi082.stdout:8/261: rename d0/l10 to d0/d3/d1b/d24/d46/d4e/l4f 0 2024-04-27T07:33:19.687 INFO:tasks.workunit.client.0.smithi082.stdout:5/540: creat d8/fb5 x:0 0 0 2024-04-27T07:33:19.688 INFO:tasks.workunit.client.0.smithi082.stdout:4/332: dread d3/d6/d26/f60 [0,4194304] 0 2024-04-27T07:33:19.689 INFO:tasks.workunit.client.0.smithi082.stdout:5/541: creat d8/d29/d4e/fb6 x:0 0 0 2024-04-27T07:33:19.690 INFO:tasks.workunit.client.0.smithi082.stdout:5/542: dread - d8/fac zero size 2024-04-27T07:33:19.691 INFO:tasks.workunit.client.0.smithi082.stdout:7/358: link d3/d9/f56 d3/d49/f70 0 2024-04-27T07:33:19.691 INFO:tasks.workunit.client.0.smithi082.stdout:5/543: chown d8/d3c/d5a/d5b/l7f 29507634 1 2024-04-27T07:33:19.692 INFO:tasks.workunit.client.0.smithi082.stdout:7/359: dread - d3/de/d3a/d2a/f30 zero size 2024-04-27T07:33:19.693 INFO:tasks.workunit.client.0.smithi082.stdout:5/544: creat d8/d3b/fb7 x:0 0 0 2024-04-27T07:33:19.695 INFO:tasks.workunit.client.0.smithi082.stdout:5/545: rmdir d8/d2e/d3d 39 2024-04-27T07:33:19.696 INFO:tasks.workunit.client.0.smithi082.stdout:5/546: chown d8/d29/d4e/c8f 367389501 1 2024-04-27T07:33:19.700 INFO:tasks.workunit.client.0.smithi082.stdout:7/360: dwrite d3/d9/f56 [0,4194304] 0 2024-04-27T07:33:19.705 INFO:tasks.workunit.client.0.smithi082.stdout:4/333: getdents d3/d6/d26 0 2024-04-27T07:33:19.709 INFO:tasks.workunit.client.0.smithi082.stdout:8/262: unlink d0/d3/d1b/d24/d46/d4e/l4f 0 2024-04-27T07:33:19.712 INFO:tasks.workunit.client.0.smithi082.stdout:8/263: mknod d0/d3/d1c/d32/c50 0 2024-04-27T07:33:19.712 INFO:tasks.workunit.client.0.smithi082.stdout:5/547: dread d8/d15/f8c [0,4194304] 0 2024-04-27T07:33:19.714 INFO:tasks.workunit.client.0.smithi082.stdout:8/264: chown d0/d3/d1c/f2a 46107681 1 2024-04-27T07:33:19.715 INFO:tasks.workunit.client.0.smithi082.stdout:8/265: stat d0/cc 0 2024-04-27T07:33:19.715 INFO:tasks.workunit.client.0.smithi082.stdout:8/266: write d0/f43 [695420,114170] 0 2024-04-27T07:33:19.716 INFO:tasks.workunit.client.0.smithi082.stdout:7/361: write d3/d9/f37 [3669219,95186] 0 2024-04-27T07:33:19.718 INFO:tasks.workunit.client.0.smithi082.stdout:8/267: unlink d0/f13 0 2024-04-27T07:33:19.720 INFO:tasks.workunit.client.0.smithi082.stdout:4/334: write d3/d6/d26/f36 [204410,97223] 0 2024-04-27T07:33:19.723 INFO:tasks.workunit.client.0.smithi082.stdout:8/268: rmdir d0/d3 39 2024-04-27T07:33:19.724 INFO:tasks.workunit.client.0.smithi082.stdout:4/335: mknod d3/d6/d16/c75 0 2024-04-27T07:33:19.730 INFO:tasks.workunit.client.0.smithi082.stdout:5/548: dwrite d8/d3c/fb2 [0,4194304] 0 2024-04-27T07:33:19.732 INFO:tasks.workunit.client.0.smithi082.stdout:8/269: creat d0/d3/d1b/d29/f51 x:0 0 0 2024-04-27T07:33:19.733 INFO:tasks.workunit.client.0.smithi082.stdout:7/362: dread d3/de/d3a/f21 [4194304,4194304] 0 2024-04-27T07:33:19.734 INFO:tasks.workunit.client.0.smithi082.stdout:5/549: mkdir d8/d3c/d64/db8 0 2024-04-27T07:33:19.735 INFO:tasks.workunit.client.0.smithi082.stdout:8/270: chown d0/d3/d1b/d29/c37 104470 1 2024-04-27T07:33:19.738 INFO:tasks.workunit.client.0.smithi082.stdout:5/550: symlink d8/d3c/d4a/lb9 0 2024-04-27T07:33:19.740 INFO:tasks.workunit.client.0.smithi082.stdout:4/336: dwrite d3/d6/d26/d55/f6b [0,4194304] 0 2024-04-27T07:33:19.740 INFO:tasks.workunit.client.0.smithi082.stdout:8/271: write d0/d3/d1b/f3c [1590774,124598] 0 2024-04-27T07:33:19.743 INFO:tasks.workunit.client.0.smithi082.stdout:7/363: dread d3/de/d3a/f52 [0,4194304] 0 2024-04-27T07:33:19.744 INFO:tasks.workunit.client.0.smithi082.stdout:8/272: write d0/d3/d1b/f3c [2605068,26271] 0 2024-04-27T07:33:19.745 INFO:tasks.workunit.client.0.smithi082.stdout:4/337: readlink d3/d10/l11 0 2024-04-27T07:33:19.745 INFO:tasks.workunit.client.0.smithi082.stdout:7/364: dread d3/de/f1b [4194304,4194304] 0 2024-04-27T07:33:19.746 INFO:tasks.workunit.client.0.smithi082.stdout:8/273: write d0/d3/f18 [2398858,36915] 0 2024-04-27T07:33:19.747 INFO:tasks.workunit.client.0.smithi082.stdout:7/365: read d3/de/d3a/f21 [4319422,72007] 0 2024-04-27T07:33:19.747 INFO:tasks.workunit.client.0.smithi082.stdout:5/551: rename d8/d29/d4e/f61 to d8/d2e/d85/daa/fba 0 2024-04-27T07:33:19.747 INFO:tasks.workunit.client.0.smithi082.stdout:8/274: chown d0/cc 5557 1 2024-04-27T07:33:19.748 INFO:tasks.workunit.client.0.smithi082.stdout:5/552: write d8/d29/d4e/f52 [787929,1347] 0 2024-04-27T07:33:19.749 INFO:tasks.workunit.client.0.smithi082.stdout:8/275: dread - d0/d3/d1b/f47 zero size 2024-04-27T07:33:19.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/366: truncate d3/de/d3a/f68 524736 0 2024-04-27T07:33:19.753 INFO:tasks.workunit.client.0.smithi082.stdout:8/276: fsync d0/d3/f18 0 2024-04-27T07:33:19.754 INFO:tasks.workunit.client.0.smithi082.stdout:8/277: chown d0/f17 2071024 1 2024-04-27T07:33:19.755 INFO:tasks.workunit.client.0.smithi082.stdout:4/338: getdents d3/d6/d22/d69 0 2024-04-27T07:33:19.757 INFO:tasks.workunit.client.0.smithi082.stdout:8/278: mknod d0/d3/d1c/d32/d3d/c52 0 2024-04-27T07:33:19.757 INFO:tasks.workunit.client.0.smithi082.stdout:5/553: dread d8/d29/f35 [0,4194304] 0 2024-04-27T07:33:19.758 INFO:tasks.workunit.client.0.smithi082.stdout:8/279: write d0/f43 [833403,124331] 0 2024-04-27T07:33:19.758 INFO:tasks.workunit.client.0.smithi082.stdout:4/339: creat d3/d6/f76 x:0 0 0 2024-04-27T07:33:19.761 INFO:tasks.workunit.client.0.smithi082.stdout:4/340: fdatasync d3/d6/d26/f60 0 2024-04-27T07:33:19.762 INFO:tasks.workunit.client.0.smithi082.stdout:5/554: symlink d8/d2e/lbb 0 2024-04-27T07:33:19.763 INFO:tasks.workunit.client.0.smithi082.stdout:8/280: mkdir d0/d3/d1b/d53 0 2024-04-27T07:33:19.764 INFO:tasks.workunit.client.0.smithi082.stdout:5/555: chown d8/d15/d22/c51 12 1 2024-04-27T07:33:19.765 INFO:tasks.workunit.client.0.smithi082.stdout:4/341: symlink d3/d6/d26/d5e/d21/l77 0 2024-04-27T07:33:19.767 INFO:tasks.workunit.client.0.smithi082.stdout:7/367: dwrite d3/f1f [0,4194304] 0 2024-04-27T07:33:19.767 INFO:tasks.workunit.client.0.smithi082.stdout:4/342: write d3/d6/f58 [178073,103551] 0 2024-04-27T07:33:19.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/281: creat d0/d3/d1b/d24/f54 x:0 0 0 2024-04-27T07:33:19.768 INFO:tasks.workunit.client.0.smithi082.stdout:5/556: creat d8/d29/d4e/fbc x:0 0 0 2024-04-27T07:33:19.769 INFO:tasks.workunit.client.0.smithi082.stdout:4/343: readlink d3/d6/d26/d5e/l2c 0 2024-04-27T07:33:19.770 INFO:tasks.workunit.client.0.smithi082.stdout:7/368: readlink d3/l31 0 2024-04-27T07:33:19.774 INFO:tasks.workunit.client.0.smithi082.stdout:7/369: mkdir d3/de/d3a/d71 0 2024-04-27T07:33:19.776 INFO:tasks.workunit.client.0.smithi082.stdout:5/557: truncate d8/f45 837410 0 2024-04-27T07:33:19.776 INFO:tasks.workunit.client.0.smithi082.stdout:4/344: getdents d3/d6/d26/d55 0 2024-04-27T07:33:19.781 INFO:tasks.workunit.client.0.smithi082.stdout:4/345: rename d3/d6/f39 to d3/f78 0 2024-04-27T07:33:19.783 INFO:tasks.workunit.client.0.smithi082.stdout:7/370: dwrite d3/d9/f2d [0,4194304] 0 2024-04-27T07:33:19.784 INFO:tasks.workunit.client.0.smithi082.stdout:7/371: write d3/de/d3a/f68 [534870,11472] 0 2024-04-27T07:33:19.784 INFO:tasks.workunit.client.0.smithi082.stdout:4/346: creat d3/d6/d22/d69/f79 x:0 0 0 2024-04-27T07:33:19.787 INFO:tasks.workunit.client.0.smithi082.stdout:7/372: creat d3/de/d3a/d2a/f72 x:0 0 0 2024-04-27T07:33:19.787 INFO:tasks.workunit.client.0.smithi082.stdout:7/373: write d3/de/d3a/f68 [298909,73839] 0 2024-04-27T07:33:19.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/347: mkdir d3/d6/d16/d7a 0 2024-04-27T07:33:19.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/374: fsync d3/de/f1e 0 2024-04-27T07:33:19.791 INFO:tasks.workunit.client.0.smithi082.stdout:8/282: dread d0/d3/d1b/f2e [0,4194304] 0 2024-04-27T07:33:19.793 INFO:tasks.workunit.client.0.smithi082.stdout:4/348: dread d3/d6/d26/d55/f6b [0,4194304] 0 2024-04-27T07:33:19.795 INFO:tasks.workunit.client.0.smithi082.stdout:4/349: truncate d3/d6/d26/d5e/f2f 9355525 0 2024-04-27T07:33:19.795 INFO:tasks.workunit.client.0.smithi082.stdout:7/375: symlink d3/de/d3a/d71/l73 0 2024-04-27T07:33:19.797 INFO:tasks.workunit.client.0.smithi082.stdout:8/283: mkdir d0/d3/d55 0 2024-04-27T07:33:19.798 INFO:tasks.workunit.client.0.smithi082.stdout:7/376: creat d3/d9/f74 x:0 0 0 2024-04-27T07:33:19.801 INFO:tasks.workunit.client.0.smithi082.stdout:8/284: rename d0/d3/d1c/d32/d3d to d0/d3/d1b/d24/d46/d56 0 2024-04-27T07:33:19.803 INFO:tasks.workunit.client.0.smithi082.stdout:8/285: stat d0/d3/d1b/d24/d42 0 2024-04-27T07:33:19.805 INFO:tasks.workunit.client.0.smithi082.stdout:7/377: dread d3/d49/f70 [0,4194304] 0 2024-04-27T07:33:19.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/350: dwrite d3/d9/f44 [0,4194304] 0 2024-04-27T07:33:19.810 INFO:tasks.workunit.client.0.smithi082.stdout:7/378: unlink d3/db/d59/f67 0 2024-04-27T07:33:19.811 INFO:tasks.workunit.client.0.smithi082.stdout:8/286: dwrite d0/d2b/f4a [0,4194304] 0 2024-04-27T07:33:19.814 INFO:tasks.workunit.client.0.smithi082.stdout:4/351: creat d3/d10/f7b x:0 0 0 2024-04-27T07:33:19.819 INFO:tasks.workunit.client.0.smithi082.stdout:7/379: dwrite d3/de/f60 [0,4194304] 0 2024-04-27T07:33:19.821 INFO:tasks.workunit.client.0.smithi082.stdout:7/380: mknod d3/d9/c75 0 2024-04-27T07:33:19.824 INFO:tasks.workunit.client.0.smithi082.stdout:4/352: rmdir d3/d6/d16/d7a 0 2024-04-27T07:33:19.825 INFO:tasks.workunit.client.0.smithi082.stdout:4/353: read - d3/d6/f76 zero size 2024-04-27T07:33:19.826 INFO:tasks.workunit.client.0.smithi082.stdout:7/381: mknod d3/d49/c76 0 2024-04-27T07:33:19.829 INFO:tasks.workunit.client.0.smithi082.stdout:4/354: rename d3/d9/f1d to d3/d6/d16/f7c 0 2024-04-27T07:33:19.829 INFO:tasks.workunit.client.0.smithi082.stdout:4/355: dread - d3/d10/f6c zero size 2024-04-27T07:33:19.834 INFO:tasks.workunit.client.0.smithi082.stdout:8/287: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:19.834 INFO:tasks.workunit.client.0.smithi082.stdout:4/356: rename d3/d6/f51 to d3/d9/f7d 0 2024-04-27T07:33:19.836 INFO:tasks.workunit.client.0.smithi082.stdout:8/288: creat d0/d3/d1b/d29/f57 x:0 0 0 2024-04-27T07:33:19.837 INFO:tasks.workunit.client.0.smithi082.stdout:4/357: symlink d3/d6/d16/l7e 0 2024-04-27T07:33:19.838 INFO:tasks.workunit.client.0.smithi082.stdout:4/358: write d3/d6/d22/d69/f79 [808912,80936] 0 2024-04-27T07:33:19.842 INFO:tasks.workunit.client.0.smithi082.stdout:4/359: mknod d3/d6/d26/d55/c7f 0 2024-04-27T07:33:19.842 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:19 smithi082 ceph-mon[26613]: Reconfiguring node-exporter.smithi082 (dependencies changed)... 2024-04-27T07:33:19.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:19 smithi082 ceph-mon[26613]: Reconfiguring daemon node-exporter.smithi082 on smithi082 2024-04-27T07:33:19.843 INFO:tasks.workunit.client.0.smithi082.stdout:8/289: dwrite d0/d3/d1b/d24/f39 [0,4194304] 0 2024-04-27T07:33:19.844 INFO:tasks.workunit.client.0.smithi082.stdout:7/382: dread d3/db/f18 [0,4194304] 0 2024-04-27T07:33:19.845 INFO:tasks.workunit.client.0.smithi082.stdout:7/383: read - d3/de/d3a/f65 zero size 2024-04-27T07:33:19.846 INFO:tasks.workunit.client.0.smithi082.stdout:4/360: rename d3/f78 to d3/d6/d26/d5e/d21/f80 0 2024-04-27T07:33:19.846 INFO:tasks.workunit.client.0.smithi082.stdout:4/361: read - d3/d9/f65 zero size 2024-04-27T07:33:19.847 INFO:tasks.workunit.client.0.smithi082.stdout:7/384: mkdir d3/d9/d4f/d61/d77 0 2024-04-27T07:33:19.850 INFO:tasks.workunit.client.0.smithi082.stdout:0/518: sync 2024-04-27T07:33:19.852 INFO:tasks.workunit.client.0.smithi082.stdout:7/385: mknod d3/c78 0 2024-04-27T07:33:19.853 INFO:tasks.workunit.client.0.smithi082.stdout:7/386: stat d3/de/d3a/l23 0 2024-04-27T07:33:19.853 INFO:tasks.workunit.client.0.smithi082.stdout:0/519: chown da/d2a/f46 70542 1 2024-04-27T07:33:19.855 INFO:tasks.workunit.client.0.smithi082.stdout:7/387: truncate d3/de/d3a/d2a/f3f 218962 0 2024-04-27T07:33:19.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/388: dwrite d3/de/d3a/f65 [0,4194304] 0 2024-04-27T07:33:19.864 INFO:tasks.workunit.client.0.smithi082.stdout:7/389: dread d3/de/d3a/f38 [0,4194304] 0 2024-04-27T07:33:19.870 INFO:tasks.workunit.client.0.smithi082.stdout:7/390: dwrite d3/db/f32 [0,4194304] 0 2024-04-27T07:33:19.872 INFO:tasks.workunit.client.0.smithi082.stdout:8/290: fsync d0/d2b/f4a 0 2024-04-27T07:33:19.874 INFO:tasks.workunit.client.0.smithi082.stdout:7/391: rename d3/d49/f70 to d3/de/f79 0 2024-04-27T07:33:19.877 INFO:tasks.workunit.client.0.smithi082.stdout:4/362: dread d3/d6/d22/d69/f79 [0,4194304] 0 2024-04-27T07:33:19.878 INFO:tasks.workunit.client.0.smithi082.stdout:7/392: creat d3/de/d3a/d71/f7a x:0 0 0 2024-04-27T07:33:19.878 INFO:tasks.workunit.client.0.smithi082.stdout:4/363: read - d3/d6/d22/f59 zero size 2024-04-27T07:33:19.882 INFO:tasks.workunit.client.0.smithi082.stdout:7/393: dread d3/d9/f2d [4194304,4194304] 0 2024-04-27T07:33:19.883 INFO:tasks.workunit.client.0.smithi082.stdout:4/364: getdents d3/d6 0 2024-04-27T07:33:19.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/394: chown d3/d9/l25 510 1 2024-04-27T07:33:19.886 INFO:tasks.workunit.client.0.smithi082.stdout:4/365: mkdir d3/d81 0 2024-04-27T07:33:19.886 INFO:tasks.workunit.client.0.smithi082.stdout:7/395: mknod d3/d9/d4f/d61/d77/c7b 0 2024-04-27T07:33:19.901 INFO:tasks.workunit.client.0.smithi082.stdout:4/366: dread d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:19.906 INFO:tasks.workunit.client.0.smithi082.stdout:4/367: link d3/d10/c54 d3/c82 0 2024-04-27T07:33:19.907 INFO:tasks.workunit.client.0.smithi082.stdout:4/368: fsync d3/f4e 0 2024-04-27T07:33:19.909 INFO:tasks.workunit.client.0.smithi082.stdout:4/369: getdents d3/d81 0 2024-04-27T07:33:19.910 INFO:tasks.workunit.client.0.smithi082.stdout:4/370: mknod d3/c83 0 2024-04-27T07:33:19.910 INFO:tasks.workunit.client.0.smithi082.stdout:4/371: readlink d3/d9/lf 0 2024-04-27T07:33:19.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:19 smithi100 ceph-mon[34183]: Reconfiguring node-exporter.smithi082 (dependencies changed)... 2024-04-27T07:33:19.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:19 smithi100 ceph-mon[34183]: Reconfiguring daemon node-exporter.smithi082 on smithi082 2024-04-27T07:33:19.981 INFO:tasks.workunit.client.0.smithi082.stdout:0/520: write da/f42 [2035196,58465] 0 2024-04-27T07:33:19.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/521: write da/d28/d36/d40/f49 [1001043,66352] 0 2024-04-27T07:33:19.983 INFO:tasks.workunit.client.0.smithi082.stdout:0/522: chown da/d28/d36/d40/d83/da8 84 1 2024-04-27T07:33:19.985 INFO:tasks.workunit.client.0.smithi082.stdout:0/523: read f7 [43098,108037] 0 2024-04-27T07:33:19.988 INFO:tasks.workunit.client.0.smithi082.stdout:7/396: write d3/db/ff [640539,50839] 0 2024-04-27T07:33:20.010 INFO:tasks.workunit.client.0.smithi082.stdout:6/368: sync 2024-04-27T07:33:20.010 INFO:tasks.workunit.client.0.smithi082.stdout:3/554: sync 2024-04-27T07:33:20.013 INFO:tasks.workunit.client.0.smithi082.stdout:8/291: dwrite d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:20.013 INFO:tasks.workunit.client.0.smithi082.stdout:4/372: write d3/d6/d22/f24 [1342888,35356] 0 2024-04-27T07:33:20.013 INFO:tasks.workunit.client.0.smithi082.stdout:7/397: stat d3/de/l12 0 2024-04-27T07:33:20.017 INFO:tasks.workunit.client.0.smithi082.stdout:6/369: creat d2/d2e/f7c x:0 0 0 2024-04-27T07:33:20.020 INFO:tasks.workunit.client.0.smithi082.stdout:0/524: dwrite da/d3c/d3f/d57/f76 [0,4194304] 0 2024-04-27T07:33:20.022 INFO:tasks.workunit.client.0.smithi082.stdout:0/525: chown da/c10 1174 1 2024-04-27T07:33:20.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/398: dread d3/d9/d4f/f54 [0,4194304] 0 2024-04-27T07:33:20.027 INFO:tasks.workunit.client.0.smithi082.stdout:7/399: write d3/de/f62 [196533,22462] 0 2024-04-27T07:33:20.030 INFO:tasks.workunit.client.0.smithi082.stdout:6/370: mkdir d2/d1e/d32/d7d 0 2024-04-27T07:33:20.031 INFO:tasks.workunit.client.0.smithi082.stdout:6/371: readlink d2/d2e/l3c 0 2024-04-27T07:33:20.032 INFO:tasks.workunit.client.0.smithi082.stdout:6/372: write d2/d3/d1b/f4b [561477,21896] 0 2024-04-27T07:33:20.036 INFO:tasks.workunit.client.0.smithi082.stdout:7/400: mkdir d3/d9/d7c 0 2024-04-27T07:33:20.040 INFO:tasks.workunit.client.0.smithi082.stdout:6/373: dwrite d2/d2e/f61 [0,4194304] 0 2024-04-27T07:33:20.044 INFO:tasks.workunit.client.0.smithi082.stdout:7/401: dwrite d3/de/f3d [0,4194304] 0 2024-04-27T07:33:20.046 INFO:tasks.workunit.client.0.smithi082.stdout:3/555: dread d8/d9/d3f/f4a [0,4194304] 0 2024-04-27T07:33:20.046 INFO:tasks.workunit.client.0.smithi082.stdout:7/402: chown d3/de/d3a/d2a/f2b 57 1 2024-04-27T07:33:20.046 INFO:tasks.workunit.client.0.smithi082.stdout:6/374: rename d2/d2d/f69 to d2/d75/f7e 0 2024-04-27T07:33:20.049 INFO:tasks.workunit.client.0.smithi082.stdout:7/403: chown d3/de/l1c 0 1 2024-04-27T07:33:20.050 INFO:tasks.workunit.client.0.smithi082.stdout:6/375: dread d2/de/d13/f67 [0,4194304] 0 2024-04-27T07:33:20.051 INFO:tasks.workunit.client.0.smithi082.stdout:6/376: truncate d2/de/d13/f21 5694630 0 2024-04-27T07:33:20.053 INFO:tasks.workunit.client.0.smithi082.stdout:3/556: creat d8/d9/d1d/db5/dc7/fcd x:0 0 0 2024-04-27T07:33:20.055 INFO:tasks.workunit.client.0.smithi082.stdout:3/557: truncate d8/d9/f86 87652 0 2024-04-27T07:33:20.057 INFO:tasks.workunit.client.0.smithi082.stdout:6/377: rmdir d2/d2d/d3d 39 2024-04-27T07:33:20.059 INFO:tasks.workunit.client.0.smithi082.stdout:3/558: mkdir d8/d9/d25/d26/d4d/d82/dce 0 2024-04-27T07:33:20.060 INFO:tasks.workunit.client.0.smithi082.stdout:6/378: symlink d2/d2e/l7f 0 2024-04-27T07:33:20.062 INFO:tasks.workunit.client.0.smithi082.stdout:8/292: creat d0/f58 x:0 0 0 2024-04-27T07:33:20.064 INFO:tasks.workunit.client.0.smithi082.stdout:3/559: fsync d8/d9/d1f/f4c 0 2024-04-27T07:33:20.066 INFO:tasks.workunit.client.0.smithi082.stdout:0/526: dwrite da/d28/f4d [0,4194304] 0 2024-04-27T07:33:20.068 INFO:tasks.workunit.client.0.smithi082.stdout:7/404: rename d3/db/d59 to d3/de/d7d 0 2024-04-27T07:33:20.068 INFO:tasks.workunit.client.0.smithi082.stdout:7/405: chown d3/d9/c75 13730 1 2024-04-27T07:33:20.072 INFO:tasks.workunit.client.0.smithi082.stdout:8/293: unlink d0/d3/d1b/d24/d46/d56/c52 0 2024-04-27T07:33:20.073 INFO:tasks.workunit.client.0.smithi082.stdout:3/560: creat d8/d9/d25/d26/d4d/d82/d8b/fcf x:0 0 0 2024-04-27T07:33:20.074 INFO:tasks.workunit.client.0.smithi082.stdout:0/527: mknod da/d38/d7f/cc1 0 2024-04-27T07:33:20.076 INFO:tasks.workunit.client.0.smithi082.stdout:7/406: creat d3/de/d3a/d71/f7e x:0 0 0 2024-04-27T07:33:20.076 INFO:tasks.workunit.client.0.smithi082.stdout:0/528: write da/fe [3432181,35576] 0 2024-04-27T07:33:20.077 INFO:tasks.workunit.client.0.smithi082.stdout:8/294: symlink d0/d3/d1b/d24/d46/d4e/l59 0 2024-04-27T07:33:20.078 INFO:tasks.workunit.client.0.smithi082.stdout:4/373: symlink d3/d6/l84 0 2024-04-27T07:33:20.081 INFO:tasks.workunit.client.0.smithi082.stdout:3/561: dwrite d8/d9/d25/d26/d3d/dad/fc2 [0,4194304] 0 2024-04-27T07:33:20.087 INFO:tasks.workunit.client.0.smithi082.stdout:7/407: link d3/de/d3a/f65 d3/de/d6c/f7f 0 2024-04-27T07:33:20.088 INFO:tasks.workunit.client.0.smithi082.stdout:6/379: write d2/f60 [865210,33993] 0 2024-04-27T07:33:20.089 INFO:tasks.workunit.client.0.smithi082.stdout:3/562: mknod d8/d9/d1d/da5/dc4/cd0 0 2024-04-27T07:33:20.090 INFO:tasks.workunit.client.0.smithi082.stdout:3/563: dread - d8/d9/dd/da3/fa9 zero size 2024-04-27T07:33:20.091 INFO:tasks.workunit.client.0.smithi082.stdout:6/380: mkdir d2/d1e/d80 0 2024-04-27T07:33:20.093 INFO:tasks.workunit.client.0.smithi082.stdout:3/564: truncate d8/d9/dd/d13/d1b/dbd/f7d 699308 0 2024-04-27T07:33:20.093 INFO:tasks.workunit.client.0.smithi082.stdout:6/381: mkdir d2/d81 0 2024-04-27T07:33:20.094 INFO:tasks.workunit.client.0.smithi082.stdout:3/565: stat d8/d9/dd/d13/la2 0 2024-04-27T07:33:20.094 INFO:tasks.workunit.client.0.smithi082.stdout:6/382: stat d2/d1e/d80 0 2024-04-27T07:33:20.095 INFO:tasks.workunit.client.0.smithi082.stdout:6/383: write d2/d1e/f22 [1524951,87524] 0 2024-04-27T07:33:20.101 INFO:tasks.workunit.client.0.smithi082.stdout:3/566: write d8/d9/d25/d26/d3d/dad/fc2 [4566592,8251] 0 2024-04-27T07:33:20.102 INFO:tasks.workunit.client.0.smithi082.stdout:4/374: mkdir d3/d6/d22/d69/d85 0 2024-04-27T07:33:20.104 INFO:tasks.workunit.client.0.smithi082.stdout:3/567: readlink d8/d9/d25/d26/lc3 0 2024-04-27T07:33:20.104 INFO:tasks.workunit.client.0.smithi082.stdout:0/529: dread da/d28/f66 [0,4194304] 0 2024-04-27T07:33:20.105 INFO:tasks.workunit.client.0.smithi082.stdout:4/375: chown d3/d6/f76 101406 1 2024-04-27T07:33:20.105 INFO:tasks.workunit.client.0.smithi082.stdout:6/384: dwrite d2/d45/f6f [0,4194304] 0 2024-04-27T07:33:20.106 INFO:tasks.workunit.client.0.smithi082.stdout:3/568: chown d8/d9/d1f/f41 22 1 2024-04-27T07:33:20.107 INFO:tasks.workunit.client.0.smithi082.stdout:4/376: write f2 [3361372,105427] 0 2024-04-27T07:33:20.107 INFO:tasks.workunit.client.0.smithi082.stdout:0/530: write da/d3c/d3f/d57/f7e [1680998,36973] 0 2024-04-27T07:33:20.108 INFO:tasks.workunit.client.0.smithi082.stdout:3/569: stat d8/d9/d1f/f99 0 2024-04-27T07:33:20.109 INFO:tasks.workunit.client.0.smithi082.stdout:0/531: stat da/c55 0 2024-04-27T07:33:20.111 INFO:tasks.workunit.client.0.smithi082.stdout:6/385: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:20.113 INFO:tasks.workunit.client.0.smithi082.stdout:0/532: mknod da/d38/d7f/d4a/d80/cc2 0 2024-04-27T07:33:20.115 INFO:tasks.workunit.client.0.smithi082.stdout:4/377: creat d3/d6/d26/d55/d67/f86 x:0 0 0 2024-04-27T07:33:20.115 INFO:tasks.workunit.client.0.smithi082.stdout:6/386: stat d2/d2d/d4a/f52 0 2024-04-27T07:33:20.116 INFO:tasks.workunit.client.0.smithi082.stdout:4/378: truncate d3/f4e 999251 0 2024-04-27T07:33:20.118 INFO:tasks.workunit.client.0.smithi082.stdout:3/570: getdents d8/d9 0 2024-04-27T07:33:20.120 INFO:tasks.workunit.client.0.smithi082.stdout:4/379: mknod d3/d6/d16/c87 0 2024-04-27T07:33:20.121 INFO:tasks.workunit.client.0.smithi082.stdout:3/571: symlink d8/d9/d1d/da5/db3/ld1 0 2024-04-27T07:33:20.123 INFO:tasks.workunit.client.0.smithi082.stdout:0/533: rmdir da/d38/d7f/d4a/d80 39 2024-04-27T07:33:20.125 INFO:tasks.workunit.client.0.smithi082.stdout:0/534: fdatasync da/d28/d36/d40/f49 0 2024-04-27T07:33:20.125 INFO:tasks.workunit.client.0.smithi082.stdout:6/387: dwrite d2/d3/d1b/f5c [0,4194304] 0 2024-04-27T07:33:20.126 INFO:tasks.workunit.client.0.smithi082.stdout:0/535: fdatasync da/d28/f61 0 2024-04-27T07:33:20.126 INFO:tasks.workunit.client.0.smithi082.stdout:4/380: rename d3/d6/d16/c87 to d3/d6/c88 0 2024-04-27T07:33:20.128 INFO:tasks.workunit.client.0.smithi082.stdout:3/572: creat d8/d9/dd/d13/d1b/dbd/d8e/fd2 x:0 0 0 2024-04-27T07:33:20.129 INFO:tasks.workunit.client.0.smithi082.stdout:3/573: fdatasync d8/d9/fae 0 2024-04-27T07:33:20.141 INFO:tasks.workunit.client.0.smithi082.stdout:4/381: dwrite d3/d6/d26/d5e/f48 [0,4194304] 0 2024-04-27T07:33:20.146 INFO:tasks.workunit.client.0.smithi082.stdout:4/382: write d3/d6/d26/f60 [879281,29324] 0 2024-04-27T07:33:20.149 INFO:tasks.workunit.client.0.smithi082.stdout:6/388: dread d2/de/f72 [0,4194304] 0 2024-04-27T07:33:20.149 INFO:tasks.workunit.client.0.smithi082.stdout:0/536: dread da/d3c/d3f/d4c/f54 [4194304,4194304] 0 2024-04-27T07:33:20.151 INFO:tasks.workunit.client.0.smithi082.stdout:4/383: creat d3/d6/f89 x:0 0 0 2024-04-27T07:33:20.151 INFO:tasks.workunit.client.0.smithi082.stdout:3/574: dwrite d8/f2e [0,4194304] 0 2024-04-27T07:33:20.152 INFO:tasks.workunit.client.0.smithi082.stdout:6/389: truncate d2/de/f24 712362 0 2024-04-27T07:33:20.152 INFO:tasks.workunit.client.0.smithi082.stdout:4/384: stat d3/d10/f15 0 2024-04-27T07:33:20.153 INFO:tasks.workunit.client.0.smithi082.stdout:0/537: creat da/d3c/d3f/d57/fc3 x:0 0 0 2024-04-27T07:33:20.154 INFO:tasks.workunit.client.0.smithi082.stdout:4/385: truncate d3/d6/d26/f74 240055 0 2024-04-27T07:33:20.155 INFO:tasks.workunit.client.0.smithi082.stdout:3/575: creat d8/d9/d1d/db5/dc7/fd3 x:0 0 0 2024-04-27T07:33:20.157 INFO:tasks.workunit.client.0.smithi082.stdout:3/576: write d8/d9/f1c [3050682,123881] 0 2024-04-27T07:33:20.161 INFO:tasks.workunit.client.0.smithi082.stdout:6/390: dwrite d2/de/f72 [4194304,4194304] 0 2024-04-27T07:33:20.245 INFO:tasks.workunit.client.0.smithi082.stdout:4/386: creat d3/d6/d26/d55/d67/f8a x:0 0 0 2024-04-27T07:33:20.246 INFO:tasks.workunit.client.0.smithi082.stdout:4/387: write d3/d9/fb [6165096,65078] 0 2024-04-27T07:33:20.247 INFO:tasks.workunit.client.0.smithi082.stdout:4/388: readlink d3/d10/l23 0 2024-04-27T07:33:20.249 INFO:tasks.workunit.client.0.smithi082.stdout:6/391: mkdir d2/d1e/d32/d7d/d82 0 2024-04-27T07:33:20.254 INFO:tasks.workunit.client.0.smithi082.stdout:6/392: creat d2/de/f83 x:0 0 0 2024-04-27T07:33:20.259 INFO:tasks.workunit.client.0.smithi082.stdout:6/393: symlink d2/d2e/d6a/l84 0 2024-04-27T07:33:20.259 INFO:tasks.workunit.client.0.smithi082.stdout:0/538: dwrite da/d28/d36/d40/f44 [0,4194304] 0 2024-04-27T07:33:20.262 INFO:tasks.workunit.client.0.smithi082.stdout:4/389: dwrite d3/d6/f76 [0,4194304] 0 2024-04-27T07:33:20.264 INFO:tasks.workunit.client.0.smithi082.stdout:3/577: dwrite d8/d9/d1d/f90 [0,4194304] 0 2024-04-27T07:33:20.264 INFO:tasks.workunit.client.0.smithi082.stdout:6/394: mkdir d2/d1e/d32/d85 0 2024-04-27T07:33:20.268 INFO:tasks.workunit.client.0.smithi082.stdout:0/539: mkdir da/d2a/dc4 0 2024-04-27T07:33:20.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/578: truncate d8/d9/dd/d13/d1b/f5d 1027426 0 2024-04-27T07:33:20.273 INFO:tasks.workunit.client.0.smithi082.stdout:6/395: creat d2/d81/f86 x:0 0 0 2024-04-27T07:33:20.273 INFO:tasks.workunit.client.0.smithi082.stdout:0/540: symlink da/d38/d7f/lc5 0 2024-04-27T07:33:20.274 INFO:tasks.workunit.client.0.smithi082.stdout:3/579: creat d8/d9/d25/d26/d4d/fd4 x:0 0 0 2024-04-27T07:33:20.275 INFO:tasks.workunit.client.0.smithi082.stdout:0/541: write da/d3c/d3f/d57/f76 [4863775,61108] 0 2024-04-27T07:33:20.277 INFO:tasks.workunit.client.0.smithi082.stdout:3/580: unlink d8/d9/f86 0 2024-04-27T07:33:20.279 INFO:tasks.workunit.client.0.smithi082.stdout:0/542: truncate da/f1f 2212907 0 2024-04-27T07:33:20.280 INFO:tasks.workunit.client.0.smithi082.stdout:0/543: chown da/d28/d36/d40/d83 22072477 1 2024-04-27T07:33:20.294 INFO:tasks.workunit.client.0.smithi082.stdout:4/390: dwrite d3/d6/d22/d69/f70 [0,4194304] 0 2024-04-27T07:33:20.298 INFO:tasks.workunit.client.0.smithi082.stdout:3/581: rename d8/d9/dd/da3/fa9 to d8/d9/dd/da3/fd5 0 2024-04-27T07:33:20.299 INFO:tasks.workunit.client.0.smithi082.stdout:4/391: fdatasync d3/d6/d16/f7c 0 2024-04-27T07:33:20.299 INFO:tasks.workunit.client.0.smithi082.stdout:3/582: readlink d8/l2c 0 2024-04-27T07:33:20.302 INFO:tasks.workunit.client.0.smithi082.stdout:4/392: dread d3/d9/f44 [0,4194304] 0 2024-04-27T07:33:20.303 INFO:tasks.workunit.client.0.smithi082.stdout:4/393: write d3/d10/f3d [2982983,35280] 0 2024-04-27T07:33:20.304 INFO:tasks.workunit.client.0.smithi082.stdout:4/394: truncate d3/d10/f4f 1388352 0 2024-04-27T07:33:20.308 INFO:tasks.workunit.client.0.smithi082.stdout:4/395: rename d3/d6/d26/d5e/d21/f2a to d3/d9/f8b 0 2024-04-27T07:33:20.310 INFO:tasks.workunit.client.0.smithi082.stdout:4/396: write d3/d9/f68 [675713,4418] 0 2024-04-27T07:33:20.318 INFO:tasks.workunit.client.0.smithi082.stdout:4/397: truncate d3/d10/f3d 3018213 0 2024-04-27T07:33:20.320 INFO:tasks.workunit.client.0.smithi082.stdout:3/583: dread d8/d9/dd/f35 [0,4194304] 0 2024-04-27T07:33:20.320 INFO:tasks.workunit.client.0.smithi082.stdout:4/398: unlink d3/d9/c34 0 2024-04-27T07:33:20.321 INFO:tasks.workunit.client.0.smithi082.stdout:4/399: chown d3/d10/l23 32 1 2024-04-27T07:33:20.327 INFO:tasks.workunit.client.0.smithi082.stdout:3/584: dwrite d8/d9/d25/d26/f98 [0,4194304] 0 2024-04-27T07:33:20.328 INFO:tasks.workunit.client.0.smithi082.stdout:3/585: fdatasync d8/d9/d25/d26/d4d/f97 0 2024-04-27T07:33:20.331 INFO:tasks.workunit.client.0.smithi082.stdout:4/400: truncate d3/d6/f3e 1387928 0 2024-04-27T07:33:20.334 INFO:tasks.workunit.client.0.smithi082.stdout:3/586: creat d8/d9/db0/fd6 x:0 0 0 2024-04-27T07:33:20.338 INFO:tasks.workunit.client.0.smithi082.stdout:4/401: dwrite d3/d9/f6a [0,4194304] 0 2024-04-27T07:33:20.339 INFO:tasks.workunit.client.0.smithi082.stdout:3/587: getdents d8/d9/dd/d13/d1b/dbd 0 2024-04-27T07:33:20.343 INFO:tasks.workunit.client.0.smithi082.stdout:3/588: unlink d8/d9/d25/d66/l89 0 2024-04-27T07:33:20.344 INFO:tasks.workunit.client.0.smithi082.stdout:3/589: truncate d8/f2e 4239644 0 2024-04-27T07:33:20.347 INFO:tasks.workunit.client.0.smithi082.stdout:3/590: write d8/d9/dd/d13/d1b/f93 [151321,100453] 0 2024-04-27T07:33:20.347 INFO:tasks.workunit.client.0.smithi082.stdout:4/402: dwrite d3/d6/d26/d5e/f2f [0,4194304] 0 2024-04-27T07:33:20.351 INFO:tasks.workunit.client.0.smithi082.stdout:3/591: creat d8/d9/dd/fd7 x:0 0 0 2024-04-27T07:33:20.352 INFO:tasks.workunit.client.0.smithi082.stdout:4/403: mkdir d3/d6/d22/d69/d85/d8c 0 2024-04-27T07:33:20.360 INFO:tasks.workunit.client.0.smithi082.stdout:4/404: dwrite d3/d6/d22/d69/f79 [0,4194304] 0 2024-04-27T07:33:20.369 INFO:tasks.workunit.client.0.smithi082.stdout:3/592: write d8/ff [589207,82596] 0 2024-04-27T07:33:20.372 INFO:tasks.workunit.client.0.smithi082.stdout:3/593: mkdir d8/d9/dd/d13/d1b/dbd/dd8 0 2024-04-27T07:33:20.373 INFO:tasks.workunit.client.0.smithi082.stdout:3/594: symlink d8/d9/d25/d4e/ld9 0 2024-04-27T07:33:20.375 INFO:tasks.workunit.client.0.smithi082.stdout:3/595: symlink d8/d9/lda 0 2024-04-27T07:33:20.381 INFO:tasks.workunit.client.0.smithi082.stdout:3/596: rename d8/d9/d25/d66/c9d to d8/d9/dd/d13/d1b/dbd/dd8/cdb 0 2024-04-27T07:33:20.385 INFO:tasks.workunit.client.0.smithi082.stdout:3/597: truncate d8/f2e 2223840 0 2024-04-27T07:33:20.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/598: dread f5 [0,4194304] 0 2024-04-27T07:33:20.401 INFO:tasks.workunit.client.0.smithi082.stdout:3/599: getdents d8/d9/d25/d91 0 2024-04-27T07:33:20.405 INFO:tasks.workunit.client.0.smithi082.stdout:3/600: write d8/d9/d3f/f80 [3761430,104493] 0 2024-04-27T07:33:20.408 INFO:tasks.workunit.client.0.smithi082.stdout:3/601: write d8/f2e [71531,83454] 0 2024-04-27T07:33:20.414 INFO:tasks.workunit.client.0.smithi082.stdout:3/602: dwrite d8/d9/dd/d13/d1b/dbd/f7d [0,4194304] 0 2024-04-27T07:33:20.417 INFO:tasks.workunit.client.0.smithi082.stdout:3/603: fsync d8/d9/d1d/fa1 0 2024-04-27T07:33:20.418 INFO:tasks.workunit.client.0.smithi082.stdout:3/604: stat d8/d9/dd/d13/fbf 0 2024-04-27T07:33:20.418 INFO:tasks.workunit.client.0.smithi082.stdout:3/605: write d8/d9/d25/d4e/f96 [2103202,22327] 0 2024-04-27T07:33:20.420 INFO:tasks.workunit.client.0.smithi082.stdout:3/606: truncate d8/d9/dd/d13/f1e 9154435 0 2024-04-27T07:33:20.422 INFO:tasks.workunit.client.0.smithi082.stdout:3/607: stat d8/d9/d1f/f99 0 2024-04-27T07:33:20.424 INFO:tasks.workunit.client.0.smithi082.stdout:3/608: creat d8/d9/d25/d66/fdc x:0 0 0 2024-04-27T07:33:20.427 INFO:tasks.workunit.client.0.smithi082.stdout:3/609: mkdir d8/d9/d25/d26/d4d/d82/dce/ddd 0 2024-04-27T07:33:20.429 INFO:tasks.workunit.client.0.smithi082.stdout:3/610: creat d8/d9/d1d/da5/db3/fde x:0 0 0 2024-04-27T07:33:20.429 INFO:tasks.workunit.client.0.smithi082.stdout:3/611: dread - d8/d9/dd/da3/fd5 zero size 2024-04-27T07:33:20.431 INFO:tasks.workunit.client.0.smithi082.stdout:3/612: rmdir d8/d9/d1d/da5/dc4 39 2024-04-27T07:33:20.432 INFO:tasks.workunit.client.0.smithi082.stdout:3/613: getdents d8/d9/d25/d26/d4d/d82/db9 0 2024-04-27T07:33:20.434 INFO:tasks.workunit.client.0.smithi082.stdout:3/614: rename d8/d9/d1f/laf to d8/d9/dd/d13/d1b/dbd/dd8/ldf 0 2024-04-27T07:33:20.457 INFO:tasks.workunit.client.0.smithi082.stdout:3/615: rmdir d8/d9/d25/d26/d4d/d82/db9 0 2024-04-27T07:33:20.457 INFO:tasks.workunit.client.0.smithi082.stdout:9/329: sync 2024-04-27T07:33:20.457 INFO:tasks.workunit.client.0.smithi082.stdout:1/449: sync 2024-04-27T07:33:20.458 INFO:tasks.workunit.client.0.smithi082.stdout:2/337: sync 2024-04-27T07:33:20.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/450: rmdir d4/d15/d49 39 2024-04-27T07:33:20.461 INFO:tasks.workunit.client.0.smithi082.stdout:9/330: mkdir d9/da/dc/d35/d42/d66 0 2024-04-27T07:33:20.461 INFO:tasks.workunit.client.0.smithi082.stdout:9/331: dread - d9/d2d/f57 zero size 2024-04-27T07:33:20.462 INFO:tasks.workunit.client.0.smithi082.stdout:2/338: symlink d7/d31/d6f/l72 0 2024-04-27T07:33:20.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/451: chown d4/d2a/d3e/c8b 16631463 1 2024-04-27T07:33:20.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/452: write d4/f34 [850463,100092] 0 2024-04-27T07:33:20.466 INFO:tasks.workunit.client.0.smithi082.stdout:1/453: truncate d4/d2a/d4c/f8d 379226 0 2024-04-27T07:33:20.467 INFO:tasks.workunit.client.0.smithi082.stdout:1/454: readlink d4/d15/l45 0 2024-04-27T07:33:20.467 INFO:tasks.workunit.client.0.smithi082.stdout:3/616: link d8/d9/dd/d13/d1b/dbd/dd8/cdb d8/d9/d1d/da5/db3/ce0 0 2024-04-27T07:33:20.470 INFO:tasks.workunit.client.0.smithi082.stdout:9/332: dwrite d9/fb [8388608,4194304] 0 2024-04-27T07:33:20.474 INFO:tasks.workunit.client.0.smithi082.stdout:1/455: creat d4/d2a/f9b x:0 0 0 2024-04-27T07:33:20.475 INFO:tasks.workunit.client.0.smithi082.stdout:9/333: creat d9/da/f67 x:0 0 0 2024-04-27T07:33:20.475 INFO:tasks.workunit.client.0.smithi082.stdout:2/339: write d7/d30/f3f [4990034,61908] 0 2024-04-27T07:33:20.477 INFO:tasks.workunit.client.0.smithi082.stdout:1/456: unlink d4/d2a/d3e/d53/f6f 0 2024-04-27T07:33:20.478 INFO:tasks.workunit.client.0.smithi082.stdout:1/457: stat d4/d15/l58 0 2024-04-27T07:33:20.480 INFO:tasks.workunit.client.0.smithi082.stdout:9/334: rename d9/da/dc/f3e to d9/d2d/f68 0 2024-04-27T07:33:20.481 INFO:tasks.workunit.client.0.smithi082.stdout:2/340: mknod d7/d30/d23/c73 0 2024-04-27T07:33:20.482 INFO:tasks.workunit.client.0.smithi082.stdout:3/617: getdents d8/d9/d25/d26/d4d/d82/dce 0 2024-04-27T07:33:20.484 INFO:tasks.workunit.client.0.smithi082.stdout:3/618: read d8/d9/d25/d4e/fcb [286977,29752] 0 2024-04-27T07:33:20.484 INFO:tasks.workunit.client.0.smithi082.stdout:1/458: symlink d4/d2a/d4c/d7a/d8c/l9c 0 2024-04-27T07:33:20.485 INFO:tasks.workunit.client.0.smithi082.stdout:9/335: symlink d9/da/dc/d35/d4a/d50/l69 0 2024-04-27T07:33:20.486 INFO:tasks.workunit.client.0.smithi082.stdout:1/459: write d4/d15/d3f/f67 [1602441,104867] 0 2024-04-27T07:33:20.487 INFO:tasks.workunit.client.0.smithi082.stdout:2/341: creat d7/d8/f74 x:0 0 0 2024-04-27T07:33:20.489 INFO:tasks.workunit.client.0.smithi082.stdout:9/336: creat d9/da/dc/d35/d4a/f6a x:0 0 0 2024-04-27T07:33:20.489 INFO:tasks.workunit.client.0.smithi082.stdout:1/460: fdatasync d4/f10 0 2024-04-27T07:33:20.490 INFO:tasks.workunit.client.0.smithi082.stdout:2/342: fsync d7/d30/f36 0 2024-04-27T07:33:20.491 INFO:tasks.workunit.client.0.smithi082.stdout:9/337: fsync d9/da/f64 0 2024-04-27T07:33:20.492 INFO:tasks.workunit.client.0.smithi082.stdout:3/619: dwrite d8/d9/d3f/f4a [0,4194304] 0 2024-04-27T07:33:20.493 INFO:tasks.workunit.client.0.smithi082.stdout:1/461: creat d4/d2a/d4c/f9d x:0 0 0 2024-04-27T07:33:20.493 INFO:tasks.workunit.client.0.smithi082.stdout:9/338: write d9/da/dc/d33/f47 [226218,104133] 0 2024-04-27T07:33:20.495 INFO:tasks.workunit.client.0.smithi082.stdout:3/620: stat d8/d9/dd/d13/d1b 0 2024-04-27T07:33:20.495 INFO:tasks.workunit.client.0.smithi082.stdout:1/462: write d4/f1e [1569913,94352] 0 2024-04-27T07:33:20.496 INFO:tasks.workunit.client.0.smithi082.stdout:9/339: chown d9/da/dc/d33/f37 19561 1 2024-04-27T07:33:20.498 INFO:tasks.workunit.client.0.smithi082.stdout:1/463: chown d4/d2a/d3e/d46 485488 1 2024-04-27T07:33:20.499 INFO:tasks.workunit.client.0.smithi082.stdout:1/464: fdatasync d4/d2a/f6b 0 2024-04-27T07:33:20.500 INFO:tasks.workunit.client.0.smithi082.stdout:3/621: unlink d8/d9/d25/d26/fb1 0 2024-04-27T07:33:20.501 INFO:tasks.workunit.client.0.smithi082.stdout:3/622: write d8/d9/d1d/da5/db3/fde [685721,18694] 0 2024-04-27T07:33:20.508 INFO:tasks.workunit.client.0.smithi082.stdout:9/340: rename d9/d48/c4e to d9/da/dc/d35/d4a/c6b 0 2024-04-27T07:33:20.509 INFO:tasks.workunit.client.0.smithi082.stdout:1/465: symlink d4/d15/d49/d99/l9e 0 2024-04-27T07:33:20.511 INFO:tasks.workunit.client.0.smithi082.stdout:9/341: unlink d9/da/dc/d35/d38/l3c 0 2024-04-27T07:33:20.511 INFO:tasks.workunit.client.0.smithi082.stdout:9/342: chown d9/da 1 1 2024-04-27T07:33:20.514 INFO:tasks.workunit.client.0.smithi082.stdout:1/466: read d4/f12 [4055888,49165] 0 2024-04-27T07:33:20.515 INFO:tasks.workunit.client.0.smithi082.stdout:9/343: creat d9/da/dc/d35/d42/d66/f6c x:0 0 0 2024-04-27T07:33:20.516 INFO:tasks.workunit.client.0.smithi082.stdout:1/467: creat d4/d15/d3f/f9f x:0 0 0 2024-04-27T07:33:20.517 INFO:tasks.workunit.client.0.smithi082.stdout:3/623: dread d8/d9/d25/d26/d3d/f38 [0,4194304] 0 2024-04-27T07:33:20.518 INFO:tasks.workunit.client.0.smithi082.stdout:2/343: write f3 [837052,106675] 0 2024-04-27T07:33:20.518 INFO:tasks.workunit.client.0.smithi082.stdout:1/468: write d4/f3a [1373265,85245] 0 2024-04-27T07:33:20.519 INFO:tasks.workunit.client.0.smithi082.stdout:2/344: fsync d7/f28 0 2024-04-27T07:33:20.520 INFO:tasks.workunit.client.0.smithi082.stdout:3/624: dread - d8/d9/dd/d13/f4b zero size 2024-04-27T07:33:20.521 INFO:tasks.workunit.client.0.smithi082.stdout:1/469: truncate d4/f12 5021287 0 2024-04-27T07:33:20.521 INFO:tasks.workunit.client.0.smithi082.stdout:9/344: rename d9/da/dc/d33/l4f to d9/da/dc/d35/d42/d66/l6d 0 2024-04-27T07:33:20.521 INFO:tasks.workunit.client.0.smithi082.stdout:3/625: readlink d8/d9/dd/d13/l67 0 2024-04-27T07:33:20.522 INFO:tasks.workunit.client.0.smithi082.stdout:9/345: fdatasync d9/d2d/d2b/d46/f58 0 2024-04-27T07:33:20.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/470: truncate d4/d2a/d4c/f6a 956822 0 2024-04-27T07:33:20.524 INFO:tasks.workunit.client.0.smithi082.stdout:9/346: rename d9/da/dc/d33 to d9/da/dc/d33/d5e/d6e 22 2024-04-27T07:33:20.524 INFO:tasks.workunit.client.0.smithi082.stdout:1/471: read d4/f16 [240014,68116] 0 2024-04-27T07:33:20.526 INFO:tasks.workunit.client.0.smithi082.stdout:2/345: getdents d7/d9/d4f 0 2024-04-27T07:33:20.529 INFO:tasks.workunit.client.0.smithi082.stdout:1/472: rename d4/d2a/d39 to d4/d15/d49/da0 0 2024-04-27T07:33:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/473: creat d4/fa1 x:0 0 0 2024-04-27T07:33:20.534 INFO:tasks.workunit.client.0.smithi082.stdout:9/347: rename d9/da/dc/d33/d3d to d9/d2d/d2b/d46/d5d/d6f 0 2024-04-27T07:33:20.535 INFO:tasks.workunit.client.0.smithi082.stdout:2/346: mknod d7/d8/c75 0 2024-04-27T07:33:20.536 INFO:tasks.workunit.client.0.smithi082.stdout:1/474: creat d4/d15/d1c/fa2 x:0 0 0 2024-04-27T07:33:20.539 INFO:tasks.workunit.client.0.smithi082.stdout:9/348: mknod d9/da/dc/c70 0 2024-04-27T07:33:20.540 INFO:tasks.workunit.client.0.smithi082.stdout:2/347: symlink d7/d30/l76 0 2024-04-27T07:33:20.541 INFO:tasks.workunit.client.0.smithi082.stdout:1/475: creat d4/d15/d49/d99/d9a/fa3 x:0 0 0 2024-04-27T07:33:20.543 INFO:tasks.workunit.client.0.smithi082.stdout:2/348: unlink d7/d9/d4f/f5d 0 2024-04-27T07:33:20.544 INFO:tasks.workunit.client.0.smithi082.stdout:1/476: symlink d4/la4 0 2024-04-27T07:33:20.545 INFO:tasks.workunit.client.0.smithi082.stdout:3/626: dwrite d8/d9/d25/d26/d3d/f6b [0,4194304] 0 2024-04-27T07:33:20.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/349: dread - d7/d8/d13/f4b zero size 2024-04-27T07:33:20.549 INFO:tasks.workunit.client.0.smithi082.stdout:1/477: mkdir d4/d2a/d3e/d57/da5 0 2024-04-27T07:33:20.550 INFO:tasks.workunit.client.0.smithi082.stdout:9/349: dwrite d9/da/d32/f41 [0,4194304] 0 2024-04-27T07:33:20.551 INFO:tasks.workunit.client.0.smithi082.stdout:9/350: stat d9/da 0 2024-04-27T07:33:20.556 INFO:tasks.workunit.client.0.smithi082.stdout:3/627: mkdir d8/d9/dd/de1 0 2024-04-27T07:33:20.557 INFO:tasks.workunit.client.0.smithi082.stdout:3/628: stat d8/d9/d25/d26/d4d/d82/dce 0 2024-04-27T07:33:20.557 INFO:tasks.workunit.client.0.smithi082.stdout:2/350: mknod d7/d9/d4f/d6e/c77 0 2024-04-27T07:33:20.561 INFO:tasks.workunit.client.0.smithi082.stdout:3/629: mknod d8/d9/d25/d91/ce2 0 2024-04-27T07:33:20.565 INFO:tasks.workunit.client.0.smithi082.stdout:2/351: dwrite d7/d14/f5c [0,4194304] 0 2024-04-27T07:33:20.565 INFO:tasks.workunit.client.0.smithi082.stdout:9/351: dread d9/f21 [0,4194304] 0 2024-04-27T07:33:20.569 INFO:tasks.workunit.client.0.smithi082.stdout:2/352: creat d7/d14/f78 x:0 0 0 2024-04-27T07:33:20.570 INFO:tasks.workunit.client.0.smithi082.stdout:3/630: dwrite d8/d9/d1d/db5/dc7/fd3 [0,4194304] 0 2024-04-27T07:33:20.571 INFO:tasks.workunit.client.0.smithi082.stdout:2/353: read - d7/d30/d61/f71 zero size 2024-04-27T07:33:20.571 INFO:tasks.workunit.client.0.smithi082.stdout:3/631: readlink d8/l2c 0 2024-04-27T07:33:20.576 INFO:tasks.workunit.client.0.smithi082.stdout:9/352: link d9/cd d9/da/dc/d35/d4b/c71 0 2024-04-27T07:33:20.577 INFO:tasks.workunit.client.0.smithi082.stdout:2/354: dread d7/d31/d54/f6d [0,4194304] 0 2024-04-27T07:33:20.578 INFO:tasks.workunit.client.0.smithi082.stdout:9/353: mkdir d9/d2d/d72 0 2024-04-27T07:33:20.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/354: truncate d9/f21 3106649 0 2024-04-27T07:33:20.579 INFO:tasks.workunit.client.0.smithi082.stdout:2/355: creat d7/d31/d6f/f79 x:0 0 0 2024-04-27T07:33:20.580 INFO:tasks.workunit.client.0.smithi082.stdout:2/356: dread d7/d30/d23/f49 [0,4194304] 0 2024-04-27T07:33:20.582 INFO:tasks.workunit.client.0.smithi082.stdout:2/357: fsync d7/d30/f36 0 2024-04-27T07:33:20.588 INFO:tasks.workunit.client.0.smithi082.stdout:2/358: symlink d7/d9/d4f/l7a 0 2024-04-27T07:33:20.589 INFO:tasks.workunit.client.0.smithi082.stdout:2/359: chown d7/d8/d13/f60 0 1 2024-04-27T07:33:20.590 INFO:tasks.workunit.client.0.smithi082.stdout:2/360: creat d7/d8/d13/f7b x:0 0 0 2024-04-27T07:33:20.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/361: stat d7/d8/f74 0 2024-04-27T07:33:20.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/362: write d7/d8/d13/f4b [468082,122410] 0 2024-04-27T07:33:20.594 INFO:tasks.workunit.client.0.smithi082.stdout:2/363: creat d7/d9/d4f/d66/f7c x:0 0 0 2024-04-27T07:33:20.604 INFO:tasks.workunit.client.0.smithi082.stdout:2/364: dwrite d7/d31/d54/f6d [0,4194304] 0 2024-04-27T07:33:20.604 INFO:tasks.workunit.client.0.smithi082.stdout:3/632: dwrite d8/d9/dd/d13/f4b [0,4194304] 0 2024-04-27T07:33:20.606 INFO:tasks.workunit.client.0.smithi082.stdout:9/355: dwrite d9/d2d/d2b/f34 [0,4194304] 0 2024-04-27T07:33:20.617 INFO:tasks.workunit.client.0.smithi082.stdout:2/365: dwrite d7/d14/f3d [0,4194304] 0 2024-04-27T07:33:20.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/356: dread d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:20.620 INFO:tasks.workunit.client.0.smithi082.stdout:2/366: symlink d7/l7d 0 2024-04-27T07:33:20.623 INFO:tasks.workunit.client.0.smithi082.stdout:9/357: mkdir d9/da/dc/d73 0 2024-04-27T07:33:20.624 INFO:tasks.workunit.client.0.smithi082.stdout:2/367: mknod d7/d30/d23/c7e 0 2024-04-27T07:33:20.625 INFO:tasks.workunit.client.0.smithi082.stdout:2/368: chown d7/d14 14559 1 2024-04-27T07:33:20.627 INFO:tasks.workunit.client.0.smithi082.stdout:2/369: mkdir d7/d14/d7f 0 2024-04-27T07:33:20.629 INFO:tasks.workunit.client.0.smithi082.stdout:9/358: dwrite d9/da/dc/d33/f47 [0,4194304] 0 2024-04-27T07:33:20.633 INFO:tasks.workunit.client.0.smithi082.stdout:9/359: creat d9/da/dc/d35/d4b/f74 x:0 0 0 2024-04-27T07:33:20.635 INFO:tasks.workunit.client.0.smithi082.stdout:9/360: rmdir d9/da/dc/d35/d4a/d50 39 2024-04-27T07:33:20.639 INFO:tasks.workunit.client.0.smithi082.stdout:2/370: getdents d7 0 2024-04-27T07:33:20.641 INFO:tasks.workunit.client.0.smithi082.stdout:3/633: dread d8/d9/d25/d26/d4d/fc1 [0,4194304] 0 2024-04-27T07:33:20.642 INFO:tasks.workunit.client.0.smithi082.stdout:2/371: creat d7/d9/d4f/f80 x:0 0 0 2024-04-27T07:33:20.643 INFO:tasks.workunit.client.0.smithi082.stdout:9/361: dwrite d9/f21 [0,4194304] 0 2024-04-27T07:33:20.644 INFO:tasks.workunit.client.0.smithi082.stdout:2/372: dread - d7/d9/d4f/f80 zero size 2024-04-27T07:33:20.646 INFO:tasks.workunit.client.0.smithi082.stdout:2/373: write d7/d31/d54/f6d [1592101,34441] 0 2024-04-27T07:33:20.646 INFO:tasks.workunit.client.0.smithi082.stdout:9/362: rmdir d9/da/dc/d33 39 2024-04-27T07:33:20.650 INFO:tasks.workunit.client.0.smithi082.stdout:2/374: read d7/d30/f36 [3458390,24823] 0 2024-04-27T07:33:20.651 INFO:tasks.workunit.client.0.smithi082.stdout:3/634: dwrite d8/d9/d1d/da5/db3/fde [0,4194304] 0 2024-04-27T07:33:20.655 INFO:tasks.workunit.client.0.smithi082.stdout:2/375: unlink d7/d30/c52 0 2024-04-27T07:33:20.657 INFO:tasks.workunit.client.0.smithi082.stdout:9/363: dwrite d9/da/dc/f3f [0,4194304] 0 2024-04-27T07:33:20.659 INFO:tasks.workunit.client.0.smithi082.stdout:2/376: write d7/d9/d4f/f5a [42352,59612] 0 2024-04-27T07:33:20.663 INFO:tasks.workunit.client.0.smithi082.stdout:2/377: mknod d7/d30/d61/c81 0 2024-04-27T07:33:20.663 INFO:tasks.workunit.client.0.smithi082.stdout:9/364: mknod d9/da/dc/d33/c75 0 2024-04-27T07:33:20.664 INFO:tasks.workunit.client.0.smithi082.stdout:3/635: dwrite d8/d9/dd/d13/f7b [4194304,4194304] 0 2024-04-27T07:33:20.668 INFO:tasks.workunit.client.0.smithi082.stdout:3/636: symlink d8/d9/d1d/db5/le3 0 2024-04-27T07:33:20.669 INFO:tasks.workunit.client.0.smithi082.stdout:9/365: mkdir d9/d2d/d2b/d46/d76 0 2024-04-27T07:33:20.670 INFO:tasks.workunit.client.0.smithi082.stdout:3/637: chown d8/d9/dd/f35 12748566 1 2024-04-27T07:33:20.670 INFO:tasks.workunit.client.0.smithi082.stdout:2/378: dread d7/d30/f3f [4194304,4194304] 0 2024-04-27T07:33:20.671 INFO:tasks.workunit.client.0.smithi082.stdout:3/638: stat d8/d9/dd/d13/d1b/dbd/f7d 0 2024-04-27T07:33:20.673 INFO:tasks.workunit.client.0.smithi082.stdout:2/379: mkdir d7/d9/d4f/d6e/d82 0 2024-04-27T07:33:20.674 INFO:tasks.workunit.client.0.smithi082.stdout:2/380: chown d7/d14/l2f 30 1 2024-04-27T07:33:20.674 INFO:tasks.workunit.client.0.smithi082.stdout:9/366: creat d9/da/dc/d35/d38/d65/f77 x:0 0 0 2024-04-27T07:33:20.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/639: creat d8/d9/d1d/db5/fe4 x:0 0 0 2024-04-27T07:33:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:2/381: rmdir d7/d30/d23 39 2024-04-27T07:33:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:3/640: write d8/d9/d3f/f80 [2415910,100681] 0 2024-04-27T07:33:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:3/641: stat d8/d9/dd/d13/d1b/dbd/d8e 0 2024-04-27T07:33:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:3/642: write d8/d9/d1d/db5/dc7/fd3 [4918331,24070] 0 2024-04-27T07:33:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:9/367: dread d9/da/dc/d35/d4b/f5f [4194304,4194304] 0 2024-04-27T07:33:20.681 INFO:tasks.workunit.client.0.smithi082.stdout:9/368: write d9/f51 [121511,128601] 0 2024-04-27T07:33:20.681 INFO:tasks.workunit.client.0.smithi082.stdout:2/382: rename d7/d30/d23/l43 to d7/d9/d4f/d6e/l83 0 2024-04-27T07:33:20.683 INFO:tasks.workunit.client.0.smithi082.stdout:9/369: readlink d9/da/dc/d33/l53 0 2024-04-27T07:33:20.686 INFO:tasks.workunit.client.0.smithi082.stdout:9/370: unlink f0 0 2024-04-27T07:33:20.688 INFO:tasks.workunit.client.0.smithi082.stdout:2/383: creat d7/d30/f84 x:0 0 0 2024-04-27T07:33:20.689 INFO:tasks.workunit.client.0.smithi082.stdout:3/643: dwrite d8/d9/dd/d13/d1b/f31 [0,4194304] 0 2024-04-27T07:33:20.689 INFO:tasks.workunit.client.0.smithi082.stdout:9/371: mkdir d9/da/dc/d35/d38/d78 0 2024-04-27T07:33:20.689 INFO:tasks.workunit.client.0.smithi082.stdout:2/384: write f3 [1794673,91998] 0 2024-04-27T07:33:20.691 INFO:tasks.workunit.client.0.smithi082.stdout:9/372: chown d9/da/d32/f41 32455672 1 2024-04-27T07:33:20.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/373: write d9/f51 [645709,2885] 0 2024-04-27T07:33:20.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/644: dread d8/d9/d25/d26/d3d/dad/fc2 [0,4194304] 0 2024-04-27T07:33:20.700 INFO:tasks.workunit.client.0.smithi082.stdout:9/374: dwrite d9/f21 [0,4194304] 0 2024-04-27T07:33:20.702 INFO:tasks.workunit.client.0.smithi082.stdout:3/645: unlink d8/d9/dd/d13/d1b/dbd/cc5 0 2024-04-27T07:33:20.704 INFO:tasks.workunit.client.0.smithi082.stdout:9/375: chown d9/da/dc/d35/d4a/c6b 12 1 2024-04-27T07:33:20.705 INFO:tasks.workunit.client.0.smithi082.stdout:9/376: dread - d9/da/dc/d35/d4b/f74 zero size 2024-04-27T07:33:20.706 INFO:tasks.workunit.client.0.smithi082.stdout:5/558: sync 2024-04-27T07:33:20.707 INFO:tasks.workunit.client.0.smithi082.stdout:9/377: rename d9/l2f to d9/da/l79 0 2024-04-27T07:33:20.709 INFO:tasks.workunit.client.0.smithi082.stdout:9/378: readlink d9/da/dc/d35/d42/d66/l6d 0 2024-04-27T07:33:20.711 INFO:tasks.workunit.client.0.smithi082.stdout:5/559: read d8/d14/d7b/f96 [385263,17776] 0 2024-04-27T07:33:20.712 INFO:tasks.workunit.client.0.smithi082.stdout:9/379: symlink d9/da/dc/l7a 0 2024-04-27T07:33:20.712 INFO:tasks.workunit.client.0.smithi082.stdout:5/560: readlink d8/d3c/l40 0 2024-04-27T07:33:20.714 INFO:tasks.workunit.client.0.smithi082.stdout:5/561: mknod d8/d2e/d3d/cbd 0 2024-04-27T07:33:20.716 INFO:tasks.workunit.client.0.smithi082.stdout:9/380: link d9/c5c d9/d2d/d2b/d46/d76/c7b 0 2024-04-27T07:33:20.719 INFO:tasks.workunit.client.0.smithi082.stdout:9/381: dread d9/da/dc/d33/f47 [0,4194304] 0 2024-04-27T07:33:20.719 INFO:tasks.workunit.client.0.smithi082.stdout:9/382: readlink d9/da/dc/d35/d42/l5b 0 2024-04-27T07:33:20.724 INFO:tasks.workunit.client.0.smithi082.stdout:3/646: dread d8/d9/d1f/f94 [0,4194304] 0 2024-04-27T07:33:20.728 INFO:tasks.workunit.client.0.smithi082.stdout:3/647: dread d8/d9/f70 [0,4194304] 0 2024-04-27T07:33:20.805 INFO:tasks.workunit.client.0.smithi082.stdout:5/562: creat d8/d29/d4e/dad/fbe x:0 0 0 2024-04-27T07:33:20.806 INFO:tasks.workunit.client.0.smithi082.stdout:5/563: chown d8/d15/d22/c51 350589 1 2024-04-27T07:33:20.807 INFO:tasks.workunit.client.0.smithi082.stdout:9/383: mknod d9/d2d/d2b/d46/d5d/c7c 0 2024-04-27T07:33:20.807 INFO:tasks.workunit.client.0.smithi082.stdout:5/564: fdatasync d8/d29/f68 0 2024-04-27T07:33:20.808 INFO:tasks.workunit.client.0.smithi082.stdout:3/648: creat d8/d9/d1d/db5/dc7/fe5 x:0 0 0 2024-04-27T07:33:20.808 INFO:tasks.workunit.client.0.smithi082.stdout:9/384: dread d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:20.809 INFO:tasks.workunit.client.0.smithi082.stdout:9/385: write d9/f21 [3713926,4869] 0 2024-04-27T07:33:20.814 INFO:tasks.workunit.client.0.smithi082.stdout:9/386: mknod d9/da/c7d 0 2024-04-27T07:33:20.816 INFO:tasks.workunit.client.0.smithi082.stdout:5/565: rename d8/d3c/d5a/d5b/d5f/f7c to d8/d2e/fbf 0 2024-04-27T07:33:20.819 INFO:tasks.workunit.client.0.smithi082.stdout:3/649: dwrite d8/d9/d25/fc9 [0,4194304] 0 2024-04-27T07:33:20.820 INFO:tasks.workunit.client.0.smithi082.stdout:5/566: creat d8/d3c/fc0 x:0 0 0 2024-04-27T07:33:20.824 INFO:tasks.workunit.client.0.smithi082.stdout:9/387: dwrite d9/da/dc/d35/d4a/f6a [0,4194304] 0 2024-04-27T07:33:20.828 INFO:tasks.workunit.client.0.smithi082.stdout:5/567: dread d8/d15/d65/f9b [0,4194304] 0 2024-04-27T07:33:20.828 INFO:tasks.workunit.client.0.smithi082.stdout:9/388: chown d9/f4c 42323052 1 2024-04-27T07:33:20.829 INFO:tasks.workunit.client.0.smithi082.stdout:3/650: rename d8/d9/dd/c17 to d8/ce6 0 2024-04-27T07:33:20.830 INFO:tasks.workunit.client.0.smithi082.stdout:3/651: chown d8/d9/dd/f35 50382340 1 2024-04-27T07:33:20.832 INFO:tasks.workunit.client.0.smithi082.stdout:5/568: symlink d8/d15/lc1 0 2024-04-27T07:33:20.833 INFO:tasks.workunit.client.0.smithi082.stdout:5/569: write d8/d15/f24 [3890969,61051] 0 2024-04-27T07:33:20.835 INFO:tasks.workunit.client.0.smithi082.stdout:9/389: mkdir d9/da/dc/d35/d4a/d7e 0 2024-04-27T07:33:20.837 INFO:tasks.workunit.client.0.smithi082.stdout:3/652: creat d8/d9/d25/fe7 x:0 0 0 2024-04-27T07:33:20.840 INFO:tasks.workunit.client.0.smithi082.stdout:3/653: mkdir d8/d9/dd/d13/dc0/de8 0 2024-04-27T07:33:20.840 INFO:tasks.workunit.client.0.smithi082.stdout:5/570: dread d8/d2e/fbf [0,4194304] 0 2024-04-27T07:33:20.842 INFO:tasks.workunit.client.0.smithi082.stdout:3/654: chown d8/d9/dd/d13/d1b/dbd/c54 15674727 1 2024-04-27T07:33:20.843 INFO:tasks.workunit.client.0.smithi082.stdout:5/571: creat d8/d29/d4e/d90/fc2 x:0 0 0 2024-04-27T07:33:20.847 INFO:tasks.workunit.client.0.smithi082.stdout:3/655: creat d8/d9/d25/d4e/da4/fe9 x:0 0 0 2024-04-27T07:33:20.849 INFO:tasks.workunit.client.0.smithi082.stdout:9/390: truncate d9/da/dc/d35/d4a/f6a 382682 0 2024-04-27T07:33:20.849 INFO:tasks.workunit.client.0.smithi082.stdout:3/656: readlink d8/d9/dd/d13/la2 0 2024-04-27T07:33:20.849 INFO:tasks.workunit.client.0.smithi082.stdout:5/572: dwrite d8/d77/f78 [0,4194304] 0 2024-04-27T07:33:20.851 INFO:tasks.workunit.client.0.smithi082.stdout:5/573: chown d8/d14/c8e 32 1 2024-04-27T07:33:20.852 INFO:tasks.workunit.client.0.smithi082.stdout:9/391: creat d9/da/dc/d35/d38/d65/f7f x:0 0 0 2024-04-27T07:33:20.853 INFO:tasks.workunit.client.0.smithi082.stdout:3/657: truncate d8/d9/d1f/f4c 2577657 0 2024-04-27T07:33:20.853 INFO:tasks.workunit.client.0.smithi082.stdout:9/392: readlink d9/da/dc/d35/d42/l56 0 2024-04-27T07:33:20.855 INFO:tasks.workunit.client.0.smithi082.stdout:5/574: fdatasync d8/d15/f13 0 2024-04-27T07:33:20.858 INFO:tasks.workunit.client.0.smithi082.stdout:3/658: mkdir d8/d9/d25/d26/dea 0 2024-04-27T07:33:20.859 INFO:tasks.workunit.client.0.smithi082.stdout:5/575: creat d8/fc3 x:0 0 0 2024-04-27T07:33:20.864 INFO:tasks.workunit.client.0.smithi082.stdout:5/576: dwrite d8/d2e/f37 [0,4194304] 0 2024-04-27T07:33:20.867 INFO:tasks.workunit.client.0.smithi082.stdout:5/577: write d8/f2d [1211159,18490] 0 2024-04-27T07:33:20.870 INFO:tasks.workunit.client.0.smithi082.stdout:5/578: write d8/d14/d7b/f96 [11700971,6695] 0 2024-04-27T07:33:20.873 INFO:tasks.workunit.client.0.smithi082.stdout:5/579: symlink d8/d29/d4e/dad/lc4 0 2024-04-27T07:33:20.876 INFO:tasks.workunit.client.0.smithi082.stdout:5/580: symlink d8/d2e/d3d/lc5 0 2024-04-27T07:33:20.878 INFO:tasks.workunit.client.0.smithi082.stdout:5/581: rename d8/d3c/d5a/d5b/c63 to d8/d98/cc6 0 2024-04-27T07:33:20.880 INFO:tasks.workunit.client.0.smithi082.stdout:5/582: write d8/d42/f54 [3693377,97991] 0 2024-04-27T07:33:20.882 INFO:tasks.workunit.client.0.smithi082.stdout:5/583: mkdir d8/d15/d65/dc7 0 2024-04-27T07:33:20.882 INFO:tasks.workunit.client.0.smithi082.stdout:5/584: dread - d8/d15/d22/fb4 zero size 2024-04-27T07:33:20.885 INFO:tasks.workunit.client.0.smithi082.stdout:3/659: link d8/d9/d1f/f4c d8/d9/d25/d26/feb 0 2024-04-27T07:33:20.886 INFO:tasks.workunit.client.0.smithi082.stdout:3/660: mknod d8/d9/d25/d66/cec 0 2024-04-27T07:33:20.887 INFO:tasks.workunit.client.0.smithi082.stdout:3/661: write d8/d9/d3f/f80 [4265769,97896] 0 2024-04-27T07:33:20.889 INFO:tasks.workunit.client.0.smithi082.stdout:3/662: symlink d8/d9/dd/d13/dc0/led 0 2024-04-27T07:33:20.889 INFO:tasks.workunit.client.0.smithi082.stdout:5/585: dwrite f5 [0,4194304] 0 2024-04-27T07:33:20.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/586: mknod d8/d14/cc8 0 2024-04-27T07:33:20.898 INFO:tasks.workunit.client.0.smithi082.stdout:5/587: getdents d8/d29 0 2024-04-27T07:33:20.900 INFO:tasks.workunit.client.0.smithi082.stdout:3/663: write d8/d9/f70 [896370,18170] 0 2024-04-27T07:33:20.901 INFO:tasks.workunit.client.0.smithi082.stdout:3/664: chown d8/d9/dd/d13/c3e 27035953 1 2024-04-27T07:33:20.902 INFO:tasks.workunit.client.0.smithi082.stdout:5/588: fdatasync d8/d3c/d47/f2f 0 2024-04-27T07:33:20.904 INFO:tasks.workunit.client.0.smithi082.stdout:5/589: write d8/d2e/d85/daa/fba [520377,23375] 0 2024-04-27T07:33:20.906 INFO:tasks.workunit.client.0.smithi082.stdout:3/665: dread d8/d9/d3f/f4a [0,4194304] 0 2024-04-27T07:33:20.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/590: creat d8/d77/fc9 x:0 0 0 2024-04-27T07:33:20.909 INFO:tasks.workunit.client.0.smithi082.stdout:5/591: read d8/d29/d4e/f52 [606112,1865] 0 2024-04-27T07:33:20.913 INFO:tasks.workunit.client.0.smithi082.stdout:3/666: getdents d8/d9/d25/d26 0 2024-04-27T07:33:20.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:20 smithi100 ceph-mon[34183]: pgmap v16: 65 pgs: 65 active+clean; 671 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 73 MiB/s wr, 357 op/s 2024-04-27T07:33:20.917 INFO:tasks.workunit.client.0.smithi082.stdout:3/667: rename d8/f5e to d8/d9/dd/d13/d1b/fee 0 2024-04-27T07:33:20.918 INFO:tasks.workunit.client.0.smithi082.stdout:5/592: dread d8/fa [8388608,4194304] 0 2024-04-27T07:33:20.919 INFO:tasks.workunit.client.0.smithi082.stdout:5/593: chown d8/d3c/d47 24510095 1 2024-04-27T07:33:20.933 INFO:tasks.workunit.client.0.smithi082.stdout:3/668: dread d8/d9/d25/d91/f56 [4194304,4194304] 0 2024-04-27T07:33:20.992 INFO:tasks.workunit.client.0.smithi082.stdout:7/408: sync 2024-04-27T07:33:20.993 INFO:tasks.workunit.client.0.smithi082.stdout:8/295: sync 2024-04-27T07:33:20.994 INFO:tasks.workunit.client.0.smithi082.stdout:8/296: rmdir d0/d3/d1b/d24/d46/d4e 39 2024-04-27T07:33:20.995 INFO:tasks.workunit.client.0.smithi082.stdout:7/409: symlink d3/d9/d7c/l80 0 2024-04-27T07:33:20.995 INFO:tasks.workunit.client.0.smithi082.stdout:8/297: write d0/d3/d1b/f3c [4320941,48409] 0 2024-04-27T07:33:20.996 INFO:tasks.workunit.client.0.smithi082.stdout:7/410: creat d3/de/d3a/d2a/f81 x:0 0 0 2024-04-27T07:33:20.997 INFO:tasks.workunit.client.0.smithi082.stdout:7/411: write d3/f1f [2821285,33551] 0 2024-04-27T07:33:20.997 INFO:tasks.workunit.client.0.smithi082.stdout:8/298: unlink d0/d3/d1b/d29/c44 0 2024-04-27T07:33:20.999 INFO:tasks.workunit.client.0.smithi082.stdout:7/412: mknod d3/d9/d4f/d61/c82 0 2024-04-27T07:33:21.000 INFO:tasks.workunit.client.0.smithi082.stdout:8/299: mknod d0/c5a 0 2024-04-27T07:33:21.001 INFO:tasks.workunit.client.0.smithi082.stdout:8/300: write d0/d3/f18 [1700208,66653] 0 2024-04-27T07:33:21.002 INFO:tasks.workunit.client.0.smithi082.stdout:7/413: creat d3/de/d7d/f83 x:0 0 0 2024-04-27T07:33:21.002 INFO:tasks.workunit.client.0.smithi082.stdout:8/301: write d0/d3/d1b/f2e [4707163,15959] 0 2024-04-27T07:33:21.003 INFO:tasks.workunit.client.0.smithi082.stdout:8/302: chown d0/d2b/f4c 5586504 1 2024-04-27T07:33:21.005 INFO:tasks.workunit.client.0.smithi082.stdout:8/303: unlink d0/d2b/f4a 0 2024-04-27T07:33:21.006 INFO:tasks.workunit.client.0.smithi082.stdout:7/414: mknod d3/db/c84 0 2024-04-27T07:33:21.007 INFO:tasks.workunit.client.0.smithi082.stdout:8/304: dread d0/d3/f1a [0,4194304] 0 2024-04-27T07:33:21.009 INFO:tasks.workunit.client.0.smithi082.stdout:8/305: read d0/d2b/f4c [7916855,77692] 0 2024-04-27T07:33:21.016 INFO:tasks.workunit.client.0.smithi082.stdout:8/306: dwrite d0/d3/d1b/d24/f54 [0,4194304] 0 2024-04-27T07:33:21.018 INFO:tasks.workunit.client.0.smithi082.stdout:8/307: write d0/d2b/f38 [868713,80638] 0 2024-04-27T07:33:21.020 INFO:tasks.workunit.client.0.smithi082.stdout:7/415: dread d3/de/d6c/f7f [0,4194304] 0 2024-04-27T07:33:21.022 INFO:tasks.workunit.client.0.smithi082.stdout:8/308: link d0/d3/d1b/d29/f57 d0/d3/d1b/d24/d42/f5b 0 2024-04-27T07:33:21.024 INFO:tasks.workunit.client.0.smithi082.stdout:7/416: rename d3/de/f62 to d3/f85 0 2024-04-27T07:33:21.026 INFO:tasks.workunit.client.0.smithi082.stdout:8/309: symlink d0/d3/d1b/d24/d42/l5c 0 2024-04-27T07:33:21.028 INFO:tasks.workunit.client.0.smithi082.stdout:7/417: link d3/f45 d3/d9/d4f/d61/f86 0 2024-04-27T07:33:21.030 INFO:tasks.workunit.client.0.smithi082.stdout:8/310: creat d0/d3/d1b/d24/d46/d56/f5d x:0 0 0 2024-04-27T07:33:21.031 INFO:tasks.workunit.client.0.smithi082.stdout:7/418: symlink d3/d9/l87 0 2024-04-27T07:33:21.032 INFO:tasks.workunit.client.0.smithi082.stdout:8/311: mknod d0/d3/c5e 0 2024-04-27T07:33:21.034 INFO:tasks.workunit.client.0.smithi082.stdout:8/312: mknod d0/d3/d1b/d24/c5f 0 2024-04-27T07:33:21.035 INFO:tasks.workunit.client.0.smithi082.stdout:7/419: getdents d3/de/d6c 0 2024-04-27T07:33:21.043 INFO:tasks.workunit.client.0.smithi082.stdout:8/313: rename d0/d3/d1b/d24 to d0/d3/d1c/d60 0 2024-04-27T07:33:21.044 INFO:tasks.workunit.client.0.smithi082.stdout:7/420: write d3/de/f2f [4690326,112628] 0 2024-04-27T07:33:21.045 INFO:tasks.workunit.client.0.smithi082.stdout:7/421: creat d3/de/d3a/d2a/f88 x:0 0 0 2024-04-27T07:33:21.047 INFO:tasks.workunit.client.0.smithi082.stdout:8/314: rename d0/d3/d1b/d29/f51 to d0/d3/d55/f61 0 2024-04-27T07:33:21.049 INFO:tasks.workunit.client.0.smithi082.stdout:8/315: unlink d0/f17 0 2024-04-27T07:33:21.049 INFO:tasks.workunit.client.0.smithi082.stdout:8/316: read d0/d3/d1c/d60/f54 [3059974,28271] 0 2024-04-27T07:33:21.053 INFO:tasks.workunit.client.0.smithi082.stdout:8/317: link d0/d3/c5e d0/d3/c62 0 2024-04-27T07:33:21.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/318: write d0/d3/f1d [2550872,121870] 0 2024-04-27T07:33:21.056 INFO:tasks.workunit.client.0.smithi082.stdout:7/422: truncate d3/f8 379447 0 2024-04-27T07:33:21.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/319: chown d0/l11 9 1 2024-04-27T07:33:21.058 INFO:tasks.workunit.client.0.smithi082.stdout:7/423: rmdir d3/de/d7d 39 2024-04-27T07:33:21.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/320: symlink d0/d3/d55/l63 0 2024-04-27T07:33:21.063 INFO:tasks.workunit.client.0.smithi082.stdout:8/321: mknod d0/d3/c64 0 2024-04-27T07:33:21.065 INFO:tasks.workunit.client.0.smithi082.stdout:8/322: mkdir d0/d3/d1b/d29/d65 0 2024-04-27T07:33:21.066 INFO:tasks.workunit.client.0.smithi082.stdout:7/424: truncate d3/f5 8302236 0 2024-04-27T07:33:21.069 INFO:tasks.workunit.client.0.smithi082.stdout:7/425: rename d3/de/d3a/l23 to d3/de/d3a/d71/l89 0 2024-04-27T07:33:21.070 INFO:tasks.workunit.client.0.smithi082.stdout:8/323: dread d0/d3/d1b/f1e [0,4194304] 0 2024-04-27T07:33:21.071 INFO:tasks.workunit.client.0.smithi082.stdout:6/396: sync 2024-04-27T07:33:21.072 INFO:tasks.workunit.client.0.smithi082.stdout:0/544: sync 2024-04-27T07:33:21.073 INFO:tasks.workunit.client.0.smithi082.stdout:0/545: write da/d2a/f87 [3694171,12946] 0 2024-04-27T07:33:21.077 INFO:tasks.workunit.client.0.smithi082.stdout:8/324: getdents d0/d3/d1c/d60 0 2024-04-27T07:33:21.081 INFO:tasks.workunit.client.0.smithi082.stdout:6/397: dread d2/d3/d1b/f5c [0,4194304] 0 2024-04-27T07:33:21.081 INFO:tasks.workunit.client.0.smithi082.stdout:7/426: dwrite d3/db/f5d [0,4194304] 0 2024-04-27T07:33:21.082 INFO:tasks.workunit.client.0.smithi082.stdout:7/427: readlink d3/de/d3a/d71/l73 0 2024-04-27T07:33:21.082 INFO:tasks.workunit.client.0.smithi082.stdout:8/325: unlink d0/d3/d1c/d60/f39 0 2024-04-27T07:33:21.088 INFO:tasks.workunit.client.0.smithi082.stdout:6/398: mknod d2/c87 0 2024-04-27T07:33:21.089 INFO:tasks.workunit.client.0.smithi082.stdout:7/428: mkdir d3/db/d8a 0 2024-04-27T07:33:21.091 INFO:tasks.workunit.client.0.smithi082.stdout:8/326: symlink d0/l66 0 2024-04-27T07:33:21.095 INFO:tasks.workunit.client.0.smithi082.stdout:8/327: write d0/f43 [704320,11800] 0 2024-04-27T07:33:21.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:20 smithi082 ceph-mon[26613]: pgmap v16: 65 pgs: 65 active+clean; 671 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 7.5 MiB/s rd, 73 MiB/s wr, 357 op/s 2024-04-27T07:33:21.096 INFO:tasks.workunit.client.0.smithi082.stdout:7/429: symlink d3/d9/d7c/l8b 0 2024-04-27T07:33:21.096 INFO:tasks.workunit.client.0.smithi082.stdout:0/546: dread da/d3c/d3f/f41 [0,4194304] 0 2024-04-27T07:33:21.098 INFO:tasks.workunit.client.0.smithi082.stdout:8/328: rmdir d0/d3/d1c/d60/d46/d56 39 2024-04-27T07:33:21.099 INFO:tasks.workunit.client.0.smithi082.stdout:8/329: truncate d0/d3/d1c/d32/d35/f49 835118 0 2024-04-27T07:33:21.102 INFO:tasks.workunit.client.0.smithi082.stdout:0/547: mknod da/d3c/d3f/d4c/d74/d81/cc6 0 2024-04-27T07:33:21.103 INFO:tasks.workunit.client.0.smithi082.stdout:7/430: creat d3/f8c x:0 0 0 2024-04-27T07:33:21.106 INFO:tasks.workunit.client.0.smithi082.stdout:6/399: dwrite d2/de/d13/f67 [0,4194304] 0 2024-04-27T07:33:21.107 INFO:tasks.workunit.client.0.smithi082.stdout:6/400: chown d2/d75/f7e 107 1 2024-04-27T07:33:21.108 INFO:tasks.workunit.client.0.smithi082.stdout:6/401: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:21.110 INFO:tasks.workunit.client.0.smithi082.stdout:7/431: unlink d3/f5 0 2024-04-27T07:33:21.110 INFO:tasks.workunit.client.0.smithi082.stdout:8/330: truncate d0/d3/d1c/d60/f54 1542002 0 2024-04-27T07:33:21.114 INFO:tasks.workunit.client.0.smithi082.stdout:8/331: creat d0/d3/d1c/d32/f67 x:0 0 0 2024-04-27T07:33:21.115 INFO:tasks.workunit.client.0.smithi082.stdout:8/332: chown d0/d3/d1c/d32/d35/f49 0 1 2024-04-27T07:33:21.116 INFO:tasks.workunit.client.0.smithi082.stdout:8/333: readlink d0/d3/d55/l63 0 2024-04-27T07:33:21.117 INFO:tasks.workunit.client.0.smithi082.stdout:7/432: chown d3/de/d3a/f21 3654427 1 2024-04-27T07:33:21.117 INFO:tasks.workunit.client.0.smithi082.stdout:8/334: dread - d0/d3/d1c/d60/f3e zero size 2024-04-27T07:33:21.120 INFO:tasks.workunit.client.0.smithi082.stdout:0/548: dread da/f19 [0,4194304] 0 2024-04-27T07:33:21.120 INFO:tasks.workunit.client.0.smithi082.stdout:8/335: creat d0/d2b/f68 x:0 0 0 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:7/433: mknod d3/c8d 0 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:9/393: sync 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:1/478: sync 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:2/385: sync 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:4/405: sync 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:3/669: sync 2024-04-27T07:33:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:5/594: sync 2024-04-27T07:33:21.125 INFO:tasks.workunit.client.0.smithi082.stdout:7/434: chown d3/de/f79 0 1 2024-04-27T07:33:21.127 INFO:tasks.workunit.client.0.smithi082.stdout:6/402: dwrite d2/d2e/f30 [0,4194304] 0 2024-04-27T07:33:21.127 INFO:tasks.workunit.client.0.smithi082.stdout:1/479: dread - d4/d15/d3f/d6d/f85 zero size 2024-04-27T07:33:21.127 INFO:tasks.workunit.client.0.smithi082.stdout:2/386: creat d7/d30/d61/f85 x:0 0 0 2024-04-27T07:33:21.128 INFO:tasks.workunit.client.0.smithi082.stdout:9/394: write d9/d2d/f68 [322256,90227] 0 2024-04-27T07:33:21.128 INFO:tasks.workunit.client.0.smithi082.stdout:7/435: stat d3/de/d3a/d71/f7e 0 2024-04-27T07:33:21.129 INFO:tasks.workunit.client.0.smithi082.stdout:6/403: write d2/de/f83 [841791,22005] 0 2024-04-27T07:33:21.129 INFO:tasks.workunit.client.0.smithi082.stdout:2/387: chown d7/d8/d13/c55 2639 1 2024-04-27T07:33:21.130 INFO:tasks.workunit.client.0.smithi082.stdout:9/395: fsync d9/f21 0 2024-04-27T07:33:21.131 INFO:tasks.workunit.client.0.smithi082.stdout:9/396: readlink d9/l1d 0 2024-04-27T07:33:21.132 INFO:tasks.workunit.client.0.smithi082.stdout:6/404: write d2/d2e/f30 [85101,93432] 0 2024-04-27T07:33:21.132 INFO:tasks.workunit.client.0.smithi082.stdout:2/388: write d7/d8/d13/f60 [415085,44908] 0 2024-04-27T07:33:21.136 INFO:tasks.workunit.client.0.smithi082.stdout:9/397: mknod d9/d2d/d2b/d46/c80 0 2024-04-27T07:33:21.137 INFO:tasks.workunit.client.0.smithi082.stdout:9/398: fdatasync f4 0 2024-04-27T07:33:21.140 INFO:tasks.workunit.client.0.smithi082.stdout:2/389: dwrite d7/d30/d61/f71 [0,4194304] 0 2024-04-27T07:33:21.141 INFO:tasks.workunit.client.0.smithi082.stdout:2/390: write d7/d30/d61/f71 [2347877,45138] 0 2024-04-27T07:33:21.145 INFO:tasks.workunit.client.0.smithi082.stdout:0/549: dread da/d3c/d3f/f5b [0,4194304] 0 2024-04-27T07:33:21.233 INFO:tasks.workunit.client.0.smithi082.stdout:4/406: link d3/d6/l57 d3/d6/d26/l8d 0 2024-04-27T07:33:21.235 INFO:tasks.workunit.client.0.smithi082.stdout:6/405: creat d2/d1e/f88 x:0 0 0 2024-04-27T07:33:21.236 INFO:tasks.workunit.client.0.smithi082.stdout:7/436: mknod d3/db/c8e 0 2024-04-27T07:33:21.237 INFO:tasks.workunit.client.0.smithi082.stdout:5/595: truncate d8/d2e/f37 3266113 0 2024-04-27T07:33:21.237 INFO:tasks.workunit.client.0.smithi082.stdout:7/437: chown d3/d9/l87 1338 1 2024-04-27T07:33:21.240 INFO:tasks.workunit.client.0.smithi082.stdout:4/407: dread d3/d6/d26/d55/f72 [0,4194304] 0 2024-04-27T07:33:21.247 INFO:tasks.workunit.client.0.smithi082.stdout:3/670: truncate d8/d9/dd/d13/d1b/f93 218612 0 2024-04-27T07:33:21.247 INFO:tasks.workunit.client.0.smithi082.stdout:6/406: symlink d2/d3/l89 0 2024-04-27T07:33:21.249 INFO:tasks.workunit.client.0.smithi082.stdout:7/438: dread d3/de/f14 [0,4194304] 0 2024-04-27T07:33:21.249 INFO:tasks.workunit.client.0.smithi082.stdout:5/596: mkdir d8/d15/dca 0 2024-04-27T07:33:21.252 INFO:tasks.workunit.client.0.smithi082.stdout:2/391: write d7/d9/f1d [1039238,45859] 0 2024-04-27T07:33:21.254 INFO:tasks.workunit.client.0.smithi082.stdout:2/392: fsync f3 0 2024-04-27T07:33:21.255 INFO:tasks.workunit.client.0.smithi082.stdout:0/550: unlink da/d38/d7f/d4a/d80/l91 0 2024-04-27T07:33:21.257 INFO:tasks.workunit.client.0.smithi082.stdout:3/671: dread d8/d9/d1d/da5/db3/fde [0,4194304] 0 2024-04-27T07:33:21.259 INFO:tasks.workunit.client.0.smithi082.stdout:6/407: dwrite d2/de/f24 [0,4194304] 0 2024-04-27T07:33:21.261 INFO:tasks.workunit.client.0.smithi082.stdout:5/597: mknod d8/d98/ccb 0 2024-04-27T07:33:21.261 INFO:tasks.workunit.client.0.smithi082.stdout:6/408: fdatasync d2/d45/f6b 0 2024-04-27T07:33:21.262 INFO:tasks.workunit.client.0.smithi082.stdout:7/439: creat d3/d9/d7c/f8f x:0 0 0 2024-04-27T07:33:21.263 INFO:tasks.workunit.client.0.smithi082.stdout:4/408: dread d3/d6/d26/f35 [0,4194304] 0 2024-04-27T07:33:21.263 INFO:tasks.workunit.client.0.smithi082.stdout:6/409: write d2/d2d/d4a/f52 [185072,88188] 0 2024-04-27T07:33:21.263 INFO:tasks.workunit.client.0.smithi082.stdout:9/399: write d9/d2d/f19 [588555,111627] 0 2024-04-27T07:33:21.264 INFO:tasks.workunit.client.0.smithi082.stdout:6/410: fdatasync d2/d2e/f7c 0 2024-04-27T07:33:21.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/400: truncate f4 2803611 0 2024-04-27T07:33:21.266 INFO:tasks.workunit.client.0.smithi082.stdout:6/411: write d2/f60 [1747162,53667] 0 2024-04-27T07:33:21.268 INFO:tasks.workunit.client.0.smithi082.stdout:4/409: truncate d3/d6/f89 444984 0 2024-04-27T07:33:21.269 INFO:tasks.workunit.client.0.smithi082.stdout:4/410: write d3/d6/d22/f59 [641995,59224] 0 2024-04-27T07:33:21.271 INFO:tasks.workunit.client.0.smithi082.stdout:0/551: mkdir da/d3c/dc7 0 2024-04-27T07:33:21.274 INFO:tasks.workunit.client.0.smithi082.stdout:5/598: dread - d8/d14/f49 zero size 2024-04-27T07:33:21.280 INFO:tasks.workunit.client.0.smithi082.stdout:0/552: rmdir da/d38/d7f/d4a/d80/da0 39 2024-04-27T07:33:21.280 INFO:tasks.workunit.client.0.smithi082.stdout:3/672: symlink d8/d9/dd/d13/dc0/de8/lef 0 2024-04-27T07:33:21.282 INFO:tasks.workunit.client.0.smithi082.stdout:7/440: fsync d3/de/d7d/f64 0 2024-04-27T07:33:21.283 INFO:tasks.workunit.client.0.smithi082.stdout:3/673: readlink d8/d9/dd/d13/dc0/de8/lef 0 2024-04-27T07:33:21.284 INFO:tasks.workunit.client.0.smithi082.stdout:2/393: creat d7/d30/f86 x:0 0 0 2024-04-27T07:33:21.284 INFO:tasks.workunit.client.0.smithi082.stdout:8/336: sync 2024-04-27T07:33:21.289 INFO:tasks.workunit.client.0.smithi082.stdout:5/599: dread d8/d14/d7b/f96 [8388608,4194304] 0 2024-04-27T07:33:21.289 INFO:tasks.workunit.client.0.smithi082.stdout:3/674: creat d8/d9/d25/d4e/ff0 x:0 0 0 2024-04-27T07:33:21.290 INFO:tasks.workunit.client.0.smithi082.stdout:5/600: dread - d8/fac zero size 2024-04-27T07:33:21.291 INFO:tasks.workunit.client.0.smithi082.stdout:7/441: creat d3/db/d8a/f90 x:0 0 0 2024-04-27T07:33:21.291 INFO:tasks.workunit.client.0.smithi082.stdout:4/411: getdents d3/d6/d26/d5e 0 2024-04-27T07:33:21.293 INFO:tasks.workunit.client.0.smithi082.stdout:2/394: link d7/d14/f78 d7/f87 0 2024-04-27T07:33:21.297 INFO:tasks.workunit.client.0.smithi082.stdout:8/337: mknod d0/d3/d1b/d29/d65/c69 0 2024-04-27T07:33:21.298 INFO:tasks.workunit.client.0.smithi082.stdout:0/553: creat da/d3c/d3f/fc8 x:0 0 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:3/675: mkdir d8/d9/d1d/df1 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:6/412: dread d2/d2e/f61 [0,4194304] 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:7/442: truncate d3/de/f36 96377 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:9/401: dread d9/da/dc/d35/d4b/f5f [0,4194304] 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:2/395: dread - d7/d30/f84 zero size 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:5/601: dread d8/d3c/d47/f2f [0,4194304] 0 2024-04-27T07:33:21.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/338: mkdir d0/d3/d1b/d29/d6a 0 2024-04-27T07:33:21.300 INFO:tasks.workunit.client.0.smithi082.stdout:4/412: creat d3/d6/f8e x:0 0 0 2024-04-27T07:33:21.301 INFO:tasks.workunit.client.0.smithi082.stdout:0/554: creat da/d3c/d3f/d4c/d95/fc9 x:0 0 0 2024-04-27T07:33:21.303 INFO:tasks.workunit.client.0.smithi082.stdout:7/443: mkdir d3/db/d8a/d91 0 2024-04-27T07:33:21.305 INFO:tasks.workunit.client.0.smithi082.stdout:8/339: write d0/d3/d55/f61 [315476,112453] 0 2024-04-27T07:33:21.307 INFO:tasks.workunit.client.0.smithi082.stdout:4/413: mkdir d3/d6/d22/d8f 0 2024-04-27T07:33:21.307 INFO:tasks.workunit.client.0.smithi082.stdout:8/340: truncate d0/d3/d1c/d60/d42/f5b 1001039 0 2024-04-27T07:33:21.308 INFO:tasks.workunit.client.0.smithi082.stdout:4/414: chown d3/d6/d26/d55/d67/f8a 0 1 2024-04-27T07:33:21.309 INFO:tasks.workunit.client.0.smithi082.stdout:6/413: mkdir d2/d1e/d32/d85/d8a 0 2024-04-27T07:33:21.310 INFO:tasks.workunit.client.0.smithi082.stdout:9/402: symlink d9/da/dc/l81 0 2024-04-27T07:33:21.311 INFO:tasks.workunit.client.0.smithi082.stdout:7/444: rmdir d3/d9/d4f/d61 39 2024-04-27T07:33:21.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/602: rename d8/d14/c83 to d8/d3c/d5a/ccc 0 2024-04-27T07:33:21.315 INFO:tasks.workunit.client.0.smithi082.stdout:8/341: dwrite d0/d3/d1b/f3c [0,4194304] 0 2024-04-27T07:33:21.317 INFO:tasks.workunit.client.0.smithi082.stdout:4/415: dwrite d3/d6/d26/d55/f5f [0,4194304] 0 2024-04-27T07:33:21.319 INFO:tasks.workunit.client.0.smithi082.stdout:0/555: mknod da/d38/da9/cca 0 2024-04-27T07:33:21.320 INFO:tasks.workunit.client.0.smithi082.stdout:0/556: readlink da/lc 0 2024-04-27T07:33:21.321 INFO:tasks.workunit.client.0.smithi082.stdout:6/414: creat d2/d1e/d32/d85/f8b x:0 0 0 2024-04-27T07:33:21.323 INFO:tasks.workunit.client.0.smithi082.stdout:3/676: write d8/d9/d25/d26/f6e [349010,34298] 0 2024-04-27T07:33:21.325 INFO:tasks.workunit.client.0.smithi082.stdout:2/396: creat d7/d8/f88 x:0 0 0 2024-04-27T07:33:21.325 INFO:tasks.workunit.client.0.smithi082.stdout:4/416: dwrite d3/d6/d26/d5e/f48 [4194304,4194304] 0 2024-04-27T07:33:21.327 INFO:tasks.workunit.client.0.smithi082.stdout:5/603: rmdir d8/d15/d22 39 2024-04-27T07:33:21.327 INFO:tasks.workunit.client.0.smithi082.stdout:3/677: chown d8/d9/d25/d26/d4d/l60 163322 1 2024-04-27T07:33:21.327 INFO:tasks.workunit.client.0.smithi082.stdout:4/417: readlink d3/d6/d16/l4b 0 2024-04-27T07:33:21.328 INFO:tasks.workunit.client.0.smithi082.stdout:4/418: read - d3/d9/f8b zero size 2024-04-27T07:33:21.329 INFO:tasks.workunit.client.0.smithi082.stdout:0/557: stat da/d3c/d3f/c5a 0 2024-04-27T07:33:21.331 INFO:tasks.workunit.client.0.smithi082.stdout:0/558: write da/d3c/d3f/d57/f76 [269923,39215] 0 2024-04-27T07:33:21.332 INFO:tasks.workunit.client.0.smithi082.stdout:0/559: dread - da/d3c/fa2 zero size 2024-04-27T07:33:21.333 INFO:tasks.workunit.client.0.smithi082.stdout:5/604: unlink d8/d3c/d64/cae 0 2024-04-27T07:33:21.335 INFO:tasks.workunit.client.0.smithi082.stdout:5/605: dread d8/d2e/fbf [0,4194304] 0 2024-04-27T07:33:21.338 INFO:tasks.workunit.client.0.smithi082.stdout:4/419: unlink d3/d6/d26/d5e/f48 0 2024-04-27T07:33:21.340 INFO:tasks.workunit.client.0.smithi082.stdout:4/420: fdatasync d3/d6/d26/d5e/f2f 0 2024-04-27T07:33:21.341 INFO:tasks.workunit.client.0.smithi082.stdout:4/421: write d3/d6/d26/d55/f5f [1465306,38850] 0 2024-04-27T07:33:21.343 INFO:tasks.workunit.client.0.smithi082.stdout:5/606: mknod d8/d3c/d5a/d5b/ccd 0 2024-04-27T07:33:21.343 INFO:tasks.workunit.client.0.smithi082.stdout:6/415: creat d2/f8c x:0 0 0 2024-04-27T07:33:21.345 INFO:tasks.workunit.client.0.smithi082.stdout:9/403: getdents d9/da/dc 0 2024-04-27T07:33:21.347 INFO:tasks.workunit.client.0.smithi082.stdout:9/404: truncate d9/da/d32/f41 4223911 0 2024-04-27T07:33:21.347 INFO:tasks.workunit.client.0.smithi082.stdout:2/397: unlink d7/d14/c63 0 2024-04-27T07:33:21.348 INFO:tasks.workunit.client.0.smithi082.stdout:4/422: write d3/d9/f7d [270803,61486] 0 2024-04-27T07:33:21.348 INFO:tasks.workunit.client.0.smithi082.stdout:4/423: dread - d3/d10/f7b zero size 2024-04-27T07:33:21.351 INFO:tasks.workunit.client.0.smithi082.stdout:2/398: write d7/d31/f67 [288926,102983] 0 2024-04-27T07:33:21.352 INFO:tasks.workunit.client.0.smithi082.stdout:2/399: fdatasync d7/d30/d61/f71 0 2024-04-27T07:33:21.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/416: mknod d2/de/d77/c8d 0 2024-04-27T07:33:21.358 INFO:tasks.workunit.client.0.smithi082.stdout:3/678: dwrite d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 [0,4194304] 0 2024-04-27T07:33:21.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/417: rmdir d2/d2e/d6a 39 2024-04-27T07:33:21.360 INFO:tasks.workunit.client.0.smithi082.stdout:4/424: dread d3/d6/d22/f24 [0,4194304] 0 2024-04-27T07:33:21.362 INFO:tasks.workunit.client.0.smithi082.stdout:5/607: write d8/d29/f56 [779655,110310] 0 2024-04-27T07:33:21.365 INFO:tasks.workunit.client.0.smithi082.stdout:3/679: creat d8/d9/dd/d13/d1b/ff2 x:0 0 0 2024-04-27T07:33:21.369 INFO:tasks.workunit.client.0.smithi082.stdout:4/425: link d3/d10/f6c d3/d6/d26/f90 0 2024-04-27T07:33:21.370 INFO:tasks.workunit.client.0.smithi082.stdout:9/405: dwrite d9/da/dc/d33/f47 [0,4194304] 0 2024-04-27T07:33:21.370 INFO:tasks.workunit.client.0.smithi082.stdout:3/680: creat d8/d9/d1d/ff3 x:0 0 0 2024-04-27T07:33:21.371 INFO:tasks.workunit.client.0.smithi082.stdout:5/608: mkdir d8/d15/dca/dce 0 2024-04-27T07:33:21.371 INFO:tasks.workunit.client.0.smithi082.stdout:6/418: dwrite d2/d75/f7e [0,4194304] 0 2024-04-27T07:33:21.373 INFO:tasks.workunit.client.0.smithi082.stdout:4/426: rmdir d3/d6/d22 39 2024-04-27T07:33:21.375 INFO:tasks.workunit.client.0.smithi082.stdout:4/427: write d3/d9/fb [10028832,14138] 0 2024-04-27T07:33:21.379 INFO:tasks.workunit.client.0.smithi082.stdout:6/419: write d2/de/f17 [5620007,70915] 0 2024-04-27T07:33:21.380 INFO:tasks.workunit.client.0.smithi082.stdout:2/400: truncate d7/f51 3304129 0 2024-04-27T07:33:21.382 INFO:tasks.workunit.client.0.smithi082.stdout:2/401: chown d7/d14/d7f 48068630 1 2024-04-27T07:33:21.383 INFO:tasks.workunit.client.0.smithi082.stdout:9/406: dwrite d9/d2d/f59 [0,4194304] 0 2024-04-27T07:33:21.383 INFO:tasks.workunit.client.0.smithi082.stdout:5/609: getdents d8/d2e/d85/daa 0 2024-04-27T07:33:21.385 INFO:tasks.workunit.client.0.smithi082.stdout:6/420: fsync d2/d2e/f61 0 2024-04-27T07:33:21.387 INFO:tasks.workunit.client.0.smithi082.stdout:6/421: chown d2/de/d13/l4f 0 1 2024-04-27T07:33:21.388 INFO:tasks.workunit.client.0.smithi082.stdout:3/681: rename d8/d9/d1f/f63 to d8/d9/dd/ff4 0 2024-04-27T07:33:21.388 INFO:tasks.workunit.client.0.smithi082.stdout:6/422: chown d2/d2e/l73 4627 1 2024-04-27T07:33:21.390 INFO:tasks.workunit.client.0.smithi082.stdout:9/407: creat d9/da/dc/d35/d38/d65/f82 x:0 0 0 2024-04-27T07:33:21.396 INFO:tasks.workunit.client.0.smithi082.stdout:4/428: rename d3/d6/d26/d5e/f2f to d3/f91 0 2024-04-27T07:33:21.398 INFO:tasks.workunit.client.0.smithi082.stdout:9/408: fsync d9/da/dc/f20 0 2024-04-27T07:33:21.399 INFO:tasks.workunit.client.0.smithi082.stdout:2/402: dread d7/d8/f19 [0,4194304] 0 2024-04-27T07:33:21.400 INFO:tasks.workunit.client.0.smithi082.stdout:5/610: rename d8/d3b/f74 to d8/d2e/d85/fcf 0 2024-04-27T07:33:21.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/423: dwrite d2/d1e/f34 [0,4194304] 0 2024-04-27T07:33:21.402 INFO:tasks.workunit.client.0.smithi082.stdout:3/682: dwrite d8/d9/d1d/db5/fe4 [0,4194304] 0 2024-04-27T07:33:21.402 INFO:tasks.workunit.client.0.smithi082.stdout:4/429: truncate d3/d9/f68 1340980 0 2024-04-27T07:33:21.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/403: chown d7/d31/d54/l70 86501 1 2024-04-27T07:33:21.405 INFO:tasks.workunit.client.0.smithi082.stdout:6/424: write d2/d3/f27 [1433622,46938] 0 2024-04-27T07:33:21.407 INFO:tasks.workunit.client.0.smithi082.stdout:6/425: write d2/d3/d1b/f28 [3446697,113392] 0 2024-04-27T07:33:21.410 INFO:tasks.workunit.client.0.smithi082.stdout:3/683: write d8/d9/db0/fd6 [787037,79865] 0 2024-04-27T07:33:21.411 INFO:tasks.workunit.client.0.smithi082.stdout:3/684: readlink d8/d9/d25/d4e/ld9 0 2024-04-27T07:33:21.411 INFO:tasks.workunit.client.0.smithi082.stdout:9/409: mknod d9/da/dc/d35/d38/c83 0 2024-04-27T07:33:21.412 INFO:tasks.workunit.client.0.smithi082.stdout:9/410: chown f4 1173066 1 2024-04-27T07:33:21.414 INFO:tasks.workunit.client.0.smithi082.stdout:5/611: unlink d8/d14/l28 0 2024-04-27T07:33:21.416 INFO:tasks.workunit.client.0.smithi082.stdout:2/404: chown d7/d30/l48 385297 1 2024-04-27T07:33:21.421 INFO:tasks.workunit.client.0.smithi082.stdout:3/685: creat d8/d9/d1d/df1/ff5 x:0 0 0 2024-04-27T07:33:21.424 INFO:tasks.workunit.client.0.smithi082.stdout:2/405: mknod d7/d30/c89 0 2024-04-27T07:33:21.424 INFO:tasks.workunit.client.0.smithi082.stdout:4/430: getdents d3/d10 0 2024-04-27T07:33:21.425 INFO:tasks.workunit.client.0.smithi082.stdout:2/406: truncate d7/d8/d13/f60 1227645 0 2024-04-27T07:33:21.426 INFO:tasks.workunit.client.0.smithi082.stdout:9/411: rmdir d9/da/dc/d35/d38/d78 0 2024-04-27T07:33:21.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/412: write d9/da/dc/d35/d4b/f74 [546895,33487] 0 2024-04-27T07:33:21.429 INFO:tasks.workunit.client.0.smithi082.stdout:2/407: creat d7/d31/d6f/f8a x:0 0 0 2024-04-27T07:33:21.429 INFO:tasks.workunit.client.0.smithi082.stdout:4/431: dread d3/f29 [0,4194304] 0 2024-04-27T07:33:21.430 INFO:tasks.workunit.client.0.smithi082.stdout:5/612: getdents d8/d14 0 2024-04-27T07:33:21.433 INFO:tasks.workunit.client.0.smithi082.stdout:5/613: write d8/fa [383264,50042] 0 2024-04-27T07:33:21.437 INFO:tasks.workunit.client.0.smithi082.stdout:4/432: creat d3/d6/d22/d69/d85/f92 x:0 0 0 2024-04-27T07:33:21.439 INFO:tasks.workunit.client.0.smithi082.stdout:5/614: symlink d8/d15/dca/dce/ld0 0 2024-04-27T07:33:21.439 INFO:tasks.workunit.client.0.smithi082.stdout:3/686: dread d8/d9/d3f/f8c [0,4194304] 0 2024-04-27T07:33:21.440 INFO:tasks.workunit.client.0.smithi082.stdout:4/433: unlink d3/d10/c1a 0 2024-04-27T07:33:21.444 INFO:tasks.workunit.client.0.smithi082.stdout:5/615: rename d8/d3c/fa2 to d8/d14/d7b/d8b/fd1 0 2024-04-27T07:33:21.444 INFO:tasks.workunit.client.0.smithi082.stdout:2/408: dwrite d7/f5b [0,4194304] 0 2024-04-27T07:33:21.445 INFO:tasks.workunit.client.0.smithi082.stdout:5/616: readlink d8/d15/l9a 0 2024-04-27T07:33:21.447 INFO:tasks.workunit.client.0.smithi082.stdout:5/617: chown d8/d2e/d85/daa 7 1 2024-04-27T07:33:21.451 INFO:tasks.workunit.client.0.smithi082.stdout:3/687: dwrite d8/d9/dd/d13/d1b/dbd/f44 [0,4194304] 0 2024-04-27T07:33:21.452 INFO:tasks.workunit.client.0.smithi082.stdout:4/434: dwrite d3/d6/d16/f3f [4194304,4194304] 0 2024-04-27T07:33:21.453 INFO:tasks.workunit.client.0.smithi082.stdout:3/688: stat d8/f2e 0 2024-04-27T07:33:21.460 INFO:tasks.workunit.client.0.smithi082.stdout:1/480: sync 2024-04-27T07:33:21.460 INFO:tasks.workunit.client.0.smithi082.stdout:3/689: chown d8/d9/dd/d13/d1b/f93 3726364 1 2024-04-27T07:33:21.461 INFO:tasks.workunit.client.0.smithi082.stdout:5/618: dwrite d8/d42/fb3 [0,4194304] 0 2024-04-27T07:33:21.463 INFO:tasks.workunit.client.0.smithi082.stdout:2/409: dwrite d7/f51 [4194304,4194304] 0 2024-04-27T07:33:21.468 INFO:tasks.workunit.client.0.smithi082.stdout:4/435: link d3/d6/d22/l6e d3/d9/l93 0 2024-04-27T07:33:21.473 INFO:tasks.workunit.client.0.smithi082.stdout:5/619: link d8/d29/d4e/d90/c91 d8/d98/cd2 0 2024-04-27T07:33:21.475 INFO:tasks.workunit.client.0.smithi082.stdout:3/690: rename d8/d9/f70 to d8/ff6 0 2024-04-27T07:33:21.476 INFO:tasks.workunit.client.0.smithi082.stdout:1/481: write d4/d15/f2f [831310,74405] 0 2024-04-27T07:33:21.478 INFO:tasks.workunit.client.0.smithi082.stdout:4/436: creat d3/d81/f94 x:0 0 0 2024-04-27T07:33:21.480 INFO:tasks.workunit.client.0.smithi082.stdout:2/410: rename d7/d14/l4c to d7/d9/d4f/d6e/l8b 0 2024-04-27T07:33:21.480 INFO:tasks.workunit.client.0.smithi082.stdout:2/411: chown d7/f51 173689995 1 2024-04-27T07:33:21.482 INFO:tasks.workunit.client.0.smithi082.stdout:3/691: rmdir d8/d9/dd 39 2024-04-27T07:33:21.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/437: write d3/d6/d22/f24 [1206688,114683] 0 2024-04-27T07:33:21.485 INFO:tasks.workunit.client.0.smithi082.stdout:1/482: rename d4/d15/d49/da0/c5c to d4/ca6 0 2024-04-27T07:33:21.488 INFO:tasks.workunit.client.0.smithi082.stdout:2/412: dwrite d7/d30/d61/f65 [4194304,4194304] 0 2024-04-27T07:33:21.490 INFO:tasks.workunit.client.0.smithi082.stdout:1/483: dread d4/d2a/d4c/f6a [0,4194304] 0 2024-04-27T07:33:21.492 INFO:tasks.workunit.client.0.smithi082.stdout:2/413: write d7/d8/f1f [3412021,95586] 0 2024-04-27T07:33:21.495 INFO:tasks.workunit.client.0.smithi082.stdout:3/692: creat d8/d9/dd/d13/d1b/dbd/d8e/ff7 x:0 0 0 2024-04-27T07:33:21.498 INFO:tasks.workunit.client.0.smithi082.stdout:3/693: truncate d8/d9/dd/d13/d1b/dbd/d8e/ff7 47867 0 2024-04-27T07:33:21.502 INFO:tasks.workunit.client.0.smithi082.stdout:1/484: mkdir d4/d15/da7 0 2024-04-27T07:33:21.503 INFO:tasks.workunit.client.0.smithi082.stdout:4/438: dread d3/d10/f4f [0,4194304] 0 2024-04-27T07:33:21.503 INFO:tasks.workunit.client.0.smithi082.stdout:2/414: rename d7/d31/d6f/f8a to d7/d31/d6f/f8c 0 2024-04-27T07:33:21.503 INFO:tasks.workunit.client.0.smithi082.stdout:2/415: write d7/d30/f84 [312636,102785] 0 2024-04-27T07:33:21.503 INFO:tasks.workunit.client.0.smithi082.stdout:1/485: dread d4/d15/f2f [0,4194304] 0 2024-04-27T07:33:21.506 INFO:tasks.workunit.client.0.smithi082.stdout:2/416: dread d7/d14/f50 [0,4194304] 0 2024-04-27T07:33:21.507 INFO:tasks.workunit.client.0.smithi082.stdout:2/417: read - d7/d30/d61/f85 zero size 2024-04-27T07:33:21.507 INFO:tasks.workunit.client.0.smithi082.stdout:1/486: mknod d4/d15/d49/d99/d9a/ca8 0 2024-04-27T07:33:21.507 INFO:tasks.workunit.client.0.smithi082.stdout:2/418: fdatasync d7/d31/f67 0 2024-04-27T07:33:21.510 INFO:tasks.workunit.client.0.smithi082.stdout:2/419: rmdir d7/d30 39 2024-04-27T07:33:21.511 INFO:tasks.workunit.client.0.smithi082.stdout:1/487: mkdir d4/d15/d49/d99/d9a/da9 0 2024-04-27T07:33:21.512 INFO:tasks.workunit.client.0.smithi082.stdout:2/420: fsync d7/d8/f19 0 2024-04-27T07:33:21.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/694: truncate d8/d9/d25/d4e/f96 1649342 0 2024-04-27T07:33:21.519 INFO:tasks.workunit.client.0.smithi082.stdout:4/439: dread d3/d6/f19 [0,4194304] 0 2024-04-27T07:33:21.523 INFO:tasks.workunit.client.0.smithi082.stdout:4/440: getdents d3/d10 0 2024-04-27T07:33:21.525 INFO:tasks.workunit.client.0.smithi082.stdout:4/441: chown d3/d6/d26/d55/d67/f8a 36 1 2024-04-27T07:33:21.526 INFO:tasks.workunit.client.0.smithi082.stdout:2/421: dread d7/d14/f3d [0,4194304] 0 2024-04-27T07:33:21.526 INFO:tasks.workunit.client.0.smithi082.stdout:3/695: dwrite d8/d9/d1d/df1/ff5 [0,4194304] 0 2024-04-27T07:33:21.531 INFO:tasks.workunit.client.0.smithi082.stdout:3/696: creat d8/d9/dd/d13/d1b/da8/ff8 x:0 0 0 2024-04-27T07:33:21.533 INFO:tasks.workunit.client.0.smithi082.stdout:2/422: rename d7/d31/l38 to d7/d8/d13/l8d 0 2024-04-27T07:33:21.535 INFO:tasks.workunit.client.0.smithi082.stdout:3/697: mkdir d8/d9/db0/df9 0 2024-04-27T07:33:21.536 INFO:tasks.workunit.client.0.smithi082.stdout:2/423: creat d7/d9/d4f/d66/f8e x:0 0 0 2024-04-27T07:33:21.537 INFO:tasks.workunit.client.0.smithi082.stdout:2/424: chown d7/d31/d6f 290104 1 2024-04-27T07:33:21.539 INFO:tasks.workunit.client.0.smithi082.stdout:4/442: dwrite d3/d9/f6a [4194304,4194304] 0 2024-04-27T07:33:21.539 INFO:tasks.workunit.client.0.smithi082.stdout:3/698: mknod d8/d9/dd/d13/d1b/da8/cfa 0 2024-04-27T07:33:21.541 INFO:tasks.workunit.client.0.smithi082.stdout:4/443: readlink d3/d6/d22/l6e 0 2024-04-27T07:33:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/425: getdents d7/d30 0 2024-04-27T07:33:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:2/426: write d7/d8/f19 [368357,130594] 0 2024-04-27T07:33:21.548 INFO:tasks.workunit.client.0.smithi082.stdout:3/699: dwrite d8/d9/dd/fd7 [0,4194304] 0 2024-04-27T07:33:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:2/427: dread - d7/d31/d6f/f79 zero size 2024-04-27T07:33:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:4/444: rmdir d3/d6/d22/d69/d85/d8c 0 2024-04-27T07:33:21.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/445: rename d3/d6/d26/l5a to d3/d6/d22/d69/l95 0 2024-04-27T07:33:21.560 INFO:tasks.workunit.client.0.smithi082.stdout:4/446: unlink d3/c64 0 2024-04-27T07:33:21.561 INFO:tasks.workunit.client.0.smithi082.stdout:4/447: creat d3/d6/d22/d69/f96 x:0 0 0 2024-04-27T07:33:21.564 INFO:tasks.workunit.client.0.smithi082.stdout:4/448: creat d3/d6/d26/d5e/f97 x:0 0 0 2024-04-27T07:33:21.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/449: mkdir d3/d6/d16/d98 0 2024-04-27T07:33:21.573 INFO:tasks.workunit.client.0.smithi082.stdout:4/450: rename d3/d6/d22/d69/l95 to d3/d6/d22/d69/l99 0 2024-04-27T07:33:21.574 INFO:tasks.workunit.client.0.smithi082.stdout:3/700: dread d8/d9/d1d/f90 [0,4194304] 0 2024-04-27T07:33:21.574 INFO:tasks.workunit.client.0.smithi082.stdout:2/428: dread d7/f28 [0,4194304] 0 2024-04-27T07:33:21.575 INFO:tasks.workunit.client.0.smithi082.stdout:2/429: chown d7/d8/d13 2881683 1 2024-04-27T07:33:21.576 INFO:tasks.workunit.client.0.smithi082.stdout:3/701: write d8/d9/dd/d13/fa7 [3496612,79307] 0 2024-04-27T07:33:21.579 INFO:tasks.workunit.client.0.smithi082.stdout:3/702: write d8/d9/d25/d26/d3d/fb2 [219239,26380] 0 2024-04-27T07:33:21.583 INFO:tasks.workunit.client.0.smithi082.stdout:4/451: dwrite d3/d6/f89 [0,4194304] 0 2024-04-27T07:33:21.584 INFO:tasks.workunit.client.0.smithi082.stdout:3/703: symlink d8/d9/dd/d13/dc0/lfb 0 2024-04-27T07:33:21.584 INFO:tasks.workunit.client.0.smithi082.stdout:2/430: dwrite d7/d8/f19 [0,4194304] 0 2024-04-27T07:33:21.586 INFO:tasks.workunit.client.0.smithi082.stdout:3/704: read - d8/d9/d1f/fca zero size 2024-04-27T07:33:21.594 INFO:tasks.workunit.client.0.smithi082.stdout:3/705: mkdir d8/d9/d25/d26/d4d/d82/d8b/dfc 0 2024-04-27T07:33:21.596 INFO:tasks.workunit.client.0.smithi082.stdout:3/706: write d8/d9/dd/f1a [5043781,63986] 0 2024-04-27T07:33:21.599 INFO:tasks.workunit.client.0.smithi082.stdout:2/431: dwrite d7/d9/d4f/f5a [0,4194304] 0 2024-04-27T07:33:21.602 INFO:tasks.workunit.client.0.smithi082.stdout:2/432: mknod d7/d9/d4f/d66/c8f 0 2024-04-27T07:33:21.603 INFO:tasks.workunit.client.0.smithi082.stdout:3/707: creat d8/d9/ffd x:0 0 0 2024-04-27T07:33:21.604 INFO:tasks.workunit.client.0.smithi082.stdout:2/433: mknod d7/d9/c90 0 2024-04-27T07:33:21.605 INFO:tasks.workunit.client.0.smithi082.stdout:2/434: read d7/f28 [5480,60894] 0 2024-04-27T07:33:21.606 INFO:tasks.workunit.client.0.smithi082.stdout:2/435: fsync d7/d8/f19 0 2024-04-27T07:33:21.609 INFO:tasks.workunit.client.0.smithi082.stdout:2/436: rmdir d7/d30 39 2024-04-27T07:33:21.610 INFO:tasks.workunit.client.0.smithi082.stdout:2/437: write d7/d9/d4f/f5a [160241,102120] 0 2024-04-27T07:33:21.613 INFO:tasks.workunit.client.0.smithi082.stdout:2/438: dread d7/f28 [0,4194304] 0 2024-04-27T07:33:21.613 INFO:tasks.workunit.client.0.smithi082.stdout:7/445: sync 2024-04-27T07:33:21.616 INFO:tasks.workunit.client.0.smithi082.stdout:4/452: dread d3/d9/f45 [0,4194304] 0 2024-04-27T07:33:21.616 INFO:tasks.workunit.client.0.smithi082.stdout:2/439: truncate d7/d9/d4f/f80 530100 0 2024-04-27T07:33:21.618 INFO:tasks.workunit.client.0.smithi082.stdout:2/440: chown d7/l7d 0 1 2024-04-27T07:33:21.618 INFO:tasks.workunit.client.0.smithi082.stdout:2/441: write d7/f28 [3851284,78900] 0 2024-04-27T07:33:21.619 INFO:tasks.workunit.client.0.smithi082.stdout:7/446: creat d3/de/d3a/f92 x:0 0 0 2024-04-27T07:33:21.620 INFO:tasks.workunit.client.0.smithi082.stdout:4/453: stat d3/d6/c42 0 2024-04-27T07:33:21.622 INFO:tasks.workunit.client.0.smithi082.stdout:7/447: chown d3/d9/c41 3658550 1 2024-04-27T07:33:21.623 INFO:tasks.workunit.client.0.smithi082.stdout:4/454: creat d3/d6/d22/f9a x:0 0 0 2024-04-27T07:33:21.624 INFO:tasks.workunit.client.0.smithi082.stdout:2/442: creat d7/d30/d23/f91 x:0 0 0 2024-04-27T07:33:21.626 INFO:tasks.workunit.client.0.smithi082.stdout:2/443: fdatasync d7/d8/f88 0 2024-04-27T07:33:21.628 INFO:tasks.workunit.client.0.smithi082.stdout:2/444: write d7/d30/d61/f85 [689327,19987] 0 2024-04-27T07:33:21.629 INFO:tasks.workunit.client.0.smithi082.stdout:7/448: dwrite d3/d49/f51 [0,4194304] 0 2024-04-27T07:33:21.631 INFO:tasks.workunit.client.0.smithi082.stdout:4/455: rmdir d3/d6/d22/d8f 0 2024-04-27T07:33:21.633 INFO:tasks.workunit.client.0.smithi082.stdout:2/445: chown d7/d9/d4f/d6e/l83 4 1 2024-04-27T07:33:21.635 INFO:tasks.workunit.client.0.smithi082.stdout:7/449: rmdir d3/de/d3a/d71 39 2024-04-27T07:33:21.638 INFO:tasks.workunit.client.0.smithi082.stdout:2/446: creat d7/d31/d54/f92 x:0 0 0 2024-04-27T07:33:21.642 INFO:tasks.workunit.client.0.smithi082.stdout:4/456: dwrite d3/d9/f7d [0,4194304] 0 2024-04-27T07:33:21.646 INFO:tasks.workunit.client.0.smithi082.stdout:2/447: mkdir d7/d9/d4f/d6e/d93 0 2024-04-27T07:33:21.649 INFO:tasks.workunit.client.0.smithi082.stdout:2/448: readlink d7/d31/l64 0 2024-04-27T07:33:21.651 INFO:tasks.workunit.client.0.smithi082.stdout:3/708: dwrite d8/d9/d25/d4e/f7c [0,4194304] 0 2024-04-27T07:33:21.652 INFO:tasks.workunit.client.0.smithi082.stdout:4/457: creat d3/d6/d26/d5e/d21/f9b x:0 0 0 2024-04-27T07:33:21.653 INFO:tasks.workunit.client.0.smithi082.stdout:7/450: dwrite d3/db/f18 [0,4194304] 0 2024-04-27T07:33:21.655 INFO:tasks.workunit.client.0.smithi082.stdout:2/449: write d7/d14/f50 [459146,70381] 0 2024-04-27T07:33:21.658 INFO:tasks.workunit.client.0.smithi082.stdout:2/450: mkdir d7/d8/d13/d94 0 2024-04-27T07:33:21.660 INFO:tasks.workunit.client.0.smithi082.stdout:7/451: rename d3/de/f3d to d3/de/d7d/f93 0 2024-04-27T07:33:21.664 INFO:tasks.workunit.client.0.smithi082.stdout:2/451: symlink d7/d9/d4f/l95 0 2024-04-27T07:33:21.668 INFO:tasks.workunit.client.0.smithi082.stdout:2/452: dread d7/d31/f34 [0,4194304] 0 2024-04-27T07:33:21.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/458: getdents d3/d6/d26/d55 0 2024-04-27T07:33:21.668 INFO:tasks.workunit.client.0.smithi082.stdout:7/452: link d3/de/d3a/l24 d3/de/d6c/l94 0 2024-04-27T07:33:21.669 INFO:tasks.workunit.client.0.smithi082.stdout:7/453: read d3/de/d6c/f7f [1029975,16379] 0 2024-04-27T07:33:21.670 INFO:tasks.workunit.client.0.smithi082.stdout:7/454: chown d3/de/d3a/d2a/l50 7090419 1 2024-04-27T07:33:21.670 INFO:tasks.workunit.client.0.smithi082.stdout:2/453: creat d7/d31/d54/f96 x:0 0 0 2024-04-27T07:33:21.671 INFO:tasks.workunit.client.0.smithi082.stdout:4/459: mkdir d3/d10/d9c 0 2024-04-27T07:33:21.672 INFO:tasks.workunit.client.0.smithi082.stdout:2/454: dread - d7/d31/d54/f96 zero size 2024-04-27T07:33:21.673 INFO:tasks.workunit.client.0.smithi082.stdout:7/455: creat d3/de/d3a/d2a/f95 x:0 0 0 2024-04-27T07:33:21.676 INFO:tasks.workunit.client.0.smithi082.stdout:2/455: rename d7/d31/f34 to d7/d9/d4f/d6e/d93/f97 0 2024-04-27T07:33:21.678 INFO:tasks.workunit.client.0.smithi082.stdout:7/456: symlink d3/l96 0 2024-04-27T07:33:21.679 INFO:tasks.workunit.client.0.smithi082.stdout:4/460: dwrite d3/d9/f65 [0,4194304] 0 2024-04-27T07:33:21.682 INFO:tasks.workunit.client.0.smithi082.stdout:7/457: fsync d3/de/d3a/d71/f7a 0 2024-04-27T07:33:21.683 INFO:tasks.workunit.client.0.smithi082.stdout:7/458: dread - d3/de/d3a/f92 zero size 2024-04-27T07:33:21.687 INFO:tasks.workunit.client.0.smithi082.stdout:4/461: mkdir d3/d6/d26/d55/d67/d9d 0 2024-04-27T07:33:21.689 INFO:tasks.workunit.client.0.smithi082.stdout:3/709: dread d8/d9/dd/f5a [0,4194304] 0 2024-04-27T07:33:21.691 INFO:tasks.workunit.client.0.smithi082.stdout:4/462: rmdir d3/d6/d26/d5e/d21 39 2024-04-27T07:33:21.691 INFO:tasks.workunit.client.0.smithi082.stdout:2/456: dread f3 [0,4194304] 0 2024-04-27T07:33:21.694 INFO:tasks.workunit.client.0.smithi082.stdout:3/710: mkdir d8/d9/d25/d26/d4d/d82/d8b/dfe 0 2024-04-27T07:33:21.699 INFO:tasks.workunit.client.0.smithi082.stdout:4/463: unlink d3/d6/l57 0 2024-04-27T07:33:21.701 INFO:tasks.workunit.client.0.smithi082.stdout:2/457: dwrite d7/d31/f67 [0,4194304] 0 2024-04-27T07:33:21.702 INFO:tasks.workunit.client.0.smithi082.stdout:3/711: symlink d8/d9/d25/d91/lff 0 2024-04-27T07:33:21.702 INFO:tasks.workunit.client.0.smithi082.stdout:4/464: dread d3/f29 [0,4194304] 0 2024-04-27T07:33:21.706 INFO:tasks.workunit.client.0.smithi082.stdout:3/712: stat d8/d9/dd/d13/d1b/dbd/c6a 0 2024-04-27T07:33:21.706 INFO:tasks.workunit.client.0.smithi082.stdout:2/458: truncate d7/d8/d13/f4b 779518 0 2024-04-27T07:33:21.707 INFO:tasks.workunit.client.0.smithi082.stdout:4/465: creat d3/d6/d26/f9e x:0 0 0 2024-04-27T07:33:21.708 INFO:tasks.workunit.client.0.smithi082.stdout:2/459: chown d7/d30/d23/l6b 1520420 1 2024-04-27T07:33:21.712 INFO:tasks.workunit.client.0.smithi082.stdout:2/460: rmdir d7/d9/d4f/d6e 39 2024-04-27T07:33:21.713 INFO:tasks.workunit.client.0.smithi082.stdout:4/466: mkdir d3/d10/d9c/d9f 0 2024-04-27T07:33:21.716 INFO:tasks.workunit.client.0.smithi082.stdout:3/713: dwrite d8/d9/dd/d13/d1b/dbd/f7f [0,4194304] 0 2024-04-27T07:33:21.719 INFO:tasks.workunit.client.0.smithi082.stdout:3/714: rmdir d8/d9/d25/d26/d3d/dad 39 2024-04-27T07:33:21.722 INFO:tasks.workunit.client.0.smithi082.stdout:4/467: getdents d3/d9 0 2024-04-27T07:33:21.722 INFO:tasks.workunit.client.0.smithi082.stdout:4/468: chown d3/d81 110 1 2024-04-27T07:33:21.722 INFO:tasks.workunit.client.0.smithi082.stdout:3/715: mknod d8/d9/d25/d26/d4d/d82/c100 0 2024-04-27T07:33:21.723 INFO:tasks.workunit.client.0.smithi082.stdout:4/469: write d3/d6/f89 [5165877,50805] 0 2024-04-27T07:33:21.728 INFO:tasks.workunit.client.0.smithi082.stdout:2/461: truncate d7/d14/f3d 1314722 0 2024-04-27T07:33:21.730 INFO:tasks.workunit.client.0.smithi082.stdout:3/716: dwrite d8/d9/dd/d13/fbf [0,4194304] 0 2024-04-27T07:33:21.731 INFO:tasks.workunit.client.0.smithi082.stdout:3/717: write d8/d9/dd/d13/f4b [5177988,12164] 0 2024-04-27T07:33:21.733 INFO:tasks.workunit.client.0.smithi082.stdout:3/718: stat d8/d9/dd/d13/d1b/c81 0 2024-04-27T07:33:21.738 INFO:tasks.workunit.client.0.smithi082.stdout:3/719: mkdir d8/d9/d25/d26/d4d/d82/dce/d101 0 2024-04-27T07:33:21.739 INFO:tasks.workunit.client.0.smithi082.stdout:2/462: rmdir d7/d14/d7f 0 2024-04-27T07:33:21.741 INFO:tasks.workunit.client.0.smithi082.stdout:3/720: creat d8/d9/d1d/da5/db3/f102 x:0 0 0 2024-04-27T07:33:21.743 INFO:tasks.workunit.client.0.smithi082.stdout:4/470: dwrite d3/d10/f3d [0,4194304] 0 2024-04-27T07:33:21.743 INFO:tasks.workunit.client.0.smithi082.stdout:2/463: creat d7/d9/d4f/d6e/d93/f98 x:0 0 0 2024-04-27T07:33:21.746 INFO:tasks.workunit.client.0.smithi082.stdout:4/471: chown d3/d10/c54 6261318 1 2024-04-27T07:33:21.747 INFO:tasks.workunit.client.0.smithi082.stdout:2/464: mkdir d7/d8/d99 0 2024-04-27T07:33:21.748 INFO:tasks.workunit.client.0.smithi082.stdout:4/472: write d3/d10/f3d [2836106,120124] 0 2024-04-27T07:33:21.750 INFO:tasks.workunit.client.0.smithi082.stdout:2/465: write d7/d31/d54/f6d [4374046,57832] 0 2024-04-27T07:33:21.751 INFO:tasks.workunit.client.0.smithi082.stdout:4/473: write d3/d6/d22/d69/f96 [57577,60332] 0 2024-04-27T07:33:21.752 INFO:tasks.workunit.client.0.smithi082.stdout:2/466: dread - d7/d8/f74 zero size 2024-04-27T07:33:21.753 INFO:tasks.workunit.client.0.smithi082.stdout:2/467: creat d7/d14/f9a x:0 0 0 2024-04-27T07:33:21.757 INFO:tasks.workunit.client.0.smithi082.stdout:2/468: mknod d7/d9/d4f/d66/c9b 0 2024-04-27T07:33:21.759 INFO:tasks.workunit.client.0.smithi082.stdout:2/469: write d7/d14/f50 [1059420,115297] 0 2024-04-27T07:33:21.762 INFO:tasks.workunit.client.0.smithi082.stdout:4/474: dwrite d3/d6/d26/d5e/f97 [0,4194304] 0 2024-04-27T07:33:21.763 INFO:tasks.workunit.client.0.smithi082.stdout:2/470: unlink d7/d30/d23/l2c 0 2024-04-27T07:33:21.765 INFO:tasks.workunit.client.0.smithi082.stdout:2/471: write d7/d30/f84 [108053,33915] 0 2024-04-27T07:33:21.769 INFO:tasks.workunit.client.0.smithi082.stdout:4/475: rename d3/d9/f44 to d3/d6/d16/d98/fa0 0 2024-04-27T07:33:21.770 INFO:tasks.workunit.client.0.smithi082.stdout:2/472: mknod d7/d8/d13/c9c 0 2024-04-27T07:33:21.770 INFO:tasks.workunit.client.0.smithi082.stdout:4/476: symlink d3/d6/d16/la1 0 2024-04-27T07:33:21.772 INFO:tasks.workunit.client.0.smithi082.stdout:4/477: mknod d3/d10/d9c/ca2 0 2024-04-27T07:33:21.781 INFO:tasks.workunit.client.0.smithi082.stdout:4/478: unlink d3/d9/l93 0 2024-04-27T07:33:21.782 INFO:tasks.workunit.client.0.smithi082.stdout:4/479: symlink d3/d81/la3 0 2024-04-27T07:33:21.784 INFO:tasks.workunit.client.0.smithi082.stdout:4/480: mknod d3/d6/d22/d69/ca4 0 2024-04-27T07:33:21.784 INFO:tasks.workunit.client.0.smithi082.stdout:4/481: read d3/d6/f19 [3265977,90904] 0 2024-04-27T07:33:21.786 INFO:tasks.workunit.client.0.smithi082.stdout:4/482: dread - d3/d6/d26/d55/d67/f8a zero size 2024-04-27T07:33:21.788 INFO:tasks.workunit.client.0.smithi082.stdout:4/483: unlink d3/d6/f19 0 2024-04-27T07:33:21.788 INFO:tasks.workunit.client.0.smithi082.stdout:4/484: chown d3/d6/d16/d98/fa0 17075778 1 2024-04-27T07:33:21.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/485: rmdir d3/d9 39 2024-04-27T07:33:21.792 INFO:tasks.workunit.client.0.smithi082.stdout:4/486: write d3/d9/f6a [7506408,15088] 0 2024-04-27T07:33:21.792 INFO:tasks.workunit.client.0.smithi082.stdout:4/487: chown d3/d6/d16/d98 0 1 2024-04-27T07:33:21.795 INFO:tasks.workunit.client.0.smithi082.stdout:4/488: rename d3/d81/f94 to d3/fa5 0 2024-04-27T07:33:21.796 INFO:tasks.workunit.client.0.smithi082.stdout:4/489: read d3/f29 [291078,86244] 0 2024-04-27T07:33:21.796 INFO:tasks.workunit.client.0.smithi082.stdout:4/490: readlink d3/d81/la3 0 2024-04-27T07:33:21.797 INFO:tasks.workunit.client.0.smithi082.stdout:4/491: chown d3/d6/d16/f7c 1 1 2024-04-27T07:33:21.807 INFO:tasks.workunit.client.0.smithi082.stdout:4/492: dread d3/d6/d26/f33 [0,4194304] 0 2024-04-27T07:33:21.809 INFO:tasks.workunit.client.0.smithi082.stdout:4/493: write d3/d9/f65 [1607575,124496] 0 2024-04-27T07:33:21.810 INFO:tasks.workunit.client.0.smithi082.stdout:4/494: write d3/d6/d22/f59 [826739,113848] 0 2024-04-27T07:33:21.816 INFO:tasks.workunit.client.0.smithi082.stdout:8/342: sync 2024-04-27T07:33:21.819 INFO:tasks.workunit.client.0.smithi082.stdout:8/343: creat d0/d3/d1b/d29/d6a/f6b x:0 0 0 2024-04-27T07:33:21.820 INFO:tasks.workunit.client.0.smithi082.stdout:8/344: write d0/d2b/f68 [1002993,112984] 0 2024-04-27T07:33:21.834 INFO:tasks.workunit.client.0.smithi082.stdout:4/495: dread d3/d6/d26/f36 [0,4194304] 0 2024-04-27T07:33:21.834 INFO:tasks.workunit.client.0.smithi082.stdout:8/345: dread d0/d3/d1c/f2a [0,4194304] 0 2024-04-27T07:33:21.835 INFO:tasks.workunit.client.0.smithi082.stdout:8/346: chown d0/d2b/f38 228243 1 2024-04-27T07:33:21.837 INFO:tasks.workunit.client.0.smithi082.stdout:4/496: chown d3/d6/d26/d5e/d21/l4a 1513225 1 2024-04-27T07:33:21.838 INFO:tasks.workunit.client.0.smithi082.stdout:8/347: unlink d0/d3/d1c/d60/d42/l5c 0 2024-04-27T07:33:21.839 INFO:tasks.workunit.client.0.smithi082.stdout:4/497: chown d3/d9/f68 2084562 1 2024-04-27T07:33:21.839 INFO:tasks.workunit.client.0.smithi082.stdout:8/348: write d0/d2b/f68 [926841,4380] 0 2024-04-27T07:33:21.841 INFO:tasks.workunit.client.0.smithi082.stdout:8/349: read - d0/d3/d1c/d32/f67 zero size 2024-04-27T07:33:21.841 INFO:tasks.workunit.client.0.smithi082.stdout:4/498: fdatasync d3/d6/d26/f36 0 2024-04-27T07:33:21.842 INFO:tasks.workunit.client.0.smithi082.stdout:8/350: fdatasync d0/d3/d1b/f3c 0 2024-04-27T07:33:21.846 INFO:tasks.workunit.client.0.smithi082.stdout:8/351: dread d0/d2b/f68 [0,4194304] 0 2024-04-27T07:33:21.847 INFO:tasks.workunit.client.0.smithi082.stdout:4/499: rename d3/d6/d26/l8d to d3/d10/la6 0 2024-04-27T07:33:21.849 INFO:tasks.workunit.client.0.smithi082.stdout:8/352: unlink d0/d3/d1b/f47 0 2024-04-27T07:33:21.850 INFO:tasks.workunit.client.0.smithi082.stdout:4/500: chown d3/d6/d16/c73 3897 1 2024-04-27T07:33:21.854 INFO:tasks.workunit.client.0.smithi082.stdout:4/501: symlink d3/d6/la7 0 2024-04-27T07:33:21.854 INFO:tasks.workunit.client.0.smithi082.stdout:4/502: chown d3/d6/d22/d69 5 1 2024-04-27T07:33:21.861 INFO:tasks.workunit.client.0.smithi082.stdout:4/503: link d3/d6/f58 d3/d6/d26/d5e/fa8 0 2024-04-27T07:33:21.861 INFO:tasks.workunit.client.0.smithi082.stdout:8/353: rmdir d0 39 2024-04-27T07:33:21.861 INFO:tasks.workunit.client.0.smithi082.stdout:4/504: write d3/f43 [112326,36335] 0 2024-04-27T07:33:21.862 INFO:tasks.workunit.client.0.smithi082.stdout:4/505: chown f2 803 1 2024-04-27T07:33:21.864 INFO:tasks.workunit.client.0.smithi082.stdout:8/354: symlink d0/d3/d1b/l6c 0 2024-04-27T07:33:21.865 INFO:tasks.workunit.client.0.smithi082.stdout:4/506: creat d3/d6/d26/d55/fa9 x:0 0 0 2024-04-27T07:33:21.866 INFO:tasks.workunit.client.0.smithi082.stdout:8/355: mkdir d0/d3/d55/d6d 0 2024-04-27T07:33:21.866 INFO:tasks.workunit.client.0.smithi082.stdout:4/507: readlink d3/d6/d16/l2e 0 2024-04-27T07:33:21.867 INFO:tasks.workunit.client.0.smithi082.stdout:8/356: readlink d0/d3/d1c/d60/l2d 0 2024-04-27T07:33:21.869 INFO:tasks.workunit.client.0.smithi082.stdout:8/357: unlink d0/d3/d55/l63 0 2024-04-27T07:33:21.873 INFO:tasks.workunit.client.0.smithi082.stdout:8/358: dread d0/d2b/f38 [0,4194304] 0 2024-04-27T07:33:21.874 INFO:tasks.workunit.client.0.smithi082.stdout:8/359: write d0/d3/d1c/d32/d35/f49 [726132,25313] 0 2024-04-27T07:33:21.875 INFO:tasks.workunit.client.0.smithi082.stdout:8/360: dread - d0/d3/d1c/d60/f3e zero size 2024-04-27T07:33:21.877 INFO:tasks.workunit.client.0.smithi082.stdout:8/361: fdatasync d0/d3/f1a 0 2024-04-27T07:33:21.878 INFO:tasks.workunit.client.0.smithi082.stdout:8/362: chown d0/d3/f18 2201 1 2024-04-27T07:33:21.883 INFO:tasks.workunit.client.0.smithi082.stdout:8/363: getdents d0/d3/d1b 0 2024-04-27T07:33:21.884 INFO:tasks.workunit.client.0.smithi082.stdout:8/364: rmdir d0 39 2024-04-27T07:33:21.890 INFO:tasks.workunit.client.0.smithi082.stdout:8/365: write d0/d3/d55/f61 [969325,94565] 0 2024-04-27T07:33:21.890 INFO:tasks.workunit.client.0.smithi082.stdout:8/366: unlink d0/d3/d1c/f2a 0 2024-04-27T07:33:21.891 INFO:tasks.workunit.client.0.smithi082.stdout:8/367: symlink d0/d2b/l6e 0 2024-04-27T07:33:21.896 INFO:tasks.workunit.client.0.smithi082.stdout:8/368: dwrite d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:21.897 INFO:tasks.workunit.client.0.smithi082.stdout:8/369: chown d0/d3/d1b/d29/d65 712 1 2024-04-27T07:33:21.898 INFO:tasks.workunit.client.0.smithi082.stdout:8/370: read d0/d3/d1b/f3c [2962671,109853] 0 2024-04-27T07:33:21.899 INFO:tasks.workunit.client.0.smithi082.stdout:8/371: write d0/d3/d55/f61 [1756681,75697] 0 2024-04-27T07:33:21.901 INFO:tasks.workunit.client.0.smithi082.stdout:8/372: mkdir d0/d2b/d6f 0 2024-04-27T07:33:21.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:21 smithi100 ceph-mon[34183]: pgmap v17: 65 pgs: 65 active+clean; 997 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 114 MiB/s wr, 435 op/s 2024-04-27T07:33:21.917 INFO:tasks.workunit.client.0.smithi082.stdout:8/373: dread d0/d3/d1b/f2e [0,4194304] 0 2024-04-27T07:33:21.920 INFO:tasks.workunit.client.0.smithi082.stdout:8/374: creat d0/d2b/d6f/f70 x:0 0 0 2024-04-27T07:33:21.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/375: dwrite d0/d3/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:21.931 INFO:tasks.workunit.client.0.smithi082.stdout:8/376: write d0/d3/d1c/d32/f41 [59525,28086] 0 2024-04-27T07:33:21.937 INFO:tasks.workunit.client.0.smithi082.stdout:8/377: rename d0/d3/d1c/d60/d46/d56 to d0/d3/d1c/d60/d71 0 2024-04-27T07:33:21.953 INFO:tasks.workunit.client.0.smithi082.stdout:8/378: dread d0/d3/f1d [4194304,4194304] 0 2024-04-27T07:33:21.955 INFO:tasks.workunit.client.0.smithi082.stdout:8/379: mknod d0/d3/d1b/d53/c72 0 2024-04-27T07:33:21.956 INFO:tasks.workunit.client.0.smithi082.stdout:8/380: readlink d0/l11 0 2024-04-27T07:33:21.957 INFO:tasks.workunit.client.0.smithi082.stdout:8/381: creat d0/d3/d1b/d53/f73 x:0 0 0 2024-04-27T07:33:21.959 INFO:tasks.workunit.client.0.smithi082.stdout:8/382: mknod d0/d3/d1c/d32/c74 0 2024-04-27T07:33:21.959 INFO:tasks.workunit.client.0.smithi082.stdout:8/383: fdatasync d0/f43 0 2024-04-27T07:33:21.964 INFO:tasks.workunit.client.0.smithi082.stdout:8/384: dread d0/d3/d1b/f1e [0,4194304] 0 2024-04-27T07:33:21.967 INFO:tasks.workunit.client.0.smithi082.stdout:8/385: rename d0/f43 to d0/d3/d1c/d32/d35/f75 0 2024-04-27T07:33:21.972 INFO:tasks.workunit.client.0.smithi082.stdout:8/386: dwrite d0/d2b/d6f/f70 [0,4194304] 0 2024-04-27T07:33:21.979 INFO:tasks.workunit.client.0.smithi082.stdout:8/387: dread d0/d3/d1c/d32/d35/f75 [0,4194304] 0 2024-04-27T07:33:21.980 INFO:tasks.workunit.client.0.smithi082.stdout:8/388: fdatasync d0/d3/d1c/d60/f28 0 2024-04-27T07:33:21.982 INFO:tasks.workunit.client.0.smithi082.stdout:8/389: mkdir d0/d3/d1c/d76 0 2024-04-27T07:33:21.984 INFO:tasks.workunit.client.0.smithi082.stdout:8/390: symlink d0/d3/d1b/d29/d65/l77 0 2024-04-27T07:33:21.987 INFO:tasks.workunit.client.0.smithi082.stdout:8/391: unlink d0/d2b/f38 0 2024-04-27T07:33:21.990 INFO:tasks.workunit.client.0.smithi082.stdout:8/392: link d0/d3/d1c/d60/f3e d0/d2b/d6f/f78 0 2024-04-27T07:33:22.004 INFO:tasks.workunit.client.0.smithi082.stdout:8/393: dread d0/d3/f18 [0,4194304] 0 2024-04-27T07:33:22.009 INFO:tasks.workunit.client.0.smithi082.stdout:8/394: write d0/d3/d1c/d60/f54 [2481854,29590] 0 2024-04-27T07:33:22.010 INFO:tasks.workunit.client.0.smithi082.stdout:8/395: creat d0/d2b/d6f/f79 x:0 0 0 2024-04-27T07:33:22.015 INFO:tasks.workunit.client.0.smithi082.stdout:8/396: creat d0/d3/d1c/d76/f7a x:0 0 0 2024-04-27T07:33:22.015 INFO:tasks.workunit.client.0.smithi082.stdout:8/397: stat d0/d3/d1c/d60/f54 0 2024-04-27T07:33:22.016 INFO:tasks.workunit.client.0.smithi082.stdout:8/398: rmdir d0/d3/d1c/d60/d46 39 2024-04-27T07:33:22.018 INFO:tasks.workunit.client.0.smithi082.stdout:8/399: creat d0/d3/d1b/d53/f7b x:0 0 0 2024-04-27T07:33:22.019 INFO:tasks.workunit.client.0.smithi082.stdout:8/400: write d0/d3/d1c/d32/f67 [607911,3002] 0 2024-04-27T07:33:22.022 INFO:tasks.workunit.client.0.smithi082.stdout:8/401: rename d0/d3/d1c/d60/f54 to d0/d3/d1b/d29/d65/f7c 0 2024-04-27T07:33:22.024 INFO:tasks.workunit.client.0.smithi082.stdout:8/402: creat d0/d3/d1c/f7d x:0 0 0 2024-04-27T07:33:22.025 INFO:tasks.workunit.client.0.smithi082.stdout:8/403: fsync d0/d3/d1b/f1e 0 2024-04-27T07:33:22.027 INFO:tasks.workunit.client.0.smithi082.stdout:8/404: rename d0/l11 to d0/d3/d1c/d60/d42/l7e 0 2024-04-27T07:33:22.028 INFO:tasks.workunit.client.0.smithi082.stdout:8/405: fdatasync d0/d3/d1c/f7d 0 2024-04-27T07:33:22.029 INFO:tasks.workunit.client.0.smithi082.stdout:8/406: dread d0/d3/f1a [0,4194304] 0 2024-04-27T07:33:22.040 INFO:tasks.workunit.client.0.smithi082.stdout:8/407: dread d0/d3/d1c/d32/f34 [0,4194304] 0 2024-04-27T07:33:22.041 INFO:tasks.workunit.client.0.smithi082.stdout:8/408: write d0/d3/f9 [4403481,43859] 0 2024-04-27T07:33:22.043 INFO:tasks.workunit.client.0.smithi082.stdout:8/409: fdatasync d0/d2b/d6f/f78 0 2024-04-27T07:33:22.044 INFO:tasks.workunit.client.0.smithi082.stdout:8/410: stat d0/d3/d1b/d53/f7b 0 2024-04-27T07:33:22.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/411: dread d0/d3/d1c/d32/d35/f45 [0,4194304] 0 2024-04-27T07:33:22.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/412: read - d0/d3/d1b/d53/f7b zero size 2024-04-27T07:33:22.061 INFO:tasks.workunit.client.0.smithi082.stdout:8/413: mkdir d0/d3/d1c/d60/d42/d7f 0 2024-04-27T07:33:22.063 INFO:tasks.workunit.client.0.smithi082.stdout:8/414: mkdir d0/d2b/d80 0 2024-04-27T07:33:22.065 INFO:tasks.workunit.client.0.smithi082.stdout:8/415: creat d0/d2b/f81 x:0 0 0 2024-04-27T07:33:22.070 INFO:tasks.workunit.client.0.smithi082.stdout:8/416: dwrite d0/d3/d1c/d32/f41 [0,4194304] 0 2024-04-27T07:33:22.074 INFO:tasks.workunit.client.0.smithi082.stdout:8/417: getdents d0/d3 0 2024-04-27T07:33:22.076 INFO:tasks.workunit.client.0.smithi082.stdout:8/418: mkdir d0/d3/d1c/d60/d42/d7f/d82 0 2024-04-27T07:33:22.078 INFO:tasks.workunit.client.0.smithi082.stdout:8/419: mkdir d0/d83 0 2024-04-27T07:33:22.079 INFO:tasks.workunit.client.0.smithi082.stdout:8/420: mknod d0/d2b/d80/c84 0 2024-04-27T07:33:22.080 INFO:tasks.workunit.client.0.smithi082.stdout:8/421: chown d0/d3/d1b/f2e 7621374 1 2024-04-27T07:33:22.082 INFO:tasks.workunit.client.0.smithi082.stdout:8/422: dread d0/d3/d1c/d32/f67 [0,4194304] 0 2024-04-27T07:33:22.089 INFO:tasks.workunit.client.0.smithi082.stdout:8/423: truncate d0/d2b/d6f/f70 1109018 0 2024-04-27T07:33:22.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:21 smithi082 ceph-mon[26613]: pgmap v17: 65 pgs: 65 active+clean; 997 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 22 MiB/s rd, 114 MiB/s wr, 435 op/s 2024-04-27T07:33:22.094 INFO:tasks.workunit.client.0.smithi082.stdout:8/424: truncate d0/d3/f1d 2160465 0 2024-04-27T07:33:22.098 INFO:tasks.workunit.client.0.smithi082.stdout:8/425: dread d0/d3/d1c/d60/d42/f5b [0,4194304] 0 2024-04-27T07:33:22.099 INFO:tasks.workunit.client.0.smithi082.stdout:8/426: write d0/d3/d1b/f1e [1944598,74477] 0 2024-04-27T07:33:22.105 INFO:tasks.workunit.client.0.smithi082.stdout:8/427: dwrite d0/d3/d1b/d29/d6a/f6b [0,4194304] 0 2024-04-27T07:33:22.109 INFO:tasks.workunit.client.0.smithi082.stdout:8/428: rename d0/d3/d1b/d53/f7b to d0/d3/d1c/f85 0 2024-04-27T07:33:22.111 INFO:tasks.workunit.client.0.smithi082.stdout:8/429: write d0/d3/d1b/d53/f73 [603211,77834] 0 2024-04-27T07:33:22.111 INFO:tasks.workunit.client.0.smithi082.stdout:8/430: dread - d0/d3/d1c/f7d zero size 2024-04-27T07:33:22.118 INFO:tasks.workunit.client.0.smithi082.stdout:8/431: dread d0/d3/d1b/d53/f73 [0,4194304] 0 2024-04-27T07:33:22.118 INFO:tasks.workunit.client.0.smithi082.stdout:8/432: fsync d0/d3/d1c/f7d 0 2024-04-27T07:33:22.129 INFO:tasks.workunit.client.0.smithi082.stdout:8/433: dwrite d0/d3/f1d [0,4194304] 0 2024-04-27T07:33:22.131 INFO:tasks.workunit.client.0.smithi082.stdout:8/434: write d0/d3/f18 [1282433,14517] 0 2024-04-27T07:33:22.132 INFO:tasks.workunit.client.0.smithi082.stdout:6/426: sync 2024-04-27T07:33:22.132 INFO:tasks.workunit.client.0.smithi082.stdout:0/560: sync 2024-04-27T07:33:22.133 INFO:tasks.workunit.client.0.smithi082.stdout:8/435: mknod d0/d3/d1c/d60/d42/d7f/c86 0 2024-04-27T07:33:22.134 INFO:tasks.workunit.client.0.smithi082.stdout:6/427: write d2/d3/d1b/f28 [3030219,50250] 0 2024-04-27T07:33:22.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/436: fdatasync d0/d2b/f4c 0 2024-04-27T07:33:22.135 INFO:tasks.workunit.client.0.smithi082.stdout:6/428: write d2/d2e/f61 [1007329,83053] 0 2024-04-27T07:33:22.135 INFO:tasks.workunit.client.0.smithi082.stdout:8/437: stat d0/d3/d55/d6d 0 2024-04-27T07:33:22.136 INFO:tasks.workunit.client.0.smithi082.stdout:0/561: mkdir da/d38/d7f/d4a/d80/dcb 0 2024-04-27T07:33:22.137 INFO:tasks.workunit.client.0.smithi082.stdout:8/438: read - d0/d3/d1c/d76/f7a zero size 2024-04-27T07:33:22.138 INFO:tasks.workunit.client.0.smithi082.stdout:6/429: symlink d2/d81/l8e 0 2024-04-27T07:33:22.140 INFO:tasks.workunit.client.0.smithi082.stdout:8/439: unlink d0/d3/d1c/d76/f7a 0 2024-04-27T07:33:22.143 INFO:tasks.workunit.client.0.smithi082.stdout:0/562: rename da/d28/d36/d40/d83 to da/d3c/d3f/d57/dcc 0 2024-04-27T07:33:22.144 INFO:tasks.workunit.client.0.smithi082.stdout:0/563: readlink da/d3c/d3f/d4c/d74/l97 0 2024-04-27T07:33:22.149 INFO:tasks.workunit.client.0.smithi082.stdout:0/564: creat da/d3c/d3f/d4c/d74/fcd x:0 0 0 2024-04-27T07:33:22.151 INFO:tasks.workunit.client.0.smithi082.stdout:0/565: write da/d3c/d3f/d4c/f54 [4377324,73719] 0 2024-04-27T07:33:22.158 INFO:tasks.workunit.client.0.smithi082.stdout:8/440: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:22.159 INFO:tasks.workunit.client.0.smithi082.stdout:6/430: dread d2/de/f72 [4194304,4194304] 0 2024-04-27T07:33:22.160 INFO:tasks.workunit.client.0.smithi082.stdout:6/431: write d2/d1e/f22 [4984471,87825] 0 2024-04-27T07:33:22.161 INFO:tasks.workunit.client.0.smithi082.stdout:8/441: unlink d0/d2b/d6f/f79 0 2024-04-27T07:33:22.162 INFO:tasks.workunit.client.0.smithi082.stdout:8/442: readlink d0/d2b/l6e 0 2024-04-27T07:33:22.163 INFO:tasks.workunit.client.0.smithi082.stdout:6/432: write d2/d2e/f3b [5846541,112555] 0 2024-04-27T07:33:22.164 INFO:tasks.workunit.client.0.smithi082.stdout:6/433: write d2/d3/f6 [1454804,17668] 0 2024-04-27T07:33:22.165 INFO:tasks.workunit.client.0.smithi082.stdout:8/443: rename d0/d3/d1c/d60 to d0/d3/d87 0 2024-04-27T07:33:22.167 INFO:tasks.workunit.client.0.smithi082.stdout:6/434: mknod d2/d1e/d32/d85/d8a/c8f 0 2024-04-27T07:33:22.168 INFO:tasks.workunit.client.0.smithi082.stdout:6/435: creat d2/d1e/f90 x:0 0 0 2024-04-27T07:33:22.170 INFO:tasks.workunit.client.0.smithi082.stdout:8/444: dread d0/d3/d1c/d32/f41 [0,4194304] 0 2024-04-27T07:33:22.170 INFO:tasks.workunit.client.0.smithi082.stdout:6/436: write d2/d1e/f34 [2165717,87198] 0 2024-04-27T07:33:22.181 INFO:tasks.workunit.client.0.smithi082.stdout:8/445: dwrite d0/d3/d1c/d32/f41 [4194304,4194304] 0 2024-04-27T07:33:22.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/437: dwrite d2/d1e/d32/f4e [0,4194304] 0 2024-04-27T07:33:22.183 INFO:tasks.workunit.client.0.smithi082.stdout:8/446: readlink d0/d3/d1b/l31 0 2024-04-27T07:33:22.188 INFO:tasks.workunit.client.0.smithi082.stdout:8/447: symlink d0/d3/l88 0 2024-04-27T07:33:22.194 INFO:tasks.workunit.client.0.smithi082.stdout:8/448: dwrite d0/d3/d87/f28 [4194304,4194304] 0 2024-04-27T07:33:22.197 INFO:tasks.workunit.client.0.smithi082.stdout:8/449: rename d0/d3/d1c/d32/f67 to d0/d3/d1b/f89 0 2024-04-27T07:33:22.203 INFO:tasks.workunit.client.0.smithi082.stdout:6/438: dwrite d2/f18 [0,4194304] 0 2024-04-27T07:33:22.210 INFO:tasks.workunit.client.0.smithi082.stdout:6/439: link d2/f60 d2/d1e/d32/d7d/d82/f91 0 2024-04-27T07:33:22.211 INFO:tasks.workunit.client.0.smithi082.stdout:8/450: dwrite d0/d3/d87/f3e [0,4194304] 0 2024-04-27T07:33:22.212 INFO:tasks.workunit.client.0.smithi082.stdout:8/451: readlink d0/d3/l88 0 2024-04-27T07:33:22.219 INFO:tasks.workunit.client.0.smithi082.stdout:6/440: dwrite d2/f60 [0,4194304] 0 2024-04-27T07:33:22.222 INFO:tasks.workunit.client.0.smithi082.stdout:8/452: rename d0/d3/d1b/d29/d65/l77 to d0/d3/d87/d46/d4e/l8a 0 2024-04-27T07:33:22.223 INFO:tasks.workunit.client.0.smithi082.stdout:6/441: symlink d2/d1e/d80/l92 0 2024-04-27T07:33:22.224 INFO:tasks.workunit.client.0.smithi082.stdout:6/442: chown d2 1 1 2024-04-27T07:33:22.234 INFO:tasks.workunit.client.0.smithi082.stdout:9/413: sync 2024-04-27T07:33:22.235 INFO:tasks.workunit.client.0.smithi082.stdout:9/414: write d9/d2d/d2b/d46/f58 [3313537,77976] 0 2024-04-27T07:33:22.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/415: write d9/da/f26 [4969819,54794] 0 2024-04-27T07:33:22.241 INFO:tasks.workunit.client.0.smithi082.stdout:9/416: creat d9/da/dc/d35/d4a/f84 x:0 0 0 2024-04-27T07:33:22.244 INFO:tasks.workunit.client.0.smithi082.stdout:9/417: mkdir d9/da/d85 0 2024-04-27T07:33:22.245 INFO:tasks.workunit.client.0.smithi082.stdout:6/443: getdents d2/d1e/d80 0 2024-04-27T07:33:22.247 INFO:tasks.workunit.client.0.smithi082.stdout:9/418: creat d9/d2d/d2b/d46/d5d/d6f/f86 x:0 0 0 2024-04-27T07:33:22.248 INFO:tasks.workunit.client.0.smithi082.stdout:6/444: mkdir d2/d1e/d32/d85/d93 0 2024-04-27T07:33:22.251 INFO:tasks.workunit.client.0.smithi082.stdout:8/453: dread d0/d3/d87/f3f [0,4194304] 0 2024-04-27T07:33:22.252 INFO:tasks.workunit.client.0.smithi082.stdout:8/454: dread d0/d2b/f68 [0,4194304] 0 2024-04-27T07:33:22.253 INFO:tasks.workunit.client.0.smithi082.stdout:8/455: chown d0/d3/l23 309 1 2024-04-27T07:33:22.259 INFO:tasks.workunit.client.0.smithi082.stdout:6/445: dread d2/d2e/f61 [0,4194304] 0 2024-04-27T07:33:22.260 INFO:tasks.workunit.client.0.smithi082.stdout:8/456: dwrite d0/d2b/d6f/f78 [0,4194304] 0 2024-04-27T07:33:22.262 INFO:tasks.workunit.client.0.smithi082.stdout:6/446: creat d2/d1e/d32/d85/f94 x:0 0 0 2024-04-27T07:33:22.263 INFO:tasks.workunit.client.0.smithi082.stdout:8/457: mkdir d0/d3/d1b/d29/d8b 0 2024-04-27T07:33:22.267 INFO:tasks.workunit.client.0.smithi082.stdout:9/419: dread d9/da/dc/f3f [0,4194304] 0 2024-04-27T07:33:22.270 INFO:tasks.workunit.client.0.smithi082.stdout:8/458: link d0/d3/d1c/f85 d0/d3/d87/d42/d7f/d82/f8c 0 2024-04-27T07:33:22.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/447: rmdir d2 39 2024-04-27T07:33:22.274 INFO:tasks.workunit.client.0.smithi082.stdout:8/459: creat d0/d3/d87/d42/d7f/f8d x:0 0 0 2024-04-27T07:33:22.275 INFO:tasks.workunit.client.0.smithi082.stdout:9/420: creat d9/da/dc/d35/d4a/d50/f87 x:0 0 0 2024-04-27T07:33:22.276 INFO:tasks.workunit.client.0.smithi082.stdout:6/448: symlink d2/d3/d1b/l95 0 2024-04-27T07:33:22.277 INFO:tasks.workunit.client.0.smithi082.stdout:8/460: write d0/d3/d1c/f85 [284853,103713] 0 2024-04-27T07:33:22.278 INFO:tasks.workunit.client.0.smithi082.stdout:9/421: mkdir d9/da/dc/d88 0 2024-04-27T07:33:22.283 INFO:tasks.workunit.client.0.smithi082.stdout:8/461: symlink d0/d3/d87/d46/l8e 0 2024-04-27T07:33:22.287 INFO:tasks.workunit.client.0.smithi082.stdout:8/462: creat d0/d3/d87/f8f x:0 0 0 2024-04-27T07:33:22.290 INFO:tasks.workunit.client.0.smithi082.stdout:8/463: rmdir d0/d3/d87/d46 39 2024-04-27T07:33:22.291 INFO:tasks.workunit.client.0.smithi082.stdout:6/449: dread d2/d1e/f22 [0,4194304] 0 2024-04-27T07:33:22.294 INFO:tasks.workunit.client.0.smithi082.stdout:9/422: unlink d9/da/dc/d35/d42/l56 0 2024-04-27T07:33:22.294 INFO:tasks.workunit.client.0.smithi082.stdout:8/464: rmdir d0/d3 39 2024-04-27T07:33:22.295 INFO:tasks.workunit.client.0.smithi082.stdout:6/450: mknod d2/d1e/d32/d7d/d82/c96 0 2024-04-27T07:33:22.298 INFO:tasks.workunit.client.0.smithi082.stdout:6/451: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:22.298 INFO:tasks.workunit.client.0.smithi082.stdout:9/423: creat d9/da/dc/d33/f89 x:0 0 0 2024-04-27T07:33:22.300 INFO:tasks.workunit.client.0.smithi082.stdout:9/424: write d9/fb [11130183,113327] 0 2024-04-27T07:33:22.300 INFO:tasks.workunit.client.0.smithi082.stdout:8/465: dread d0/d3/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:22.302 INFO:tasks.workunit.client.0.smithi082.stdout:8/466: fsync d0/d2b/f81 0 2024-04-27T07:33:22.304 INFO:tasks.workunit.client.0.smithi082.stdout:8/467: mkdir d0/d83/d90 0 2024-04-27T07:33:22.307 INFO:tasks.workunit.client.0.smithi082.stdout:6/452: dwrite d2/d1e/d32/d85/f94 [0,4194304] 0 2024-04-27T07:33:22.311 INFO:tasks.workunit.client.0.smithi082.stdout:9/425: dwrite d9/da/dc/d35/d38/d65/f77 [0,4194304] 0 2024-04-27T07:33:22.311 INFO:tasks.workunit.client.0.smithi082.stdout:8/468: symlink d0/d3/d1b/l91 0 2024-04-27T07:33:22.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/426: creat d9/d2d/d72/f8a x:0 0 0 2024-04-27T07:33:22.317 INFO:tasks.workunit.client.0.smithi082.stdout:8/469: dread d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:22.318 INFO:tasks.workunit.client.0.smithi082.stdout:9/427: write d9/da/dc/d35/d4a/d50/f87 [377928,95770] 0 2024-04-27T07:33:22.319 INFO:tasks.workunit.client.0.smithi082.stdout:8/470: mkdir d0/d2b/d92 0 2024-04-27T07:33:22.319 INFO:tasks.workunit.client.0.smithi082.stdout:9/428: stat d9/da/dc/d35/d42/d66 0 2024-04-27T07:33:22.323 INFO:tasks.workunit.client.0.smithi082.stdout:6/453: dread d2/de/f83 [0,4194304] 0 2024-04-27T07:33:22.325 INFO:tasks.workunit.client.0.smithi082.stdout:8/471: dwrite d0/d3/d87/f3e [0,4194304] 0 2024-04-27T07:33:22.325 INFO:tasks.workunit.client.0.smithi082.stdout:6/454: readlink d2/de/l1a 0 2024-04-27T07:33:22.327 INFO:tasks.workunit.client.0.smithi082.stdout:6/455: write d2/d3/fd [5714487,116476] 0 2024-04-27T07:33:22.328 INFO:tasks.workunit.client.0.smithi082.stdout:6/456: chown d2/d2d/d4a 17 1 2024-04-27T07:33:22.329 INFO:tasks.workunit.client.0.smithi082.stdout:8/472: mknod d0/d3/d1b/d29/d6a/c93 0 2024-04-27T07:33:22.330 INFO:tasks.workunit.client.0.smithi082.stdout:6/457: readlink d2/d1e/d32/l68 0 2024-04-27T07:33:22.344 INFO:tasks.workunit.client.0.smithi082.stdout:9/429: dread d9/da/dc/d35/d4b/f5f [0,4194304] 0 2024-04-27T07:33:22.345 INFO:tasks.workunit.client.0.smithi082.stdout:9/430: write d9/da/dc/f17 [387862,74539] 0 2024-04-27T07:33:22.346 INFO:tasks.workunit.client.0.smithi082.stdout:9/431: fsync d9/da/f67 0 2024-04-27T07:33:22.348 INFO:tasks.workunit.client.0.smithi082.stdout:6/458: dread d2/d75/f7e [0,4194304] 0 2024-04-27T07:33:22.348 INFO:tasks.workunit.client.0.smithi082.stdout:6/459: read d2/d2d/f51 [1053,61263] 0 2024-04-27T07:33:22.349 INFO:tasks.workunit.client.0.smithi082.stdout:6/460: fdatasync d2/d1e/f34 0 2024-04-27T07:33:22.351 INFO:tasks.workunit.client.0.smithi082.stdout:6/461: mkdir d2/d1e/d32/d85/d97 0 2024-04-27T07:33:22.352 INFO:tasks.workunit.client.0.smithi082.stdout:6/462: creat d2/d1e/f98 x:0 0 0 2024-04-27T07:33:22.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/463: mknod d2/c99 0 2024-04-27T07:33:22.356 INFO:tasks.workunit.client.0.smithi082.stdout:6/464: link d2/d1e/l54 d2/d1e/d32/d85/d93/l9a 0 2024-04-27T07:33:22.359 INFO:tasks.workunit.client.0.smithi082.stdout:6/465: dread d2/d45/f6b [4194304,4194304] 0 2024-04-27T07:33:22.359 INFO:tasks.workunit.client.0.smithi082.stdout:6/466: chown d2/f18 67348 1 2024-04-27T07:33:22.360 INFO:tasks.workunit.client.0.smithi082.stdout:6/467: truncate d2/d81/f86 363885 0 2024-04-27T07:33:22.361 INFO:tasks.workunit.client.0.smithi082.stdout:6/468: write d2/d45/f42 [2813196,94899] 0 2024-04-27T07:33:22.362 INFO:tasks.workunit.client.0.smithi082.stdout:6/469: write d2/de/d13/f21 [831921,99160] 0 2024-04-27T07:33:22.364 INFO:tasks.workunit.client.0.smithi082.stdout:6/470: symlink d2/d1e/d32/d85/d97/l9b 0 2024-04-27T07:33:22.368 INFO:tasks.workunit.client.0.smithi082.stdout:6/471: dwrite d2/d1e/f90 [0,4194304] 0 2024-04-27T07:33:22.370 INFO:tasks.workunit.client.0.smithi082.stdout:5/620: sync 2024-04-27T07:33:22.370 INFO:tasks.workunit.client.0.smithi082.stdout:1/488: sync 2024-04-27T07:33:22.371 INFO:tasks.workunit.client.0.smithi082.stdout:1/489: chown d4/d15/d49/da0 930956 1 2024-04-27T07:33:22.372 INFO:tasks.workunit.client.0.smithi082.stdout:6/472: dread d2/d1e/f90 [0,4194304] 0 2024-04-27T07:33:22.379 INFO:tasks.workunit.client.0.smithi082.stdout:5/621: truncate d8/d15/f24 1076478 0 2024-04-27T07:33:22.379 INFO:tasks.workunit.client.0.smithi082.stdout:5/622: fsync d8/d2e/fa9 0 2024-04-27T07:33:22.382 INFO:tasks.workunit.client.0.smithi082.stdout:5/623: rename d8/d3c/d4a/lb9 to d8/d3c/d5a/d5b/da3/ld3 0 2024-04-27T07:33:22.385 INFO:tasks.workunit.client.0.smithi082.stdout:5/624: creat d8/d15/d22/fd4 x:0 0 0 2024-04-27T07:33:22.386 INFO:tasks.workunit.client.0.smithi082.stdout:5/625: mknod d8/d3c/d47/cd5 0 2024-04-27T07:33:22.394 INFO:tasks.workunit.client.0.smithi082.stdout:6/473: dread d2/de/f72 [0,4194304] 0 2024-04-27T07:33:22.394 INFO:tasks.workunit.client.0.smithi082.stdout:6/474: chown d2/d2e/f7c 7194692 1 2024-04-27T07:33:22.397 INFO:tasks.workunit.client.0.smithi082.stdout:6/475: dread d2/f18 [0,4194304] 0 2024-04-27T07:33:22.397 INFO:tasks.workunit.client.0.smithi082.stdout:6/476: chown d2/d2e 11107 1 2024-04-27T07:33:22.398 INFO:tasks.workunit.client.0.smithi082.stdout:6/477: truncate d2/d1e/d32/d85/f8b 378435 0 2024-04-27T07:33:22.399 INFO:tasks.workunit.client.0.smithi082.stdout:6/478: mkdir d2/d3/d9c 0 2024-04-27T07:33:22.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/479: getdents d2/d1e/d32 0 2024-04-27T07:33:22.407 INFO:tasks.workunit.client.0.smithi082.stdout:6/480: dwrite d2/d1e/f88 [0,4194304] 0 2024-04-27T07:33:22.408 INFO:tasks.workunit.client.0.smithi082.stdout:6/481: dread - d2/d1e/f98 zero size 2024-04-27T07:33:22.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/482: dread d2/de/f24 [0,4194304] 0 2024-04-27T07:33:22.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/483: read d2/f18 [3611466,8667] 0 2024-04-27T07:33:22.438 INFO:tasks.workunit.client.0.smithi082.stdout:6/484: read d2/d45/f6b [1182353,29655] 0 2024-04-27T07:33:22.439 INFO:tasks.workunit.client.0.smithi082.stdout:6/485: fdatasync d2/d1e/d32/d7d/d82/f91 0 2024-04-27T07:33:22.507 INFO:tasks.workunit.client.0.smithi082.stdout:6/486: symlink d2/d1e/l9d 0 2024-04-27T07:33:22.513 INFO:tasks.workunit.client.0.smithi082.stdout:6/487: dwrite d2/d1e/f98 [0,4194304] 0 2024-04-27T07:33:22.555 INFO:tasks.workunit.client.0.smithi082.stdout:3/721: sync 2024-04-27T07:33:22.556 INFO:tasks.workunit.client.0.smithi082.stdout:7/459: sync 2024-04-27T07:33:22.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/566: sync 2024-04-27T07:33:22.556 INFO:tasks.workunit.client.0.smithi082.stdout:4/508: sync 2024-04-27T07:33:22.556 INFO:tasks.workunit.client.0.smithi082.stdout:2/473: sync 2024-04-27T07:33:22.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/567: chown da/d38/d7f 1 1 2024-04-27T07:33:22.559 INFO:tasks.workunit.client.0.smithi082.stdout:2/474: dread d7/f56 [0,4194304] 0 2024-04-27T07:33:22.560 INFO:tasks.workunit.client.0.smithi082.stdout:7/460: rename d3/de to d3/d49/d97 0 2024-04-27T07:33:22.562 INFO:tasks.workunit.client.0.smithi082.stdout:4/509: truncate d3/d6/d16/f47 490552 0 2024-04-27T07:33:22.563 INFO:tasks.workunit.client.0.smithi082.stdout:3/722: dwrite d8/d9/d3f/f8c [0,4194304] 0 2024-04-27T07:33:22.565 INFO:tasks.workunit.client.0.smithi082.stdout:2/475: creat d7/d9/d4f/f9d x:0 0 0 2024-04-27T07:33:22.567 INFO:tasks.workunit.client.0.smithi082.stdout:3/723: mknod d8/d9/dd/d13/d1b/dbd/dd8/c103 0 2024-04-27T07:33:22.568 INFO:tasks.workunit.client.0.smithi082.stdout:7/461: getdents d3/d49/d97/d7d 0 2024-04-27T07:33:22.573 INFO:tasks.workunit.client.0.smithi082.stdout:3/724: creat d8/d9/d25/d26/d3d/f104 x:0 0 0 2024-04-27T07:33:22.574 INFO:tasks.workunit.client.0.smithi082.stdout:3/725: chown d8/ce6 0 1 2024-04-27T07:33:22.585 INFO:tasks.workunit.client.0.smithi082.stdout:4/510: dread d3/d6/d16/d98/fa0 [0,4194304] 0 2024-04-27T07:33:22.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/511: dread - d3/d9/f8b zero size 2024-04-27T07:33:22.587 INFO:tasks.workunit.client.0.smithi082.stdout:2/476: dread d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:22.589 INFO:tasks.workunit.client.0.smithi082.stdout:3/726: dwrite d8/d9/dd/d13/d1b/f8f [0,4194304] 0 2024-04-27T07:33:22.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/477: mknod d7/d9/d4f/d6e/d93/c9e 0 2024-04-27T07:33:22.593 INFO:tasks.workunit.client.0.smithi082.stdout:3/727: creat d8/d9/d25/d26/d4d/d82/d8b/dfc/f105 x:0 0 0 2024-04-27T07:33:22.594 INFO:tasks.workunit.client.0.smithi082.stdout:4/512: truncate d3/f91 2722530 0 2024-04-27T07:33:22.599 INFO:tasks.workunit.client.0.smithi082.stdout:3/728: fsync d8/d9/d1d/f2d 0 2024-04-27T07:33:22.600 INFO:tasks.workunit.client.0.smithi082.stdout:4/513: fsync d3/d6/d22/f24 0 2024-04-27T07:33:22.604 INFO:tasks.workunit.client.0.smithi082.stdout:2/478: dwrite d7/d9/d4f/d6e/d93/f98 [0,4194304] 0 2024-04-27T07:33:22.611 INFO:tasks.workunit.client.0.smithi082.stdout:2/479: dwrite d7/d14/f9a [0,4194304] 0 2024-04-27T07:33:22.622 INFO:tasks.workunit.client.0.smithi082.stdout:2/480: link d7/d9/d4f/d6e/d93/f97 d7/d14/f9f 0 2024-04-27T07:33:22.623 INFO:tasks.workunit.client.0.smithi082.stdout:4/514: creat d3/d10/faa x:0 0 0 2024-04-27T07:33:22.623 INFO:tasks.workunit.client.0.smithi082.stdout:3/729: getdents d8/d9/d25/d4e/da4 0 2024-04-27T07:33:22.624 INFO:tasks.workunit.client.0.smithi082.stdout:2/481: symlink d7/d30/d61/la0 0 2024-04-27T07:33:22.625 INFO:tasks.workunit.client.0.smithi082.stdout:3/730: creat d8/d9/d1d/da5/db3/f106 x:0 0 0 2024-04-27T07:33:22.626 INFO:tasks.workunit.client.0.smithi082.stdout:4/515: mkdir d3/dab 0 2024-04-27T07:33:22.646 INFO:tasks.workunit.client.0.smithi082.stdout:8/473: sync 2024-04-27T07:33:22.673 INFO:tasks.workunit.client.0.smithi082.stdout:3/731: mkdir d8/d9/db0/df9/d107 0 2024-04-27T07:33:22.673 INFO:tasks.workunit.client.0.smithi082.stdout:3/732: stat d8/d9/d1f/f94 0 2024-04-27T07:33:22.674 INFO:tasks.workunit.client.0.smithi082.stdout:4/516: mknod d3/d10/d9c/cac 0 2024-04-27T07:33:22.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/733: write d8/d9/d3f/f80 [4190912,19256] 0 2024-04-27T07:33:22.675 INFO:tasks.workunit.client.0.smithi082.stdout:4/517: dread - d3/d6/d26/d55/fa9 zero size 2024-04-27T07:33:22.675 INFO:tasks.workunit.client.0.smithi082.stdout:8/474: unlink d0/d3/d87/c4d 0 2024-04-27T07:33:22.676 INFO:tasks.workunit.client.0.smithi082.stdout:2/482: creat d7/d9/d4f/fa1 x:0 0 0 2024-04-27T07:33:22.677 INFO:tasks.workunit.client.0.smithi082.stdout:4/518: write d3/d6/d22/f24 [1109578,39440] 0 2024-04-27T07:33:22.678 INFO:tasks.workunit.client.0.smithi082.stdout:8/475: creat d0/d3/d1c/d76/f94 x:0 0 0 2024-04-27T07:33:22.678 INFO:tasks.workunit.client.0.smithi082.stdout:4/519: chown d3/f43 40637511 1 2024-04-27T07:33:22.679 INFO:tasks.workunit.client.0.smithi082.stdout:8/476: write d0/f58 [224872,34724] 0 2024-04-27T07:33:22.680 INFO:tasks.workunit.client.0.smithi082.stdout:3/734: mkdir d8/d108 0 2024-04-27T07:33:22.680 INFO:tasks.workunit.client.0.smithi082.stdout:2/483: mknod d7/d8/d13/ca2 0 2024-04-27T07:33:22.682 INFO:tasks.workunit.client.0.smithi082.stdout:4/520: fsync d3/d6/d26/f9e 0 2024-04-27T07:33:22.682 INFO:tasks.workunit.client.0.smithi082.stdout:8/477: write d0/d3/d87/f28 [4804402,112610] 0 2024-04-27T07:33:22.683 INFO:tasks.workunit.client.0.smithi082.stdout:3/735: dread - d8/d9/d25/d26/d4d/d82/d8b/fcf zero size 2024-04-27T07:33:22.686 INFO:tasks.workunit.client.0.smithi082.stdout:4/521: write d3/d6/f5d [3292149,61192] 0 2024-04-27T07:33:22.686 INFO:tasks.workunit.client.0.smithi082.stdout:8/478: creat d0/d83/f95 x:0 0 0 2024-04-27T07:33:22.688 INFO:tasks.workunit.client.0.smithi082.stdout:3/736: creat d8/d9/d25/d66/f109 x:0 0 0 2024-04-27T07:33:22.689 INFO:tasks.workunit.client.0.smithi082.stdout:2/484: dwrite d7/d8/d13/f4b [0,4194304] 0 2024-04-27T07:33:22.691 INFO:tasks.workunit.client.0.smithi082.stdout:4/522: unlink d3/d6/d16/c75 0 2024-04-27T07:33:22.693 INFO:tasks.workunit.client.0.smithi082.stdout:8/479: symlink d0/d3/d1c/d32/d35/l96 0 2024-04-27T07:33:22.698 INFO:tasks.workunit.client.0.smithi082.stdout:4/523: dread d3/d6/d22/f59 [0,4194304] 0 2024-04-27T07:33:22.701 INFO:tasks.workunit.client.0.smithi082.stdout:2/485: write d7/d9/d4f/d6e/d93/f97 [307981,85666] 0 2024-04-27T07:33:22.701 INFO:tasks.workunit.client.0.smithi082.stdout:8/480: dwrite d0/d3/d1c/d32/d35/f49 [0,4194304] 0 2024-04-27T07:33:22.702 INFO:tasks.workunit.client.0.smithi082.stdout:4/524: write d3/d6/d26/d55/d67/f8a [348679,39957] 0 2024-04-27T07:33:22.704 INFO:tasks.workunit.client.0.smithi082.stdout:2/486: mknod d7/d14/ca3 0 2024-04-27T07:33:22.705 INFO:tasks.workunit.client.0.smithi082.stdout:3/737: dread d8/d9/dd/f35 [0,4194304] 0 2024-04-27T07:33:22.705 INFO:tasks.workunit.client.0.smithi082.stdout:2/487: fsync d7/f5b 0 2024-04-27T07:33:22.706 INFO:tasks.workunit.client.0.smithi082.stdout:4/525: mkdir d3/d6/d26/d5e/d21/dad 0 2024-04-27T07:33:22.710 INFO:tasks.workunit.client.0.smithi082.stdout:4/526: creat d3/d6/d16/fae x:0 0 0 2024-04-27T07:33:22.710 INFO:tasks.workunit.client.0.smithi082.stdout:2/488: dread d7/d14/f9f [0,4194304] 0 2024-04-27T07:33:22.712 INFO:tasks.workunit.client.0.smithi082.stdout:8/481: dwrite d0/d3/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:22.715 INFO:tasks.workunit.client.0.smithi082.stdout:8/482: truncate d0/d3/f1a 377969 0 2024-04-27T07:33:22.716 INFO:tasks.workunit.client.0.smithi082.stdout:2/489: mkdir d7/d9/d4f/d6e/d82/da4 0 2024-04-27T07:33:22.721 INFO:tasks.workunit.client.0.smithi082.stdout:4/527: dwrite d3/d6/d26/d55/f5f [4194304,4194304] 0 2024-04-27T07:33:22.726 INFO:tasks.workunit.client.0.smithi082.stdout:2/490: link d7/d31/d54/f92 d7/d30/d61/fa5 0 2024-04-27T07:33:22.728 INFO:tasks.workunit.client.0.smithi082.stdout:8/483: rmdir d0/d3/d1b/d29/d8b 0 2024-04-27T07:33:22.728 INFO:tasks.workunit.client.0.smithi082.stdout:2/491: dread d7/d30/d23/f49 [0,4194304] 0 2024-04-27T07:33:22.728 INFO:tasks.workunit.client.0.smithi082.stdout:4/528: symlink d3/dab/laf 0 2024-04-27T07:33:22.728 INFO:tasks.workunit.client.0.smithi082.stdout:4/529: unlink d3/d6/d22/d69/f96 0 2024-04-27T07:33:22.729 INFO:tasks.workunit.client.0.smithi082.stdout:8/484: symlink d0/d3/d1b/d53/l97 0 2024-04-27T07:33:22.732 INFO:tasks.workunit.client.0.smithi082.stdout:4/530: rename d3/d6/d22/f24 to d3/d6/d22/fb0 0 2024-04-27T07:33:22.736 INFO:tasks.workunit.client.0.smithi082.stdout:2/492: link d7/d31/d6f/l72 d7/d9/d4f/d6e/la6 0 2024-04-27T07:33:22.738 INFO:tasks.workunit.client.0.smithi082.stdout:4/531: dwrite f2 [4194304,4194304] 0 2024-04-27T07:33:22.738 INFO:tasks.workunit.client.0.smithi082.stdout:8/485: creat d0/d3/d1b/f98 x:0 0 0 2024-04-27T07:33:22.739 INFO:tasks.workunit.client.0.smithi082.stdout:4/532: stat d3/d6/f5d 0 2024-04-27T07:33:22.740 INFO:tasks.workunit.client.0.smithi082.stdout:2/493: write d7/d9/f18 [2702261,98093] 0 2024-04-27T07:33:22.743 INFO:tasks.workunit.client.0.smithi082.stdout:8/486: creat d0/f99 x:0 0 0 2024-04-27T07:33:22.744 INFO:tasks.workunit.client.0.smithi082.stdout:2/494: mknod d7/d8/d13/d94/ca7 0 2024-04-27T07:33:22.746 INFO:tasks.workunit.client.0.smithi082.stdout:8/487: mkdir d0/d2b/d9a 0 2024-04-27T07:33:22.746 INFO:tasks.workunit.client.0.smithi082.stdout:2/495: read - d7/d9/d4f/d66/f8e zero size 2024-04-27T07:33:22.747 INFO:tasks.workunit.client.0.smithi082.stdout:4/533: dwrite d3/d6/d26/d55/f5f [4194304,4194304] 0 2024-04-27T07:33:22.752 INFO:tasks.workunit.client.0.smithi082.stdout:8/488: rename d0/d3/d87/f8f to d0/d3/d87/d42/f9b 0 2024-04-27T07:33:22.754 INFO:tasks.workunit.client.0.smithi082.stdout:8/489: fsync d0/d3/d1c/f85 0 2024-04-27T07:33:22.754 INFO:tasks.workunit.client.0.smithi082.stdout:8/490: dread - d0/d3/d1c/f7d zero size 2024-04-27T07:33:22.762 INFO:tasks.workunit.client.0.smithi082.stdout:4/534: dwrite d3/d9/f45 [0,4194304] 0 2024-04-27T07:33:22.763 INFO:tasks.workunit.client.0.smithi082.stdout:8/491: link d0/d3/d1b/d53/l97 d0/d3/d87/d42/d7f/l9c 0 2024-04-27T07:33:22.767 INFO:tasks.workunit.client.0.smithi082.stdout:8/492: creat d0/d83/d90/f9d x:0 0 0 2024-04-27T07:33:22.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/493: chown d0/d3/d1b/d29/d65/c69 1601575 1 2024-04-27T07:33:22.769 INFO:tasks.workunit.client.0.smithi082.stdout:4/535: rename d3/d10/f6c to d3/d6/d26/d55/d67/fb1 0 2024-04-27T07:33:22.772 INFO:tasks.workunit.client.0.smithi082.stdout:8/494: link d0/d2b/d6f/f78 d0/d3/d1b/d29/f9e 0 2024-04-27T07:33:22.773 INFO:tasks.workunit.client.0.smithi082.stdout:4/536: rename d3/d6/d26/d5e/d21/f9b to d3/fb2 0 2024-04-27T07:33:22.774 INFO:tasks.workunit.client.0.smithi082.stdout:4/537: fsync d3/d9/f6a 0 2024-04-27T07:33:22.774 INFO:tasks.workunit.client.0.smithi082.stdout:8/495: mknod d0/d3/d1b/d29/c9f 0 2024-04-27T07:33:22.775 INFO:tasks.workunit.client.0.smithi082.stdout:4/538: write d3/d6/d26/f9e [868709,44405] 0 2024-04-27T07:33:22.776 INFO:tasks.workunit.client.0.smithi082.stdout:4/539: dread - d3/d6/d26/d55/fa9 zero size 2024-04-27T07:33:22.777 INFO:tasks.workunit.client.0.smithi082.stdout:8/496: fdatasync d0/d3/d1b/f2e 0 2024-04-27T07:33:22.779 INFO:tasks.workunit.client.0.smithi082.stdout:8/497: dread d0/d3/d1c/d32/f34 [0,4194304] 0 2024-04-27T07:33:22.781 INFO:tasks.workunit.client.0.smithi082.stdout:8/498: mkdir d0/d3/d1c/d76/da0 0 2024-04-27T07:33:22.792 INFO:tasks.workunit.client.0.smithi082.stdout:8/499: dread d0/d3/d87/f28 [0,4194304] 0 2024-04-27T07:33:22.793 INFO:tasks.workunit.client.0.smithi082.stdout:8/500: creat d0/d3/d1b/d29/fa1 x:0 0 0 2024-04-27T07:33:22.796 INFO:tasks.workunit.client.0.smithi082.stdout:8/501: creat d0/d3/d1b/d29/d65/fa2 x:0 0 0 2024-04-27T07:33:22.796 INFO:tasks.workunit.client.0.smithi082.stdout:5/626: sync 2024-04-27T07:33:22.797 INFO:tasks.workunit.client.0.smithi082.stdout:1/490: sync 2024-04-27T07:33:22.797 INFO:tasks.workunit.client.0.smithi082.stdout:9/432: sync 2024-04-27T07:33:22.797 INFO:tasks.workunit.client.0.smithi082.stdout:8/502: fsync d0/d3/d1b/f1e 0 2024-04-27T07:33:22.799 INFO:tasks.workunit.client.0.smithi082.stdout:5/627: creat d8/d2e/d85/fd6 x:0 0 0 2024-04-27T07:33:22.800 INFO:tasks.workunit.client.0.smithi082.stdout:9/433: creat d9/d2d/d2b/d46/f8b x:0 0 0 2024-04-27T07:33:22.801 INFO:tasks.workunit.client.0.smithi082.stdout:9/434: write d9/d2d/d2b/d46/f58 [1055927,106424] 0 2024-04-27T07:33:22.802 INFO:tasks.workunit.client.0.smithi082.stdout:1/491: creat d4/d15/d49/d99/d9a/da9/faa x:0 0 0 2024-04-27T07:33:22.803 INFO:tasks.workunit.client.0.smithi082.stdout:9/435: write d9/da/f26 [1856012,9965] 0 2024-04-27T07:33:22.805 INFO:tasks.workunit.client.0.smithi082.stdout:8/503: getdents d0/d3/d1b/d53 0 2024-04-27T07:33:22.807 INFO:tasks.workunit.client.0.smithi082.stdout:8/504: dread - d0/d3/d1b/d29/fa1 zero size 2024-04-27T07:33:22.809 INFO:tasks.workunit.client.0.smithi082.stdout:9/436: dwrite d9/da/dc/d35/d4b/f74 [0,4194304] 0 2024-04-27T07:33:22.815 INFO:tasks.workunit.client.0.smithi082.stdout:8/505: dwrite d0/d2b/f4c [8388608,4194304] 0 2024-04-27T07:33:22.818 INFO:tasks.workunit.client.0.smithi082.stdout:8/506: creat d0/d2b/fa3 x:0 0 0 2024-04-27T07:33:22.818 INFO:tasks.workunit.client.0.smithi082.stdout:9/437: dwrite d9/da/dc/f2a [0,4194304] 0 2024-04-27T07:33:22.820 INFO:tasks.workunit.client.0.smithi082.stdout:9/438: readlink d9/da/dc/l81 0 2024-04-27T07:33:22.821 INFO:tasks.workunit.client.0.smithi082.stdout:9/439: truncate d9/da/f64 516151 0 2024-04-27T07:33:22.823 INFO:tasks.workunit.client.0.smithi082.stdout:9/440: mknod d9/da/c8c 0 2024-04-27T07:33:22.823 INFO:tasks.workunit.client.0.smithi082.stdout:8/507: dwrite d0/f7 [0,4194304] 0 2024-04-27T07:33:22.825 INFO:tasks.workunit.client.0.smithi082.stdout:8/508: read d0/f58 [91160,38689] 0 2024-04-27T07:33:22.826 INFO:tasks.workunit.client.0.smithi082.stdout:8/509: write d0/d3/d87/f28 [9311789,78261] 0 2024-04-27T07:33:22.827 INFO:tasks.workunit.client.0.smithi082.stdout:8/510: write d0/d3/d1c/d32/f34 [4403418,92112] 0 2024-04-27T07:33:22.828 INFO:tasks.workunit.client.0.smithi082.stdout:8/511: chown d0/d3/d1c/d76 2018052691 1 2024-04-27T07:33:22.829 INFO:tasks.workunit.client.0.smithi082.stdout:8/512: fdatasync d0/d3/d87/d42/d7f/f8d 0 2024-04-27T07:33:22.830 INFO:tasks.workunit.client.0.smithi082.stdout:8/513: write d0/d2b/fa3 [936380,110134] 0 2024-04-27T07:33:22.835 INFO:tasks.workunit.client.0.smithi082.stdout:8/514: dwrite d0/d3/d87/d42/d7f/f8d [0,4194304] 0 2024-04-27T07:33:22.836 INFO:tasks.workunit.client.0.smithi082.stdout:8/515: chown d0/d3/d1c/d32/c74 282 1 2024-04-27T07:33:22.838 INFO:tasks.workunit.client.0.smithi082.stdout:8/516: rename d0/d3/d1c/d32 to d0/d2b/d9a/da4 0 2024-04-27T07:33:22.842 INFO:tasks.workunit.client.0.smithi082.stdout:8/517: rename d0/d3/d87/d46/d4e/l8a to d0/d83/la5 0 2024-04-27T07:33:22.847 INFO:tasks.workunit.client.0.smithi082.stdout:8/518: dwrite d0/d2b/f81 [0,4194304] 0 2024-04-27T07:33:22.850 INFO:tasks.workunit.client.0.smithi082.stdout:8/519: creat d0/d3/d1b/fa6 x:0 0 0 2024-04-27T07:33:22.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/520: mknod d0/d2b/d9a/da4/d35/ca7 0 2024-04-27T07:33:22.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/521: readlink d0/d2b/d9a/da4/l40 0 2024-04-27T07:33:22.910 INFO:tasks.workunit.client.0.smithi082.stdout:2/496: dwrite d7/d8/f2d [0,4194304] 0 2024-04-27T07:33:22.911 INFO:tasks.workunit.client.0.smithi082.stdout:2/497: truncate d7/d9/d4f/fa1 658758 0 2024-04-27T07:33:22.919 INFO:tasks.workunit.client.0.smithi082.stdout:2/498: dwrite d7/d31/d6f/f79 [0,4194304] 0 2024-04-27T07:33:22.951 INFO:tasks.workunit.client.0.smithi082.stdout:1/492: dread d4/d15/d1c/f2c [4194304,4194304] 0 2024-04-27T07:33:22.952 INFO:tasks.workunit.client.0.smithi082.stdout:1/493: write d4/f86 [519583,54799] 0 2024-04-27T07:33:22.953 INFO:tasks.workunit.client.0.smithi082.stdout:2/499: dread d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:22.954 INFO:tasks.workunit.client.0.smithi082.stdout:2/500: stat d7/l7d 0 2024-04-27T07:33:22.955 INFO:tasks.workunit.client.0.smithi082.stdout:2/501: truncate d7/d9/d4f/fa1 1657191 0 2024-04-27T07:33:22.958 INFO:tasks.workunit.client.0.smithi082.stdout:1/494: dwrite d4/f10 [0,4194304] 0 2024-04-27T07:33:22.960 INFO:tasks.workunit.client.0.smithi082.stdout:2/502: rename d7/d9/d4f/l7a to d7/d9/d4f/d66/la8 0 2024-04-27T07:33:22.963 INFO:tasks.workunit.client.0.smithi082.stdout:2/503: rename d7/f28 to d7/d31/d6f/fa9 0 2024-04-27T07:33:22.964 INFO:tasks.workunit.client.0.smithi082.stdout:2/504: write d7/d8/d13/f7b [326956,36558] 0 2024-04-27T07:33:22.966 INFO:tasks.workunit.client.0.smithi082.stdout:1/495: write d4/d2a/d4c/f6c [122803,95228] 0 2024-04-27T07:33:22.970 INFO:tasks.workunit.client.0.smithi082.stdout:1/496: unlink d4/d15/d49/d4e/f5e 0 2024-04-27T07:33:22.971 INFO:tasks.workunit.client.0.smithi082.stdout:2/505: dwrite d7/d31/f67 [0,4194304] 0 2024-04-27T07:33:22.972 INFO:tasks.workunit.client.0.smithi082.stdout:2/506: stat d7/d30/d61/f71 0 2024-04-27T07:33:22.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/497: chown d4/d15/d49/d4e/c95 5378 1 2024-04-27T07:33:22.974 INFO:tasks.workunit.client.0.smithi082.stdout:2/507: rmdir d7/d8/d13/d94 39 2024-04-27T07:33:22.976 INFO:tasks.workunit.client.0.smithi082.stdout:0/568: sync 2024-04-27T07:33:22.977 INFO:tasks.workunit.client.0.smithi082.stdout:6/488: sync 2024-04-27T07:33:22.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/569: dwrite da/d2a/f87 [0,4194304] 0 2024-04-27T07:33:22.986 INFO:tasks.workunit.client.0.smithi082.stdout:0/570: mkdir da/d3c/d3f/dce 0 2024-04-27T07:33:22.991 INFO:tasks.workunit.client.0.smithi082.stdout:6/489: truncate d2/d45/f6f 841956 0 2024-04-27T07:33:22.992 INFO:tasks.workunit.client.0.smithi082.stdout:0/571: rmdir da/d3c/d3f/dce 0 2024-04-27T07:33:22.993 INFO:tasks.workunit.client.0.smithi082.stdout:6/490: write d2/f18 [4249258,71468] 0 2024-04-27T07:33:22.996 INFO:tasks.workunit.client.0.smithi082.stdout:6/491: fdatasync d2/de/d13/f16 0 2024-04-27T07:33:22.998 INFO:tasks.workunit.client.0.smithi082.stdout:2/508: dread d7/f5b [0,4194304] 0 2024-04-27T07:33:23.000 INFO:tasks.workunit.client.0.smithi082.stdout:6/492: getdents d2 0 2024-04-27T07:33:23.003 INFO:tasks.workunit.client.0.smithi082.stdout:1/498: dread d4/f35 [0,4194304] 0 2024-04-27T07:33:23.004 INFO:tasks.workunit.client.0.smithi082.stdout:6/493: unlink d2/d2e/l5b 0 2024-04-27T07:33:23.007 INFO:tasks.workunit.client.0.smithi082.stdout:2/509: dwrite d7/d8/d13/f4b [0,4194304] 0 2024-04-27T07:33:23.008 INFO:tasks.workunit.client.0.smithi082.stdout:1/499: truncate d4/d2a/d4c/f92 105281 0 2024-04-27T07:33:23.011 INFO:tasks.workunit.client.0.smithi082.stdout:1/500: dread d4/d2a/d4c/f6a [0,4194304] 0 2024-04-27T07:33:23.013 INFO:tasks.workunit.client.0.smithi082.stdout:2/510: mknod d7/d9/d4f/d66/caa 0 2024-04-27T07:33:23.014 INFO:tasks.workunit.client.0.smithi082.stdout:6/494: link d2/d1e/d32/l6e d2/d3/d1b/l9e 0 2024-04-27T07:33:23.014 INFO:tasks.workunit.client.0.smithi082.stdout:1/501: read d4/f16 [196515,47752] 0 2024-04-27T07:33:23.015 INFO:tasks.workunit.client.0.smithi082.stdout:6/495: fdatasync d2/f60 0 2024-04-27T07:33:23.016 INFO:tasks.workunit.client.0.smithi082.stdout:0/572: dread da/d3c/d3f/d4c/f54 [0,4194304] 0 2024-04-27T07:33:23.017 INFO:tasks.workunit.client.0.smithi082.stdout:0/573: fsync da/fe 0 2024-04-27T07:33:23.022 INFO:tasks.workunit.client.0.smithi082.stdout:0/574: creat da/d2a/dc4/fcf x:0 0 0 2024-04-27T07:33:23.022 INFO:tasks.workunit.client.0.smithi082.stdout:2/511: getdents d7/d9/d4f/d6e/d93 0 2024-04-27T07:33:23.023 INFO:tasks.workunit.client.0.smithi082.stdout:6/496: dwrite d2/d1e/f22 [0,4194304] 0 2024-04-27T07:33:23.024 INFO:tasks.workunit.client.0.smithi082.stdout:2/512: chown d7/d14/ca3 1 1 2024-04-27T07:33:23.027 INFO:tasks.workunit.client.0.smithi082.stdout:0/575: unlink da/d3c/d3f/fc8 0 2024-04-27T07:33:23.031 INFO:tasks.workunit.client.0.smithi082.stdout:2/513: creat d7/d31/d54/fab x:0 0 0 2024-04-27T07:33:23.033 INFO:tasks.workunit.client.0.smithi082.stdout:0/576: write da/d1d/f24 [4720124,121113] 0 2024-04-27T07:33:23.033 INFO:tasks.workunit.client.0.smithi082.stdout:6/497: creat d2/d3/d9c/f9f x:0 0 0 2024-04-27T07:33:23.034 INFO:tasks.workunit.client.0.smithi082.stdout:2/514: truncate d7/d8/f19 4737818 0 2024-04-27T07:33:23.035 INFO:tasks.workunit.client.0.smithi082.stdout:6/498: write d2/d2e/f30 [3229228,70695] 0 2024-04-27T07:33:23.036 INFO:tasks.workunit.client.0.smithi082.stdout:0/577: mkdir da/d1d/d6a/dd0 0 2024-04-27T07:33:23.039 INFO:tasks.workunit.client.0.smithi082.stdout:2/515: rename d7/d14/f78 to d7/d30/d23/fac 0 2024-04-27T07:33:23.042 INFO:tasks.workunit.client.0.smithi082.stdout:0/578: creat da/d2a/dc4/fd1 x:0 0 0 2024-04-27T07:33:23.046 INFO:tasks.workunit.client.0.smithi082.stdout:2/516: creat d7/d8/d13/d94/fad x:0 0 0 2024-04-27T07:33:23.047 INFO:tasks.workunit.client.0.smithi082.stdout:0/579: dwrite f9 [0,4194304] 0 2024-04-27T07:33:23.053 INFO:tasks.workunit.client.0.smithi082.stdout:2/517: rename d7/d31/d6f to d7/d9/d4f/d66/dae 0 2024-04-27T07:33:23.054 INFO:tasks.workunit.client.0.smithi082.stdout:0/580: dread da/d3c/fbd [0,4194304] 0 2024-04-27T07:33:23.056 INFO:tasks.workunit.client.0.smithi082.stdout:6/499: dwrite d2/d45/f6f [0,4194304] 0 2024-04-27T07:33:23.056 INFO:tasks.workunit.client.0.smithi082.stdout:2/518: write d7/f56 [411186,56229] 0 2024-04-27T07:33:23.058 INFO:tasks.workunit.client.0.smithi082.stdout:6/500: chown d2/d1e/d80/l92 211517 1 2024-04-27T07:33:23.058 INFO:tasks.workunit.client.0.smithi082.stdout:0/581: creat da/d28/d36/fd2 x:0 0 0 2024-04-27T07:33:23.059 INFO:tasks.workunit.client.0.smithi082.stdout:2/519: write d7/d8/f2d [1373849,67203] 0 2024-04-27T07:33:23.066 INFO:tasks.workunit.client.0.smithi082.stdout:0/582: dwrite da/f12 [0,4194304] 0 2024-04-27T07:33:23.068 INFO:tasks.workunit.client.0.smithi082.stdout:6/501: dwrite d2/de/f24 [0,4194304] 0 2024-04-27T07:33:23.070 INFO:tasks.workunit.client.0.smithi082.stdout:0/583: chown da/d28/c7d 34661 1 2024-04-27T07:33:23.071 INFO:tasks.workunit.client.0.smithi082.stdout:6/502: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:23.074 INFO:tasks.workunit.client.0.smithi082.stdout:0/584: creat da/fd3 x:0 0 0 2024-04-27T07:33:23.075 INFO:tasks.workunit.client.0.smithi082.stdout:6/503: mkdir d2/d1e/d32/d7d/d82/da0 0 2024-04-27T07:33:23.080 INFO:tasks.workunit.client.0.smithi082.stdout:2/520: dread d7/d9/d4f/d66/dae/fa9 [0,4194304] 0 2024-04-27T07:33:23.081 INFO:tasks.workunit.client.0.smithi082.stdout:2/521: chown d7/d8/f74 59 1 2024-04-27T07:33:23.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/522: dread d7/d14/f9a [0,4194304] 0 2024-04-27T07:33:23.085 INFO:tasks.workunit.client.0.smithi082.stdout:2/523: stat d7/d8/f74 0 2024-04-27T07:33:23.086 INFO:tasks.workunit.client.0.smithi082.stdout:2/524: write d7/d30/d23/f49 [779936,114711] 0 2024-04-27T07:33:23.088 INFO:tasks.workunit.client.0.smithi082.stdout:2/525: write d7/d8/f74 [667383,28995] 0 2024-04-27T07:33:23.091 INFO:tasks.workunit.client.0.smithi082.stdout:2/526: rename d7/d30/l1c to d7/laf 0 2024-04-27T07:33:23.093 INFO:tasks.workunit.client.0.smithi082.stdout:2/527: mknod d7/d8/d13/cb0 0 2024-04-27T07:33:23.099 INFO:tasks.workunit.client.0.smithi082.stdout:2/528: dwrite d7/d31/d54/fab [0,4194304] 0 2024-04-27T07:33:23.101 INFO:tasks.workunit.client.0.smithi082.stdout:0/585: dread da/d28/f61 [0,4194304] 0 2024-04-27T07:33:23.105 INFO:tasks.workunit.client.0.smithi082.stdout:6/504: dread d2/de/d13/f21 [0,4194304] 0 2024-04-27T07:33:23.106 INFO:tasks.workunit.client.0.smithi082.stdout:2/529: write d7/d14/f3d [49082,13640] 0 2024-04-27T07:33:23.107 INFO:tasks.workunit.client.0.smithi082.stdout:6/505: readlink d2/d2d/l36 0 2024-04-27T07:33:23.108 INFO:tasks.workunit.client.0.smithi082.stdout:2/530: write d7/d9/d4f/d66/dae/f79 [3014735,31863] 0 2024-04-27T07:33:23.109 INFO:tasks.workunit.client.0.smithi082.stdout:6/506: read d2/d3/f6 [1023450,5415] 0 2024-04-27T07:33:23.110 INFO:tasks.workunit.client.0.smithi082.stdout:0/586: dread da/d38/d7f/d4a/f58 [0,4194304] 0 2024-04-27T07:33:23.111 INFO:tasks.workunit.client.0.smithi082.stdout:0/587: dread - da/d3c/d3f/d4c/d95/faf zero size 2024-04-27T07:33:23.112 INFO:tasks.workunit.client.0.smithi082.stdout:2/531: unlink d7/d31/d54/f92 0 2024-04-27T07:33:23.113 INFO:tasks.workunit.client.0.smithi082.stdout:6/507: mknod d2/de/d13/ca1 0 2024-04-27T07:33:23.116 INFO:tasks.workunit.client.0.smithi082.stdout:6/508: mknod d2/de/d13/ca2 0 2024-04-27T07:33:23.118 INFO:tasks.workunit.client.0.smithi082.stdout:0/588: dwrite da/d3c/d3f/d4c/f9c [0,4194304] 0 2024-04-27T07:33:23.121 INFO:tasks.workunit.client.0.smithi082.stdout:6/509: rename d2/d2e/d6a/c6d to d2/d1e/d32/d85/ca3 0 2024-04-27T07:33:23.123 INFO:tasks.workunit.client.0.smithi082.stdout:0/589: mknod da/d3c/d3f/d57/cd4 0 2024-04-27T07:33:23.127 INFO:tasks.workunit.client.0.smithi082.stdout:0/590: truncate da/d28/d36/f7b 544425 0 2024-04-27T07:33:23.127 INFO:tasks.workunit.client.0.smithi082.stdout:0/591: stat da/d3c/d3f/d57/c7c 0 2024-04-27T07:33:23.128 INFO:tasks.workunit.client.0.smithi082.stdout:0/592: write da/d28/f61 [492072,7347] 0 2024-04-27T07:33:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:0/593: mkdir da/d38/d7f/d4a/d80/da0/dd5 0 2024-04-27T07:33:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:0/594: creat da/d38/da9/fd6 x:0 0 0 2024-04-27T07:33:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:0/595: chown da/d38/d7f/d4a/d80/fb8 18596 1 2024-04-27T07:33:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:6/510: rename d2/d1e/d32/d85/ca3 to d2/d2d/d3d/ca4 0 2024-04-27T07:33:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:0/596: chown da/d2a/f5d 7374 1 2024-04-27T07:33:23.138 INFO:tasks.workunit.client.0.smithi082.stdout:6/511: mknod d2/d2e/d55/ca5 0 2024-04-27T07:33:23.139 INFO:tasks.workunit.client.0.smithi082.stdout:0/597: mkdir da/d28/d36/d40/dd7 0 2024-04-27T07:33:23.141 INFO:tasks.workunit.client.0.smithi082.stdout:0/598: creat da/d3c/fd8 x:0 0 0 2024-04-27T07:33:23.142 INFO:tasks.workunit.client.0.smithi082.stdout:0/599: truncate da/f62 346431 0 2024-04-27T07:33:23.144 INFO:tasks.workunit.client.0.smithi082.stdout:0/600: read da/d38/f50 [1524713,37037] 0 2024-04-27T07:33:23.146 INFO:tasks.workunit.client.0.smithi082.stdout:0/601: truncate da/d38/f6e 3055977 0 2024-04-27T07:33:23.148 INFO:tasks.workunit.client.0.smithi082.stdout:6/512: dwrite d2/d2d/d4a/f50 [0,4194304] 0 2024-04-27T07:33:23.149 INFO:tasks.workunit.client.0.smithi082.stdout:6/513: read - d2/f2a zero size 2024-04-27T07:33:23.172 INFO:tasks.workunit.client.0.smithi082.stdout:6/514: dread d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:23.172 INFO:tasks.workunit.client.0.smithi082.stdout:6/515: chown d2/d1e/d32/d85/f8b 852163 1 2024-04-27T07:33:23.176 INFO:tasks.workunit.client.0.smithi082.stdout:6/516: write d2/de/d13/f33 [853478,52450] 0 2024-04-27T07:33:23.178 INFO:tasks.workunit.client.0.smithi082.stdout:6/517: creat d2/d3/d9c/fa6 x:0 0 0 2024-04-27T07:33:23.179 INFO:tasks.workunit.client.0.smithi082.stdout:6/518: mknod d2/d81/ca7 0 2024-04-27T07:33:23.181 INFO:tasks.workunit.client.0.smithi082.stdout:6/519: mkdir d2/d3/da8 0 2024-04-27T07:33:23.186 INFO:tasks.workunit.client.0.smithi082.stdout:6/520: dwrite d2/d2e/f30 [0,4194304] 0 2024-04-27T07:33:23.190 INFO:tasks.workunit.client.0.smithi082.stdout:6/521: mknod d2/d2e/ca9 0 2024-04-27T07:33:23.192 INFO:tasks.workunit.client.0.smithi082.stdout:6/522: unlink d2/d3/d1b/c58 0 2024-04-27T07:33:23.196 INFO:tasks.workunit.client.0.smithi082.stdout:6/523: dwrite d2/d3/f27 [0,4194304] 0 2024-04-27T07:33:23.200 INFO:tasks.workunit.client.0.smithi082.stdout:6/524: getdents d2/d45 0 2024-04-27T07:33:23.211 INFO:tasks.workunit.client.0.smithi082.stdout:6/525: dread d2/de/d13/f33 [0,4194304] 0 2024-04-27T07:33:23.212 INFO:tasks.workunit.client.0.smithi082.stdout:6/526: write d2/d3/d9c/f9f [339048,91531] 0 2024-04-27T07:33:23.214 INFO:tasks.workunit.client.0.smithi082.stdout:6/527: creat d2/de/d13/faa x:0 0 0 2024-04-27T07:33:23.215 INFO:tasks.workunit.client.0.smithi082.stdout:6/528: fsync d2/f74 0 2024-04-27T07:33:23.216 INFO:tasks.workunit.client.0.smithi082.stdout:6/529: read d2/d3/d1b/f5c [1397084,15569] 0 2024-04-27T07:33:23.217 INFO:tasks.workunit.client.0.smithi082.stdout:6/530: write d2/d81/f86 [898386,128931] 0 2024-04-27T07:33:23.223 INFO:tasks.workunit.client.0.smithi082.stdout:6/531: dwrite d2/d1e/f90 [0,4194304] 0 2024-04-27T07:33:23.232 INFO:tasks.workunit.client.0.smithi082.stdout:6/532: dread d2/d3/d1b/f4b [0,4194304] 0 2024-04-27T07:33:23.235 INFO:tasks.workunit.client.0.smithi082.stdout:6/533: creat d2/d1e/d32/d7d/d82/da0/fab x:0 0 0 2024-04-27T07:33:23.237 INFO:tasks.workunit.client.0.smithi082.stdout:6/534: creat d2/d1e/d32/d7d/d82/da0/fac x:0 0 0 2024-04-27T07:33:23.306 INFO:tasks.workunit.client.0.smithi082.stdout:3/738: sync 2024-04-27T07:33:23.311 INFO:tasks.workunit.client.0.smithi082.stdout:3/739: mkdir d8/d9/d1d/da5/d10a 0 2024-04-27T07:33:23.314 INFO:tasks.workunit.client.0.smithi082.stdout:3/740: mkdir d8/d9/d25/d91/d10b 0 2024-04-27T07:33:23.316 INFO:tasks.workunit.client.0.smithi082.stdout:3/741: read d8/d9/d25/d26/d4d/fc1 [1462084,126590] 0 2024-04-27T07:33:23.321 INFO:tasks.workunit.client.0.smithi082.stdout:3/742: dwrite d8/d9/d1d/fa1 [0,4194304] 0 2024-04-27T07:33:23.326 INFO:tasks.workunit.client.0.smithi082.stdout:3/743: creat d8/d9/dd/de1/f10c x:0 0 0 2024-04-27T07:33:23.343 INFO:tasks.workunit.client.0.smithi082.stdout:3/744: dread d8/d9/dd/d13/d1b/fee [0,4194304] 0 2024-04-27T07:33:23.353 INFO:tasks.workunit.client.0.smithi082.stdout:3/745: dread d8/d9/d1f/f94 [0,4194304] 0 2024-04-27T07:33:23.354 INFO:tasks.workunit.client.0.smithi082.stdout:3/746: symlink d8/d9/d3f/l10d 0 2024-04-27T07:33:23.356 INFO:tasks.workunit.client.0.smithi082.stdout:3/747: read d8/d9/d3f/f80 [2109382,121524] 0 2024-04-27T07:33:23.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/748: mknod d8/d9/d25/d66/c10e 0 2024-04-27T07:33:23.368 INFO:tasks.workunit.client.0.smithi082.stdout:3/749: dread d8/d9/d25/d26/f98 [0,4194304] 0 2024-04-27T07:33:23.369 INFO:tasks.workunit.client.0.smithi082.stdout:3/750: write d8/d9/db0/fd6 [1197461,58712] 0 2024-04-27T07:33:23.371 INFO:tasks.workunit.client.0.smithi082.stdout:3/751: creat d8/d9/d25/d26/d4d/d82/d8b/f10f x:0 0 0 2024-04-27T07:33:23.382 INFO:tasks.workunit.client.0.smithi082.stdout:3/752: dread d8/d9/d3f/f8c [0,4194304] 0 2024-04-27T07:33:23.382 INFO:tasks.workunit.client.0.smithi082.stdout:3/753: stat d8/l2c 0 2024-04-27T07:33:23.384 INFO:tasks.workunit.client.0.smithi082.stdout:3/754: creat d8/d9/dd/d13/d1b/dbd/f110 x:0 0 0 2024-04-27T07:33:23.386 INFO:tasks.workunit.client.0.smithi082.stdout:3/755: mknod d8/d9/d1d/da5/c111 0 2024-04-27T07:33:23.389 INFO:tasks.workunit.client.0.smithi082.stdout:3/756: getdents d8/d9/d1f 0 2024-04-27T07:33:23.391 INFO:tasks.workunit.client.0.smithi082.stdout:3/757: creat d8/d9/d25/d4e/da4/f112 x:0 0 0 2024-04-27T07:33:23.392 INFO:tasks.workunit.client.0.smithi082.stdout:3/758: chown d8/d9/d25/d26/f6e 64872 1 2024-04-27T07:33:23.393 INFO:tasks.workunit.client.0.smithi082.stdout:3/759: creat d8/d9/dd/d13/d1b/dbd/d8e/f113 x:0 0 0 2024-04-27T07:33:23.394 INFO:tasks.workunit.client.0.smithi082.stdout:3/760: truncate d8/d9/d25/d26/f6e 731597 0 2024-04-27T07:33:23.419 INFO:tasks.workunit.client.0.smithi082.stdout:4/540: sync 2024-04-27T07:33:23.419 INFO:tasks.workunit.client.0.smithi082.stdout:7/462: sync 2024-04-27T07:33:23.425 INFO:tasks.workunit.client.0.smithi082.stdout:7/463: dwrite d3/d49/d97/f60 [0,4194304] 0 2024-04-27T07:33:23.426 INFO:tasks.workunit.client.0.smithi082.stdout:4/541: dwrite d3/d6/d16/d98/fa0 [0,4194304] 0 2024-04-27T07:33:23.433 INFO:tasks.workunit.client.0.smithi082.stdout:7/464: creat d3/db/d8a/d91/f98 x:0 0 0 2024-04-27T07:33:23.433 INFO:tasks.workunit.client.0.smithi082.stdout:4/542: getdents d3/d10/d9c/d9f 0 2024-04-27T07:33:23.444 INFO:tasks.workunit.client.0.smithi082.stdout:4/543: dwrite d3/d9/fb [0,4194304] 0 2024-04-27T07:33:23.444 INFO:tasks.workunit.client.0.smithi082.stdout:7/465: dwrite d3/d9/d4f/d61/f86 [8388608,4194304] 0 2024-04-27T07:33:23.447 INFO:tasks.workunit.client.0.smithi082.stdout:4/544: creat d3/d10/d9c/fb3 x:0 0 0 2024-04-27T07:33:23.449 INFO:tasks.workunit.client.0.smithi082.stdout:7/466: write d3/d49/d97/d3a/f65 [3246201,115574] 0 2024-04-27T07:33:23.453 INFO:tasks.workunit.client.0.smithi082.stdout:4/545: creat d3/d81/fb4 x:0 0 0 2024-04-27T07:33:23.453 INFO:tasks.workunit.client.0.smithi082.stdout:7/467: mkdir d3/db/d8a/d91/d99 0 2024-04-27T07:33:23.456 INFO:tasks.workunit.client.0.smithi082.stdout:7/468: mkdir d3/d9/d4f/d9a 0 2024-04-27T07:33:23.457 INFO:tasks.workunit.client.0.smithi082.stdout:7/469: creat d3/f9b x:0 0 0 2024-04-27T07:33:23.458 INFO:tasks.workunit.client.0.smithi082.stdout:4/546: read d3/d6/d22/d69/f79 [1240390,91937] 0 2024-04-27T07:33:23.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/470: dread - d3/db/d8a/d91/f98 zero size 2024-04-27T07:33:23.460 INFO:tasks.workunit.client.0.smithi082.stdout:4/547: creat d3/d6/d22/fb5 x:0 0 0 2024-04-27T07:33:23.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/471: rmdir d3/db/d8a/d91/d99 0 2024-04-27T07:33:23.463 INFO:tasks.workunit.client.0.smithi082.stdout:4/548: rename d3/d6/d16/c41 to d3/d6/d26/d55/d67/d9d/cb6 0 2024-04-27T07:33:23.464 INFO:tasks.workunit.client.0.smithi082.stdout:7/472: write d3/d49/d97/d3a/d2a/f57 [293630,21717] 0 2024-04-27T07:33:23.466 INFO:tasks.workunit.client.0.smithi082.stdout:4/549: unlink d3/d10/c54 0 2024-04-27T07:33:23.466 INFO:tasks.workunit.client.0.smithi082.stdout:7/473: write d3/d49/d97/d3a/f68 [490827,40424] 0 2024-04-27T07:33:23.468 INFO:tasks.workunit.client.0.smithi082.stdout:4/550: fdatasync d3/d10/f7b 0 2024-04-27T07:33:23.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/474: dread - d3/db/f46 zero size 2024-04-27T07:33:23.470 INFO:tasks.workunit.client.0.smithi082.stdout:4/551: mknod d3/d6/d26/d55/cb7 0 2024-04-27T07:33:23.471 INFO:tasks.workunit.client.0.smithi082.stdout:4/552: write d3/d6/d16/f3f [1910021,11894] 0 2024-04-27T07:33:23.472 INFO:tasks.workunit.client.0.smithi082.stdout:4/553: fsync d3/d6/d22/f9a 0 2024-04-27T07:33:23.472 INFO:tasks.workunit.client.0.smithi082.stdout:7/475: unlink d3/d9/d4f/d61/d77/c7b 0 2024-04-27T07:33:23.473 INFO:tasks.workunit.client.0.smithi082.stdout:7/476: stat d3/c8d 0 2024-04-27T07:33:23.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/477: write d3/d49/d97/d3a/f92 [5351,54295] 0 2024-04-27T07:33:23.474 INFO:tasks.workunit.client.0.smithi082.stdout:4/554: mkdir d3/d6/d22/d69/d85/db8 0 2024-04-27T07:33:23.477 INFO:tasks.workunit.client.0.smithi082.stdout:4/555: write d3/d6/d22/f59 [762778,3403] 0 2024-04-27T07:33:23.478 INFO:tasks.workunit.client.0.smithi082.stdout:7/478: truncate d3/db/f2e 3733547 0 2024-04-27T07:33:23.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/556: creat d3/d9/fb9 x:0 0 0 2024-04-27T07:33:23.485 INFO:tasks.workunit.client.0.smithi082.stdout:7/479: dwrite d3/d49/d97/d7d/f93 [0,4194304] 0 2024-04-27T07:33:23.489 INFO:tasks.workunit.client.0.smithi082.stdout:7/480: rmdir d3/d9/d4f/d61 39 2024-04-27T07:33:23.492 INFO:tasks.workunit.client.0.smithi082.stdout:7/481: read d3/d49/d97/d6c/f7f [209030,70746] 0 2024-04-27T07:33:23.494 INFO:tasks.workunit.client.0.smithi082.stdout:7/482: write d3/d49/d97/f2f [5396451,82895] 0 2024-04-27T07:33:23.497 INFO:tasks.workunit.client.0.smithi082.stdout:7/483: unlink d3/d9/l6d 0 2024-04-27T07:33:23.498 INFO:tasks.workunit.client.0.smithi082.stdout:4/557: chown d3/d10/l38 880 1 2024-04-27T07:33:23.502 INFO:tasks.workunit.client.0.smithi082.stdout:4/558: creat d3/fba x:0 0 0 2024-04-27T07:33:23.503 INFO:tasks.workunit.client.0.smithi082.stdout:7/484: dwrite d3/f9b [0,4194304] 0 2024-04-27T07:33:23.510 INFO:tasks.workunit.client.0.smithi082.stdout:4/559: chown d3/f4e 0 1 2024-04-27T07:33:23.510 INFO:tasks.workunit.client.0.smithi082.stdout:7/485: dread d3/db/ff [0,4194304] 0 2024-04-27T07:33:23.511 INFO:tasks.workunit.client.0.smithi082.stdout:4/560: fdatasync d3/d6/d26/d5e/f97 0 2024-04-27T07:33:23.512 INFO:tasks.workunit.client.0.smithi082.stdout:7/486: chown d3/d49/d97/d3a/d71/f7e 15 1 2024-04-27T07:33:23.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/561: chown d3/d10/faa 3815490 1 2024-04-27T07:33:23.514 INFO:tasks.workunit.client.0.smithi082.stdout:7/487: rmdir d3/d9 39 2024-04-27T07:33:23.515 INFO:tasks.workunit.client.0.smithi082.stdout:4/562: symlink d3/d6/d26/d5e/d21/dad/lbb 0 2024-04-27T07:33:23.526 INFO:tasks.workunit.client.0.smithi082.stdout:4/563: dread d3/d6/f5d [0,4194304] 0 2024-04-27T07:33:23.528 INFO:tasks.workunit.client.0.smithi082.stdout:4/564: read d3/d10/f3d [1669057,128296] 0 2024-04-27T07:33:23.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/488: dread d3/d49/d97/f14 [0,4194304] 0 2024-04-27T07:33:23.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/565: write d3/d6/d26/f9e [1528435,106844] 0 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:2/532: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:9/441: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:6/535: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:8/522: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/602: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:5/628: sync 2024-04-27T07:33:23.531 INFO:tasks.workunit.client.0.smithi082.stdout:1/502: sync 2024-04-27T07:33:23.534 INFO:tasks.workunit.client.0.smithi082.stdout:9/442: dread - d9/da/dc/d35/d38/d65/f7f zero size 2024-04-27T07:33:23.534 INFO:tasks.workunit.client.0.smithi082.stdout:7/489: mknod d3/d9/c9c 0 2024-04-27T07:33:23.534 INFO:tasks.workunit.client.0.smithi082.stdout:1/503: fdatasync d4/d15/d49/d4e/f5a 0 2024-04-27T07:33:23.535 INFO:tasks.workunit.client.0.smithi082.stdout:4/566: unlink d3/f91 0 2024-04-27T07:33:23.537 INFO:tasks.workunit.client.0.smithi082.stdout:5/629: creat d8/d14/d7b/d8b/fd7 x:0 0 0 2024-04-27T07:33:23.538 INFO:tasks.workunit.client.0.smithi082.stdout:8/523: creat d0/d3/d1b/d53/fa8 x:0 0 0 2024-04-27T07:33:23.540 INFO:tasks.workunit.client.0.smithi082.stdout:8/524: read - d0/d3/d1c/f7d zero size 2024-04-27T07:33:23.540 INFO:tasks.workunit.client.0.smithi082.stdout:6/536: dwrite d2/d1e/f90 [0,4194304] 0 2024-04-27T07:33:23.541 INFO:tasks.workunit.client.0.smithi082.stdout:0/603: rename da/d38/d7f/d4a/d80/fb8 to da/d38/da9/fd9 0 2024-04-27T07:33:23.545 INFO:tasks.workunit.client.0.smithi082.stdout:4/567: write d3/d10/f3d [3447279,18794] 0 2024-04-27T07:33:23.547 INFO:tasks.workunit.client.0.smithi082.stdout:7/490: symlink d3/d9/d4f/l9d 0 2024-04-27T07:33:23.548 INFO:tasks.workunit.client.0.smithi082.stdout:7/491: chown d3/f8c 1833894 1 2024-04-27T07:33:23.549 INFO:tasks.workunit.client.0.smithi082.stdout:0/604: mknod da/d1d/d6a/cda 0 2024-04-27T07:33:23.551 INFO:tasks.workunit.client.0.smithi082.stdout:8/525: dwrite d0/d2b/d9a/da4/d35/f49 [0,4194304] 0 2024-04-27T07:33:23.554 INFO:tasks.workunit.client.0.smithi082.stdout:4/568: stat d3/d6/d26/d55/c7f 0 2024-04-27T07:33:23.554 INFO:tasks.workunit.client.0.smithi082.stdout:6/537: truncate d2/de/f72 7756745 0 2024-04-27T07:33:23.557 INFO:tasks.workunit.client.0.smithi082.stdout:8/526: mkdir d0/d2b/d80/da9 0 2024-04-27T07:33:23.558 INFO:tasks.workunit.client.0.smithi082.stdout:5/630: dread d8/d3c/d4a/f55 [4194304,4194304] 0 2024-04-27T07:33:23.559 INFO:tasks.workunit.client.0.smithi082.stdout:6/538: mkdir d2/d2d/d4a/dad 0 2024-04-27T07:33:23.559 INFO:tasks.workunit.client.0.smithi082.stdout:5/631: read - d8/d14/f49 zero size 2024-04-27T07:33:23.561 INFO:tasks.workunit.client.0.smithi082.stdout:4/569: chown d3/d6/d22/d69/l99 338 1 2024-04-27T07:33:23.563 INFO:tasks.workunit.client.0.smithi082.stdout:9/443: dread d9/d2d/d2b/d46/f58 [0,4194304] 0 2024-04-27T07:33:23.565 INFO:tasks.workunit.client.0.smithi082.stdout:9/444: read d9/f4c [356317,34169] 0 2024-04-27T07:33:23.565 INFO:tasks.workunit.client.0.smithi082.stdout:9/445: chown d9/d2d/d2b/c2e 0 1 2024-04-27T07:33:23.566 INFO:tasks.workunit.client.0.smithi082.stdout:9/446: write d9/da/f67 [318647,5062] 0 2024-04-27T07:33:23.568 INFO:tasks.workunit.client.0.smithi082.stdout:9/447: readlink d9/da/dc/d35/d42/l5b 0 2024-04-27T07:33:23.572 INFO:tasks.workunit.client.0.smithi082.stdout:5/632: mknod d8/d77/cd8 0 2024-04-27T07:33:23.574 INFO:tasks.workunit.client.0.smithi082.stdout:9/448: symlink d9/da/dc/d35/d4b/l8d 0 2024-04-27T07:33:23.577 INFO:tasks.workunit.client.0.smithi082.stdout:5/633: creat d8/d98/d9c/fd9 x:0 0 0 2024-04-27T07:33:23.577 INFO:tasks.workunit.client.0.smithi082.stdout:8/527: getdents d0/d2b/d9a/da4/d35 0 2024-04-27T07:33:23.580 INFO:tasks.workunit.client.0.smithi082.stdout:9/449: chown d9/c43 13 1 2024-04-27T07:33:23.580 INFO:tasks.workunit.client.0.smithi082.stdout:8/528: dread - d0/d3/d1b/d53/fa8 zero size 2024-04-27T07:33:23.581 INFO:tasks.workunit.client.0.smithi082.stdout:5/634: truncate d8/d29/d4e/dad/fbe 681790 0 2024-04-27T07:33:23.584 INFO:tasks.workunit.client.0.smithi082.stdout:8/529: mknod d0/d3/d55/caa 0 2024-04-27T07:33:23.584 INFO:tasks.workunit.client.0.smithi082.stdout:8/530: chown d0/d3/d87/d71 122014482 1 2024-04-27T07:33:23.587 INFO:tasks.workunit.client.0.smithi082.stdout:7/492: dread d3/d49/d97/f1e [0,4194304] 0 2024-04-27T07:33:23.588 INFO:tasks.workunit.client.0.smithi082.stdout:5/635: symlink d8/d29/d4e/dad/lda 0 2024-04-27T07:33:23.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/605: dread da/d2a/fae [0,4194304] 0 2024-04-27T07:33:23.589 INFO:tasks.workunit.client.0.smithi082.stdout:5/636: write f5 [3797899,14330] 0 2024-04-27T07:33:23.589 INFO:tasks.workunit.client.0.smithi082.stdout:4/570: truncate d3/d10/f3d 2974554 0 2024-04-27T07:33:23.592 INFO:tasks.workunit.client.0.smithi082.stdout:8/531: creat d0/d3/d87/d42/fab x:0 0 0 2024-04-27T07:33:23.592 INFO:tasks.workunit.client.0.smithi082.stdout:4/571: write d3/d6/d22/f9a [139592,104945] 0 2024-04-27T07:33:23.598 INFO:tasks.workunit.client.0.smithi082.stdout:9/450: dread d9/da/dc/d35/d4b/f74 [0,4194304] 0 2024-04-27T07:33:23.598 INFO:tasks.workunit.client.0.smithi082.stdout:4/572: dread - d3/d6/d26/d5e/d21/f80 zero size 2024-04-27T07:33:23.604 INFO:tasks.workunit.client.0.smithi082.stdout:7/493: link d3/d49/d97/d3a/d71/l73 d3/d49/d97/d3a/d2a/l9e 0 2024-04-27T07:33:23.605 INFO:tasks.workunit.client.0.smithi082.stdout:0/606: dwrite da/d2a/f87 [4194304,4194304] 0 2024-04-27T07:33:23.607 INFO:tasks.workunit.client.0.smithi082.stdout:4/573: readlink d3/d6/d16/la1 0 2024-04-27T07:33:23.607 INFO:tasks.workunit.client.0.smithi082.stdout:5/637: write d8/d15/d65/f9b [475396,8871] 0 2024-04-27T07:33:23.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/494: chown d3/d49/d97/f5a 1 1 2024-04-27T07:33:23.611 INFO:tasks.workunit.client.0.smithi082.stdout:8/532: dwrite d0/d3/d87/d42/d7f/f8d [0,4194304] 0 2024-04-27T07:33:23.614 INFO:tasks.workunit.client.0.smithi082.stdout:8/533: chown d0/d3/d1b/l91 50 1 2024-04-27T07:33:23.617 INFO:tasks.workunit.client.0.smithi082.stdout:5/638: dwrite d8/d29/d4e/f5e [0,4194304] 0 2024-04-27T07:33:23.627 INFO:tasks.workunit.client.0.smithi082.stdout:7/495: rename d3/d9/l25 to d3/d9/l9f 0 2024-04-27T07:33:23.630 INFO:tasks.workunit.client.0.smithi082.stdout:8/534: mkdir d0/d3/d87/d42/d7f/dac 0 2024-04-27T07:33:23.631 INFO:tasks.workunit.client.0.smithi082.stdout:8/535: chown d0/d3/d87/d46 13642 1 2024-04-27T07:33:23.632 INFO:tasks.workunit.client.0.smithi082.stdout:9/451: symlink d9/da/dc/d35/d4a/d61/l8e 0 2024-04-27T07:33:23.632 INFO:tasks.workunit.client.0.smithi082.stdout:4/574: dwrite d3/d6/d26/d55/f6b [0,4194304] 0 2024-04-27T07:33:23.635 INFO:tasks.workunit.client.0.smithi082.stdout:5/639: rename f7 to d8/d15/fdb 0 2024-04-27T07:33:23.638 INFO:tasks.workunit.client.0.smithi082.stdout:9/452: creat d9/da/dc/d35/d42/f8f x:0 0 0 2024-04-27T07:33:23.638 INFO:tasks.workunit.client.0.smithi082.stdout:7/496: dwrite d3/d49/d97/d3a/d71/f7a [0,4194304] 0 2024-04-27T07:33:23.640 INFO:tasks.workunit.client.0.smithi082.stdout:4/575: mknod d3/d6/d26/d5e/d21/cbc 0 2024-04-27T07:33:23.641 INFO:tasks.workunit.client.0.smithi082.stdout:9/453: dread d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:23.643 INFO:tasks.workunit.client.0.smithi082.stdout:4/576: read d3/f29 [301553,52744] 0 2024-04-27T07:33:23.644 INFO:tasks.workunit.client.0.smithi082.stdout:9/454: creat d9/da/d32/f90 x:0 0 0 2024-04-27T07:33:23.645 INFO:tasks.workunit.client.0.smithi082.stdout:4/577: chown d3/d6/d16/fae 26200 1 2024-04-27T07:33:23.645 INFO:tasks.workunit.client.0.smithi082.stdout:9/455: write f4 [2478268,41379] 0 2024-04-27T07:33:23.647 INFO:tasks.workunit.client.0.smithi082.stdout:9/456: fdatasync d9/da/dc/d35/d38/d65/f7f 0 2024-04-27T07:33:23.649 INFO:tasks.workunit.client.0.smithi082.stdout:9/457: creat d9/da/dc/d35/d42/d66/f91 x:0 0 0 2024-04-27T07:33:23.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/458: stat d9/da/l79 0 2024-04-27T07:33:23.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/459: stat d9/da/d32/f39 0 2024-04-27T07:33:23.653 INFO:tasks.workunit.client.0.smithi082.stdout:4/578: creat d3/d9/fbd x:0 0 0 2024-04-27T07:33:23.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/460: readlink d9/da/l79 0 2024-04-27T07:33:23.654 INFO:tasks.workunit.client.0.smithi082.stdout:3/761: sync 2024-04-27T07:33:23.654 INFO:tasks.workunit.client.0.smithi082.stdout:7/497: dread d3/d49/d97/f2f [0,4194304] 0 2024-04-27T07:33:23.655 INFO:tasks.workunit.client.0.smithi082.stdout:4/579: stat d3/d6/d26/d5e 0 2024-04-27T07:33:23.658 INFO:tasks.workunit.client.0.smithi082.stdout:7/498: mkdir d3/d49/d97/d3a/d71/da0 0 2024-04-27T07:33:23.661 INFO:tasks.workunit.client.0.smithi082.stdout:7/499: mkdir d3/d49/d97/d7d/da1 0 2024-04-27T07:33:23.662 INFO:tasks.workunit.client.0.smithi082.stdout:3/762: dwrite d8/d9/f1c [0,4194304] 0 2024-04-27T07:33:23.663 INFO:tasks.workunit.client.0.smithi082.stdout:7/500: write d3/d49/d97/f60 [453187,77562] 0 2024-04-27T07:33:23.663 INFO:tasks.workunit.client.0.smithi082.stdout:3/763: chown d8/d9/d1f/c42 61 1 2024-04-27T07:33:23.665 INFO:tasks.workunit.client.0.smithi082.stdout:9/461: dread d9/d2d/f23 [0,4194304] 0 2024-04-27T07:33:23.667 INFO:tasks.workunit.client.0.smithi082.stdout:3/764: chown d8/d9/d1d/db5 82889 1 2024-04-27T07:33:23.669 INFO:tasks.workunit.client.0.smithi082.stdout:9/462: dread - d9/da/dc/d35/d42/d66/f91 zero size 2024-04-27T07:33:23.669 INFO:tasks.workunit.client.0.smithi082.stdout:7/501: symlink d3/d9/d4f/d61/d77/la2 0 2024-04-27T07:33:23.669 INFO:tasks.workunit.client.0.smithi082.stdout:3/765: chown d8/c75 56156 1 2024-04-27T07:33:23.670 INFO:tasks.workunit.client.0.smithi082.stdout:8/536: truncate d0/d3/d87/f3f 906292 0 2024-04-27T07:33:23.670 INFO:tasks.workunit.client.0.smithi082.stdout:9/463: write d9/f21 [290473,97955] 0 2024-04-27T07:33:23.671 INFO:tasks.workunit.client.0.smithi082.stdout:9/464: stat d9/da/dc/d35/d4a/d61 0 2024-04-27T07:33:23.673 INFO:tasks.workunit.client.0.smithi082.stdout:7/502: mkdir d3/d49/d97/d7d/da1/da3 0 2024-04-27T07:33:23.675 INFO:tasks.workunit.client.0.smithi082.stdout:9/465: rmdir d9/da/dc/d33 39 2024-04-27T07:33:23.675 INFO:tasks.workunit.client.0.smithi082.stdout:5/640: dread d8/d14/d7b/f96 [8388608,4194304] 0 2024-04-27T07:33:23.679 INFO:tasks.workunit.client.0.smithi082.stdout:3/766: dwrite d8/d9/dd/d13/d1b/f31 [0,4194304] 0 2024-04-27T07:33:23.680 INFO:tasks.workunit.client.0.smithi082.stdout:5/641: write d8/d77/d7a/fab [491573,37245] 0 2024-04-27T07:33:23.681 INFO:tasks.workunit.client.0.smithi082.stdout:5/642: fsync d8/d42/fb3 0 2024-04-27T07:33:23.683 INFO:tasks.workunit.client.0.smithi082.stdout:9/466: symlink d9/da/dc/d35/d4a/d50/l92 0 2024-04-27T07:33:23.684 INFO:tasks.workunit.client.0.smithi082.stdout:7/503: dwrite d3/d49/d97/f60 [0,4194304] 0 2024-04-27T07:33:23.687 INFO:tasks.workunit.client.0.smithi082.stdout:7/504: read d3/f9b [1933734,58729] 0 2024-04-27T07:33:23.687 INFO:tasks.workunit.client.0.smithi082.stdout:5/643: symlink d8/d3c/d5a/d5b/ldc 0 2024-04-27T07:33:23.692 INFO:tasks.workunit.client.0.smithi082.stdout:5/644: write d8/d2e/fb0 [785168,92547] 0 2024-04-27T07:33:23.693 INFO:tasks.workunit.client.0.smithi082.stdout:3/767: dwrite d8/d9/d1d/db5/fe4 [0,4194304] 0 2024-04-27T07:33:23.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/768: chown d8/d9/dd/d13/dc0/de8/lef 0 1 2024-04-27T07:33:23.697 INFO:tasks.workunit.client.0.smithi082.stdout:7/505: write d3/d49/d97/f79 [4581081,87072] 0 2024-04-27T07:33:23.702 INFO:tasks.workunit.client.0.smithi082.stdout:5/645: rename d8/d15/d65/d76 to d8/d29/d4e/d90/ddd 0 2024-04-27T07:33:23.705 INFO:tasks.workunit.client.0.smithi082.stdout:5/646: write d8/d15/d22/fd4 [842173,89174] 0 2024-04-27T07:33:23.707 INFO:tasks.workunit.client.0.smithi082.stdout:3/769: dwrite d8/d9/dd/ff4 [4194304,4194304] 0 2024-04-27T07:33:23.707 INFO:tasks.workunit.client.0.smithi082.stdout:7/506: rename d3/db/l39 to d3/d49/d97/d7d/da1/da3/la4 0 2024-04-27T07:33:23.707 INFO:tasks.workunit.client.0.smithi082.stdout:8/537: dread d0/d3/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:23.709 INFO:tasks.workunit.client.0.smithi082.stdout:5/647: mkdir d8/d14/d7b/dde 0 2024-04-27T07:33:23.709 INFO:tasks.workunit.client.0.smithi082.stdout:8/538: dread - d0/d3/d87/d71/f5d zero size 2024-04-27T07:33:23.710 INFO:tasks.workunit.client.0.smithi082.stdout:7/507: truncate d3/d9/d7c/f8f 89378 0 2024-04-27T07:33:23.712 INFO:tasks.workunit.client.0.smithi082.stdout:5/648: truncate d8/d3c/d47/f2f 1291243 0 2024-04-27T07:33:23.713 INFO:tasks.workunit.client.0.smithi082.stdout:7/508: fsync d3/d49/d97/d3a/f52 0 2024-04-27T07:33:23.717 INFO:tasks.workunit.client.0.smithi082.stdout:5/649: creat d8/d3c/d5a/d5b/da3/fdf x:0 0 0 2024-04-27T07:33:23.718 INFO:tasks.workunit.client.0.smithi082.stdout:7/509: creat d3/db/d8a/d91/fa5 x:0 0 0 2024-04-27T07:33:23.718 INFO:tasks.workunit.client.0.smithi082.stdout:8/539: dwrite d0/d3/d1c/f7d [0,4194304] 0 2024-04-27T07:33:23.719 INFO:tasks.workunit.client.0.smithi082.stdout:3/770: link d8/d9/dd/d13/dc0/led d8/d9/d25/d4e/da4/l114 0 2024-04-27T07:33:23.723 INFO:tasks.workunit.client.0.smithi082.stdout:8/540: creat d0/d2b/d9a/fad x:0 0 0 2024-04-27T07:33:23.725 INFO:tasks.workunit.client.0.smithi082.stdout:3/771: truncate d8/d9/d1f/f99 354682 0 2024-04-27T07:33:23.727 INFO:tasks.workunit.client.0.smithi082.stdout:5/650: dwrite d8/fa [4194304,4194304] 0 2024-04-27T07:33:23.727 INFO:tasks.workunit.client.0.smithi082.stdout:3/772: stat d8/d9/d1d/da5/dc4 0 2024-04-27T07:33:23.732 INFO:tasks.workunit.client.0.smithi082.stdout:5/651: chown d8/d3c/fb2 97368 1 2024-04-27T07:33:23.732 INFO:tasks.workunit.client.0.smithi082.stdout:3/773: mknod d8/d9/d1d/c115 0 2024-04-27T07:33:23.733 INFO:tasks.workunit.client.0.smithi082.stdout:5/652: fsync d8/d2e/d85/daa/fba 0 2024-04-27T07:33:23.734 INFO:tasks.workunit.client.0.smithi082.stdout:8/541: creat d0/d3/d1b/fae x:0 0 0 2024-04-27T07:33:23.734 INFO:tasks.workunit.client.0.smithi082.stdout:5/653: read - d8/fac zero size 2024-04-27T07:33:23.735 INFO:tasks.workunit.client.0.smithi082.stdout:5/654: dread - d8/d29/d4e/d90/fc2 zero size 2024-04-27T07:33:23.741 INFO:tasks.workunit.client.0.smithi082.stdout:3/774: dwrite d8/d9/d25/d26/d3d/f6b [0,4194304] 0 2024-04-27T07:33:23.746 INFO:tasks.workunit.client.0.smithi082.stdout:3/775: unlink d8/d9/d1d/da5/db3/ce0 0 2024-04-27T07:33:23.746 INFO:tasks.workunit.client.0.smithi082.stdout:7/510: dwrite d3/d49/d97/d3a/f21 [8388608,4194304] 0 2024-04-27T07:33:23.752 INFO:tasks.workunit.client.0.smithi082.stdout:3/776: mkdir d8/d9/d1d/da5/d10a/d116 0 2024-04-27T07:33:23.755 INFO:tasks.workunit.client.0.smithi082.stdout:7/511: creat d3/d49/d97/d3a/d71/da0/fa6 x:0 0 0 2024-04-27T07:33:23.756 INFO:tasks.workunit.client.0.smithi082.stdout:3/777: write d8/d9/d1d/df1/ff5 [3690417,32681] 0 2024-04-27T07:33:23.756 INFO:tasks.workunit.client.0.smithi082.stdout:7/512: dread - d3/d9/f74 zero size 2024-04-27T07:33:23.757 INFO:tasks.workunit.client.0.smithi082.stdout:5/655: dwrite d8/d15/d22/f6c [0,4194304] 0 2024-04-27T07:33:23.760 INFO:tasks.workunit.client.0.smithi082.stdout:3/778: creat d8/d9/dd/de1/f117 x:0 0 0 2024-04-27T07:33:23.763 INFO:tasks.workunit.client.0.smithi082.stdout:5/656: mkdir d8/d15/de0 0 2024-04-27T07:33:23.765 INFO:tasks.workunit.client.0.smithi082.stdout:3/779: link d8/d9/d25/d4e/ff0 d8/d9/d25/d26/d4d/d9f/f118 0 2024-04-27T07:33:23.770 INFO:tasks.workunit.client.0.smithi082.stdout:3/780: truncate d8/d9/dd/d13/d1b/f5d 754358 0 2024-04-27T07:33:23.772 INFO:tasks.workunit.client.0.smithi082.stdout:5/657: dwrite d8/d3c/d47/f46 [0,4194304] 0 2024-04-27T07:33:23.776 INFO:tasks.workunit.client.0.smithi082.stdout:3/781: read d8/d9/d25/d26/feb [1537866,131034] 0 2024-04-27T07:33:23.776 INFO:tasks.workunit.client.0.smithi082.stdout:5/658: rmdir d8/d42 39 2024-04-27T07:33:23.782 INFO:tasks.workunit.client.0.smithi082.stdout:7/513: dread d3/f1f [0,4194304] 0 2024-04-27T07:33:23.782 INFO:tasks.workunit.client.0.smithi082.stdout:5/659: creat d8/d2e/d85/daa/fe1 x:0 0 0 2024-04-27T07:33:23.785 INFO:tasks.workunit.client.0.smithi082.stdout:3/782: dwrite d8/d9/d25/d26/d4d/d82/d8b/dfc/f105 [0,4194304] 0 2024-04-27T07:33:23.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/514: dread d3/d49/d97/d7d/f93 [0,4194304] 0 2024-04-27T07:33:23.791 INFO:tasks.workunit.client.0.smithi082.stdout:7/515: dread - d3/d9/f74 zero size 2024-04-27T07:33:23.791 INFO:tasks.workunit.client.0.smithi082.stdout:5/660: dwrite d8/d3c/d64/f7e [0,4194304] 0 2024-04-27T07:33:23.792 INFO:tasks.workunit.client.0.smithi082.stdout:5/661: readlink d8/d3c/l40 0 2024-04-27T07:33:23.793 INFO:tasks.workunit.client.0.smithi082.stdout:5/662: read d8/d29/f35 [315294,98061] 0 2024-04-27T07:33:23.794 INFO:tasks.workunit.client.0.smithi082.stdout:3/783: write d8/d9/d1d/f2d [1465958,128616] 0 2024-04-27T07:33:23.797 INFO:tasks.workunit.client.0.smithi082.stdout:7/516: unlink d3/d9/d4f/d61/f69 0 2024-04-27T07:33:23.801 INFO:tasks.workunit.client.0.smithi082.stdout:3/784: dwrite d8/d9/db0/fd6 [0,4194304] 0 2024-04-27T07:33:23.804 INFO:tasks.workunit.client.0.smithi082.stdout:3/785: mknod d8/d9/dd/c119 0 2024-04-27T07:33:23.808 INFO:tasks.workunit.client.0.smithi082.stdout:3/786: rename d8/d9/d25/l9c to d8/d9/dd/de1/l11a 0 2024-04-27T07:33:23.809 INFO:tasks.workunit.client.0.smithi082.stdout:3/787: write d8/d9/d1d/da5/db3/f102 [612872,44776] 0 2024-04-27T07:33:23.811 INFO:tasks.workunit.client.0.smithi082.stdout:3/788: write d8/d9/d25/d26/d3d/f6b [3789324,53228] 0 2024-04-27T07:33:23.814 INFO:tasks.workunit.client.0.smithi082.stdout:5/663: dread d8/f45 [0,4194304] 0 2024-04-27T07:33:23.815 INFO:tasks.workunit.client.0.smithi082.stdout:7/517: dwrite d3/d49/d97/f1e [0,4194304] 0 2024-04-27T07:33:23.855 INFO:tasks.workunit.client.0.smithi082.stdout:3/789: truncate d8/d9/dd/d13/f6f 4032974 0 2024-04-27T07:33:23.857 INFO:tasks.workunit.client.0.smithi082.stdout:5/664: creat d8/d3c/d47/fe2 x:0 0 0 2024-04-27T07:33:23.857 INFO:tasks.workunit.client.0.smithi082.stdout:7/518: mknod d3/d49/d97/d6c/ca7 0 2024-04-27T07:33:23.857 INFO:tasks.workunit.client.0.smithi082.stdout:3/790: write d8/d9/dd/d13/d1b/dbd/d8e/f113 [731470,71021] 0 2024-04-27T07:33:23.860 INFO:tasks.workunit.client.0.smithi082.stdout:3/791: unlink d8/d9/d1f/f46 0 2024-04-27T07:33:23.862 INFO:tasks.workunit.client.0.smithi082.stdout:5/665: getdents d8/d2e/d85/daa 0 2024-04-27T07:33:23.864 INFO:tasks.workunit.client.0.smithi082.stdout:5/666: symlink d8/d15/d65/le3 0 2024-04-27T07:33:23.864 INFO:tasks.workunit.client.0.smithi082.stdout:5/667: read - d8/d15/f58 zero size 2024-04-27T07:33:23.865 INFO:tasks.workunit.client.0.smithi082.stdout:5/668: chown d8/d15/d65/le3 1 1 2024-04-27T07:33:23.866 INFO:tasks.workunit.client.0.smithi082.stdout:5/669: write d8/d3c/d47/f46 [3663598,116733] 0 2024-04-27T07:33:23.866 INFO:tasks.workunit.client.0.smithi082.stdout:5/670: chown d8/fa 177614929 1 2024-04-27T07:33:23.867 INFO:tasks.workunit.client.0.smithi082.stdout:5/671: write d8/f25 [5311893,78255] 0 2024-04-27T07:33:23.870 INFO:tasks.workunit.client.0.smithi082.stdout:5/672: creat d8/d15/d22/fe4 x:0 0 0 2024-04-27T07:33:23.872 INFO:tasks.workunit.client.0.smithi082.stdout:5/673: rmdir d8/d29 39 2024-04-27T07:33:23.873 INFO:tasks.workunit.client.0.smithi082.stdout:3/792: write d8/f74 [2916141,128703] 0 2024-04-27T07:33:23.879 INFO:tasks.workunit.client.0.smithi082.stdout:3/793: rename d8/d9/dd/d13/d1b/dbd/l2b to d8/d9/d1d/da5/l11b 0 2024-04-27T07:33:23.880 INFO:tasks.workunit.client.0.smithi082.stdout:5/674: rename d8/d3c/d5a/d5b/l75 to d8/d29/d4e/d90/ddd/le5 0 2024-04-27T07:33:23.883 INFO:tasks.workunit.client.0.smithi082.stdout:5/675: rmdir d8/d14/d7b/dde 0 2024-04-27T07:33:23.885 INFO:tasks.workunit.client.0.smithi082.stdout:5/676: mkdir d8/d98/de6 0 2024-04-27T07:33:23.888 INFO:tasks.workunit.client.0.smithi082.stdout:3/794: dread d8/d9/d25/d4e/f96 [0,4194304] 0 2024-04-27T07:33:23.891 INFO:tasks.workunit.client.0.smithi082.stdout:5/677: dwrite d8/d29/fa7 [0,4194304] 0 2024-04-27T07:33:23.891 INFO:tasks.workunit.client.0.smithi082.stdout:3/795: rmdir d8/d9/d25/d26/d3d/dad 39 2024-04-27T07:33:23.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/678: symlink d8/d3c/d5a/le7 0 2024-04-27T07:33:23.897 INFO:tasks.workunit.client.0.smithi082.stdout:3/796: rename d8/d9/db0/fd6 to d8/d9/d1d/f11c 0 2024-04-27T07:33:23.899 INFO:tasks.workunit.client.0.smithi082.stdout:5/679: unlink d8/fa 0 2024-04-27T07:33:23.900 INFO:tasks.workunit.client.0.smithi082.stdout:5/680: write d8/d3c/d47/fe2 [633409,124304] 0 2024-04-27T07:33:23.906 INFO:tasks.workunit.client.0.smithi082.stdout:3/797: dread d8/d9/dd/d13/d1b/f5d [0,4194304] 0 2024-04-27T07:33:23.906 INFO:tasks.workunit.client.0.smithi082.stdout:5/681: rename d8/d29/d4e/d90/ddd to d8/d77/de8 0 2024-04-27T07:33:23.907 INFO:tasks.workunit.client.0.smithi082.stdout:3/798: mknod d8/d9/d25/d26/d4d/d82/d8b/da0/c11d 0 2024-04-27T07:33:23.908 INFO:tasks.workunit.client.0.smithi082.stdout:5/682: symlink d8/d3c/d4a/le9 0 2024-04-27T07:33:23.911 INFO:tasks.workunit.client.0.smithi082.stdout:3/799: read d8/d9/dd/d13/d1b/dbd/f7d [3915311,69809] 0 2024-04-27T07:33:23.914 INFO:tasks.workunit.client.0.smithi082.stdout:3/800: write d8/d9/dd/d13/d1b/dbd/f110 [322664,2960] 0 2024-04-27T07:33:23.914 INFO:tasks.workunit.client.0.smithi082.stdout:5/683: dwrite d8/d15/f58 [0,4194304] 0 2024-04-27T07:33:23.915 INFO:tasks.workunit.client.0.smithi082.stdout:3/801: fsync d8/d9/d25/d91/f56 0 2024-04-27T07:33:23.924 INFO:tasks.workunit.client.0.smithi082.stdout:3/802: dwrite d8/d9/d3f/f8c [0,4194304] 0 2024-04-27T07:33:23.925 INFO:tasks.workunit.client.0.smithi082.stdout:5/684: getdents d8/d29/d4e/dad 0 2024-04-27T07:33:23.928 INFO:tasks.workunit.client.0.smithi082.stdout:3/803: fsync d8/d9/dd/d13/f6f 0 2024-04-27T07:33:23.930 INFO:tasks.workunit.client.0.smithi082.stdout:3/804: write d8/d9/dd/de1/f117 [903039,92758] 0 2024-04-27T07:33:23.932 INFO:tasks.workunit.client.0.smithi082.stdout:3/805: write d8/d9/dd/d13/d1b/dbd/f110 [1055286,29742] 0 2024-04-27T07:33:23.933 INFO:tasks.workunit.client.0.smithi082.stdout:5/685: rename d8/d3c/d5a/d5b to d8/d29/dea 0 2024-04-27T07:33:23.935 INFO:tasks.workunit.client.0.smithi082.stdout:5/686: rmdir d8/d29 39 2024-04-27T07:33:23.935 INFO:tasks.workunit.client.0.smithi082.stdout:3/806: mkdir d8/d9/dd/d11e 0 2024-04-27T07:33:23.936 INFO:tasks.workunit.client.0.smithi082.stdout:3/807: chown d8/d9/ffd 800022676 1 2024-04-27T07:33:23.937 INFO:tasks.workunit.client.0.smithi082.stdout:5/687: fsync d8/f45 0 2024-04-27T07:33:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:5/688: getdents d8/d29/dea/d5f 0 2024-04-27T07:33:23.942 INFO:tasks.workunit.client.0.smithi082.stdout:5/689: chown d8/d29/d4e/c8f 586452184 1 2024-04-27T07:33:23.946 INFO:tasks.workunit.client.0.smithi082.stdout:5/690: dread d8/d3c/d47/f2f [0,4194304] 0 2024-04-27T07:33:23.951 INFO:tasks.workunit.client.0.smithi082.stdout:5/691: write d8/d15/f13 [9142789,110877] 0 2024-04-27T07:33:23.952 INFO:tasks.workunit.client.0.smithi082.stdout:5/692: dread - d8/d29/d4e/d90/fc2 zero size 2024-04-27T07:33:23.952 INFO:tasks.workunit.client.0.smithi082.stdout:5/693: chown d8/d15/f24 6378 1 2024-04-27T07:33:23.953 INFO:tasks.workunit.client.0.smithi082.stdout:5/694: chown d8/l19 9332 1 2024-04-27T07:33:23.955 INFO:tasks.workunit.client.0.smithi082.stdout:5/695: symlink d8/d29/dea/d5f/leb 0 2024-04-27T07:33:23.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/808: dread d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 [0,4194304] 0 2024-04-27T07:33:23.957 INFO:tasks.workunit.client.0.smithi082.stdout:3/809: read - d8/d9/d1d/ff3 zero size 2024-04-27T07:33:23.958 INFO:tasks.workunit.client.0.smithi082.stdout:3/810: write d8/d9/ffd [291503,46819] 0 2024-04-27T07:33:23.961 INFO:tasks.workunit.client.0.smithi082.stdout:3/811: dread d8/d9/d3f/f8c [0,4194304] 0 2024-04-27T07:33:23.961 INFO:tasks.workunit.client.0.smithi082.stdout:5/696: dread d8/d15/f24 [0,4194304] 0 2024-04-27T07:33:23.965 INFO:tasks.workunit.client.0.smithi082.stdout:3/812: link d8/d9/d25/f77 d8/d9/d1f/f11f 0 2024-04-27T07:33:23.967 INFO:tasks.workunit.client.0.smithi082.stdout:5/697: dwrite d8/d29/fa7 [0,4194304] 0 2024-04-27T07:33:23.969 INFO:tasks.workunit.client.0.smithi082.stdout:3/813: creat d8/d9/dd/d13/d1b/dbd/dd8/f120 x:0 0 0 2024-04-27T07:33:23.970 INFO:tasks.workunit.client.0.smithi082.stdout:3/814: read - d8/d9/d25/d26/d4d/f97 zero size 2024-04-27T07:33:23.971 INFO:tasks.workunit.client.0.smithi082.stdout:5/698: creat d8/d77/fec x:0 0 0 2024-04-27T07:33:23.971 INFO:tasks.workunit.client.0.smithi082.stdout:3/815: readlink d8/d9/d1d/db5/le3 0 2024-04-27T07:33:23.974 INFO:tasks.workunit.client.0.smithi082.stdout:5/699: creat d8/d14/d7b/fed x:0 0 0 2024-04-27T07:33:23.976 INFO:tasks.workunit.client.0.smithi082.stdout:5/700: symlink d8/d2e/d85/daa/lee 0 2024-04-27T07:33:23.992 INFO:tasks.workunit.client.0.smithi082.stdout:3/816: dread d8/d9/dd/f1a [0,4194304] 0 2024-04-27T07:33:24.012 INFO:tasks.workunit.client.0.smithi082.stdout:2/533: sync 2024-04-27T07:33:24.012 INFO:tasks.workunit.client.0.smithi082.stdout:2/534: readlink d7/d9/d4f/l95 0 2024-04-27T07:33:24.014 INFO:tasks.workunit.client.0.smithi082.stdout:2/535: symlink d7/d9/d4f/d66/dae/lb1 0 2024-04-27T07:33:24.015 INFO:tasks.workunit.client.0.smithi082.stdout:2/536: creat d7/d31/d54/fb2 x:0 0 0 2024-04-27T07:33:24.023 INFO:tasks.workunit.client.0.smithi082.stdout:2/537: dwrite d7/d30/f3f [4194304,4194304] 0 2024-04-27T07:33:24.025 INFO:tasks.workunit.client.0.smithi082.stdout:2/538: dread d7/d9/d4f/fa1 [0,4194304] 0 2024-04-27T07:33:24.028 INFO:tasks.workunit.client.0.smithi082.stdout:2/539: creat d7/d9/d4f/d66/fb3 x:0 0 0 2024-04-27T07:33:24.030 INFO:tasks.workunit.client.0.smithi082.stdout:2/540: mkdir d7/d8/d99/db4 0 2024-04-27T07:33:24.031 INFO:tasks.workunit.client.0.smithi082.stdout:2/541: readlink d7/d31/l40 0 2024-04-27T07:33:24.031 INFO:tasks.workunit.client.0.smithi082.stdout:2/542: write d7/d9/d4f/f5a [2835106,40630] 0 2024-04-27T07:33:24.040 INFO:tasks.workunit.client.0.smithi082.stdout:2/543: write d7/d30/d23/fac [890841,130950] 0 2024-04-27T07:33:24.043 INFO:tasks.workunit.client.0.smithi082.stdout:2/544: read d7/d30/d61/f85 [429139,57891] 0 2024-04-27T07:33:24.045 INFO:tasks.workunit.client.0.smithi082.stdout:2/545: fsync d7/d9/d4f/fa1 0 2024-04-27T07:33:24.047 INFO:tasks.workunit.client.0.smithi082.stdout:2/546: creat d7/d8/d13/fb5 x:0 0 0 2024-04-27T07:33:24.049 INFO:tasks.workunit.client.0.smithi082.stdout:2/547: creat d7/d14/fb6 x:0 0 0 2024-04-27T07:33:24.051 INFO:tasks.workunit.client.0.smithi082.stdout:2/548: rename d7/d8/f88 to d7/d30/d23/fb7 0 2024-04-27T07:33:24.053 INFO:tasks.workunit.client.0.smithi082.stdout:2/549: rmdir d7/d31/d54 39 2024-04-27T07:33:24.054 INFO:tasks.workunit.client.0.smithi082.stdout:2/550: stat d7/d9/d4f/d6e/l83 0 2024-04-27T07:33:24.057 INFO:tasks.workunit.client.0.smithi082.stdout:2/551: getdents d7/d9/d4f/d6e/d82 0 2024-04-27T07:33:24.058 INFO:tasks.workunit.client.0.smithi082.stdout:2/552: readlink d7/d30/d23/l2e 0 2024-04-27T07:33:24.059 INFO:tasks.workunit.client.0.smithi082.stdout:2/553: chown d7/d9/le 306351628 1 2024-04-27T07:33:24.062 INFO:tasks.workunit.client.0.smithi082.stdout:2/554: unlink d7/d14/f3d 0 2024-04-27T07:33:24.068 INFO:tasks.workunit.client.0.smithi082.stdout:2/555: dwrite d7/f56 [0,4194304] 0 2024-04-27T07:33:24.075 INFO:tasks.workunit.client.0.smithi082.stdout:2/556: dwrite d7/d8/d13/d94/fad [0,4194304] 0 2024-04-27T07:33:24.077 INFO:tasks.workunit.client.0.smithi082.stdout:2/557: write d7/d9/d4f/d66/dae/f8c [380620,17344] 0 2024-04-27T07:33:24.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/558: chown d7/d8/d13/f7b 31817 1 2024-04-27T07:33:24.080 INFO:tasks.workunit.client.0.smithi082.stdout:2/559: chown d7/d30/d23/f49 1427304 1 2024-04-27T07:33:24.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/560: unlink d7/d30/f84 0 2024-04-27T07:33:24.086 INFO:tasks.workunit.client.0.smithi082.stdout:2/561: truncate d7/d31/d54/f96 595548 0 2024-04-27T07:33:24.091 INFO:tasks.workunit.client.0.smithi082.stdout:2/562: rename d7/d30/f3f to d7/d8/d13/fb8 0 2024-04-27T07:33:24.093 INFO:tasks.workunit.client.0.smithi082.stdout:2/563: mknod d7/d30/cb9 0 2024-04-27T07:33:24.102 INFO:tasks.workunit.client.0.smithi082.stdout:2/564: dwrite d7/d30/d61/fa5 [0,4194304] 0 2024-04-27T07:33:24.103 INFO:tasks.workunit.client.0.smithi082.stdout:2/565: fdatasync d7/d31/d54/fb2 0 2024-04-27T07:33:24.104 INFO:tasks.workunit.client.0.smithi082.stdout:2/566: write d7/d9/d4f/d66/fb3 [405992,62852] 0 2024-04-27T07:33:24.110 INFO:tasks.workunit.client.0.smithi082.stdout:2/567: rename d7/d9/d4f/fa1 to d7/d9/d4f/fba 0 2024-04-27T07:33:24.111 INFO:tasks.workunit.client.0.smithi082.stdout:2/568: chown d7/d14/f50 410014387 1 2024-04-27T07:33:24.112 INFO:tasks.workunit.client.0.smithi082.stdout:2/569: truncate d7/d8/f2d 4636221 0 2024-04-27T07:33:24.119 INFO:tasks.workunit.client.0.smithi082.stdout:2/570: truncate d7/d8/f1f 1166245 0 2024-04-27T07:33:24.119 INFO:tasks.workunit.client.0.smithi082.stdout:2/571: fdatasync d7/d30/d23/fac 0 2024-04-27T07:33:24.121 INFO:tasks.workunit.client.0.smithi082.stdout:2/572: symlink d7/d30/lbb 0 2024-04-27T07:33:24.137 INFO:tasks.workunit.client.0.smithi082.stdout:2/573: dread d7/d9/d4f/d6e/d93/f98 [0,4194304] 0 2024-04-27T07:33:24.141 INFO:tasks.workunit.client.0.smithi082.stdout:2/574: link d7/d30/cb9 d7/d9/d4f/d6e/d82/cbc 0 2024-04-27T07:33:24.142 INFO:tasks.workunit.client.0.smithi082.stdout:2/575: creat d7/d31/d54/fbd x:0 0 0 2024-04-27T07:33:24.143 INFO:tasks.workunit.client.0.smithi082.stdout:2/576: readlink d7/l7d 0 2024-04-27T07:33:24.144 INFO:tasks.workunit.client.0.smithi082.stdout:2/577: fdatasync d7/d14/f9a 0 2024-04-27T07:33:24.155 INFO:tasks.workunit.client.0.smithi082.stdout:2/578: dread d7/d9/f1d [4194304,4194304] 0 2024-04-27T07:33:24.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/579: dread d7/d14/f5c [0,4194304] 0 2024-04-27T07:33:24.170 INFO:tasks.workunit.client.0.smithi082.stdout:2/580: creat d7/d8/d99/db4/fbe x:0 0 0 2024-04-27T07:33:24.172 INFO:tasks.workunit.client.0.smithi082.stdout:2/581: mknod d7/d31/d54/cbf 0 2024-04-27T07:33:24.172 INFO:tasks.workunit.client.0.smithi082.stdout:2/582: stat d7/d9/d4f/l69 0 2024-04-27T07:33:24.175 INFO:tasks.workunit.client.0.smithi082.stdout:2/583: symlink d7/d8/lc0 0 2024-04-27T07:33:24.176 INFO:tasks.workunit.client.0.smithi082.stdout:2/584: write d7/d9/d4f/fba [2233487,38145] 0 2024-04-27T07:33:24.178 INFO:tasks.workunit.client.0.smithi082.stdout:2/585: mknod d7/d9/d4f/d6e/d82/cc1 0 2024-04-27T07:33:24.298 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:24 smithi082 ceph-mon[26613]: pgmap v18: 65 pgs: 65 active+clean; 997 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 21 MiB/s rd, 104 MiB/s wr, 366 op/s 2024-04-27T07:33:24.299 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:24 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:24.301 INFO:tasks.workunit.client.0.smithi082.stdout:1/504: sync 2024-04-27T07:33:24.304 INFO:tasks.workunit.client.0.smithi082.stdout:1/505: mkdir d4/d15/d49/dab 0 2024-04-27T07:33:24.306 INFO:tasks.workunit.client.0.smithi082.stdout:1/506: creat d4/d2a/d3e/d53/d72/fac x:0 0 0 2024-04-27T07:33:24.308 INFO:tasks.workunit.client.0.smithi082.stdout:1/507: creat d4/d2a/d3e/d53/fad x:0 0 0 2024-04-27T07:33:24.310 INFO:tasks.workunit.client.0.smithi082.stdout:1/508: creat d4/d2a/d4c/d7a/fae x:0 0 0 2024-04-27T07:33:24.313 INFO:tasks.workunit.client.0.smithi082.stdout:1/509: fdatasync d4/d2a/d3e/d46/f50 0 2024-04-27T07:33:24.314 INFO:tasks.workunit.client.0.smithi082.stdout:1/510: write d4/fd [1298885,30690] 0 2024-04-27T07:33:24.317 INFO:tasks.workunit.client.0.smithi082.stdout:1/511: rename d4/d15/d29/c8a to d4/d2a/d3e/d53/caf 0 2024-04-27T07:33:24.319 INFO:tasks.workunit.client.0.smithi082.stdout:1/512: symlink d4/d2a/d4c/d7a/d8c/lb0 0 2024-04-27T07:33:24.328 INFO:tasks.workunit.client.0.smithi082.stdout:1/513: dread d4/d15/d1c/f2c [4194304,4194304] 0 2024-04-27T07:33:24.330 INFO:tasks.workunit.client.0.smithi082.stdout:1/514: symlink d4/d2a/d3e/d57/da5/lb1 0 2024-04-27T07:33:24.333 INFO:tasks.workunit.client.0.smithi082.stdout:1/515: mknod d4/d15/d49/d99/d9a/da9/cb2 0 2024-04-27T07:33:24.338 INFO:tasks.workunit.client.0.smithi082.stdout:1/516: write d4/d2a/d3e/d53/f54 [597007,19607] 0 2024-04-27T07:33:24.340 INFO:tasks.workunit.client.0.smithi082.stdout:1/517: write d4/d15/d29/f7d [4379701,30569] 0 2024-04-27T07:33:24.341 INFO:tasks.workunit.client.0.smithi082.stdout:1/518: dread - d4/d2a/d3e/d53/d72/fac zero size 2024-04-27T07:33:24.355 INFO:tasks.workunit.client.0.smithi082.stdout:1/519: dread d4/f10 [0,4194304] 0 2024-04-27T07:33:24.358 INFO:tasks.workunit.client.0.smithi082.stdout:1/520: creat d4/d2a/fb3 x:0 0 0 2024-04-27T07:33:24.361 INFO:tasks.workunit.client.0.smithi082.stdout:1/521: rename d4/f5 to d4/d15/d49/d99/d9a/da9/fb4 0 2024-04-27T07:33:24.363 INFO:tasks.workunit.client.0.smithi082.stdout:1/522: dread - d4/d2a/d3e/f87 zero size 2024-04-27T07:33:24.377 INFO:tasks.workunit.client.0.smithi082.stdout:1/523: dread d4/d15/d29/f7d [0,4194304] 0 2024-04-27T07:33:24.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/524: read d4/f3a [1250985,70493] 0 2024-04-27T07:33:24.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/607: sync 2024-04-27T07:33:24.383 INFO:tasks.workunit.client.0.smithi082.stdout:6/539: sync 2024-04-27T07:33:24.387 INFO:tasks.workunit.client.0.smithi082.stdout:1/525: dwrite f2 [0,4194304] 0 2024-04-27T07:33:24.387 INFO:tasks.workunit.client.0.smithi082.stdout:0/608: symlink da/d3c/d3f/d4c/d74/d81/ldb 0 2024-04-27T07:33:24.389 INFO:tasks.workunit.client.0.smithi082.stdout:6/540: dread d2/d81/f86 [0,4194304] 0 2024-04-27T07:33:24.390 INFO:tasks.workunit.client.0.smithi082.stdout:0/609: creat da/d3c/d3f/d57/fdc x:0 0 0 2024-04-27T07:33:24.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/526: dwrite d4/d15/d49/da0/f7f [4194304,4194304] 0 2024-04-27T07:33:24.401 INFO:tasks.workunit.client.0.smithi082.stdout:1/527: fdatasync d4/d2a/d3e/f87 0 2024-04-27T07:33:24.403 INFO:tasks.workunit.client.0.smithi082.stdout:0/610: dwrite da/d3c/d3f/d4c/f54 [4194304,4194304] 0 2024-04-27T07:33:24.404 INFO:tasks.workunit.client.0.smithi082.stdout:1/528: dread - d4/d2a/fb3 zero size 2024-04-27T07:33:24.406 INFO:tasks.workunit.client.0.smithi082.stdout:0/611: write da/d28/d36/d40/f49 [1090155,13822] 0 2024-04-27T07:33:24.409 INFO:tasks.workunit.client.0.smithi082.stdout:1/529: symlink d4/d15/d3f/lb5 0 2024-04-27T07:33:24.411 INFO:tasks.workunit.client.0.smithi082.stdout:6/541: dread d2/d3/d1b/f28 [0,4194304] 0 2024-04-27T07:33:24.412 INFO:tasks.workunit.client.0.smithi082.stdout:1/530: creat d4/d15/d49/d99/fb6 x:0 0 0 2024-04-27T07:33:24.414 INFO:tasks.workunit.client.0.smithi082.stdout:0/612: rmdir da/d28/d36/d40/dd7 0 2024-04-27T07:33:24.415 INFO:tasks.workunit.client.0.smithi082.stdout:0/613: dread - da/d1d/d6a/fbf zero size 2024-04-27T07:33:24.417 INFO:tasks.workunit.client.0.smithi082.stdout:0/614: chown da/d38/d7f/d4a/d80/c8a 671211317 1 2024-04-27T07:33:24.436 INFO:tasks.workunit.client.0.smithi082.stdout:1/531: dwrite d4/d2a/d3e/d57/f77 [0,4194304] 0 2024-04-27T07:33:24.437 INFO:tasks.workunit.client.0.smithi082.stdout:0/615: dwrite da/d2a/f87 [4194304,4194304] 0 2024-04-27T07:33:24.438 INFO:tasks.workunit.client.0.smithi082.stdout:0/616: readlink da/d2a/lb1 0 2024-04-27T07:33:24.440 INFO:tasks.workunit.client.0.smithi082.stdout:1/532: mkdir d4/d15/d3f/d6d/db7 0 2024-04-27T07:33:24.441 INFO:tasks.workunit.client.0.smithi082.stdout:0/617: mkdir da/d38/da9/ddd 0 2024-04-27T07:33:24.442 INFO:tasks.workunit.client.0.smithi082.stdout:1/533: mkdir d4/d15/d49/d99/db8 0 2024-04-27T07:33:24.443 INFO:tasks.workunit.client.0.smithi082.stdout:6/542: dread d2/d3/fd [0,4194304] 0 2024-04-27T07:33:24.443 INFO:tasks.workunit.client.0.smithi082.stdout:3/817: sync 2024-04-27T07:33:24.443 INFO:tasks.workunit.client.0.smithi082.stdout:8/542: sync 2024-04-27T07:33:24.443 INFO:tasks.workunit.client.0.smithi082.stdout:9/467: sync 2024-04-27T07:33:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/534: chown d4/d15/d3f/d97 899930 1 2024-04-27T07:33:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:2/586: sync 2024-04-27T07:33:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:4/580: sync 2024-04-27T07:33:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:7/519: sync 2024-04-27T07:33:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:5/701: sync 2024-04-27T07:33:24.448 INFO:tasks.workunit.client.0.smithi082.stdout:0/618: rename da/d2a/f5d to da/d28/fde 0 2024-04-27T07:33:24.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/468: dread - d9/da/dc/d35/d38/d65/f82 zero size 2024-04-27T07:33:24.454 INFO:tasks.workunit.client.0.smithi082.stdout:7/520: mkdir d3/db/d8a/da8 0 2024-04-27T07:33:24.454 INFO:tasks.workunit.client.0.smithi082.stdout:6/543: mkdir d2/d2e/dae 0 2024-04-27T07:33:24.454 INFO:tasks.workunit.client.0.smithi082.stdout:8/543: symlink d0/d2b/d9a/da4/laf 0 2024-04-27T07:33:24.456 INFO:tasks.workunit.client.0.smithi082.stdout:2/587: rename d7/d9/d4f/f5a to d7/d14/fc2 0 2024-04-27T07:33:24.456 INFO:tasks.workunit.client.0.smithi082.stdout:8/544: chown d0/d83/d90/f9d 227035 1 2024-04-27T07:33:24.456 INFO:tasks.workunit.client.0.smithi082.stdout:5/702: dread d8/d3c/fa0 [0,4194304] 0 2024-04-27T07:33:24.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/521: mkdir d3/db/d8a/da9 0 2024-04-27T07:33:24.461 INFO:tasks.workunit.client.0.smithi082.stdout:5/703: chown d8/d3c/d47/f2f 5 1 2024-04-27T07:33:24.461 INFO:tasks.workunit.client.0.smithi082.stdout:9/469: dwrite d9/f51 [0,4194304] 0 2024-04-27T07:33:24.462 INFO:tasks.workunit.client.0.smithi082.stdout:5/704: fdatasync f5 0 2024-04-27T07:33:24.465 INFO:tasks.workunit.client.0.smithi082.stdout:6/544: unlink d2/d2d/d4a/f50 0 2024-04-27T07:33:24.466 INFO:tasks.workunit.client.0.smithi082.stdout:6/545: write d2/d1e/f22 [5129192,27086] 0 2024-04-27T07:33:24.467 INFO:tasks.workunit.client.0.smithi082.stdout:0/619: mkdir da/d38/d7f/d4a/d80/da0/dd5/ddf 0 2024-04-27T07:33:24.469 INFO:tasks.workunit.client.0.smithi082.stdout:2/588: unlink d7/d8/d13/c9c 0 2024-04-27T07:33:24.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/522: rmdir d3/d9/d7c 39 2024-04-27T07:33:24.471 INFO:tasks.workunit.client.0.smithi082.stdout:3/818: write d8/d9/d25/d26/d3d/f38 [4855059,123007] 0 2024-04-27T07:33:24.472 INFO:tasks.workunit.client.0.smithi082.stdout:2/589: read d7/d30/d23/fac [771163,88101] 0 2024-04-27T07:33:24.472 INFO:tasks.workunit.client.0.smithi082.stdout:8/545: creat d0/d3/d1c/fb0 x:0 0 0 2024-04-27T07:33:24.473 INFO:tasks.workunit.client.0.smithi082.stdout:5/705: fsync d8/d15/ff 0 2024-04-27T07:33:24.473 INFO:tasks.workunit.client.0.smithi082.stdout:7/523: read d3/d49/d97/d3a/d71/f7a [2670737,23800] 0 2024-04-27T07:33:24.476 INFO:tasks.workunit.client.0.smithi082.stdout:9/470: mkdir d9/da/dc/d88/d93 0 2024-04-27T07:33:24.477 INFO:tasks.workunit.client.0.smithi082.stdout:2/590: chown d7/d9/d4f/d66/f7c 695201 1 2024-04-27T07:33:24.478 INFO:tasks.workunit.client.0.smithi082.stdout:3/819: readlink d8/d9/dd/d13/dc0/led 0 2024-04-27T07:33:24.479 INFO:tasks.workunit.client.0.smithi082.stdout:5/706: symlink d8/d2e/d85/lef 0 2024-04-27T07:33:24.479 INFO:tasks.workunit.client.0.smithi082.stdout:9/471: chown d9/f21 13858 1 2024-04-27T07:33:24.481 INFO:tasks.workunit.client.0.smithi082.stdout:4/581: dread d3/d6/d26/d5e/f97 [0,4194304] 0 2024-04-27T07:33:24.485 INFO:tasks.workunit.client.0.smithi082.stdout:5/707: creat d8/d29/d4e/ff0 x:0 0 0 2024-04-27T07:33:24.485 INFO:tasks.workunit.client.0.smithi082.stdout:8/546: dwrite d0/d3/d87/f28 [8388608,4194304] 0 2024-04-27T07:33:24.486 INFO:tasks.workunit.client.0.smithi082.stdout:7/524: rename d3/d49/d97/f14 to d3/d9/d4f/faa 0 2024-04-27T07:33:24.487 INFO:tasks.workunit.client.0.smithi082.stdout:7/525: dread - d3/f8c zero size 2024-04-27T07:33:24.488 INFO:tasks.workunit.client.0.smithi082.stdout:3/820: mknod d8/d9/d1d/df1/c121 0 2024-04-27T07:33:24.489 INFO:tasks.workunit.client.0.smithi082.stdout:4/582: read d3/d6/d26/d5e/fa8 [22916,63603] 0 2024-04-27T07:33:24.491 INFO:tasks.workunit.client.0.smithi082.stdout:0/620: dread da/d3c/d3f/d57/dcc/da8/fb2 [0,4194304] 0 2024-04-27T07:33:24.492 INFO:tasks.workunit.client.0.smithi082.stdout:4/583: truncate d3/d6/d22/f9a 640712 0 2024-04-27T07:33:24.494 INFO:tasks.workunit.client.0.smithi082.stdout:0/621: write da/d2a/dc4/fcf [307333,110889] 0 2024-04-27T07:33:24.494 INFO:tasks.workunit.client.0.smithi082.stdout:5/708: creat d8/d29/dea/ff1 x:0 0 0 2024-04-27T07:33:24.497 INFO:tasks.workunit.client.0.smithi082.stdout:7/526: symlink d3/d9/d4f/d61/d77/lab 0 2024-04-27T07:33:24.498 INFO:tasks.workunit.client.0.smithi082.stdout:7/527: write d3/d9/f74 [621216,45034] 0 2024-04-27T07:33:24.499 INFO:tasks.workunit.client.0.smithi082.stdout:7/528: readlink d3/d49/d97/d3a/d2a/l2c 0 2024-04-27T07:33:24.500 INFO:tasks.workunit.client.0.smithi082.stdout:9/472: link d9/d2d/f19 d9/f94 0 2024-04-27T07:33:24.504 INFO:tasks.workunit.client.0.smithi082.stdout:8/547: creat d0/d3/d87/d42/d7f/d82/fb1 x:0 0 0 2024-04-27T07:33:24.505 INFO:tasks.workunit.client.0.smithi082.stdout:0/622: creat da/d38/d7f/d4a/d80/da0/fe0 x:0 0 0 2024-04-27T07:33:24.506 INFO:tasks.workunit.client.0.smithi082.stdout:4/584: dread d3/d10/f4f [0,4194304] 0 2024-04-27T07:33:24.507 INFO:tasks.workunit.client.0.smithi082.stdout:5/709: mkdir d8/d2e/d3d/df2 0 2024-04-27T07:33:24.507 INFO:tasks.workunit.client.0.smithi082.stdout:0/623: chown da/d38/d7f/d4a/d80/da0/laa 2595 1 2024-04-27T07:33:24.508 INFO:tasks.workunit.client.0.smithi082.stdout:0/624: chown da/fe 404375 1 2024-04-27T07:33:24.508 INFO:tasks.workunit.client.0.smithi082.stdout:0/625: chown da/d3c 15 1 2024-04-27T07:33:24.509 INFO:tasks.workunit.client.0.smithi082.stdout:0/626: chown da/d38/d7f/d4a 632269838 1 2024-04-27T07:33:24.512 INFO:tasks.workunit.client.0.smithi082.stdout:2/591: link d7/d9/d4f/d6e/d82/cc1 d7/d30/d23/cc3 0 2024-04-27T07:33:24.512 INFO:tasks.workunit.client.0.smithi082.stdout:0/627: chown da/l22 131521246 1 2024-04-27T07:33:24.513 INFO:tasks.workunit.client.0.smithi082.stdout:2/592: write d7/d30/d23/fac [22159,562] 0 2024-04-27T07:33:24.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/585: write d3/d6/f58 [226476,110705] 0 2024-04-27T07:33:24.516 INFO:tasks.workunit.client.0.smithi082.stdout:7/529: dwrite d3/d49/d97/d7d/f93 [0,4194304] 0 2024-04-27T07:33:24.517 INFO:tasks.workunit.client.0.smithi082.stdout:3/821: dread d8/d9/dd/f5a [0,4194304] 0 2024-04-27T07:33:24.521 INFO:tasks.workunit.client.0.smithi082.stdout:0/628: chown da/d3c/d3f/d4c/d74/l97 49189 1 2024-04-27T07:33:24.522 INFO:tasks.workunit.client.0.smithi082.stdout:3/822: readlink d8/d9/dd/d13/d1b/da8/lbc 0 2024-04-27T07:33:24.527 INFO:tasks.workunit.client.0.smithi082.stdout:2/593: dwrite d7/d30/d23/f91 [0,4194304] 0 2024-04-27T07:33:24.527 INFO:tasks.workunit.client.0.smithi082.stdout:7/530: rename d3/db/d8a to d3/d49/d97/d3a/d2a/dac 0 2024-04-27T07:33:24.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/531: chown d3/d49/d97/d3a/f92 25641 1 2024-04-27T07:33:24.531 INFO:tasks.workunit.client.0.smithi082.stdout:2/594: chown d7/d30/d61/c81 0 1 2024-04-27T07:33:24.532 INFO:tasks.workunit.client.0.smithi082.stdout:4/586: getdents d3/d6/d16 0 2024-04-27T07:33:24.532 INFO:tasks.workunit.client.0.smithi082.stdout:3/823: write d8/d9/d1d/da5/db3/fde [2194671,29603] 0 2024-04-27T07:33:24.536 INFO:tasks.workunit.client.0.smithi082.stdout:9/473: dwrite d9/da/dc/f20 [0,4194304] 0 2024-04-27T07:33:24.537 INFO:tasks.workunit.client.0.smithi082.stdout:4/587: readlink d3/d10/l11 0 2024-04-27T07:33:24.542 INFO:tasks.workunit.client.0.smithi082.stdout:4/588: symlink d3/d6/d26/d55/d67/lbe 0 2024-04-27T07:33:24.542 INFO:tasks.workunit.client.0.smithi082.stdout:7/532: creat d3/d49/d97/d3a/fad x:0 0 0 2024-04-27T07:33:24.544 INFO:tasks.workunit.client.0.smithi082.stdout:3/824: link d8/d9/d1d/df1/c121 d8/d9/d25/d26/d4d/d9f/c122 0 2024-04-27T07:33:24.546 INFO:tasks.workunit.client.0.smithi082.stdout:4/589: symlink d3/d10/d9c/lbf 0 2024-04-27T07:33:24.546 INFO:tasks.workunit.client.0.smithi082.stdout:3/825: fdatasync d8/d9/d1d/db5/dc7/fcd 0 2024-04-27T07:33:24.548 INFO:tasks.workunit.client.0.smithi082.stdout:9/474: link d9/da/dc/d35/d4a/f6a d9/da/dc/d73/f95 0 2024-04-27T07:33:24.548 INFO:tasks.workunit.client.0.smithi082.stdout:4/590: stat d3/d6/d26/d55/d67/fb1 0 2024-04-27T07:33:24.549 INFO:tasks.workunit.client.0.smithi082.stdout:2/595: dwrite d7/d9/d4f/d6e/d93/f98 [0,4194304] 0 2024-04-27T07:33:24.549 INFO:tasks.workunit.client.0.smithi082.stdout:7/533: mkdir d3/d49/d97/d3a/d2a/dac/dae 0 2024-04-27T07:33:24.551 INFO:tasks.workunit.client.0.smithi082.stdout:7/534: write d3/d49/d97/d3a/f68 [144455,14136] 0 2024-04-27T07:33:24.552 INFO:tasks.workunit.client.0.smithi082.stdout:2/596: write d7/d8/d13/fb5 [323576,58907] 0 2024-04-27T07:33:24.552 INFO:tasks.workunit.client.0.smithi082.stdout:9/475: creat d9/d2d/d2b/d46/f96 x:0 0 0 2024-04-27T07:33:24.555 INFO:tasks.workunit.client.0.smithi082.stdout:4/591: fdatasync d3/d6/d26/f60 0 2024-04-27T07:33:24.556 INFO:tasks.workunit.client.0.smithi082.stdout:2/597: write d7/d30/d23/fac [1788414,26312] 0 2024-04-27T07:33:24.556 INFO:tasks.workunit.client.0.smithi082.stdout:9/476: dread - d9/da/dc/d35/d38/d65/f82 zero size 2024-04-27T07:33:24.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/592: readlink d3/d6/d26/d5e/d21/l6f 0 2024-04-27T07:33:24.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/593: fdatasync d3/fba 0 2024-04-27T07:33:24.558 INFO:tasks.workunit.client.0.smithi082.stdout:7/535: mknod d3/d49/d97/d3a/d2a/dac/caf 0 2024-04-27T07:33:24.558 INFO:tasks.workunit.client.0.smithi082.stdout:9/477: truncate d9/da/dc/d73/f95 703170 0 2024-04-27T07:33:24.562 INFO:tasks.workunit.client.0.smithi082.stdout:7/536: creat d3/d49/d97/d7d/da1/fb0 x:0 0 0 2024-04-27T07:33:24.563 INFO:tasks.workunit.client.0.smithi082.stdout:9/478: mkdir d9/da/dc/d35/d42/d66/d97 0 2024-04-27T07:33:24.566 INFO:tasks.workunit.client.0.smithi082.stdout:4/594: creat d3/d6/fc0 x:0 0 0 2024-04-27T07:33:24.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/537: mkdir d3/db1 0 2024-04-27T07:33:24.569 INFO:tasks.workunit.client.0.smithi082.stdout:9/479: rename d9/da/dc/d35/d4a/f6a to d9/da/dc/d88/d93/f98 0 2024-04-27T07:33:24.571 INFO:tasks.workunit.client.0.smithi082.stdout:4/595: fdatasync d3/d6/d16/f47 0 2024-04-27T07:33:24.571 INFO:tasks.workunit.client.0.smithi082.stdout:9/480: chown d9/da/dc/d35/d42/d66/f6c 4 1 2024-04-27T07:33:24.572 INFO:tasks.workunit.client.0.smithi082.stdout:4/596: stat d3/d6/d16/la1 0 2024-04-27T07:33:24.573 INFO:tasks.workunit.client.0.smithi082.stdout:4/597: fsync d3/d6/d16/f3f 0 2024-04-27T07:33:24.577 INFO:tasks.workunit.client.0.smithi082.stdout:4/598: creat d3/d6/d16/fc1 x:0 0 0 2024-04-27T07:33:24.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/481: rename d9/da/dc/d35/d4a/d50/f87 to d9/da/dc/d35/d42/f99 0 2024-04-27T07:33:24.580 INFO:tasks.workunit.client.0.smithi082.stdout:3/826: dread d8/d9/d25/d26/d4d/fc1 [0,4194304] 0 2024-04-27T07:33:24.582 INFO:tasks.workunit.client.0.smithi082.stdout:4/599: mkdir d3/d10/d9c/dc2 0 2024-04-27T07:33:24.585 INFO:tasks.workunit.client.0.smithi082.stdout:9/482: unlink d9/fb 0 2024-04-27T07:33:24.586 INFO:tasks.workunit.client.0.smithi082.stdout:7/538: dread d3/db/f2e [0,4194304] 0 2024-04-27T07:33:24.587 INFO:tasks.workunit.client.0.smithi082.stdout:7/539: write d3/d9/f2d [2841596,93049] 0 2024-04-27T07:33:24.589 INFO:tasks.workunit.client.0.smithi082.stdout:4/600: symlink d3/d6/d26/d55/d67/lc3 0 2024-04-27T07:33:24.590 INFO:tasks.workunit.client.0.smithi082.stdout:9/483: mknod d9/da/dc/d35/d42/d66/c9a 0 2024-04-27T07:33:24.593 INFO:tasks.workunit.client.0.smithi082.stdout:4/601: creat d3/d10/d9c/fc4 x:0 0 0 2024-04-27T07:33:24.596 INFO:tasks.workunit.client.0.smithi082.stdout:7/540: mknod d3/d9/d4f/cb2 0 2024-04-27T07:33:24.597 INFO:tasks.workunit.client.0.smithi082.stdout:3/827: dread d8/d9/dd/d13/d1b/dbd/f7f [0,4194304] 0 2024-04-27T07:33:24.598 INFO:tasks.workunit.client.0.smithi082.stdout:3/828: truncate d8/d9/d25/d26/d3d/fb2 624355 0 2024-04-27T07:33:24.619 INFO:tasks.workunit.client.0.smithi082.stdout:4/602: mkdir d3/d6/d26/d55/dc5 0 2024-04-27T07:33:24.619 INFO:tasks.workunit.client.0.smithi082.stdout:7/541: mknod d3/d49/d97/d7d/da1/da3/cb3 0 2024-04-27T07:33:24.623 INFO:tasks.workunit.client.0.smithi082.stdout:3/829: dwrite d8/d9/d1d/ff3 [0,4194304] 0 2024-04-27T07:33:24.624 INFO:tasks.workunit.client.0.smithi082.stdout:3/830: dread - d8/d9/d25/d4e/ff0 zero size 2024-04-27T07:33:24.637 INFO:tasks.workunit.client.0.smithi082.stdout:9/484: dwrite d9/da/dc/d73/f95 [0,4194304] 0 2024-04-27T07:33:24.647 INFO:tasks.workunit.client.0.smithi082.stdout:3/831: dread d8/d9/d25/fc9 [0,4194304] 0 2024-04-27T07:33:24.648 INFO:tasks.workunit.client.0.smithi082.stdout:3/832: chown d8/d9/dd/de1/f117 171001220 1 2024-04-27T07:33:24.650 INFO:tasks.workunit.client.0.smithi082.stdout:3/833: write d8/d9/dd/d13/f4b [3940783,37198] 0 2024-04-27T07:33:24.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/485: fdatasync d9/da/dc/d35/d42/f99 0 2024-04-27T07:33:24.655 INFO:tasks.workunit.client.0.smithi082.stdout:4/603: chown d3/d9/f8b 8803 1 2024-04-27T07:33:24.659 INFO:tasks.workunit.client.0.smithi082.stdout:3/834: rename d8/d9/dd/d13/d1b/l64 to d8/d9/dd/d11e/l123 0 2024-04-27T07:33:24.660 INFO:tasks.workunit.client.0.smithi082.stdout:9/486: truncate d9/da/d32/f39 738134 0 2024-04-27T07:33:24.662 INFO:tasks.workunit.client.0.smithi082.stdout:4/604: rmdir d3/d6/d26/d55 39 2024-04-27T07:33:24.662 INFO:tasks.workunit.client.0.smithi082.stdout:4/605: dread - d3/d9/fbd zero size 2024-04-27T07:33:24.664 INFO:tasks.workunit.client.0.smithi082.stdout:3/835: truncate d8/d9/d1f/f41 1397073 0 2024-04-27T07:33:24.665 INFO:tasks.workunit.client.0.smithi082.stdout:3/836: fsync d8/d9/dd/d13/d1b/dbd/d8e/f113 0 2024-04-27T07:33:24.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:24 smithi100 ceph-mon[34183]: pgmap v18: 65 pgs: 65 active+clean; 997 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 21 MiB/s rd, 104 MiB/s wr, 366 op/s 2024-04-27T07:33:24.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:24 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:24.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/606: symlink d3/d10/d9c/dc2/lc6 0 2024-04-27T07:33:24.669 INFO:tasks.workunit.client.0.smithi082.stdout:3/837: mkdir d8/d9/db0/df9/d107/d124 0 2024-04-27T07:33:24.671 INFO:tasks.workunit.client.0.smithi082.stdout:4/607: write d3/d9/f8b [817076,16574] 0 2024-04-27T07:33:24.673 INFO:tasks.workunit.client.0.smithi082.stdout:3/838: creat d8/d9/d25/d26/d4d/d82/d8b/dfc/f125 x:0 0 0 2024-04-27T07:33:24.673 INFO:tasks.workunit.client.0.smithi082.stdout:4/608: rmdir d3/d6/d26/d5e/d21 39 2024-04-27T07:33:24.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/839: fsync d8/d9/d25/fc9 0 2024-04-27T07:33:24.676 INFO:tasks.workunit.client.0.smithi082.stdout:3/840: chown d8/d9/dd/d13/c83 30237 1 2024-04-27T07:33:24.677 INFO:tasks.workunit.client.0.smithi082.stdout:4/609: unlink d3/d6/d16/f3f 0 2024-04-27T07:33:24.678 INFO:tasks.workunit.client.0.smithi082.stdout:3/841: write d8/d9/d25/d91/f56 [2313632,99374] 0 2024-04-27T07:33:24.679 INFO:tasks.workunit.client.0.smithi082.stdout:3/842: dread - d8/d9/dd/da3/fd5 zero size 2024-04-27T07:33:24.680 INFO:tasks.workunit.client.0.smithi082.stdout:4/610: rmdir d3/d6/d22/d69 39 2024-04-27T07:33:24.683 INFO:tasks.workunit.client.0.smithi082.stdout:3/843: dread d8/d9/dd/d13/d1b/f28 [0,4194304] 0 2024-04-27T07:33:24.683 INFO:tasks.workunit.client.0.smithi082.stdout:4/611: creat d3/d9/fc7 x:0 0 0 2024-04-27T07:33:24.686 INFO:tasks.workunit.client.0.smithi082.stdout:4/612: chown d3/d6/d22/d69/l99 19 1 2024-04-27T07:33:24.687 INFO:tasks.workunit.client.0.smithi082.stdout:4/613: fsync d3/d6/d22/f59 0 2024-04-27T07:33:24.689 INFO:tasks.workunit.client.0.smithi082.stdout:4/614: readlink d3/d6/d16/l7e 0 2024-04-27T07:33:24.690 INFO:tasks.workunit.client.0.smithi082.stdout:9/487: dread d9/da/d32/f39 [0,4194304] 0 2024-04-27T07:33:24.694 INFO:tasks.workunit.client.0.smithi082.stdout:7/542: dwrite d3/f8 [0,4194304] 0 2024-04-27T07:33:24.695 INFO:tasks.workunit.client.0.smithi082.stdout:9/488: fsync d9/d2d/d2b/d46/d5d/d6f/f86 0 2024-04-27T07:33:24.695 INFO:tasks.workunit.client.0.smithi082.stdout:7/543: fsync d3/db/f5d 0 2024-04-27T07:33:24.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/844: dwrite d8/d9/dd/d13/d1b/f28 [0,4194304] 0 2024-04-27T07:33:24.697 INFO:tasks.workunit.client.0.smithi082.stdout:7/544: stat d3/d49/d97/l66 0 2024-04-27T07:33:24.702 INFO:tasks.workunit.client.0.smithi082.stdout:3/845: chown d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 5 1 2024-04-27T07:33:24.704 INFO:tasks.workunit.client.0.smithi082.stdout:7/545: dread d3/f8 [0,4194304] 0 2024-04-27T07:33:24.704 INFO:tasks.workunit.client.0.smithi082.stdout:3/846: fdatasync d8/d9/dd/d13/d1b/da8/ff8 0 2024-04-27T07:33:24.706 INFO:tasks.workunit.client.0.smithi082.stdout:3/847: chown d8/d9/d25/d66/l84 25895 1 2024-04-27T07:33:24.707 INFO:tasks.workunit.client.0.smithi082.stdout:9/489: truncate d9/da/f31 1532985 0 2024-04-27T07:33:24.709 INFO:tasks.workunit.client.0.smithi082.stdout:3/848: write d8/d9/d1d/db5/dc7/fd3 [5132077,104935] 0 2024-04-27T07:33:24.712 INFO:tasks.workunit.client.0.smithi082.stdout:7/546: rename d3/d9/f56 to d3/d9/d7c/fb4 0 2024-04-27T07:33:24.712 INFO:tasks.workunit.client.0.smithi082.stdout:4/615: write d3/d10/f15 [2584895,98442] 0 2024-04-27T07:33:24.715 INFO:tasks.workunit.client.0.smithi082.stdout:9/490: creat d9/da/dc/d35/d4a/d7e/f9b x:0 0 0 2024-04-27T07:33:24.716 INFO:tasks.workunit.client.0.smithi082.stdout:7/547: mknod d3/d49/d97/d3a/d2a/cb5 0 2024-04-27T07:33:24.717 INFO:tasks.workunit.client.0.smithi082.stdout:9/491: fsync d9/da/dc/d35/d42/d66/f6c 0 2024-04-27T07:33:24.718 INFO:tasks.workunit.client.0.smithi082.stdout:7/548: truncate d3/db/ff 1720992 0 2024-04-27T07:33:24.719 INFO:tasks.workunit.client.0.smithi082.stdout:9/492: creat d9/d2d/d72/f9c x:0 0 0 2024-04-27T07:33:24.719 INFO:tasks.workunit.client.0.smithi082.stdout:7/549: chown d3/db/f2e 12518 1 2024-04-27T07:33:24.719 INFO:tasks.workunit.client.0.smithi082.stdout:3/849: link d8/d9/d1d/c115 d8/d9/dd/d13/d1b/dbd/dd8/c126 0 2024-04-27T07:33:24.721 INFO:tasks.workunit.client.0.smithi082.stdout:9/493: write d9/da/dc/d88/d93/f98 [462849,58801] 0 2024-04-27T07:33:24.730 INFO:tasks.workunit.client.0.smithi082.stdout:4/616: dread d3/d6/d26/f36 [0,4194304] 0 2024-04-27T07:33:24.731 INFO:tasks.workunit.client.0.smithi082.stdout:9/494: truncate d9/d2d/f59 961946 0 2024-04-27T07:33:24.734 INFO:tasks.workunit.client.0.smithi082.stdout:4/617: read d3/d6/d26/d55/f5f [6049741,107861] 0 2024-04-27T07:33:24.734 INFO:tasks.workunit.client.0.smithi082.stdout:9/495: read d9/da/dc/d35/d4b/f5f [3726250,78944] 0 2024-04-27T07:33:24.734 INFO:tasks.workunit.client.0.smithi082.stdout:4/618: chown d3/d9/fc7 15005 1 2024-04-27T07:33:24.737 INFO:tasks.workunit.client.0.smithi082.stdout:4/619: mknod d3/d10/d9c/dc2/cc8 0 2024-04-27T07:33:24.737 INFO:tasks.workunit.client.0.smithi082.stdout:7/550: dread d3/d49/d97/f6a [0,4194304] 0 2024-04-27T07:33:24.738 INFO:tasks.workunit.client.0.smithi082.stdout:9/496: symlink d9/da/dc/d33/d5e/l9d 0 2024-04-27T07:33:24.740 INFO:tasks.workunit.client.0.smithi082.stdout:9/497: symlink d9/da/dc/d33/l9e 0 2024-04-27T07:33:24.741 INFO:tasks.workunit.client.0.smithi082.stdout:4/620: truncate d3/d6/f3e 1809602 0 2024-04-27T07:33:24.742 INFO:tasks.workunit.client.0.smithi082.stdout:7/551: getdents d3/d9/d4f 0 2024-04-27T07:33:24.742 INFO:tasks.workunit.client.0.smithi082.stdout:4/621: write d3/d10/faa [170500,8947] 0 2024-04-27T07:33:24.745 INFO:tasks.workunit.client.0.smithi082.stdout:9/498: creat d9/d2d/d2b/d46/d76/f9f x:0 0 0 2024-04-27T07:33:24.745 INFO:tasks.workunit.client.0.smithi082.stdout:4/622: chown d3/d6/d26/d5e/d21/f80 25 1 2024-04-27T07:33:24.746 INFO:tasks.workunit.client.0.smithi082.stdout:7/552: mkdir d3/d49/d97/d7d/da1/db6 0 2024-04-27T07:33:24.747 INFO:tasks.workunit.client.0.smithi082.stdout:7/553: chown d3/d9/f74 1 1 2024-04-27T07:33:24.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/554: creat d3/d49/fb7 x:0 0 0 2024-04-27T07:33:24.750 INFO:tasks.workunit.client.0.smithi082.stdout:7/555: fdatasync d3/f8 0 2024-04-27T07:33:24.755 INFO:tasks.workunit.client.0.smithi082.stdout:4/623: write d3/d6/d26/d55/d67/fb1 [106450,55802] 0 2024-04-27T07:33:24.756 INFO:tasks.workunit.client.0.smithi082.stdout:7/556: rmdir d3/d49/d97/d3a/d2a/dac/da8 0 2024-04-27T07:33:24.763 INFO:tasks.workunit.client.0.smithi082.stdout:4/624: truncate d3/d6/d22/d69/f79 2623124 0 2024-04-27T07:33:24.769 INFO:tasks.workunit.client.0.smithi082.stdout:4/625: rename d3/d6/d26/d5e/fa8 to d3/d6/d26/d55/dc5/fc9 0 2024-04-27T07:33:24.770 INFO:tasks.workunit.client.0.smithi082.stdout:7/557: dwrite d3/d49/d97/d3a/d2a/f3f [0,4194304] 0 2024-04-27T07:33:24.773 INFO:tasks.workunit.client.0.smithi082.stdout:7/558: readlink d3/d9/d7c/l80 0 2024-04-27T07:33:24.773 INFO:tasks.workunit.client.0.smithi082.stdout:4/626: rmdir d3/d10 39 2024-04-27T07:33:24.774 INFO:tasks.workunit.client.0.smithi082.stdout:4/627: write d3/d9/f6a [4609296,32886] 0 2024-04-27T07:33:24.777 INFO:tasks.workunit.client.0.smithi082.stdout:7/559: mknod d3/d49/d97/cb8 0 2024-04-27T07:33:24.779 INFO:tasks.workunit.client.0.smithi082.stdout:4/628: chown d3/d6/d22/l6e 0 1 2024-04-27T07:33:24.782 INFO:tasks.workunit.client.0.smithi082.stdout:7/560: creat d3/d9/d4f/fb9 x:0 0 0 2024-04-27T07:33:24.786 INFO:tasks.workunit.client.0.smithi082.stdout:4/629: creat d3/d6/d16/fca x:0 0 0 2024-04-27T07:33:24.789 INFO:tasks.workunit.client.0.smithi082.stdout:7/561: rename d3/db/c8e to d3/d49/d97/d7d/da1/db6/cba 0 2024-04-27T07:33:24.790 INFO:tasks.workunit.client.0.smithi082.stdout:4/630: read d3/f4e [381600,119253] 0 2024-04-27T07:33:24.794 INFO:tasks.workunit.client.0.smithi082.stdout:7/562: dread d3/d9/d7c/fb4 [4194304,4194304] 0 2024-04-27T07:33:24.795 INFO:tasks.workunit.client.0.smithi082.stdout:4/631: rename d3/d6/d16/fca to d3/d6/d16/fcb 0 2024-04-27T07:33:24.797 INFO:tasks.workunit.client.0.smithi082.stdout:4/632: write d3/f43 [54541,107314] 0 2024-04-27T07:33:24.807 INFO:tasks.workunit.client.0.smithi082.stdout:7/563: write d3/d9/d4f/f54 [648454,14940] 0 2024-04-27T07:33:24.813 INFO:tasks.workunit.client.0.smithi082.stdout:7/564: truncate d3/d9/d4f/faa 3240129 0 2024-04-27T07:33:24.815 INFO:tasks.workunit.client.0.smithi082.stdout:7/565: mkdir d3/db/dbb 0 2024-04-27T07:33:24.818 INFO:tasks.workunit.client.0.smithi082.stdout:7/566: symlink d3/d49/d97/lbc 0 2024-04-27T07:33:24.820 INFO:tasks.workunit.client.0.smithi082.stdout:7/567: truncate d3/f53 753006 0 2024-04-27T07:33:24.824 INFO:tasks.workunit.client.0.smithi082.stdout:7/568: link d3/d49/f51 d3/d49/d97/d7d/da1/fbd 0 2024-04-27T07:33:24.828 INFO:tasks.workunit.client.0.smithi082.stdout:7/569: dwrite d3/d9/f37 [0,4194304] 0 2024-04-27T07:33:24.833 INFO:tasks.workunit.client.0.smithi082.stdout:7/570: creat d3/d9/d4f/d9a/fbe x:0 0 0 2024-04-27T07:33:24.834 INFO:tasks.workunit.client.0.smithi082.stdout:7/571: dread - d3/d49/d97/d3a/d2a/f81 zero size 2024-04-27T07:33:24.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/572: rename d3/d9/d4f/c63 to d3/d49/d97/d6c/cbf 0 2024-04-27T07:33:24.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/573: dwrite d3/d9/d4f/f6b [0,4194304] 0 2024-04-27T07:33:24.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/574: rmdir d3/d49/d97/d6c 39 2024-04-27T07:33:24.940 INFO:tasks.workunit.client.1.smithi100.stdout:3/11: sync 2024-04-27T07:33:24.949 INFO:tasks.workunit.client.1.smithi100.stdout:3/12: creat f2 x:0 0 0 2024-04-27T07:33:24.950 INFO:tasks.workunit.client.1.smithi100.stdout:3/13: symlink l3 0 2024-04-27T07:33:24.951 INFO:tasks.workunit.client.1.smithi100.stdout:3/14: creat f4 x:0 0 0 2024-04-27T07:33:24.952 INFO:tasks.workunit.client.1.smithi100.stdout:3/15: creat f5 x:0 0 0 2024-04-27T07:33:24.954 INFO:tasks.workunit.client.1.smithi100.stdout:3/16: creat f6 x:0 0 0 2024-04-27T07:33:24.961 INFO:tasks.workunit.client.1.smithi100.stdout:3/17: dwrite f5 [0,4194304] 0 2024-04-27T07:33:24.961 INFO:tasks.workunit.client.1.smithi100.stdout:3/18: dread - f6 zero size 2024-04-27T07:33:24.964 INFO:tasks.workunit.client.1.smithi100.stdout:3/19: mkdir d7 0 2024-04-27T07:33:24.965 INFO:tasks.workunit.client.1.smithi100.stdout:3/20: truncate f5 5237840 0 2024-04-27T07:33:24.965 INFO:tasks.workunit.client.1.smithi100.stdout:3/21: chown l3 107847 1 2024-04-27T07:33:24.973 INFO:tasks.workunit.client.1.smithi100.stdout:3/22: dwrite f2 [0,4194304] 0 2024-04-27T07:33:24.982 INFO:tasks.workunit.client.1.smithi100.stdout:3/23: dwrite f5 [0,4194304] 0 2024-04-27T07:33:24.985 INFO:tasks.workunit.client.1.smithi100.stdout:3/24: unlink l3 0 2024-04-27T07:33:24.988 INFO:tasks.workunit.client.1.smithi100.stdout:3/25: creat d7/f8 x:0 0 0 2024-04-27T07:33:24.992 INFO:tasks.workunit.client.1.smithi100.stdout:3/26: unlink f2 0 2024-04-27T07:33:25.009 INFO:tasks.workunit.client.1.smithi100.stdout:0/5: sync 2024-04-27T07:33:25.009 INFO:tasks.workunit.client.1.smithi100.stdout:6/8: sync 2024-04-27T07:33:25.009 INFO:tasks.workunit.client.1.smithi100.stdout:0/6: dread - no filename 2024-04-27T07:33:25.010 INFO:tasks.workunit.client.1.smithi100.stdout:6/9: chown f0 1305 1 2024-04-27T07:33:25.012 INFO:tasks.workunit.client.1.smithi100.stdout:0/7: creat d1/f3 x:0 0 0 2024-04-27T07:33:25.012 INFO:tasks.workunit.client.1.smithi100.stdout:0/8: dread - d1/f3 zero size 2024-04-27T07:33:25.014 INFO:tasks.workunit.client.1.smithi100.stdout:6/10: write f0 [737360,525] 0 2024-04-27T07:33:25.016 INFO:tasks.workunit.client.1.smithi100.stdout:0/9: unlink d1/f3 0 2024-04-27T07:33:25.019 INFO:tasks.workunit.client.1.smithi100.stdout:6/11: creat f1 x:0 0 0 2024-04-27T07:33:25.020 INFO:tasks.workunit.client.1.smithi100.stdout:0/10: symlink d1/l4 0 2024-04-27T07:33:25.020 INFO:tasks.workunit.client.1.smithi100.stdout:0/11: fsync - no filename 2024-04-27T07:33:25.020 INFO:tasks.workunit.client.1.smithi100.stdout:0/12: write - no filename 2024-04-27T07:33:25.022 INFO:tasks.workunit.client.1.smithi100.stdout:6/12: rename f0 to f2 0 2024-04-27T07:33:25.024 INFO:tasks.workunit.client.1.smithi100.stdout:0/13: creat d1/f5 x:0 0 0 2024-04-27T07:33:25.030 INFO:tasks.workunit.client.1.smithi100.stdout:0/14: rename d1/l2 to d1/l6 0 2024-04-27T07:33:25.031 INFO:tasks.workunit.client.1.smithi100.stdout:0/15: write d1/f5 [891406,64206] 0 2024-04-27T07:33:25.033 INFO:tasks.workunit.client.1.smithi100.stdout:0/16: mknod d1/c7 0 2024-04-27T07:33:25.033 INFO:tasks.workunit.client.1.smithi100.stdout:0/17: chown d1/c7 139102 1 2024-04-27T07:33:25.035 INFO:tasks.workunit.client.1.smithi100.stdout:0/18: mkdir d1/d8 0 2024-04-27T07:33:25.036 INFO:tasks.workunit.client.1.smithi100.stdout:0/19: write d1/f5 [620197,72056] 0 2024-04-27T07:33:25.037 INFO:tasks.workunit.client.1.smithi100.stdout:0/20: write d1/f5 [1972050,95761] 0 2024-04-27T07:33:25.054 INFO:tasks.workunit.client.1.smithi100.stdout:8/51: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:2/116: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:1/90: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:9/51: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:5/30: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:7/4: sync 2024-04-27T07:33:25.055 INFO:tasks.workunit.client.1.smithi100.stdout:4/22: sync 2024-04-27T07:33:25.060 INFO:tasks.workunit.client.1.smithi100.stdout:1/91: write d0/f7 [4923709,96796] 0 2024-04-27T07:33:25.060 INFO:tasks.workunit.client.1.smithi100.stdout:8/52: mknod d6/c14 0 2024-04-27T07:33:25.061 INFO:tasks.workunit.client.1.smithi100.stdout:1/92: chown d0 2 1 2024-04-27T07:33:25.061 INFO:tasks.workunit.client.1.smithi100.stdout:4/23: dread f0 [0,4194304] 0 2024-04-27T07:33:25.061 INFO:tasks.workunit.client.1.smithi100.stdout:5/31: rmdir d0/d4 39 2024-04-27T07:33:25.062 INFO:tasks.workunit.client.1.smithi100.stdout:1/93: readlink d0/l11 0 2024-04-27T07:33:25.063 INFO:tasks.workunit.client.1.smithi100.stdout:2/117: creat d0/da/d29/d26/f2a x:0 0 0 2024-04-27T07:33:25.065 INFO:tasks.workunit.client.1.smithi100.stdout:9/52: rename d1/d9/db/fe to d1/d9/db/f11 0 2024-04-27T07:33:25.066 INFO:tasks.workunit.client.1.smithi100.stdout:7/5: dwrite f0 [0,4194304] 0 2024-04-27T07:33:25.066 INFO:tasks.workunit.client.1.smithi100.stdout:9/53: dread - d1/d9/db/f11 zero size 2024-04-27T07:33:25.067 INFO:tasks.workunit.client.1.smithi100.stdout:8/53: symlink d6/l15 0 2024-04-27T07:33:25.070 INFO:tasks.workunit.client.1.smithi100.stdout:4/24: creat d5/f8 x:0 0 0 2024-04-27T07:33:25.071 INFO:tasks.workunit.client.1.smithi100.stdout:1/94: rmdir d0 39 2024-04-27T07:33:25.073 INFO:tasks.workunit.client.1.smithi100.stdout:2/118: fsync d0/d1e/f27 0 2024-04-27T07:33:25.074 INFO:tasks.workunit.client.1.smithi100.stdout:7/6: dwrite f0 [0,4194304] 0 2024-04-27T07:33:25.075 INFO:tasks.workunit.client.1.smithi100.stdout:7/7: chown d1 4282 1 2024-04-27T07:33:25.077 INFO:tasks.workunit.client.1.smithi100.stdout:7/8: write f0 [1343430,68737] 0 2024-04-27T07:33:25.077 INFO:tasks.workunit.client.1.smithi100.stdout:9/54: mknod d1/c12 0 2024-04-27T07:33:25.079 INFO:tasks.workunit.client.1.smithi100.stdout:8/54: symlink d6/l16 0 2024-04-27T07:33:25.080 INFO:tasks.workunit.client.1.smithi100.stdout:1/95: fdatasync d0/f7 0 2024-04-27T07:33:25.082 INFO:tasks.workunit.client.1.smithi100.stdout:7/9: dread f0 [0,4194304] 0 2024-04-27T07:33:25.083 INFO:tasks.workunit.client.1.smithi100.stdout:7/10: write f0 [368416,21315] 0 2024-04-27T07:33:25.086 INFO:tasks.workunit.client.1.smithi100.stdout:9/55: creat d1/f13 x:0 0 0 2024-04-27T07:33:25.088 INFO:tasks.workunit.client.1.smithi100.stdout:8/55: unlink d6/f11 0 2024-04-27T07:33:25.089 INFO:tasks.workunit.client.1.smithi100.stdout:4/25: dwrite d5/f7 [0,4194304] 0 2024-04-27T07:33:25.089 INFO:tasks.workunit.client.1.smithi100.stdout:8/56: truncate d6/fb 829208 0 2024-04-27T07:33:25.091 INFO:tasks.workunit.client.1.smithi100.stdout:1/96: creat d0/f13 x:0 0 0 2024-04-27T07:33:25.091 INFO:tasks.workunit.client.1.smithi100.stdout:1/97: stat d0/c10 0 2024-04-27T07:33:25.092 INFO:tasks.workunit.client.1.smithi100.stdout:1/98: fdatasync d0/f13 0 2024-04-27T07:33:25.092 INFO:tasks.workunit.client.1.smithi100.stdout:2/119: symlink d0/l2b 0 2024-04-27T07:33:25.098 INFO:tasks.workunit.client.1.smithi100.stdout:8/57: creat d6/f17 x:0 0 0 2024-04-27T07:33:25.101 INFO:tasks.workunit.client.1.smithi100.stdout:7/11: rename f0 to d1/f2 0 2024-04-27T07:33:25.103 INFO:tasks.workunit.client.1.smithi100.stdout:9/56: link d1/f4 d1/f14 0 2024-04-27T07:33:25.103 INFO:tasks.workunit.client.1.smithi100.stdout:4/26: dwrite f0 [0,4194304] 0 2024-04-27T07:33:25.104 INFO:tasks.workunit.client.1.smithi100.stdout:1/99: dread d0/fd [0,4194304] 0 2024-04-27T07:33:25.107 INFO:tasks.workunit.client.1.smithi100.stdout:7/12: creat d1/f3 x:0 0 0 2024-04-27T07:33:25.111 INFO:tasks.workunit.client.1.smithi100.stdout:1/100: creat d0/f14 x:0 0 0 2024-04-27T07:33:25.113 INFO:tasks.workunit.client.1.smithi100.stdout:2/120: rename d0/c2 to d0/da/d29/c2c 0 2024-04-27T07:33:25.119 INFO:tasks.workunit.client.1.smithi100.stdout:1/101: write d0/fd [2762476,36206] 0 2024-04-27T07:33:25.120 INFO:tasks.workunit.client.1.smithi100.stdout:2/121: symlink d0/da/d29/l2d 0 2024-04-27T07:33:25.120 INFO:tasks.workunit.client.1.smithi100.stdout:7/13: dwrite d1/f3 [0,4194304] 0 2024-04-27T07:33:25.121 INFO:tasks.workunit.client.1.smithi100.stdout:4/27: dread d5/f6 [0,4194304] 0 2024-04-27T07:33:25.123 INFO:tasks.workunit.client.1.smithi100.stdout:4/28: fdatasync f0 0 2024-04-27T07:33:25.124 INFO:tasks.workunit.client.1.smithi100.stdout:9/57: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:25.132 INFO:tasks.workunit.client.1.smithi100.stdout:9/58: symlink d1/d9/l15 0 2024-04-27T07:33:25.135 INFO:tasks.workunit.client.1.smithi100.stdout:1/102: dwrite d0/f13 [0,4194304] 0 2024-04-27T07:33:25.140 INFO:tasks.workunit.client.1.smithi100.stdout:9/59: mknod d1/d9/db/c16 0 2024-04-27T07:33:25.142 INFO:tasks.workunit.client.1.smithi100.stdout:2/122: dread d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:25.144 INFO:tasks.workunit.client.1.smithi100.stdout:4/29: dwrite f1 [0,4194304] 0 2024-04-27T07:33:25.145 INFO:tasks.workunit.client.1.smithi100.stdout:4/30: read f1 [2773626,109638] 0 2024-04-27T07:33:25.145 INFO:tasks.workunit.client.1.smithi100.stdout:1/103: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:25.146 INFO:tasks.workunit.client.1.smithi100.stdout:9/60: symlink d1/d9/db/l17 0 2024-04-27T07:33:25.147 INFO:tasks.workunit.client.1.smithi100.stdout:4/31: write d5/f7 [3675867,35968] 0 2024-04-27T07:33:25.149 INFO:tasks.workunit.client.1.smithi100.stdout:7/14: fdatasync d1/f3 0 2024-04-27T07:33:25.151 INFO:tasks.workunit.client.1.smithi100.stdout:1/104: symlink d0/l15 0 2024-04-27T07:33:25.152 INFO:tasks.workunit.client.1.smithi100.stdout:2/123: symlink d0/da/l2e 0 2024-04-27T07:33:25.153 INFO:tasks.workunit.client.1.smithi100.stdout:9/61: mknod d1/d9/db/c18 0 2024-04-27T07:33:25.154 INFO:tasks.workunit.client.1.smithi100.stdout:9/62: chown d1/f13 686 1 2024-04-27T07:33:25.157 INFO:tasks.workunit.client.1.smithi100.stdout:7/15: symlink d1/l4 0 2024-04-27T07:33:25.158 INFO:tasks.workunit.client.1.smithi100.stdout:9/63: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:25.159 INFO:tasks.workunit.client.1.smithi100.stdout:1/105: rename d0/f7 to d0/f16 0 2024-04-27T07:33:25.160 INFO:tasks.workunit.client.1.smithi100.stdout:1/106: write d0/fd [2040106,18955] 0 2024-04-27T07:33:25.160 INFO:tasks.workunit.client.1.smithi100.stdout:1/107: chown d0 1 1 2024-04-27T07:33:25.161 INFO:tasks.workunit.client.1.smithi100.stdout:7/16: dread d1/f2 [0,4194304] 0 2024-04-27T07:33:25.162 INFO:tasks.workunit.client.1.smithi100.stdout:1/108: read d0/f16 [4010375,85752] 0 2024-04-27T07:33:25.163 INFO:tasks.workunit.client.1.smithi100.stdout:1/109: write d0/fd [3791694,32965] 0 2024-04-27T07:33:25.164 INFO:tasks.workunit.client.1.smithi100.stdout:1/110: write d0/fd [759880,28980] 0 2024-04-27T07:33:25.170 INFO:tasks.workunit.client.1.smithi100.stdout:5/32: truncate d0/fa 1205142 0 2024-04-27T07:33:25.171 INFO:tasks.workunit.client.1.smithi100.stdout:5/33: chown d0/cb 166 1 2024-04-27T07:33:25.172 INFO:tasks.workunit.client.1.smithi100.stdout:1/111: rename d0/c10 to d0/c17 0 2024-04-27T07:33:25.172 INFO:tasks.workunit.client.1.smithi100.stdout:1/112: fdatasync d0/f14 0 2024-04-27T07:33:25.174 INFO:tasks.workunit.client.1.smithi100.stdout:5/34: read - d0/d4/f7 zero size 2024-04-27T07:33:25.175 INFO:tasks.workunit.client.1.smithi100.stdout:1/113: creat d0/f18 x:0 0 0 2024-04-27T07:33:25.175 INFO:tasks.workunit.client.1.smithi100.stdout:5/35: dread - d0/f8 zero size 2024-04-27T07:33:25.177 INFO:tasks.workunit.client.1.smithi100.stdout:5/36: write d0/d4/f7 [831078,49595] 0 2024-04-27T07:33:25.183 INFO:tasks.workunit.client.1.smithi100.stdout:1/114: dread d0/f16 [0,4194304] 0 2024-04-27T07:33:25.183 INFO:tasks.workunit.client.1.smithi100.stdout:5/37: creat d0/d4/fc x:0 0 0 2024-04-27T07:33:25.183 INFO:tasks.workunit.client.1.smithi100.stdout:1/115: chown d0/f16 4201926 1 2024-04-27T07:33:25.183 INFO:tasks.workunit.client.1.smithi100.stdout:3/27: fsync f4 0 2024-04-27T07:33:25.184 INFO:tasks.workunit.client.0.smithi082.stdout:1/535: sync 2024-04-27T07:33:25.184 INFO:tasks.workunit.client.0.smithi082.stdout:6/546: sync 2024-04-27T07:33:25.189 INFO:tasks.workunit.client.0.smithi082.stdout:6/547: dwrite d2/de/d13/faa [0,4194304] 0 2024-04-27T07:33:25.190 INFO:tasks.workunit.client.1.smithi100.stdout:6/13: rename f2 to f3 0 2024-04-27T07:33:25.190 INFO:tasks.workunit.client.0.smithi082.stdout:6/548: chown d2/d75/f7e 30 1 2024-04-27T07:33:25.191 INFO:tasks.workunit.client.1.smithi100.stdout:6/14: truncate f1 604633 0 2024-04-27T07:33:25.191 INFO:tasks.workunit.client.1.smithi100.stdout:6/15: write f1 [1523133,59681] 0 2024-04-27T07:33:25.192 INFO:tasks.workunit.client.1.smithi100.stdout:0/21: readlink d1/l6 0 2024-04-27T07:33:25.193 INFO:tasks.workunit.client.0.smithi082.stdout:6/549: rename d2/d81/f86 to d2/d3/da8/faf 0 2024-04-27T07:33:25.195 INFO:tasks.workunit.client.1.smithi100.stdout:6/16: mknod c4 0 2024-04-27T07:33:25.195 INFO:tasks.workunit.client.0.smithi082.stdout:6/550: write d2/d3/d1b/f28 [3981358,61749] 0 2024-04-27T07:33:25.197 INFO:tasks.workunit.client.0.smithi082.stdout:6/551: unlink d2/d2e/f61 0 2024-04-27T07:33:25.197 INFO:tasks.workunit.client.1.smithi100.stdout:0/22: symlink d1/l9 0 2024-04-27T07:33:25.197 INFO:tasks.workunit.client.0.smithi082.stdout:6/552: chown d2/d2d/d4a/dad 1563 1 2024-04-27T07:33:25.198 INFO:tasks.workunit.client.1.smithi100.stdout:6/17: creat f5 x:0 0 0 2024-04-27T07:33:25.199 INFO:tasks.workunit.client.1.smithi100.stdout:0/23: creat d1/fa x:0 0 0 2024-04-27T07:33:25.199 INFO:tasks.workunit.client.1.smithi100.stdout:7/17: write d1/f2 [3326460,58469] 0 2024-04-27T07:33:25.200 INFO:tasks.workunit.client.1.smithi100.stdout:6/18: creat f6 x:0 0 0 2024-04-27T07:33:25.202 INFO:tasks.workunit.client.0.smithi082.stdout:6/553: rename d2/d1e/d32/d7d/d82/da0/fac to d2/de/d77/fb0 0 2024-04-27T07:33:25.203 INFO:tasks.workunit.client.1.smithi100.stdout:0/24: unlink d1/l4 0 2024-04-27T07:33:25.203 INFO:tasks.workunit.client.1.smithi100.stdout:0/25: chown d1/fa 442909551 1 2024-04-27T07:33:25.205 INFO:tasks.workunit.client.1.smithi100.stdout:7/18: dread d1/f2 [0,4194304] 0 2024-04-27T07:33:25.207 INFO:tasks.workunit.client.1.smithi100.stdout:6/19: dread f1 [0,4194304] 0 2024-04-27T07:33:25.207 INFO:tasks.workunit.client.1.smithi100.stdout:6/20: stat f5 0 2024-04-27T07:33:25.209 INFO:tasks.workunit.client.1.smithi100.stdout:0/26: rename l0 to d1/d8/lb 0 2024-04-27T07:33:25.210 INFO:tasks.workunit.client.1.smithi100.stdout:0/27: write d1/f5 [2998153,83760] 0 2024-04-27T07:33:25.210 INFO:tasks.workunit.client.1.smithi100.stdout:0/28: write d1/fa [19062,73135] 0 2024-04-27T07:33:25.211 INFO:tasks.workunit.client.1.smithi100.stdout:7/19: rename d1/f3 to d1/f5 0 2024-04-27T07:33:25.212 INFO:tasks.workunit.client.1.smithi100.stdout:4/32: rmdir d5 39 2024-04-27T07:33:25.214 INFO:tasks.workunit.client.0.smithi082.stdout:6/554: dwrite d2/f2a [0,4194304] 0 2024-04-27T07:33:25.216 INFO:tasks.workunit.client.1.smithi100.stdout:7/20: dread d1/f2 [0,4194304] 0 2024-04-27T07:33:25.216 INFO:tasks.workunit.client.1.smithi100.stdout:0/29: creat d1/d8/fc x:0 0 0 2024-04-27T07:33:25.219 INFO:tasks.workunit.client.1.smithi100.stdout:7/21: write d1/f5 [3515627,39049] 0 2024-04-27T07:33:25.220 INFO:tasks.workunit.client.1.smithi100.stdout:0/30: mknod d1/cd 0 2024-04-27T07:33:25.226 INFO:tasks.workunit.client.1.smithi100.stdout:4/33: dwrite d5/f7 [0,4194304] 0 2024-04-27T07:33:25.227 INFO:tasks.workunit.client.1.smithi100.stdout:7/22: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:25.228 INFO:tasks.workunit.client.1.smithi100.stdout:7/23: readlink d1/l4 0 2024-04-27T07:33:25.228 INFO:tasks.workunit.client.1.smithi100.stdout:8/58: rmdir d6 39 2024-04-27T07:33:25.230 INFO:tasks.workunit.client.1.smithi100.stdout:4/34: rename f1 to d5/f9 0 2024-04-27T07:33:25.233 INFO:tasks.workunit.client.1.smithi100.stdout:7/24: creat d1/f6 x:0 0 0 2024-04-27T07:33:25.233 INFO:tasks.workunit.client.1.smithi100.stdout:9/64: fsync d1/f14 0 2024-04-27T07:33:25.234 INFO:tasks.workunit.client.1.smithi100.stdout:7/25: write d1/f6 [838403,26644] 0 2024-04-27T07:33:25.235 INFO:tasks.workunit.client.1.smithi100.stdout:7/26: chown d1/f2 9500499 1 2024-04-27T07:33:25.236 INFO:tasks.workunit.client.1.smithi100.stdout:4/35: symlink d5/la 0 2024-04-27T07:33:25.236 INFO:tasks.workunit.client.0.smithi082.stdout:8/548: sync 2024-04-27T07:33:25.236 INFO:tasks.workunit.client.0.smithi082.stdout:2/598: sync 2024-04-27T07:33:25.237 INFO:tasks.workunit.client.0.smithi082.stdout:2/599: chown d7/d30 26999 1 2024-04-27T07:33:25.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/36: dread - d5/f8 zero size 2024-04-27T07:33:25.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/37: chown d5 2829 1 2024-04-27T07:33:25.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/38: chown c3 9525678 1 2024-04-27T07:33:25.239 INFO:tasks.workunit.client.0.smithi082.stdout:2/600: unlink d7/d9/d4f/fba 0 2024-04-27T07:33:25.240 INFO:tasks.workunit.client.1.smithi100.stdout:9/65: rename d1/c3 to d1/d9/db/c19 0 2024-04-27T07:33:25.241 INFO:tasks.workunit.client.1.smithi100.stdout:8/59: dread - d6/f10 zero size 2024-04-27T07:33:25.242 INFO:tasks.workunit.client.1.smithi100.stdout:7/27: fdatasync d1/f5 0 2024-04-27T07:33:25.243 INFO:tasks.workunit.client.1.smithi100.stdout:4/39: symlink d5/lb 0 2024-04-27T07:33:25.245 INFO:tasks.workunit.client.0.smithi082.stdout:2/601: dwrite d7/d14/fc2 [4194304,4194304] 0 2024-04-27T07:33:25.245 INFO:tasks.workunit.client.1.smithi100.stdout:9/66: rename d1/c12 to d1/c1a 0 2024-04-27T07:33:25.249 INFO:tasks.workunit.client.1.smithi100.stdout:4/40: rename f0 to d5/fc 0 2024-04-27T07:33:25.249 INFO:tasks.workunit.client.0.smithi082.stdout:2/602: rename d7/d31/c59 to d7/d8/d99/cc4 0 2024-04-27T07:33:25.250 INFO:tasks.workunit.client.0.smithi082.stdout:2/603: chown d7/d9/d4f/f80 152009 1 2024-04-27T07:33:25.253 INFO:tasks.workunit.client.1.smithi100.stdout:4/41: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:25.258 INFO:tasks.workunit.client.1.smithi100.stdout:2/124: getdents d0/da 0 2024-04-27T07:33:25.263 INFO:tasks.workunit.client.1.smithi100.stdout:2/125: dread d0/f11 [0,4194304] 0 2024-04-27T07:33:25.263 INFO:tasks.workunit.client.1.smithi100.stdout:2/126: chown d0/da/d29 1 1 2024-04-27T07:33:25.266 INFO:tasks.workunit.client.1.smithi100.stdout:2/127: mknod d0/da/d29/c2f 0 2024-04-27T07:33:25.267 INFO:tasks.workunit.client.1.smithi100.stdout:5/38: getdents d0/d4 0 2024-04-27T07:33:25.268 INFO:tasks.workunit.client.1.smithi100.stdout:2/128: mknod d0/da/c30 0 2024-04-27T07:33:25.268 INFO:tasks.workunit.client.1.smithi100.stdout:5/39: truncate d0/d4/fc 239869 0 2024-04-27T07:33:25.274 INFO:tasks.workunit.client.1.smithi100.stdout:6/21: getdents . 0 2024-04-27T07:33:25.276 INFO:tasks.workunit.client.1.smithi100.stdout:6/22: rename f1 to f7 0 2024-04-27T07:33:25.279 INFO:tasks.workunit.client.1.smithi100.stdout:6/23: unlink f3 0 2024-04-27T07:33:25.279 INFO:tasks.workunit.client.1.smithi100.stdout:6/24: rmdir - no directory 2024-04-27T07:33:25.282 INFO:tasks.workunit.client.1.smithi100.stdout:0/31: getdents d1/d8 0 2024-04-27T07:33:25.287 INFO:tasks.workunit.client.1.smithi100.stdout:6/25: dwrite f5 [0,4194304] 0 2024-04-27T07:33:25.289 INFO:tasks.workunit.client.1.smithi100.stdout:9/67: getdents d1/d9/db 0 2024-04-27T07:33:25.292 INFO:tasks.workunit.client.1.smithi100.stdout:8/60: write d6/fe [958582,54524] 0 2024-04-27T07:33:25.294 INFO:tasks.workunit.client.1.smithi100.stdout:4/42: getdents d5 0 2024-04-27T07:33:25.294 INFO:tasks.workunit.client.1.smithi100.stdout:0/32: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:25.295 INFO:tasks.workunit.client.1.smithi100.stdout:4/43: chown d5/f6 0 1 2024-04-27T07:33:25.295 INFO:tasks.workunit.client.1.smithi100.stdout:6/26: link f5 f8 0 2024-04-27T07:33:25.296 INFO:tasks.workunit.client.1.smithi100.stdout:7/28: truncate d1/f5 3241288 0 2024-04-27T07:33:25.300 INFO:tasks.workunit.client.1.smithi100.stdout:4/44: mknod d5/cd 0 2024-04-27T07:33:25.301 INFO:tasks.workunit.client.1.smithi100.stdout:8/61: dread f4 [0,4194304] 0 2024-04-27T07:33:25.302 INFO:tasks.workunit.client.1.smithi100.stdout:6/27: fdatasync f5 0 2024-04-27T07:33:25.302 INFO:tasks.workunit.client.1.smithi100.stdout:2/129: write d0/da/d29/f13 [2630375,20448] 0 2024-04-27T07:33:25.305 INFO:tasks.workunit.client.1.smithi100.stdout:7/29: mknod d1/c7 0 2024-04-27T07:33:25.310 INFO:tasks.workunit.client.1.smithi100.stdout:0/33: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:25.314 INFO:tasks.workunit.client.1.smithi100.stdout:4/45: dwrite d5/f8 [0,4194304] 0 2024-04-27T07:33:25.316 INFO:tasks.workunit.client.1.smithi100.stdout:2/130: dread - d0/da/d29/f23 zero size 2024-04-27T07:33:25.318 INFO:tasks.workunit.client.1.smithi100.stdout:9/68: getdents d1/d9 0 2024-04-27T07:33:25.319 INFO:tasks.workunit.client.1.smithi100.stdout:0/34: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:25.320 INFO:tasks.workunit.client.1.smithi100.stdout:0/35: dread - d1/d8/fc zero size 2024-04-27T07:33:25.322 INFO:tasks.workunit.client.1.smithi100.stdout:6/28: write f7 [1734353,103927] 0 2024-04-27T07:33:25.324 INFO:tasks.workunit.client.1.smithi100.stdout:5/40: write d0/fa [640224,20910] 0 2024-04-27T07:33:25.326 INFO:tasks.workunit.client.1.smithi100.stdout:2/131: creat d0/d1e/f31 x:0 0 0 2024-04-27T07:33:25.328 INFO:tasks.workunit.client.1.smithi100.stdout:9/69: rename d1/f5 to d1/d9/f1b 0 2024-04-27T07:33:25.329 INFO:tasks.workunit.client.1.smithi100.stdout:0/36: creat d1/fe x:0 0 0 2024-04-27T07:33:25.330 INFO:tasks.workunit.client.1.smithi100.stdout:6/29: mknod c9 0 2024-04-27T07:33:25.330 INFO:tasks.workunit.client.1.smithi100.stdout:8/62: dwrite d6/f10 [0,4194304] 0 2024-04-27T07:33:25.332 INFO:tasks.workunit.client.1.smithi100.stdout:7/30: write d1/f5 [3010141,11656] 0 2024-04-27T07:33:25.332 INFO:tasks.workunit.client.1.smithi100.stdout:0/37: chown d1/f5 0 1 2024-04-27T07:33:25.332 INFO:tasks.workunit.client.1.smithi100.stdout:6/30: write f5 [2190011,32351] 0 2024-04-27T07:33:25.334 INFO:tasks.workunit.client.1.smithi100.stdout:0/38: write d1/fe [717570,104352] 0 2024-04-27T07:33:25.337 INFO:tasks.workunit.client.1.smithi100.stdout:8/63: fdatasync d6/ff 0 2024-04-27T07:33:25.338 INFO:tasks.workunit.client.1.smithi100.stdout:6/31: creat fa x:0 0 0 2024-04-27T07:33:25.340 INFO:tasks.workunit.client.1.smithi100.stdout:7/31: mkdir d1/d8 0 2024-04-27T07:33:25.340 INFO:tasks.workunit.client.1.smithi100.stdout:7/32: write d1/f6 [494898,39551] 0 2024-04-27T07:33:25.342 INFO:tasks.workunit.client.1.smithi100.stdout:0/39: creat d1/d8/ff x:0 0 0 2024-04-27T07:33:25.344 INFO:tasks.workunit.client.1.smithi100.stdout:2/132: mknod d0/da/c32 0 2024-04-27T07:33:25.345 INFO:tasks.workunit.client.1.smithi100.stdout:0/40: write d1/d8/ff [983831,95997] 0 2024-04-27T07:33:25.345 INFO:tasks.workunit.client.1.smithi100.stdout:4/46: truncate d5/f8 1118843 0 2024-04-27T07:33:25.346 INFO:tasks.workunit.client.0.smithi082.stdout:2/604: symlink d7/d9/d4f/d6e/d82/lc5 0 2024-04-27T07:33:25.346 INFO:tasks.workunit.client.1.smithi100.stdout:5/41: write d0/f9 [565842,47028] 0 2024-04-27T07:33:25.347 INFO:tasks.workunit.client.1.smithi100.stdout:5/42: fsync d0/d4/fc 0 2024-04-27T07:33:25.347 INFO:tasks.workunit.client.1.smithi100.stdout:7/33: dread d1/f2 [0,4194304] 0 2024-04-27T07:33:25.348 INFO:tasks.workunit.client.1.smithi100.stdout:8/64: creat d6/f18 x:0 0 0 2024-04-27T07:33:25.348 INFO:tasks.workunit.client.1.smithi100.stdout:9/70: write d1/fd [1002308,74520] 0 2024-04-27T07:33:25.350 INFO:tasks.workunit.client.0.smithi082.stdout:2/605: rename d7/d9/d4f/d6e/d93 to d7/d9/d4f/d6e/d82/dc6 0 2024-04-27T07:33:25.350 INFO:tasks.workunit.client.1.smithi100.stdout:2/133: fsync d0/f24 0 2024-04-27T07:33:25.351 INFO:tasks.workunit.client.1.smithi100.stdout:4/47: creat d5/fe x:0 0 0 2024-04-27T07:33:25.352 INFO:tasks.workunit.client.1.smithi100.stdout:0/41: creat d1/f10 x:0 0 0 2024-04-27T07:33:25.353 INFO:tasks.workunit.client.1.smithi100.stdout:4/48: truncate d5/fc 4575165 0 2024-04-27T07:33:25.354 INFO:tasks.workunit.client.1.smithi100.stdout:8/65: dread d6/fe [0,4194304] 0 2024-04-27T07:33:25.354 INFO:tasks.workunit.client.1.smithi100.stdout:4/49: dread - d5/fe zero size 2024-04-27T07:33:25.355 INFO:tasks.workunit.client.0.smithi082.stdout:2/606: dwrite f3 [0,4194304] 0 2024-04-27T07:33:25.355 INFO:tasks.workunit.client.1.smithi100.stdout:7/34: creat d1/f9 x:0 0 0 2024-04-27T07:33:25.355 INFO:tasks.workunit.client.1.smithi100.stdout:8/66: truncate d6/f17 581298 0 2024-04-27T07:33:25.356 INFO:tasks.workunit.client.1.smithi100.stdout:4/50: truncate d5/f7 4506892 0 2024-04-27T07:33:25.356 INFO:tasks.workunit.client.1.smithi100.stdout:5/43: mknod d0/d4/cd 0 2024-04-27T07:33:25.361 INFO:tasks.workunit.client.0.smithi082.stdout:2/607: link d7/d9/d4f/d66/caa d7/d9/cc7 0 2024-04-27T07:33:25.361 INFO:tasks.workunit.client.1.smithi100.stdout:4/51: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:25.361 INFO:tasks.workunit.client.1.smithi100.stdout:9/71: dread d1/d9/f1b [0,4194304] 0 2024-04-27T07:33:25.362 INFO:tasks.workunit.client.0.smithi082.stdout:2/608: read d7/d9/d4f/d66/dae/f8c [136910,94852] 0 2024-04-27T07:33:25.363 INFO:tasks.workunit.client.1.smithi100.stdout:7/35: fdatasync d1/f2 0 2024-04-27T07:33:25.364 INFO:tasks.workunit.client.0.smithi082.stdout:2/609: write d7/d14/f9f [1047086,46263] 0 2024-04-27T07:33:25.365 INFO:tasks.workunit.client.1.smithi100.stdout:5/44: truncate d0/f8 704415 0 2024-04-27T07:33:25.366 INFO:tasks.workunit.client.1.smithi100.stdout:4/52: mknod d5/cf 0 2024-04-27T07:33:25.368 INFO:tasks.workunit.client.1.smithi100.stdout:9/72: mknod d1/d9/db/c1c 0 2024-04-27T07:33:25.369 INFO:tasks.workunit.client.0.smithi082.stdout:2/610: dread d7/f87 [0,4194304] 0 2024-04-27T07:33:25.370 INFO:tasks.workunit.client.1.smithi100.stdout:0/42: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:25.371 INFO:tasks.workunit.client.0.smithi082.stdout:2/611: mkdir d7/d8/d99/dc8 0 2024-04-27T07:33:25.371 INFO:tasks.workunit.client.1.smithi100.stdout:8/67: link d6/la d6/l19 0 2024-04-27T07:33:25.372 INFO:tasks.workunit.client.1.smithi100.stdout:7/36: dwrite d1/f9 [0,4194304] 0 2024-04-27T07:33:25.373 INFO:tasks.workunit.client.1.smithi100.stdout:5/45: mknod d0/ce 0 2024-04-27T07:33:25.374 INFO:tasks.workunit.client.1.smithi100.stdout:5/46: chown d0/d4 2940 1 2024-04-27T07:33:25.374 INFO:tasks.workunit.client.0.smithi082.stdout:2/612: rename d7/d9/d4f/d6e/l83 to d7/d8/d13/d94/lc9 0 2024-04-27T07:33:25.375 INFO:tasks.workunit.client.1.smithi100.stdout:7/37: write d1/f2 [4123086,62736] 0 2024-04-27T07:33:25.375 INFO:tasks.workunit.client.0.smithi082.stdout:2/613: chown d7/d8/d13/f2b 31482 1 2024-04-27T07:33:25.376 INFO:tasks.workunit.client.1.smithi100.stdout:4/53: dread d5/f6 [0,4194304] 0 2024-04-27T07:33:25.376 INFO:tasks.workunit.client.1.smithi100.stdout:9/73: dread d1/f7 [0,4194304] 0 2024-04-27T07:33:25.377 INFO:tasks.workunit.client.1.smithi100.stdout:0/43: creat d1/d8/f11 x:0 0 0 2024-04-27T07:33:25.379 INFO:tasks.workunit.client.1.smithi100.stdout:8/68: creat d6/f1a x:0 0 0 2024-04-27T07:33:25.379 INFO:tasks.workunit.client.1.smithi100.stdout:9/74: chown d1/d9/l10 2728748 1 2024-04-27T07:33:25.382 INFO:tasks.workunit.client.1.smithi100.stdout:8/69: mkdir d6/d1b 0 2024-04-27T07:33:25.383 INFO:tasks.workunit.client.1.smithi100.stdout:8/70: read d6/ff [110391,100392] 0 2024-04-27T07:33:25.384 INFO:tasks.workunit.client.1.smithi100.stdout:9/75: mknod d1/c1d 0 2024-04-27T07:33:25.386 INFO:tasks.workunit.client.1.smithi100.stdout:5/47: mknod d0/cf 0 2024-04-27T07:33:25.387 INFO:tasks.workunit.client.1.smithi100.stdout:5/48: write d0/f9 [225365,130826] 0 2024-04-27T07:33:25.388 INFO:tasks.workunit.client.1.smithi100.stdout:0/44: rename d1/d8/lb to d1/l12 0 2024-04-27T07:33:25.389 INFO:tasks.workunit.client.1.smithi100.stdout:8/71: creat d6/f1c x:0 0 0 2024-04-27T07:33:25.390 INFO:tasks.workunit.client.1.smithi100.stdout:8/72: chown d6 3412 1 2024-04-27T07:33:25.390 INFO:tasks.workunit.client.1.smithi100.stdout:5/49: dread d0/fa [0,4194304] 0 2024-04-27T07:33:25.391 INFO:tasks.workunit.client.1.smithi100.stdout:9/76: fsync d1/f8 0 2024-04-27T07:33:25.391 INFO:tasks.workunit.client.0.smithi082.stdout:3/850: sync 2024-04-27T07:33:25.391 INFO:tasks.workunit.client.0.smithi082.stdout:5/710: sync 2024-04-27T07:33:25.391 INFO:tasks.workunit.client.0.smithi082.stdout:7/575: sync 2024-04-27T07:33:25.392 INFO:tasks.workunit.client.0.smithi082.stdout:0/629: sync 2024-04-27T07:33:25.392 INFO:tasks.workunit.client.0.smithi082.stdout:4/633: sync 2024-04-27T07:33:25.392 INFO:tasks.workunit.client.0.smithi082.stdout:9/499: sync 2024-04-27T07:33:25.392 INFO:tasks.workunit.client.0.smithi082.stdout:0/630: stat da/ld 0 2024-04-27T07:33:25.392 INFO:tasks.workunit.client.0.smithi082.stdout:7/576: readlink d3/l5b 0 2024-04-27T07:33:25.393 INFO:tasks.workunit.client.1.smithi100.stdout:9/77: chown d1/d9/db/ff 1703 1 2024-04-27T07:33:25.393 INFO:tasks.workunit.client.1.smithi100.stdout:0/45: mkdir d1/d13 0 2024-04-27T07:33:25.394 INFO:tasks.workunit.client.0.smithi082.stdout:5/711: chown d8/d15/d22/c9e 39955312 1 2024-04-27T07:33:25.394 INFO:tasks.workunit.client.0.smithi082.stdout:9/500: write d9/da/f67 [358466,69261] 0 2024-04-27T07:33:25.394 INFO:tasks.workunit.client.1.smithi100.stdout:9/78: readlink d1/d9/l10 0 2024-04-27T07:33:25.395 INFO:tasks.workunit.client.0.smithi082.stdout:4/634: chown d3/d10/d9c/cac 30050185 1 2024-04-27T07:33:25.395 INFO:tasks.workunit.client.0.smithi082.stdout:0/631: read da/fe [1317714,66588] 0 2024-04-27T07:33:25.395 INFO:tasks.workunit.client.0.smithi082.stdout:3/851: rmdir d8/d9/dd/d13 39 2024-04-27T07:33:25.396 INFO:tasks.workunit.client.0.smithi082.stdout:7/577: fsync d3/d49/d97/f1b 0 2024-04-27T07:33:25.396 INFO:tasks.workunit.client.0.smithi082.stdout:9/501: write d9/da/f67 [596756,92551] 0 2024-04-27T07:33:25.397 INFO:tasks.workunit.client.1.smithi100.stdout:4/54: truncate d5/f6 77462 0 2024-04-27T07:33:25.397 INFO:tasks.workunit.client.0.smithi082.stdout:5/712: fsync d8/d2e/fbf 0 2024-04-27T07:33:25.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/852: write d8/d9/d25/d91/f56 [1205597,117447] 0 2024-04-27T07:33:25.399 INFO:tasks.workunit.client.0.smithi082.stdout:4/635: read d3/d6/d26/d55/f72 [683816,115488] 0 2024-04-27T07:33:25.400 INFO:tasks.workunit.client.1.smithi100.stdout:9/79: creat d1/d9/db/f1e x:0 0 0 2024-04-27T07:33:25.401 INFO:tasks.workunit.client.1.smithi100.stdout:5/50: dwrite d0/f9 [0,4194304] 0 2024-04-27T07:33:25.401 INFO:tasks.workunit.client.0.smithi082.stdout:9/502: dread - d9/da/dc/d35/d38/d65/f7f zero size 2024-04-27T07:33:25.403 INFO:tasks.workunit.client.1.smithi100.stdout:0/46: rename d1/d13 to d1/d8/d14 0 2024-04-27T07:33:25.403 INFO:tasks.workunit.client.0.smithi082.stdout:4/636: write d3/d6/f8e [940108,127368] 0 2024-04-27T07:33:25.404 INFO:tasks.workunit.client.0.smithi082.stdout:5/713: mkdir d8/d15/dca/dce/df3 0 2024-04-27T07:33:25.405 INFO:tasks.workunit.client.1.smithi100.stdout:4/55: write d5/fc [4841920,70637] 0 2024-04-27T07:33:25.406 INFO:tasks.workunit.client.1.smithi100.stdout:8/73: dwrite d6/f7 [0,4194304] 0 2024-04-27T07:33:25.407 INFO:tasks.workunit.client.0.smithi082.stdout:9/503: truncate d9/da/dc/d35/d42/f99 731340 0 2024-04-27T07:33:25.408 INFO:tasks.workunit.client.1.smithi100.stdout:9/80: unlink d1/d9/fc 0 2024-04-27T07:33:25.409 INFO:tasks.workunit.client.0.smithi082.stdout:7/578: dwrite d3/f45 [4194304,4194304] 0 2024-04-27T07:33:25.411 INFO:tasks.workunit.client.0.smithi082.stdout:4/637: symlink d3/d6/d26/d55/d67/d9d/lcc 0 2024-04-27T07:33:25.411 INFO:tasks.workunit.client.1.smithi100.stdout:0/47: symlink d1/d8/l15 0 2024-04-27T07:33:25.412 INFO:tasks.workunit.client.1.smithi100.stdout:4/56: creat d5/f10 x:0 0 0 2024-04-27T07:33:25.415 INFO:tasks.workunit.client.0.smithi082.stdout:9/504: symlink d9/la0 0 2024-04-27T07:33:25.416 INFO:tasks.workunit.client.0.smithi082.stdout:5/714: creat d8/d15/de0/ff4 x:0 0 0 2024-04-27T07:33:25.416 INFO:tasks.workunit.client.0.smithi082.stdout:7/579: dread d3/db/f2e [0,4194304] 0 2024-04-27T07:33:25.417 INFO:tasks.workunit.client.1.smithi100.stdout:8/74: dwrite d6/f1a [0,4194304] 0 2024-04-27T07:33:25.418 INFO:tasks.workunit.client.1.smithi100.stdout:4/57: mknod d5/c11 0 2024-04-27T07:33:25.421 INFO:tasks.workunit.client.1.smithi100.stdout:0/48: dread d1/fa [0,4194304] 0 2024-04-27T07:33:25.422 INFO:tasks.workunit.client.0.smithi082.stdout:4/638: write d3/fa5 [296210,29205] 0 2024-04-27T07:33:25.424 INFO:tasks.workunit.client.0.smithi082.stdout:5/715: creat d8/d15/de0/ff5 x:0 0 0 2024-04-27T07:33:25.424 INFO:tasks.workunit.client.1.smithi100.stdout:0/49: fdatasync d1/fe 0 2024-04-27T07:33:25.425 INFO:tasks.workunit.client.0.smithi082.stdout:9/505: symlink d9/da/dc/d35/d42/la1 0 2024-04-27T07:33:25.427 INFO:tasks.workunit.client.0.smithi082.stdout:5/716: chown d8/f2d 1 1 2024-04-27T07:33:25.428 INFO:tasks.workunit.client.0.smithi082.stdout:4/639: symlink d3/d6/d22/d69/lcd 0 2024-04-27T07:33:25.429 INFO:tasks.workunit.client.1.smithi100.stdout:4/58: dwrite d5/f7 [0,4194304] 0 2024-04-27T07:33:25.429 INFO:tasks.workunit.client.1.smithi100.stdout:8/75: dread d6/f8 [0,4194304] 0 2024-04-27T07:33:25.431 INFO:tasks.workunit.client.0.smithi082.stdout:3/853: dread d8/d9/d25/d26/d4d/d82/d8b/dfc/f105 [0,4194304] 0 2024-04-27T07:33:25.431 INFO:tasks.workunit.client.0.smithi082.stdout:7/580: rename d3/d49/d97/d6c/cbf to d3/db1/cc0 0 2024-04-27T07:33:25.432 INFO:tasks.workunit.client.0.smithi082.stdout:5/717: mkdir d8/d29/dea/d5f/df6 0 2024-04-27T07:33:25.433 INFO:tasks.workunit.client.1.smithi100.stdout:4/59: dread d5/f7 [0,4194304] 0 2024-04-27T07:33:25.433 INFO:tasks.workunit.client.0.smithi082.stdout:7/581: write d3/d49/d97/d3a/fad [686964,23467] 0 2024-04-27T07:33:25.434 INFO:tasks.workunit.client.1.smithi100.stdout:8/76: mkdir d6/d1b/d1d 0 2024-04-27T07:33:25.435 INFO:tasks.workunit.client.1.smithi100.stdout:8/77: stat d6/d1b/d1d 0 2024-04-27T07:33:25.435 INFO:tasks.workunit.client.0.smithi082.stdout:4/640: mkdir d3/dce 0 2024-04-27T07:33:25.436 INFO:tasks.workunit.client.1.smithi100.stdout:4/60: write d5/f8 [1888280,78097] 0 2024-04-27T07:33:25.437 INFO:tasks.workunit.client.0.smithi082.stdout:4/641: fsync d3/d10/d9c/fb3 0 2024-04-27T07:33:25.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/506: link d9/da/d32/c44 d9/da/ca2 0 2024-04-27T07:33:25.439 INFO:tasks.workunit.client.0.smithi082.stdout:4/642: fdatasync d3/d6/f8e 0 2024-04-27T07:33:25.439 INFO:tasks.workunit.client.1.smithi100.stdout:8/78: dread d6/f1a [0,4194304] 0 2024-04-27T07:33:25.441 INFO:tasks.workunit.client.0.smithi082.stdout:9/507: creat d9/da/fa3 x:0 0 0 2024-04-27T07:33:25.441 INFO:tasks.workunit.client.1.smithi100.stdout:8/79: creat d6/f1e x:0 0 0 2024-04-27T07:33:25.442 INFO:tasks.workunit.client.1.smithi100.stdout:8/80: chown d6/f17 220354 1 2024-04-27T07:33:25.443 INFO:tasks.workunit.client.0.smithi082.stdout:7/582: dwrite d3/f45 [8388608,4194304] 0 2024-04-27T07:33:25.444 INFO:tasks.workunit.client.1.smithi100.stdout:4/61: read d5/f8 [1295657,45990] 0 2024-04-27T07:33:25.444 INFO:tasks.workunit.client.1.smithi100.stdout:8/81: readlink d6/l19 0 2024-04-27T07:33:25.445 INFO:tasks.workunit.client.0.smithi082.stdout:4/643: rmdir d3/d10/d9c/d9f 0 2024-04-27T07:33:25.445 INFO:tasks.workunit.client.1.smithi100.stdout:8/82: fsync d6/f10 0 2024-04-27T07:33:25.445 INFO:tasks.workunit.client.1.smithi100.stdout:9/81: truncate d1/f4 360556 0 2024-04-27T07:33:25.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/508: symlink d9/da/dc/d35/d4a/d50/la4 0 2024-04-27T07:33:25.451 INFO:tasks.workunit.client.1.smithi100.stdout:8/83: symlink d6/d1b/l1f 0 2024-04-27T07:33:25.452 INFO:tasks.workunit.client.0.smithi082.stdout:7/583: mkdir d3/db/dc1 0 2024-04-27T07:33:25.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/509: dread d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:25.453 INFO:tasks.workunit.client.0.smithi082.stdout:4/644: mkdir d3/d6/dcf 0 2024-04-27T07:33:25.455 INFO:tasks.workunit.client.1.smithi100.stdout:8/84: mkdir d6/d20 0 2024-04-27T07:33:25.456 INFO:tasks.workunit.client.1.smithi100.stdout:8/85: chown d6/lc 98 1 2024-04-27T07:33:25.456 INFO:tasks.workunit.client.0.smithi082.stdout:4/645: creat d3/d6/d22/d69/fd0 x:0 0 0 2024-04-27T07:33:25.458 INFO:tasks.workunit.client.0.smithi082.stdout:9/510: write d9/da/dc/d35/d4b/f74 [3600742,120189] 0 2024-04-27T07:33:25.458 INFO:tasks.workunit.client.0.smithi082.stdout:5/718: write d8/d14/f21 [3903827,95745] 0 2024-04-27T07:33:25.463 INFO:tasks.workunit.client.0.smithi082.stdout:4/646: dread d3/d6/d26/f60 [0,4194304] 0 2024-04-27T07:33:25.464 INFO:tasks.workunit.client.1.smithi100.stdout:5/51: dwrite d0/f8 [0,4194304] 0 2024-04-27T07:33:25.465 INFO:tasks.workunit.client.1.smithi100.stdout:8/86: dread d6/f1a [0,4194304] 0 2024-04-27T07:33:25.465 INFO:tasks.workunit.client.1.smithi100.stdout:4/62: write d5/f6 [982007,84454] 0 2024-04-27T07:33:25.466 INFO:tasks.workunit.client.0.smithi082.stdout:9/511: rename d9/da/dc/d35/d42 to d9/da/dc/d35/d38/da5 0 2024-04-27T07:33:25.466 INFO:tasks.workunit.client.1.smithi100.stdout:8/87: chown d6/fb 5 1 2024-04-27T07:33:25.467 INFO:tasks.workunit.client.0.smithi082.stdout:5/719: dwrite d8/d29/d4e/ff0 [0,4194304] 0 2024-04-27T07:33:25.468 INFO:tasks.workunit.client.1.smithi100.stdout:8/88: chown d6 745733 1 2024-04-27T07:33:25.469 INFO:tasks.workunit.client.0.smithi082.stdout:4/647: symlink d3/d6/d26/d5e/ld1 0 2024-04-27T07:33:25.471 INFO:tasks.workunit.client.0.smithi082.stdout:9/512: mknod d9/d2d/d72/ca6 0 2024-04-27T07:33:25.473 INFO:tasks.workunit.client.1.smithi100.stdout:8/89: symlink d6/d20/l21 0 2024-04-27T07:33:25.474 INFO:tasks.workunit.client.0.smithi082.stdout:4/648: mknod d3/d6/d16/d98/cd2 0 2024-04-27T07:33:25.474 INFO:tasks.workunit.client.0.smithi082.stdout:3/854: dread d8/d9/d25/d26/f98 [0,4194304] 0 2024-04-27T07:33:25.475 INFO:tasks.workunit.client.1.smithi100.stdout:4/63: dread d5/f6 [0,4194304] 0 2024-04-27T07:33:25.478 INFO:tasks.workunit.client.1.smithi100.stdout:8/90: creat d6/d1b/f22 x:0 0 0 2024-04-27T07:33:25.478 INFO:tasks.workunit.client.0.smithi082.stdout:4/649: mknod d3/d6/d22/d69/d85/cd3 0 2024-04-27T07:33:25.479 INFO:tasks.workunit.client.1.smithi100.stdout:9/82: dwrite d1/f4 [0,4194304] 0 2024-04-27T07:33:25.479 INFO:tasks.workunit.client.0.smithi082.stdout:4/650: chown d3/d6/d22/fb0 105879 1 2024-04-27T07:33:25.481 INFO:tasks.workunit.client.0.smithi082.stdout:3/855: symlink d8/d9/dd/d13/dc0/de8/l127 0 2024-04-27T07:33:25.482 INFO:tasks.workunit.client.0.smithi082.stdout:3/856: chown d8/d9/d25/d26/c7a 25027065 1 2024-04-27T07:33:25.484 INFO:tasks.workunit.client.0.smithi082.stdout:9/513: rmdir d9/da/dc/d35/d38/da5 39 2024-04-27T07:33:25.485 INFO:tasks.workunit.client.0.smithi082.stdout:3/857: fdatasync d8/d9/d25/d26/d4d/d82/d8b/fcf 0 2024-04-27T07:33:25.485 INFO:tasks.workunit.client.1.smithi100.stdout:4/64: getdents d5 0 2024-04-27T07:33:25.488 INFO:tasks.workunit.client.0.smithi082.stdout:9/514: mkdir d9/d2d/d2b/d46/d5d/da7 0 2024-04-27T07:33:25.489 INFO:tasks.workunit.client.1.smithi100.stdout:4/65: dread d5/f8 [0,4194304] 0 2024-04-27T07:33:25.489 INFO:tasks.workunit.client.1.smithi100.stdout:4/66: chown d5/la 6694 1 2024-04-27T07:33:25.490 INFO:tasks.workunit.client.1.smithi100.stdout:4/67: stat d5/f7 0 2024-04-27T07:33:25.490 INFO:tasks.workunit.client.0.smithi082.stdout:9/515: chown d9/da/d32/f39 3070 1 2024-04-27T07:33:25.491 INFO:tasks.workunit.client.0.smithi082.stdout:4/651: dwrite d3/d9/f65 [0,4194304] 0 2024-04-27T07:33:25.492 INFO:tasks.workunit.client.1.smithi100.stdout:8/91: write d6/fe [1684344,63833] 0 2024-04-27T07:33:25.493 INFO:tasks.workunit.client.0.smithi082.stdout:3/858: creat d8/d9/dd/d13/d1b/dbd/f128 x:0 0 0 2024-04-27T07:33:25.494 INFO:tasks.workunit.client.1.smithi100.stdout:4/68: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:25.494 INFO:tasks.workunit.client.1.smithi100.stdout:8/92: chown d6/d1b/d1d 348550 1 2024-04-27T07:33:25.495 INFO:tasks.workunit.client.0.smithi082.stdout:5/720: dread d8/d14/f4d [0,4194304] 0 2024-04-27T07:33:25.495 INFO:tasks.workunit.client.0.smithi082.stdout:4/652: creat d3/d6/d26/d55/d67/fd4 x:0 0 0 2024-04-27T07:33:25.496 INFO:tasks.workunit.client.1.smithi100.stdout:4/69: write d5/f10 [605992,113817] 0 2024-04-27T07:33:25.497 INFO:tasks.workunit.client.0.smithi082.stdout:5/721: readlink d8/d14/l62 0 2024-04-27T07:33:25.497 INFO:tasks.workunit.client.0.smithi082.stdout:3/859: truncate d8/d9/dd/d13/d1b/dbd/dd8/f120 212220 0 2024-04-27T07:33:25.498 INFO:tasks.workunit.client.0.smithi082.stdout:9/516: getdents d9/da 0 2024-04-27T07:33:25.499 INFO:tasks.workunit.client.1.smithi100.stdout:4/70: read d5/fc [1469205,109160] 0 2024-04-27T07:33:25.499 INFO:tasks.workunit.client.0.smithi082.stdout:3/860: chown d8/d9/dd/d13/fbf 53067 1 2024-04-27T07:33:25.501 INFO:tasks.workunit.client.1.smithi100.stdout:9/83: dwrite d1/f7 [0,4194304] 0 2024-04-27T07:33:25.501 INFO:tasks.workunit.client.0.smithi082.stdout:5/722: mkdir d8/d2e/d3d/df2/df7 0 2024-04-27T07:33:25.503 INFO:tasks.workunit.client.0.smithi082.stdout:4/653: creat d3/d81/fd5 x:0 0 0 2024-04-27T07:33:25.504 INFO:tasks.workunit.client.1.smithi100.stdout:4/71: symlink d5/l12 0 2024-04-27T07:33:25.505 INFO:tasks.workunit.client.0.smithi082.stdout:4/654: write d3/d6/d16/fae [158108,41130] 0 2024-04-27T07:33:25.507 INFO:tasks.workunit.client.1.smithi100.stdout:4/72: write d5/fe [526924,83072] 0 2024-04-27T07:33:25.508 INFO:tasks.workunit.client.0.smithi082.stdout:3/861: creat d8/d9/d25/d26/d4d/d82/dce/d101/f129 x:0 0 0 2024-04-27T07:33:25.509 INFO:tasks.workunit.client.0.smithi082.stdout:5/723: truncate d8/d29/d4e/f52 1470557 0 2024-04-27T07:33:25.509 INFO:tasks.workunit.client.1.smithi100.stdout:4/73: fsync d5/f6 0 2024-04-27T07:33:25.510 INFO:tasks.workunit.client.1.smithi100.stdout:4/74: chown d5/c11 16 1 2024-04-27T07:33:25.511 INFO:tasks.workunit.client.0.smithi082.stdout:3/862: stat d8/d9/d1d/db5/dc7 0 2024-04-27T07:33:25.511 INFO:tasks.workunit.client.0.smithi082.stdout:5/724: chown d8/d29/dea/da3 2215 1 2024-04-27T07:33:25.511 INFO:tasks.workunit.client.1.smithi100.stdout:9/84: dwrite d1/f7 [0,4194304] 0 2024-04-27T07:33:25.512 INFO:tasks.workunit.client.1.smithi100.stdout:4/75: write d5/f6 [48584,91405] 0 2024-04-27T07:33:25.512 INFO:tasks.workunit.client.1.smithi100.stdout:4/76: chown d5/l12 6102503 1 2024-04-27T07:33:25.514 INFO:tasks.workunit.client.0.smithi082.stdout:4/655: dwrite d3/d6/fc0 [0,4194304] 0 2024-04-27T07:33:25.515 INFO:tasks.workunit.client.0.smithi082.stdout:3/863: mkdir d8/d9/d1f/d12a 0 2024-04-27T07:33:25.515 INFO:tasks.workunit.client.1.smithi100.stdout:4/77: creat d5/f13 x:0 0 0 2024-04-27T07:33:25.516 INFO:tasks.workunit.client.0.smithi082.stdout:9/517: dread d9/d2d/f23 [0,4194304] 0 2024-04-27T07:33:25.518 INFO:tasks.workunit.client.1.smithi100.stdout:4/78: mknod d5/c14 0 2024-04-27T07:33:25.519 INFO:tasks.workunit.client.1.smithi100.stdout:4/79: fsync d5/fe 0 2024-04-27T07:33:25.520 INFO:tasks.workunit.client.0.smithi082.stdout:4/656: chown d3/d6/d22/f40 65965796 1 2024-04-27T07:33:25.521 INFO:tasks.workunit.client.1.smithi100.stdout:9/85: dread d1/fd [0,4194304] 0 2024-04-27T07:33:25.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/536: sync 2024-04-27T07:33:25.522 INFO:tasks.workunit.client.1.smithi100.stdout:9/86: mkdir d1/d9/d1f 0 2024-04-27T07:33:25.523 INFO:tasks.workunit.client.0.smithi082.stdout:9/518: mkdir d9/da/dc/d88/da8 0 2024-04-27T07:33:25.524 INFO:tasks.workunit.client.0.smithi082.stdout:3/864: link d8/d9/d25/d26/f6e d8/d9/d25/d26/d4d/f12b 0 2024-04-27T07:33:25.525 INFO:tasks.workunit.client.1.smithi100.stdout:9/87: dread d1/fd [0,4194304] 0 2024-04-27T07:33:25.526 INFO:tasks.workunit.client.0.smithi082.stdout:4/657: creat d3/d6/d26/d5e/d21/dad/fd6 x:0 0 0 2024-04-27T07:33:25.527 INFO:tasks.workunit.client.1.smithi100.stdout:4/80: dwrite d5/f9 [0,4194304] 0 2024-04-27T07:33:25.527 INFO:tasks.workunit.client.1.smithi100.stdout:9/88: creat d1/d9/f20 x:0 0 0 2024-04-27T07:33:25.529 INFO:tasks.workunit.client.1.smithi100.stdout:9/89: write d1/f4 [1668323,127714] 0 2024-04-27T07:33:25.530 INFO:tasks.workunit.client.1.smithi100.stdout:4/81: creat d5/f15 x:0 0 0 2024-04-27T07:33:25.531 INFO:tasks.workunit.client.0.smithi082.stdout:9/519: chown d9/da/dc/d33/d5e/c62 1891551547 1 2024-04-27T07:33:25.532 INFO:tasks.workunit.client.1.smithi100.stdout:9/90: creat d1/d9/f21 x:0 0 0 2024-04-27T07:33:25.532 INFO:tasks.workunit.client.1.smithi100.stdout:4/82: fsync d5/f8 0 2024-04-27T07:33:25.533 INFO:tasks.workunit.client.1.smithi100.stdout:4/83: readlink d5/l12 0 2024-04-27T07:33:25.533 INFO:tasks.workunit.client.1.smithi100.stdout:9/91: chown d1/d9/l15 0 1 2024-04-27T07:33:25.535 INFO:tasks.workunit.client.0.smithi082.stdout:3/865: creat d8/d9/dd/d13/d1b/f12c x:0 0 0 2024-04-27T07:33:25.535 INFO:tasks.workunit.client.1.smithi100.stdout:4/84: truncate d5/f15 74858 0 2024-04-27T07:33:25.535 INFO:tasks.workunit.client.1.smithi100.stdout:9/92: creat d1/f22 x:0 0 0 2024-04-27T07:33:25.535 INFO:tasks.workunit.client.1.smithi100.stdout:9/93: stat d1/fd 0 2024-04-27T07:33:25.536 INFO:tasks.workunit.client.0.smithi082.stdout:3/866: chown d8/d9/dd/d13/d1b/dbd/d8e/ff7 733178 1 2024-04-27T07:33:25.536 INFO:tasks.workunit.client.0.smithi082.stdout:9/520: chown d9/da/dc/d35/d4b/f74 25305 1 2024-04-27T07:33:25.537 INFO:tasks.workunit.client.0.smithi082.stdout:5/725: link d8/d3c/d47/l1e d8/d14/d7b/lf8 0 2024-04-27T07:33:25.537 INFO:tasks.workunit.client.0.smithi082.stdout:9/521: fsync d9/d2d/d2b/d46/f96 0 2024-04-27T07:33:25.538 INFO:tasks.workunit.client.0.smithi082.stdout:4/658: symlink d3/d6/d22/ld7 0 2024-04-27T07:33:25.539 INFO:tasks.workunit.client.0.smithi082.stdout:4/659: chown d3/d6/d26/f36 315535 1 2024-04-27T07:33:25.541 INFO:tasks.workunit.client.0.smithi082.stdout:5/726: mkdir d8/d15/d22/df9 0 2024-04-27T07:33:25.542 INFO:tasks.workunit.client.1.smithi100.stdout:4/85: dwrite d5/f15 [0,4194304] 0 2024-04-27T07:33:25.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/727: dread - d8/d2e/d85/fd6 zero size 2024-04-27T07:33:25.546 INFO:tasks.workunit.client.0.smithi082.stdout:3/867: rename d8/d9/d1d/l20 to d8/d9/dd/l12d 0 2024-04-27T07:33:25.548 INFO:tasks.workunit.client.1.smithi100.stdout:4/86: dread d5/fe [0,4194304] 0 2024-04-27T07:33:25.549 INFO:tasks.workunit.client.1.smithi100.stdout:4/87: chown d5/cd 63078 1 2024-04-27T07:33:25.550 INFO:tasks.workunit.client.0.smithi082.stdout:4/660: dread d3/d6/d26/d55/dc5/fc9 [0,4194304] 0 2024-04-27T07:33:25.550 INFO:tasks.workunit.client.0.smithi082.stdout:9/522: mknod d9/da/dc/d35/d38/da5/d66/ca9 0 2024-04-27T07:33:25.551 INFO:tasks.workunit.client.0.smithi082.stdout:1/537: dwrite d4/d2a/d3e/d46/f48 [0,4194304] 0 2024-04-27T07:33:25.551 INFO:tasks.workunit.client.1.smithi100.stdout:4/88: mkdir d5/d16 0 2024-04-27T07:33:25.553 INFO:tasks.workunit.client.1.smithi100.stdout:9/94: dwrite d1/d9/db/ff [0,4194304] 0 2024-04-27T07:33:25.554 INFO:tasks.workunit.client.1.smithi100.stdout:4/89: mkdir d5/d16/d17 0 2024-04-27T07:33:25.555 INFO:tasks.workunit.client.0.smithi082.stdout:1/538: fdatasync d4/d2a/d4c/d7a/f80 0 2024-04-27T07:33:25.556 INFO:tasks.workunit.client.1.smithi100.stdout:9/95: creat d1/d9/f23 x:0 0 0 2024-04-27T07:33:25.556 INFO:tasks.workunit.client.1.smithi100.stdout:4/90: getdents d5/d16/d17 0 2024-04-27T07:33:25.557 INFO:tasks.workunit.client.1.smithi100.stdout:9/96: chown d1/d9/db/l17 35082 1 2024-04-27T07:33:25.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/661: creat d3/d6/d22/d69/fd8 x:0 0 0 2024-04-27T07:33:25.558 INFO:tasks.workunit.client.0.smithi082.stdout:1/539: write d4/f86 [1035732,75827] 0 2024-04-27T07:33:25.560 INFO:tasks.workunit.client.1.smithi100.stdout:4/91: dread d5/f10 [0,4194304] 0 2024-04-27T07:33:25.560 INFO:tasks.workunit.client.0.smithi082.stdout:5/728: dwrite d8/d2e/fbf [0,4194304] 0 2024-04-27T07:33:25.561 INFO:tasks.workunit.client.0.smithi082.stdout:4/662: fdatasync d3/f43 0 2024-04-27T07:33:25.561 INFO:tasks.workunit.client.0.smithi082.stdout:1/540: write d4/f12 [1781396,38852] 0 2024-04-27T07:33:25.561 INFO:tasks.workunit.client.0.smithi082.stdout:9/523: creat d9/da/dc/d33/d5e/faa x:0 0 0 2024-04-27T07:33:25.562 INFO:tasks.workunit.client.1.smithi100.stdout:4/92: write d5/f9 [1245445,38462] 0 2024-04-27T07:33:25.563 INFO:tasks.workunit.client.0.smithi082.stdout:5/729: fdatasync d8/d42/fb3 0 2024-04-27T07:33:25.565 INFO:tasks.workunit.client.1.smithi100.stdout:4/93: mknod d5/d16/d17/c18 0 2024-04-27T07:33:25.565 INFO:tasks.workunit.client.1.smithi100.stdout:4/94: chown d5/d16/d17 15412 1 2024-04-27T07:33:25.568 INFO:tasks.workunit.client.1.smithi100.stdout:4/95: dread d5/f8 [0,4194304] 0 2024-04-27T07:33:25.568 INFO:tasks.workunit.client.0.smithi082.stdout:1/541: write d4/f10 [3225044,107987] 0 2024-04-27T07:33:25.571 INFO:tasks.workunit.client.1.smithi100.stdout:4/96: write d5/f9 [338397,45405] 0 2024-04-27T07:33:25.575 INFO:tasks.workunit.client.0.smithi082.stdout:9/524: creat d9/da/dc/d35/d38/fab x:0 0 0 2024-04-27T07:33:25.579 INFO:tasks.workunit.client.0.smithi082.stdout:1/542: dwrite d4/d2a/f9b [0,4194304] 0 2024-04-27T07:33:25.580 INFO:tasks.workunit.client.1.smithi100.stdout:9/97: dwrite d1/d9/db/f11 [0,4194304] 0 2024-04-27T07:33:25.581 INFO:tasks.workunit.client.0.smithi082.stdout:3/868: dwrite d8/d9/d25/d4e/f96 [0,4194304] 0 2024-04-27T07:33:25.582 INFO:tasks.workunit.client.0.smithi082.stdout:1/543: write d4/d2a/d3e/d53/fad [749349,1510] 0 2024-04-27T07:33:25.582 INFO:tasks.workunit.client.0.smithi082.stdout:9/525: creat d9/da/dc/d88/da8/fac x:0 0 0 2024-04-27T07:33:25.584 INFO:tasks.workunit.client.0.smithi082.stdout:1/544: chown d4/d2a/d3e/c8b 4949600 1 2024-04-27T07:33:25.585 INFO:tasks.workunit.client.1.smithi100.stdout:4/97: dwrite d5/fc [4194304,4194304] 0 2024-04-27T07:33:25.586 INFO:tasks.workunit.client.0.smithi082.stdout:3/869: creat d8/d108/f12e x:0 0 0 2024-04-27T07:33:25.588 INFO:tasks.workunit.client.0.smithi082.stdout:9/526: dread d9/f4c [0,4194304] 0 2024-04-27T07:33:25.589 INFO:tasks.workunit.client.1.smithi100.stdout:4/98: chown d5/f10 12826 1 2024-04-27T07:33:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:1/545: rename d4/d2a/d3e/c8b to d4/d2a/d3e/cb9 0 2024-04-27T07:33:25.591 INFO:tasks.workunit.client.0.smithi082.stdout:9/527: symlink d9/d2d/d2b/lad 0 2024-04-27T07:33:25.592 INFO:tasks.workunit.client.1.smithi100.stdout:4/99: dread d5/f10 [0,4194304] 0 2024-04-27T07:33:25.593 INFO:tasks.workunit.client.0.smithi082.stdout:9/528: dread - d9/d2d/d2b/d46/f8b zero size 2024-04-27T07:33:25.595 INFO:tasks.workunit.client.1.smithi100.stdout:9/98: dwrite d1/d9/f20 [0,4194304] 0 2024-04-27T07:33:25.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/529: mkdir d9/d2d/d72/dae 0 2024-04-27T07:33:25.598 INFO:tasks.workunit.client.1.smithi100.stdout:4/100: mkdir d5/d16/d19 0 2024-04-27T07:33:25.599 INFO:tasks.workunit.client.0.smithi082.stdout:1/546: dread d4/d2a/f9b [0,4194304] 0 2024-04-27T07:33:25.601 INFO:tasks.workunit.client.1.smithi100.stdout:4/101: unlink d5/f7 0 2024-04-27T07:33:25.602 INFO:tasks.workunit.client.0.smithi082.stdout:3/870: getdents d8/d9/d1d 0 2024-04-27T07:33:25.603 INFO:tasks.workunit.client.1.smithi100.stdout:4/102: fdatasync d5/f6 0 2024-04-27T07:33:25.603 INFO:tasks.workunit.client.1.smithi100.stdout:4/103: chown d5/f9 126 1 2024-04-27T07:33:25.603 INFO:tasks.workunit.client.1.smithi100.stdout:9/99: symlink d1/d9/d1f/l24 0 2024-04-27T07:33:25.603 INFO:tasks.workunit.client.1.smithi100.stdout:4/104: chown d5/f9 8949556 1 2024-04-27T07:33:25.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/663: dwrite d3/d9/f7d [4194304,4194304] 0 2024-04-27T07:33:25.606 INFO:tasks.workunit.client.0.smithi082.stdout:9/530: creat d9/da/dc/d35/d38/da5/faf x:0 0 0 2024-04-27T07:33:25.607 INFO:tasks.workunit.client.0.smithi082.stdout:1/547: creat d4/d15/d49/d99/db8/fba x:0 0 0 2024-04-27T07:33:25.608 INFO:tasks.workunit.client.1.smithi100.stdout:9/100: dread d1/d9/db/f11 [0,4194304] 0 2024-04-27T07:33:25.610 INFO:tasks.workunit.client.1.smithi100.stdout:4/105: dwrite d5/f8 [0,4194304] 0 2024-04-27T07:33:25.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/664: mknod d3/d6/d26/cd9 0 2024-04-27T07:33:25.611 INFO:tasks.workunit.client.1.smithi100.stdout:4/106: chown d5/fc 114 1 2024-04-27T07:33:25.612 INFO:tasks.workunit.client.1.smithi100.stdout:1/116: sync 2024-04-27T07:33:25.613 INFO:tasks.workunit.client.1.smithi100.stdout:9/101: creat d1/d9/f25 x:0 0 0 2024-04-27T07:33:25.613 INFO:tasks.workunit.client.0.smithi082.stdout:3/871: dread d8/d9/d25/d26/d4d/fc1 [0,4194304] 0 2024-04-27T07:33:25.614 INFO:tasks.workunit.client.0.smithi082.stdout:1/548: creat d4/d2a/d3e/d57/da5/fbb x:0 0 0 2024-04-27T07:33:25.616 INFO:tasks.workunit.client.0.smithi082.stdout:1/549: symlink d4/d15/d49/da0/lbc 0 2024-04-27T07:33:25.617 INFO:tasks.workunit.client.1.smithi100.stdout:9/102: readlink d1/d9/l15 0 2024-04-27T07:33:25.617 INFO:tasks.workunit.client.1.smithi100.stdout:1/117: chown d0/fd 300233 1 2024-04-27T07:33:25.617 INFO:tasks.workunit.client.0.smithi082.stdout:3/872: mknod d8/d9/d25/d91/c12f 0 2024-04-27T07:33:25.618 INFO:tasks.workunit.client.0.smithi082.stdout:3/873: read d8/d9/dd/f5a [231350,81071] 0 2024-04-27T07:33:25.619 INFO:tasks.workunit.client.0.smithi082.stdout:4/665: creat d3/dce/fda x:0 0 0 2024-04-27T07:33:25.619 INFO:tasks.workunit.client.1.smithi100.stdout:1/118: read d0/f16 [1658421,26199] 0 2024-04-27T07:33:25.622 INFO:tasks.workunit.client.1.smithi100.stdout:1/119: write d0/f18 [863375,26280] 0 2024-04-27T07:33:25.626 INFO:tasks.workunit.client.1.smithi100.stdout:1/120: unlink d0/l11 0 2024-04-27T07:33:25.626 INFO:tasks.workunit.client.1.smithi100.stdout:4/107: dwrite d5/fc [0,4194304] 0 2024-04-27T07:33:25.627 INFO:tasks.workunit.client.0.smithi082.stdout:3/874: write d8/d9/dd/d13/d1b/dbd/dd8/f120 [209089,126825] 0 2024-04-27T07:33:25.630 INFO:tasks.workunit.client.1.smithi100.stdout:9/103: dwrite d1/d9/f25 [0,4194304] 0 2024-04-27T07:33:25.632 INFO:tasks.workunit.client.1.smithi100.stdout:4/108: symlink d5/d16/d19/l1a 0 2024-04-27T07:33:25.633 INFO:tasks.workunit.client.1.smithi100.stdout:9/104: creat d1/f26 x:0 0 0 2024-04-27T07:33:25.635 INFO:tasks.workunit.client.1.smithi100.stdout:9/105: read d1/f7 [1373736,77094] 0 2024-04-27T07:33:25.637 INFO:tasks.workunit.client.1.smithi100.stdout:4/109: write d5/f9 [735674,122869] 0 2024-04-27T07:33:25.640 INFO:tasks.workunit.client.0.smithi082.stdout:9/531: truncate d9/da/dc/d33/f47 2608421 0 2024-04-27T07:33:25.641 INFO:tasks.workunit.client.1.smithi100.stdout:9/106: readlink d1/d9/d1f/l24 0 2024-04-27T07:33:25.641 INFO:tasks.workunit.client.1.smithi100.stdout:1/121: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:25.641 INFO:tasks.workunit.client.1.smithi100.stdout:4/110: mkdir d5/d1b 0 2024-04-27T07:33:25.643 INFO:tasks.workunit.client.1.smithi100.stdout:1/122: unlink d0/l3 0 2024-04-27T07:33:25.644 INFO:tasks.workunit.client.0.smithi082.stdout:1/550: truncate d4/f10 1558597 0 2024-04-27T07:33:25.646 INFO:tasks.workunit.client.1.smithi100.stdout:9/107: rename d1/f8 to d1/d9/d1f/f27 0 2024-04-27T07:33:25.647 INFO:tasks.workunit.client.1.smithi100.stdout:9/108: read - d1/f22 zero size 2024-04-27T07:33:25.648 INFO:tasks.workunit.client.1.smithi100.stdout:1/123: dread d0/f18 [0,4194304] 0 2024-04-27T07:33:25.650 INFO:tasks.workunit.client.1.smithi100.stdout:4/111: rename d5/c11 to d5/d16/d17/c1c 0 2024-04-27T07:33:25.652 INFO:tasks.workunit.client.1.smithi100.stdout:1/124: creat d0/f19 x:0 0 0 2024-04-27T07:33:25.654 INFO:tasks.workunit.client.1.smithi100.stdout:4/112: getdents d5/d16/d19 0 2024-04-27T07:33:25.655 INFO:tasks.workunit.client.0.smithi082.stdout:4/666: rename d3/d6/f5d to d3/d6/d26/d5e/d21/fdb 0 2024-04-27T07:33:25.655 INFO:tasks.workunit.client.1.smithi100.stdout:1/125: dread d0/f18 [0,4194304] 0 2024-04-27T07:33:25.656 INFO:tasks.workunit.client.0.smithi082.stdout:4/667: truncate d3/d81/fb4 327328 0 2024-04-27T07:33:25.657 INFO:tasks.workunit.client.0.smithi082.stdout:3/875: symlink d8/d9/d25/d26/d3d/dad/l130 0 2024-04-27T07:33:25.657 INFO:tasks.workunit.client.0.smithi082.stdout:1/551: getdents d4/d15/d3f/d98 0 2024-04-27T07:33:25.658 INFO:tasks.workunit.client.0.smithi082.stdout:4/668: chown d3/d6/d26/d5e/d21 481301756 1 2024-04-27T07:33:25.659 INFO:tasks.workunit.client.1.smithi100.stdout:1/126: rename d0/l12 to d0/l1a 0 2024-04-27T07:33:25.660 INFO:tasks.workunit.client.0.smithi082.stdout:1/552: creat d4/d2a/d3e/d57/da5/fbd x:0 0 0 2024-04-27T07:33:25.661 INFO:tasks.workunit.client.1.smithi100.stdout:9/109: dwrite d1/fd [0,4194304] 0 2024-04-27T07:33:25.662 INFO:tasks.workunit.client.0.smithi082.stdout:4/669: getdents d3 0 2024-04-27T07:33:25.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/553: creat d4/d15/d49/d99/d9a/da9/fbe x:0 0 0 2024-04-27T07:33:25.664 INFO:tasks.workunit.client.0.smithi082.stdout:4/670: chown d3/d6/d22/d69/fd8 63 1 2024-04-27T07:33:25.665 INFO:tasks.workunit.client.1.smithi100.stdout:1/127: mkdir d0/d1b 0 2024-04-27T07:33:25.666 INFO:tasks.workunit.client.0.smithi082.stdout:1/554: creat d4/d15/d3f/d6d/fbf x:0 0 0 2024-04-27T07:33:25.666 INFO:tasks.workunit.client.1.smithi100.stdout:1/128: write d0/f19 [990220,96919] 0 2024-04-27T07:33:25.668 INFO:tasks.workunit.client.1.smithi100.stdout:4/113: dwrite d5/f6 [0,4194304] 0 2024-04-27T07:33:25.668 INFO:tasks.workunit.client.1.smithi100.stdout:9/110: unlink d1/c1d 0 2024-04-27T07:33:25.673 INFO:tasks.workunit.client.1.smithi100.stdout:1/129: unlink d0/lf 0 2024-04-27T07:33:25.674 INFO:tasks.workunit.client.1.smithi100.stdout:4/114: mknod d5/d16/d17/c1d 0 2024-04-27T07:33:25.674 INFO:tasks.workunit.client.1.smithi100.stdout:4/115: stat d5/f6 0 2024-04-27T07:33:25.675 INFO:tasks.workunit.client.1.smithi100.stdout:9/111: link d1/d9/f23 d1/d9/d1f/f28 0 2024-04-27T07:33:25.676 INFO:tasks.workunit.client.1.smithi100.stdout:1/130: rename d0/l15 to d0/l1c 0 2024-04-27T07:33:25.676 INFO:tasks.workunit.client.0.smithi082.stdout:1/555: truncate d4/d2a/f6b 918131 0 2024-04-27T07:33:25.678 INFO:tasks.workunit.client.1.smithi100.stdout:9/112: creat d1/f29 x:0 0 0 2024-04-27T07:33:25.680 INFO:tasks.workunit.client.0.smithi082.stdout:4/671: rmdir d3/d6/d26/d5e 39 2024-04-27T07:33:25.680 INFO:tasks.workunit.client.0.smithi082.stdout:4/672: readlink d3/d6/d16/l2e 0 2024-04-27T07:33:25.683 INFO:tasks.workunit.client.1.smithi100.stdout:1/131: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:25.683 INFO:tasks.workunit.client.0.smithi082.stdout:4/673: unlink d3/f43 0 2024-04-27T07:33:25.686 INFO:tasks.workunit.client.0.smithi082.stdout:3/876: dwrite d8/d9/d25/fa6 [0,4194304] 0 2024-04-27T07:33:25.687 INFO:tasks.workunit.client.0.smithi082.stdout:1/556: rmdir d4/d15/d3f/d6d 39 2024-04-27T07:33:25.689 INFO:tasks.workunit.client.0.smithi082.stdout:1/557: chown d4/d2a/d4c/d7a/l94 7324518 1 2024-04-27T07:33:25.690 INFO:tasks.workunit.client.0.smithi082.stdout:3/877: mkdir d8/d9/d1d/df1/d131 0 2024-04-27T07:33:25.690 INFO:tasks.workunit.client.1.smithi100.stdout:1/132: dread d0/fd [0,4194304] 0 2024-04-27T07:33:25.690 INFO:tasks.workunit.client.1.smithi100.stdout:1/133: chown d0/f16 0 1 2024-04-27T07:33:25.692 INFO:tasks.workunit.client.1.smithi100.stdout:1/134: getdents d0/d1b 0 2024-04-27T07:33:25.693 INFO:tasks.workunit.client.1.smithi100.stdout:1/135: fsync d0/f13 0 2024-04-27T07:33:25.694 INFO:tasks.workunit.client.0.smithi082.stdout:1/558: symlink d4/d2a/d3e/d57/lc0 0 2024-04-27T07:33:25.694 INFO:tasks.workunit.client.1.smithi100.stdout:4/116: truncate d5/fc 1036124 0 2024-04-27T07:33:25.695 INFO:tasks.workunit.client.0.smithi082.stdout:3/878: creat d8/d9/d1d/da5/db3/f132 x:0 0 0 2024-04-27T07:33:25.695 INFO:tasks.workunit.client.1.smithi100.stdout:4/117: chown d5/d16 19 1 2024-04-27T07:33:25.696 INFO:tasks.workunit.client.0.smithi082.stdout:1/559: readlink d4/d2a/d4c/l79 0 2024-04-27T07:33:25.696 INFO:tasks.workunit.client.1.smithi100.stdout:4/118: write d5/f8 [1497781,109334] 0 2024-04-27T07:33:25.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/879: write d8/d9/dd/d13/d1b/f28 [3541558,63099] 0 2024-04-27T07:33:25.699 INFO:tasks.workunit.client.0.smithi082.stdout:6/555: sync 2024-04-27T07:33:25.699 INFO:tasks.workunit.client.0.smithi082.stdout:8/549: sync 2024-04-27T07:33:25.700 INFO:tasks.workunit.client.1.smithi100.stdout:1/136: dread d0/f14 [0,4194304] 0 2024-04-27T07:33:25.701 INFO:tasks.workunit.client.1.smithi100.stdout:4/119: unlink d5/d16/d17/c1c 0 2024-04-27T07:33:25.701 INFO:tasks.workunit.client.1.smithi100.stdout:1/137: fdatasync d0/f19 0 2024-04-27T07:33:25.701 INFO:tasks.workunit.client.0.smithi082.stdout:6/556: mknod d2/d75/d7a/cb1 0 2024-04-27T07:33:25.702 INFO:tasks.workunit.client.1.smithi100.stdout:1/138: chown d0/f16 6220 1 2024-04-27T07:33:25.704 INFO:tasks.workunit.client.1.smithi100.stdout:4/120: rename d5/cf to d5/c1e 0 2024-04-27T07:33:25.704 INFO:tasks.workunit.client.1.smithi100.stdout:1/139: symlink d0/l1d 0 2024-04-27T07:33:25.705 INFO:tasks.workunit.client.1.smithi100.stdout:1/140: read d0/f16 [4467751,59673] 0 2024-04-27T07:33:25.708 INFO:tasks.workunit.client.0.smithi082.stdout:4/674: chown d3/d6/d26/f9e 111 1 2024-04-27T07:33:25.712 INFO:tasks.workunit.client.1.smithi100.stdout:1/141: link d0/l1c d0/d1b/l1e 0 2024-04-27T07:33:25.714 INFO:tasks.workunit.client.1.smithi100.stdout:1/142: mkdir d0/d1f 0 2024-04-27T07:33:25.715 INFO:tasks.workunit.client.1.smithi100.stdout:1/143: chown d0/f14 458 1 2024-04-27T07:33:25.715 INFO:tasks.workunit.client.0.smithi082.stdout:4/675: write d3/d6/d22/f40 [598594,87103] 0 2024-04-27T07:33:25.716 INFO:tasks.workunit.client.1.smithi100.stdout:1/144: readlink d0/l1c 0 2024-04-27T07:33:25.719 INFO:tasks.workunit.client.0.smithi082.stdout:1/560: dwrite d4/d15/d29/f33 [0,4194304] 0 2024-04-27T07:33:25.720 INFO:tasks.workunit.client.1.smithi100.stdout:1/145: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:25.721 INFO:tasks.workunit.client.0.smithi082.stdout:1/561: rmdir d4/d15/d49 39 2024-04-27T07:33:25.721 INFO:tasks.workunit.client.1.smithi100.stdout:1/146: fdatasync d0/f13 0 2024-04-27T07:33:25.724 INFO:tasks.workunit.client.0.smithi082.stdout:1/562: unlink d4/d2a/fb3 0 2024-04-27T07:33:25.725 INFO:tasks.workunit.client.0.smithi082.stdout:3/880: dread d8/d9/d1d/df1/ff5 [0,4194304] 0 2024-04-27T07:33:25.727 INFO:tasks.workunit.client.0.smithi082.stdout:6/557: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:25.727 INFO:tasks.workunit.client.0.smithi082.stdout:4/676: dwrite d3/fa5 [0,4194304] 0 2024-04-27T07:33:25.729 INFO:tasks.workunit.client.1.smithi100.stdout:1/147: dwrite d0/f18 [0,4194304] 0 2024-04-27T07:33:25.730 INFO:tasks.workunit.client.0.smithi082.stdout:8/550: dread d0/d2b/d9a/da4/d35/f45 [0,4194304] 0 2024-04-27T07:33:25.734 INFO:tasks.workunit.client.1.smithi100.stdout:1/148: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:25.735 INFO:tasks.workunit.client.0.smithi082.stdout:1/563: getdents d4/d2a/d4c 0 2024-04-27T07:33:25.736 INFO:tasks.workunit.client.1.smithi100.stdout:1/149: mkdir d0/d1b/d20 0 2024-04-27T07:33:25.737 INFO:tasks.workunit.client.0.smithi082.stdout:8/551: mknod d0/d3/d87/d42/cb2 0 2024-04-27T07:33:25.738 INFO:tasks.workunit.client.0.smithi082.stdout:1/564: chown d4/d2a/d3e/f55 31915 1 2024-04-27T07:33:25.738 INFO:tasks.workunit.client.0.smithi082.stdout:4/677: mknod d3/d10/d9c/cdc 0 2024-04-27T07:33:25.739 INFO:tasks.workunit.client.1.smithi100.stdout:1/150: mknod d0/d1f/c21 0 2024-04-27T07:33:25.740 INFO:tasks.workunit.client.0.smithi082.stdout:3/881: dwrite d8/d9/d25/fa6 [0,4194304] 0 2024-04-27T07:33:25.740 INFO:tasks.workunit.client.0.smithi082.stdout:4/678: chown d3/d6/d22/d69/d85 0 1 2024-04-27T07:33:25.740 INFO:tasks.workunit.client.0.smithi082.stdout:6/558: link d2/d1e/d32/d85/f94 d2/de/fb2 0 2024-04-27T07:33:25.741 INFO:tasks.workunit.client.0.smithi082.stdout:8/552: write d0/d3/d55/f61 [299249,123879] 0 2024-04-27T07:33:25.744 INFO:tasks.workunit.client.0.smithi082.stdout:4/679: write d3/d6/d22/f59 [1415501,31866] 0 2024-04-27T07:33:25.744 INFO:tasks.workunit.client.1.smithi100.stdout:1/151: getdents d0 0 2024-04-27T07:33:25.745 INFO:tasks.workunit.client.1.smithi100.stdout:1/152: write d0/f18 [2371492,28463] 0 2024-04-27T07:33:25.747 INFO:tasks.workunit.client.0.smithi082.stdout:8/553: unlink d0/c4b 0 2024-04-27T07:33:25.748 INFO:tasks.workunit.client.1.smithi100.stdout:1/153: symlink d0/d1b/l22 0 2024-04-27T07:33:25.749 INFO:tasks.workunit.client.1.smithi100.stdout:1/154: chown d0/d1b 122859 1 2024-04-27T07:33:25.750 INFO:tasks.workunit.client.0.smithi082.stdout:4/680: mknod d3/d10/d9c/cdd 0 2024-04-27T07:33:25.750 INFO:tasks.workunit.client.0.smithi082.stdout:6/559: dwrite d2/f2a [0,4194304] 0 2024-04-27T07:33:25.751 INFO:tasks.workunit.client.1.smithi100.stdout:1/155: write d0/f14 [2725275,109623] 0 2024-04-27T07:33:25.751 INFO:tasks.workunit.client.1.smithi100.stdout:1/156: chown d0/lb 886519601 1 2024-04-27T07:33:25.753 INFO:tasks.workunit.client.0.smithi082.stdout:3/882: rename d8/d9/dd/d13/d1b/dbd/dd8/cdb to d8/d9/d1d/c133 0 2024-04-27T07:33:25.754 INFO:tasks.workunit.client.1.smithi100.stdout:1/157: getdents d0 0 2024-04-27T07:33:25.756 INFO:tasks.workunit.client.0.smithi082.stdout:3/883: write d8/d108/f12e [13725,117517] 0 2024-04-27T07:33:25.757 INFO:tasks.workunit.client.0.smithi082.stdout:8/554: creat d0/d3/d1c/d76/da0/fb3 x:0 0 0 2024-04-27T07:33:25.758 INFO:tasks.workunit.client.1.smithi100.stdout:1/158: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:25.760 INFO:tasks.workunit.client.1.smithi100.stdout:1/159: rmdir d0/d1f 39 2024-04-27T07:33:25.761 INFO:tasks.workunit.client.0.smithi082.stdout:4/681: creat d3/d6/d22/fde x:0 0 0 2024-04-27T07:33:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:4/682: fsync d3/d6/d22/f40 0 2024-04-27T07:33:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:8/555: link d0/f7 d0/d3/d87/d46/fb4 0 2024-04-27T07:33:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:3/884: dwrite d8/d9/d1f/f94 [0,4194304] 0 2024-04-27T07:33:25.765 INFO:tasks.workunit.client.1.smithi100.stdout:1/160: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:25.768 INFO:tasks.workunit.client.1.smithi100.stdout:1/161: mkdir d0/d23 0 2024-04-27T07:33:25.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/556: symlink d0/d2b/d9a/lb5 0 2024-04-27T07:33:25.768 INFO:tasks.workunit.client.0.smithi082.stdout:4/683: fdatasync d3/f29 0 2024-04-27T07:33:25.769 INFO:tasks.workunit.client.0.smithi082.stdout:8/557: fsync d0/d3/d87/d42/d7f/d82/fb1 0 2024-04-27T07:33:25.770 INFO:tasks.workunit.client.0.smithi082.stdout:4/684: rename d3/d10/d9c to d3/d10/d9c/dc2/ddf 22 2024-04-27T07:33:25.771 INFO:tasks.workunit.client.0.smithi082.stdout:3/885: rmdir d8/d9/d1d/db5/dc7 39 2024-04-27T07:33:25.772 INFO:tasks.workunit.client.1.smithi100.stdout:1/162: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:4/685: rmdir d3/d6/d26/d55 39 2024-04-27T07:33:25.776 INFO:tasks.workunit.client.1.smithi100.stdout:1/163: dread d0/f13 [0,4194304] 0 2024-04-27T07:33:25.778 INFO:tasks.workunit.client.1.smithi100.stdout:1/164: mknod d0/d1f/c24 0 2024-04-27T07:33:25.780 INFO:tasks.workunit.client.0.smithi082.stdout:3/886: dwrite d8/d9/d25/d4e/f96 [0,4194304] 0 2024-04-27T07:33:25.784 INFO:tasks.workunit.client.1.smithi100.stdout:1/165: dread d0/f19 [0,4194304] 0 2024-04-27T07:33:25.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/558: link d0/d2b/l6e d0/d3/d1b/d29/d6a/lb6 0 2024-04-27T07:33:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:1/565: dread d4/d2a/d3e/f55 [0,4194304] 0 2024-04-27T07:33:25.786 INFO:tasks.workunit.client.0.smithi082.stdout:8/559: chown d0/d3/d55 700 1 2024-04-27T07:33:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/686: dread d3/d6/d26/f9e [0,4194304] 0 2024-04-27T07:33:25.787 INFO:tasks.workunit.client.0.smithi082.stdout:3/887: rename d8/d9/d25/d91/ce2 to d8/d9/dd/d13/d1b/da8/c134 0 2024-04-27T07:33:25.787 INFO:tasks.workunit.client.1.smithi100.stdout:1/166: rename d0/cc to d0/d1b/d20/c25 0 2024-04-27T07:33:25.789 INFO:tasks.workunit.client.1.smithi100.stdout:1/167: creat d0/f26 x:0 0 0 2024-04-27T07:33:25.789 INFO:tasks.workunit.client.0.smithi082.stdout:1/566: unlink d4/d2a/d3e/d57/da5/fbd 0 2024-04-27T07:33:25.790 INFO:tasks.workunit.client.1.smithi100.stdout:1/168: read d0/f18 [1260669,119994] 0 2024-04-27T07:33:25.790 INFO:tasks.workunit.client.0.smithi082.stdout:8/560: mknod d0/d3/d1c/d76/cb7 0 2024-04-27T07:33:25.791 INFO:tasks.workunit.client.0.smithi082.stdout:8/561: write d0/d3/d87/d42/fab [343619,79116] 0 2024-04-27T07:33:25.791 INFO:tasks.workunit.client.0.smithi082.stdout:4/687: read d3/d6/d26/f74 [193011,124725] 0 2024-04-27T07:33:25.792 INFO:tasks.workunit.client.1.smithi100.stdout:1/169: write d0/f16 [4738660,33374] 0 2024-04-27T07:33:25.793 INFO:tasks.workunit.client.0.smithi082.stdout:3/888: write d8/d9/dd/d13/d1b/dbd/f7d [1791704,62171] 0 2024-04-27T07:33:25.795 INFO:tasks.workunit.client.0.smithi082.stdout:8/562: creat d0/d2b/d9a/da4/fb8 x:0 0 0 2024-04-27T07:33:25.795 INFO:tasks.workunit.client.1.smithi100.stdout:1/170: unlink d0/f13 0 2024-04-27T07:33:25.796 INFO:tasks.workunit.client.1.smithi100.stdout:1/171: chown d0/f14 1355464 1 2024-04-27T07:33:25.797 INFO:tasks.workunit.client.0.smithi082.stdout:4/688: symlink d3/d6/d22/d69/d85/db8/le0 0 2024-04-27T07:33:25.797 INFO:tasks.workunit.client.1.smithi100.stdout:1/172: mkdir d0/d1f/d27 0 2024-04-27T07:33:25.798 INFO:tasks.workunit.client.1.smithi100.stdout:1/173: rmdir d0/d1f 39 2024-04-27T07:33:25.798 INFO:tasks.workunit.client.0.smithi082.stdout:3/889: mkdir d8/d9/d25/d26/d4d/d82/d8b/da0/d135 0 2024-04-27T07:33:25.799 INFO:tasks.workunit.client.1.smithi100.stdout:1/174: chown d0/l1c 33361381 1 2024-04-27T07:33:25.801 INFO:tasks.workunit.client.1.smithi100.stdout:1/175: creat d0/d1f/d27/f28 x:0 0 0 2024-04-27T07:33:25.801 INFO:tasks.workunit.client.1.smithi100.stdout:3/28: sync 2024-04-27T07:33:25.802 INFO:tasks.workunit.client.1.smithi100.stdout:1/176: write d0/f26 [838377,16083] 0 2024-04-27T07:33:25.802 INFO:tasks.workunit.client.1.smithi100.stdout:3/29: mkdir d7/d9 0 2024-04-27T07:33:25.804 INFO:tasks.workunit.client.0.smithi082.stdout:8/563: getdents d0/d3/d1b/d29/d6a 0 2024-04-27T07:33:25.804 INFO:tasks.workunit.client.1.smithi100.stdout:3/30: symlink d7/la 0 2024-04-27T07:33:25.805 INFO:tasks.workunit.client.1.smithi100.stdout:3/31: write d7/f8 [273570,72908] 0 2024-04-27T07:33:25.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/689: getdents d3/d6/d22 0 2024-04-27T07:33:25.806 INFO:tasks.workunit.client.1.smithi100.stdout:1/177: link d0/f16 d0/d23/f29 0 2024-04-27T07:33:25.808 INFO:tasks.workunit.client.1.smithi100.stdout:1/178: fdatasync d0/fd 0 2024-04-27T07:33:25.809 INFO:tasks.workunit.client.1.smithi100.stdout:1/179: stat d0/l1d 0 2024-04-27T07:33:25.810 INFO:tasks.workunit.client.0.smithi082.stdout:1/567: dwrite d4/f34 [0,4194304] 0 2024-04-27T07:33:25.811 INFO:tasks.workunit.client.0.smithi082.stdout:3/890: dwrite d8/d9/dd/d13/d1b/fee [0,4194304] 0 2024-04-27T07:33:25.811 INFO:tasks.workunit.client.1.smithi100.stdout:3/32: dwrite f5 [0,4194304] 0 2024-04-27T07:33:25.813 INFO:tasks.workunit.client.0.smithi082.stdout:4/690: creat d3/d6/d22/d69/d85/db8/fe1 x:0 0 0 2024-04-27T07:33:25.813 INFO:tasks.workunit.client.1.smithi100.stdout:1/180: link d0/l1a d0/d1b/d20/l2a 0 2024-04-27T07:33:25.814 INFO:tasks.workunit.client.1.smithi100.stdout:3/33: symlink d7/d9/lb 0 2024-04-27T07:33:25.815 INFO:tasks.workunit.client.1.smithi100.stdout:3/34: read - f4 zero size 2024-04-27T07:33:25.816 INFO:tasks.workunit.client.1.smithi100.stdout:3/35: chown d7/la 1503503 1 2024-04-27T07:33:25.816 INFO:tasks.workunit.client.0.smithi082.stdout:4/691: dread - d3/d6/d22/d69/d85/db8/fe1 zero size 2024-04-27T07:33:25.818 INFO:tasks.workunit.client.0.smithi082.stdout:8/564: dwrite d0/f58 [0,4194304] 0 2024-04-27T07:33:25.818 INFO:tasks.workunit.client.0.smithi082.stdout:3/891: truncate d8/d9/dd/d13/f6f 4298588 0 2024-04-27T07:33:25.820 INFO:tasks.workunit.client.1.smithi100.stdout:3/36: dread d7/f8 [0,4194304] 0 2024-04-27T07:33:25.821 INFO:tasks.workunit.client.1.smithi100.stdout:3/37: fdatasync f6 0 2024-04-27T07:33:25.826 INFO:tasks.workunit.client.1.smithi100.stdout:1/181: dwrite d0/f18 [0,4194304] 0 2024-04-27T07:33:25.828 INFO:tasks.workunit.client.0.smithi082.stdout:4/692: rename d3/d81/la3 to d3/d6/d22/d69/d85/db8/le2 0 2024-04-27T07:33:25.829 INFO:tasks.workunit.client.0.smithi082.stdout:8/565: getdents d0/d3/d1b/d29/d6a 0 2024-04-27T07:33:25.831 INFO:tasks.workunit.client.0.smithi082.stdout:3/892: creat d8/d9/d1d/db5/f136 x:0 0 0 2024-04-27T07:33:25.834 INFO:tasks.workunit.client.0.smithi082.stdout:1/568: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:25.836 INFO:tasks.workunit.client.1.smithi100.stdout:3/38: dwrite f5 [0,4194304] 0 2024-04-27T07:33:25.837 INFO:tasks.workunit.client.0.smithi082.stdout:3/893: creat d8/d9/dd/d13/d1b/da8/f137 x:0 0 0 2024-04-27T07:33:25.837 INFO:tasks.workunit.client.0.smithi082.stdout:1/569: chown d4/d2a/d4c/f8d 5 1 2024-04-27T07:33:25.838 INFO:tasks.workunit.client.1.smithi100.stdout:3/39: write f5 [5750792,70831] 0 2024-04-27T07:33:25.839 INFO:tasks.workunit.client.0.smithi082.stdout:8/566: dwrite d0/d2b/fa3 [0,4194304] 0 2024-04-27T07:33:25.841 INFO:tasks.workunit.client.0.smithi082.stdout:3/894: mknod d8/d9/dd/d11e/c138 0 2024-04-27T07:33:25.841 INFO:tasks.workunit.client.0.smithi082.stdout:8/567: dread - d0/d3/d1b/fae zero size 2024-04-27T07:33:25.843 INFO:tasks.workunit.client.1.smithi100.stdout:1/182: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:25.843 INFO:tasks.workunit.client.0.smithi082.stdout:3/895: readlink d8/d9/d1d/da5/db3/ld1 0 2024-04-27T07:33:25.843 INFO:tasks.workunit.client.0.smithi082.stdout:1/570: symlink d4/d15/d3f/d6d/db7/lc1 0 2024-04-27T07:33:25.845 INFO:tasks.workunit.client.0.smithi082.stdout:8/568: write d0/d3/d1b/d29/f57 [2184439,55408] 0 2024-04-27T07:33:25.847 INFO:tasks.workunit.client.1.smithi100.stdout:1/183: write d0/f14 [3601800,120486] 0 2024-04-27T07:33:25.850 INFO:tasks.workunit.client.0.smithi082.stdout:8/569: read d0/d3/d87/d42/d7f/d82/f8c [254084,61163] 0 2024-04-27T07:33:25.851 INFO:tasks.workunit.client.1.smithi100.stdout:3/40: dwrite f5 [4194304,4194304] 0 2024-04-27T07:33:25.852 INFO:tasks.workunit.client.0.smithi082.stdout:1/571: rename d4/d15/d3f/d6d/fbf to d4/d15/d49/fc2 0 2024-04-27T07:33:25.852 INFO:tasks.workunit.client.0.smithi082.stdout:3/896: read d8/d9/d1d/f79 [745489,92265] 0 2024-04-27T07:33:25.852 INFO:tasks.workunit.client.1.smithi100.stdout:1/184: creat d0/d1f/f2b x:0 0 0 2024-04-27T07:33:25.852 INFO:tasks.workunit.client.1.smithi100.stdout:3/41: readlink d7/la 0 2024-04-27T07:33:25.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/570: dread - d0/d2b/d9a/da4/fb8 zero size 2024-04-27T07:33:25.855 INFO:tasks.workunit.client.0.smithi082.stdout:1/572: fdatasync d4/d2a/d4c/f8d 0 2024-04-27T07:33:25.856 INFO:tasks.workunit.client.1.smithi100.stdout:3/42: unlink d7/la 0 2024-04-27T07:33:25.858 INFO:tasks.workunit.client.1.smithi100.stdout:3/43: write f4 [324554,94451] 0 2024-04-27T07:33:25.859 INFO:tasks.workunit.client.0.smithi082.stdout:3/897: getdents d8/d9/db0 0 2024-04-27T07:33:25.861 INFO:tasks.workunit.client.0.smithi082.stdout:8/571: dwrite d0/d3/d87/d71/f5d [0,4194304] 0 2024-04-27T07:33:25.863 INFO:tasks.workunit.client.1.smithi100.stdout:1/185: creat d0/d23/f2c x:0 0 0 2024-04-27T07:33:25.865 INFO:tasks.workunit.client.0.smithi082.stdout:3/898: rename d8/d9/d1d/db5/le3 to d8/d9/dd/d13/dc0/l139 0 2024-04-27T07:33:25.865 INFO:tasks.workunit.client.0.smithi082.stdout:1/573: fsync d4/f34 0 2024-04-27T07:33:25.866 INFO:tasks.workunit.client.0.smithi082.stdout:8/572: creat d0/d2b/d80/fb9 x:0 0 0 2024-04-27T07:33:25.867 INFO:tasks.workunit.client.0.smithi082.stdout:1/574: stat d4/d2a/d4c/c68 0 2024-04-27T07:33:25.867 INFO:tasks.workunit.client.0.smithi082.stdout:8/573: stat d0/d3/d55/caa 0 2024-04-27T07:33:25.868 INFO:tasks.workunit.client.1.smithi100.stdout:1/186: mkdir d0/d1b/d20/d2d 0 2024-04-27T07:33:25.868 INFO:tasks.workunit.client.0.smithi082.stdout:1/575: fdatasync d4/d15/d29/f7d 0 2024-04-27T07:33:25.869 INFO:tasks.workunit.client.1.smithi100.stdout:3/44: dwrite f5 [4194304,4194304] 0 2024-04-27T07:33:25.870 INFO:tasks.workunit.client.0.smithi082.stdout:1/576: fsync d4/d15/f37 0 2024-04-27T07:33:25.870 INFO:tasks.workunit.client.1.smithi100.stdout:3/45: write f6 [425637,72830] 0 2024-04-27T07:33:25.875 INFO:tasks.workunit.client.0.smithi082.stdout:8/574: dwrite d0/d3/d1b/f89 [0,4194304] 0 2024-04-27T07:33:25.876 INFO:tasks.workunit.client.1.smithi100.stdout:1/187: creat d0/d1b/d20/d2d/f2e x:0 0 0 2024-04-27T07:33:25.879 INFO:tasks.workunit.client.0.smithi082.stdout:8/575: mknod d0/d3/d87/d42/d7f/d82/cba 0 2024-04-27T07:33:25.880 INFO:tasks.workunit.client.1.smithi100.stdout:1/188: getdents d0/d1b 0 2024-04-27T07:33:25.885 INFO:tasks.workunit.client.1.smithi100.stdout:1/189: dread d0/d23/f29 [0,4194304] 0 2024-04-27T07:33:25.887 INFO:tasks.workunit.client.1.smithi100.stdout:1/190: creat d0/d1b/f2f x:0 0 0 2024-04-27T07:33:25.906 INFO:tasks.workunit.client.0.smithi082.stdout:3/899: write d8/d9/d25/d26/d4d/f12b [1132246,116651] 0 2024-04-27T07:33:25.909 INFO:tasks.workunit.client.0.smithi082.stdout:3/900: write d8/d9/d1f/f94 [5142787,88176] 0 2024-04-27T07:33:25.909 INFO:tasks.workunit.client.1.smithi100.stdout:3/46: truncate f4 295132 0 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:3/47: readlink d7/d9/lb 0 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:0/50: sync 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:6/32: sync 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:5/52: sync 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:2/134: sync 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:7/38: sync 2024-04-27T07:33:25.911 INFO:tasks.workunit.client.1.smithi100.stdout:8/93: sync 2024-04-27T07:33:25.912 INFO:tasks.workunit.client.0.smithi082.stdout:1/577: dwrite d4/d15/d49/d99/d9a/fa3 [0,4194304] 0 2024-04-27T07:33:25.913 INFO:tasks.workunit.client.1.smithi100.stdout:6/33: chown c4 50251 1 2024-04-27T07:33:25.913 INFO:tasks.workunit.client.1.smithi100.stdout:8/94: rename d6 to d6/d20/d23 22 2024-04-27T07:33:25.913 INFO:tasks.workunit.client.1.smithi100.stdout:2/135: readlink d0/da/d29/l2d 0 2024-04-27T07:33:25.914 INFO:tasks.workunit.client.1.smithi100.stdout:6/34: dread - f6 zero size 2024-04-27T07:33:25.914 INFO:tasks.workunit.client.1.smithi100.stdout:0/51: write d1/f10 [960641,61543] 0 2024-04-27T07:33:25.916 INFO:tasks.workunit.client.1.smithi100.stdout:3/48: creat d7/d9/fc x:0 0 0 2024-04-27T07:33:25.917 INFO:tasks.workunit.client.1.smithi100.stdout:0/52: stat d1/cd 0 2024-04-27T07:33:25.918 INFO:tasks.workunit.client.1.smithi100.stdout:6/35: chown f5 122740 1 2024-04-27T07:33:25.919 INFO:tasks.workunit.client.1.smithi100.stdout:3/49: stat f6 0 2024-04-27T07:33:25.919 INFO:tasks.workunit.client.1.smithi100.stdout:2/136: truncate d0/f24 993573 0 2024-04-27T07:33:25.919 INFO:tasks.workunit.client.1.smithi100.stdout:5/53: creat d0/f10 x:0 0 0 2024-04-27T07:33:25.922 INFO:tasks.workunit.client.1.smithi100.stdout:8/95: rename d6/fe to d6/f24 0 2024-04-27T07:33:25.923 INFO:tasks.workunit.client.1.smithi100.stdout:1/191: dwrite d0/f16 [4194304,4194304] 0 2024-04-27T07:33:25.923 INFO:tasks.workunit.client.1.smithi100.stdout:6/36: chown f6 0 1 2024-04-27T07:33:25.923 INFO:tasks.workunit.client.1.smithi100.stdout:5/54: write d0/d4/f7 [673047,117844] 0 2024-04-27T07:33:25.923 INFO:tasks.workunit.client.1.smithi100.stdout:7/39: rmdir d1/d8 0 2024-04-27T07:33:25.924 INFO:tasks.workunit.client.1.smithi100.stdout:0/53: rmdir d1/d8 39 2024-04-27T07:33:25.924 INFO:tasks.workunit.client.0.smithi082.stdout:2/614: sync 2024-04-27T07:33:25.924 INFO:tasks.workunit.client.0.smithi082.stdout:0/632: sync 2024-04-27T07:33:25.924 INFO:tasks.workunit.client.0.smithi082.stdout:7/584: sync 2024-04-27T07:33:25.928 INFO:tasks.workunit.client.1.smithi100.stdout:6/37: symlink lb 0 2024-04-27T07:33:25.928 INFO:tasks.workunit.client.1.smithi100.stdout:8/96: write d6/f1a [4669808,114022] 0 2024-04-27T07:33:25.930 INFO:tasks.workunit.client.0.smithi082.stdout:2/615: write d7/d31/d54/f96 [1483746,36433] 0 2024-04-27T07:33:25.931 INFO:tasks.workunit.client.1.smithi100.stdout:8/97: dread - d6/f18 zero size 2024-04-27T07:33:25.931 INFO:tasks.workunit.client.1.smithi100.stdout:5/55: creat d0/d4/f11 x:0 0 0 2024-04-27T07:33:25.932 INFO:tasks.workunit.client.0.smithi082.stdout:3/901: dwrite d8/d9/dd/d13/d1b/dbd/f128 [0,4194304] 0 2024-04-27T07:33:25.932 INFO:tasks.workunit.client.1.smithi100.stdout:2/137: fdatasync d0/f24 0 2024-04-27T07:33:25.933 INFO:tasks.workunit.client.1.smithi100.stdout:1/192: dread d0/d23/f29 [0,4194304] 0 2024-04-27T07:33:25.933 INFO:tasks.workunit.client.0.smithi082.stdout:1/578: rename d4/d2a to d4/d15/d49/dab/dc3 0 2024-04-27T07:33:25.933 INFO:tasks.workunit.client.1.smithi100.stdout:8/98: dread - d6/f1e zero size 2024-04-27T07:33:25.934 INFO:tasks.workunit.client.1.smithi100.stdout:6/38: creat fc x:0 0 0 2024-04-27T07:33:25.935 INFO:tasks.workunit.client.0.smithi082.stdout:3/902: write d8/d9/dd/d13/d1b/dbd/d8e/f113 [1549613,32161] 0 2024-04-27T07:33:25.937 INFO:tasks.workunit.client.0.smithi082.stdout:2/616: creat d7/d9/d4f/d6e/fca x:0 0 0 2024-04-27T07:33:25.938 INFO:tasks.workunit.client.0.smithi082.stdout:8/576: dread d0/d3/d87/d42/f5b [0,4194304] 0 2024-04-27T07:33:25.939 INFO:tasks.workunit.client.0.smithi082.stdout:0/633: rename da/d1d/f20 to da/d38/d7f/d4a/d80/dcb/fe1 0 2024-04-27T07:33:25.941 INFO:tasks.workunit.client.0.smithi082.stdout:0/634: chown da/d38/l6f 5 1 2024-04-27T07:33:25.942 INFO:tasks.workunit.client.0.smithi082.stdout:0/635: fsync da/d2a/dc4/fd1 0 2024-04-27T07:33:25.942 INFO:tasks.workunit.client.1.smithi100.stdout:7/40: dwrite d1/f6 [0,4194304] 0 2024-04-27T07:33:25.942 INFO:tasks.workunit.client.0.smithi082.stdout:2/617: write d7/d30/d23/fb7 [790769,21477] 0 2024-04-27T07:33:25.943 INFO:tasks.workunit.client.0.smithi082.stdout:1/579: mknod d4/d15/da7/cc4 0 2024-04-27T07:33:25.944 INFO:tasks.workunit.client.0.smithi082.stdout:8/577: creat d0/d2b/d80/fbb x:0 0 0 2024-04-27T07:33:25.944 INFO:tasks.workunit.client.1.smithi100.stdout:6/39: creat fd x:0 0 0 2024-04-27T07:33:25.945 INFO:tasks.workunit.client.1.smithi100.stdout:1/193: write d0/d1f/f2b [487449,46070] 0 2024-04-27T07:33:25.946 INFO:tasks.workunit.client.1.smithi100.stdout:0/54: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:25.946 INFO:tasks.workunit.client.0.smithi082.stdout:7/585: link d3/d49/d97/d3a/d2a/dac/d91/fa5 d3/d9/d4f/d9a/fc2 0 2024-04-27T07:33:25.947 INFO:tasks.workunit.client.1.smithi100.stdout:8/99: symlink d6/d1b/d1d/l25 0 2024-04-27T07:33:25.948 INFO:tasks.workunit.client.1.smithi100.stdout:7/41: mknod d1/ca 0 2024-04-27T07:33:25.950 INFO:tasks.workunit.client.1.smithi100.stdout:0/55: dread - d1/d8/f11 zero size 2024-04-27T07:33:25.951 INFO:tasks.workunit.client.1.smithi100.stdout:1/194: fdatasync d0/d1f/f2b 0 2024-04-27T07:33:25.952 INFO:tasks.workunit.client.0.smithi082.stdout:1/580: dwrite d4/d15/d29/f7d [0,4194304] 0 2024-04-27T07:33:25.952 INFO:tasks.workunit.client.0.smithi082.stdout:8/578: creat d0/d2b/d9a/da4/fbc x:0 0 0 2024-04-27T07:33:25.952 INFO:tasks.workunit.client.0.smithi082.stdout:0/636: creat da/db3/fe2 x:0 0 0 2024-04-27T07:33:25.953 INFO:tasks.workunit.client.1.smithi100.stdout:7/42: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:25.953 INFO:tasks.workunit.client.1.smithi100.stdout:5/56: rmdir d0/d4 39 2024-04-27T07:33:25.956 INFO:tasks.workunit.client.1.smithi100.stdout:7/43: write d1/f2 [3849640,44265] 0 2024-04-27T07:33:25.956 INFO:tasks.workunit.client.0.smithi082.stdout:2/618: truncate d7/f3c 3989138 0 2024-04-27T07:33:25.957 INFO:tasks.workunit.client.1.smithi100.stdout:0/56: stat d1/l12 0 2024-04-27T07:33:25.959 INFO:tasks.workunit.client.1.smithi100.stdout:0/57: fdatasync d1/fe 0 2024-04-27T07:33:25.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/637: mkdir da/d3c/d3f/d4c/d74/d81/de3 0 2024-04-27T07:33:25.961 INFO:tasks.workunit.client.1.smithi100.stdout:1/195: dwrite d0/f26 [0,4194304] 0 2024-04-27T07:33:25.962 INFO:tasks.workunit.client.0.smithi082.stdout:0/638: write da/d2a/dc4/fd1 [670395,101831] 0 2024-04-27T07:33:25.962 INFO:tasks.workunit.client.0.smithi082.stdout:8/579: creat d0/d2b/d9a/da4/d35/fbd x:0 0 0 2024-04-27T07:33:25.964 INFO:tasks.workunit.client.0.smithi082.stdout:2/619: dwrite d7/f51 [0,4194304] 0 2024-04-27T07:33:25.965 INFO:tasks.workunit.client.0.smithi082.stdout:1/581: symlink d4/d15/d49/dab/dc3/d3e/d53/lc5 0 2024-04-27T07:33:25.965 INFO:tasks.workunit.client.1.smithi100.stdout:0/58: mkdir d1/d8/d16 0 2024-04-27T07:33:25.966 INFO:tasks.workunit.client.1.smithi100.stdout:5/57: symlink d0/l12 0 2024-04-27T07:33:25.967 INFO:tasks.workunit.client.1.smithi100.stdout:7/44: dread d1/f9 [0,4194304] 0 2024-04-27T07:33:25.968 INFO:tasks.workunit.client.1.smithi100.stdout:2/138: write d0/d1e/ff [692632,85638] 0 2024-04-27T07:33:25.968 INFO:tasks.workunit.client.1.smithi100.stdout:5/58: stat d0 0 2024-04-27T07:33:25.969 INFO:tasks.workunit.client.1.smithi100.stdout:7/45: stat d1 0 2024-04-27T07:33:25.970 INFO:tasks.workunit.client.0.smithi082.stdout:3/903: truncate d8/d9/f1c 3169864 0 2024-04-27T07:33:25.972 INFO:tasks.workunit.client.0.smithi082.stdout:0/639: rmdir da/d3c/d3f/d4c 39 2024-04-27T07:33:25.974 INFO:tasks.workunit.client.1.smithi100.stdout:2/139: read d0/da/fd [160996,14314] 0 2024-04-27T07:33:25.975 INFO:tasks.workunit.client.0.smithi082.stdout:1/582: creat d4/d15/d29/fc6 x:0 0 0 2024-04-27T07:33:25.975 INFO:tasks.workunit.client.0.smithi082.stdout:2/620: dwrite d7/d14/f9a [0,4194304] 0 2024-04-27T07:33:25.977 INFO:tasks.workunit.client.1.smithi100.stdout:6/40: getdents . 0 2024-04-27T07:33:25.977 INFO:tasks.workunit.client.0.smithi082.stdout:7/586: rename d3/d9/l5e to d3/d9/d4f/lc3 0 2024-04-27T07:33:25.979 INFO:tasks.workunit.client.1.smithi100.stdout:7/46: dread d1/f2 [0,4194304] 0 2024-04-27T07:33:25.979 INFO:tasks.workunit.client.0.smithi082.stdout:1/583: mkdir d4/d15/d49/d99/d9a/dc7 0 2024-04-27T07:33:25.980 INFO:tasks.workunit.client.0.smithi082.stdout:7/587: chown d3/d49/d97/d6c/f7f 275561 1 2024-04-27T07:33:25.980 INFO:tasks.workunit.client.1.smithi100.stdout:8/100: write d6/ff [1506710,106951] 0 2024-04-27T07:33:25.980 INFO:tasks.workunit.client.0.smithi082.stdout:2/621: rmdir d7/d9/d4f/d6e 39 2024-04-27T07:33:25.980 INFO:tasks.workunit.client.0.smithi082.stdout:7/588: fsync d3/f8 0 2024-04-27T07:33:25.981 INFO:tasks.workunit.client.1.smithi100.stdout:2/140: creat d0/d1e/f33 x:0 0 0 2024-04-27T07:33:25.981 INFO:tasks.workunit.client.1.smithi100.stdout:8/101: stat d6/f1a 0 2024-04-27T07:33:25.984 INFO:tasks.workunit.client.1.smithi100.stdout:5/59: dwrite d0/d4/f7 [0,4194304] 0 2024-04-27T07:33:25.986 INFO:tasks.workunit.client.0.smithi082.stdout:0/640: rename da/d38/da9/fd6 to da/d38/d7f/d4a/fe4 0 2024-04-27T07:33:25.986 INFO:tasks.workunit.client.1.smithi100.stdout:8/102: mkdir d6/d1b/d26 0 2024-04-27T07:33:25.988 INFO:tasks.workunit.client.1.smithi100.stdout:7/47: dread d1/f9 [0,4194304] 0 2024-04-27T07:33:25.989 INFO:tasks.workunit.client.1.smithi100.stdout:8/103: creat d6/f27 x:0 0 0 2024-04-27T07:33:25.990 INFO:tasks.workunit.client.0.smithi082.stdout:1/584: rename d4/d15/d49/dab/dc3/d4c/f8d to d4/d15/d49/dab/dc3/d4c/d7a/fc8 0 2024-04-27T07:33:25.990 INFO:tasks.workunit.client.0.smithi082.stdout:3/904: link d8/d9/d1d/da5/l11b d8/d9/d1f/d12a/l13a 0 2024-04-27T07:33:25.991 INFO:tasks.workunit.client.1.smithi100.stdout:5/60: dread d0/d4/f7 [0,4194304] 0 2024-04-27T07:33:25.991 INFO:tasks.workunit.client.1.smithi100.stdout:2/141: dread d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:25.991 INFO:tasks.workunit.client.1.smithi100.stdout:8/104: chown d6/d1b 119124826 1 2024-04-27T07:33:25.992 INFO:tasks.workunit.client.1.smithi100.stdout:7/48: unlink d1/f5 0 2024-04-27T07:33:25.992 INFO:tasks.workunit.client.1.smithi100.stdout:8/105: stat d6/l15 0 2024-04-27T07:33:25.992 INFO:tasks.workunit.client.1.smithi100.stdout:5/61: fsync d0/f8 0 2024-04-27T07:33:25.994 INFO:tasks.workunit.client.0.smithi082.stdout:7/589: dwrite d3/d9/d7c/fb4 [0,4194304] 0 2024-04-27T07:33:25.994 INFO:tasks.workunit.client.1.smithi100.stdout:2/142: dread - d0/da/f1c zero size 2024-04-27T07:33:25.998 INFO:tasks.workunit.client.1.smithi100.stdout:0/59: getdents d1/d8 0 2024-04-27T07:33:26.000 INFO:tasks.workunit.client.0.smithi082.stdout:7/590: symlink d3/d49/d97/d3a/d71/da0/lc4 0 2024-04-27T07:33:26.000 INFO:tasks.workunit.client.0.smithi082.stdout:8/580: rmdir d0/d2b/d9a/da4 39 2024-04-27T07:33:26.000 INFO:tasks.workunit.client.1.smithi100.stdout:8/106: mknod d6/d1b/d26/c28 0 2024-04-27T07:33:26.001 INFO:tasks.workunit.client.0.smithi082.stdout:8/581: chown d0/d3/d1c/d76/f94 0 1 2024-04-27T07:33:26.002 INFO:tasks.workunit.client.1.smithi100.stdout:1/196: truncate d0/f14 1899787 0 2024-04-27T07:33:26.003 INFO:tasks.workunit.client.0.smithi082.stdout:0/641: link da/d38/d7f/d4a/fe4 da/d3c/d3f/d4c/d74/d81/fe5 0 2024-04-27T07:33:26.004 INFO:tasks.workunit.client.0.smithi082.stdout:0/642: truncate da/fe 5064258 0 2024-04-27T07:33:26.004 INFO:tasks.workunit.client.0.smithi082.stdout:0/643: chown f7 464 1 2024-04-27T07:33:26.005 INFO:tasks.workunit.client.0.smithi082.stdout:1/585: creat d4/d15/d3f/fc9 x:0 0 0 2024-04-27T07:33:26.005 INFO:tasks.workunit.client.1.smithi100.stdout:2/143: mknod d0/da/c34 0 2024-04-27T07:33:26.007 INFO:tasks.workunit.client.0.smithi082.stdout:7/591: rename d3/d49/d97/l12 to d3/d49/d97/d7d/da1/db6/lc5 0 2024-04-27T07:33:26.007 INFO:tasks.workunit.client.0.smithi082.stdout:7/592: fdatasync d3/db/f5d 0 2024-04-27T07:33:26.008 INFO:tasks.workunit.client.1.smithi100.stdout:0/60: creat d1/d8/d14/f17 x:0 0 0 2024-04-27T07:33:26.010 INFO:tasks.workunit.client.1.smithi100.stdout:5/62: dwrite d0/f10 [0,4194304] 0 2024-04-27T07:33:26.011 INFO:tasks.workunit.client.0.smithi082.stdout:8/582: readlink d0/d3/d87/d42/l7e 0 2024-04-27T07:33:26.012 INFO:tasks.workunit.client.0.smithi082.stdout:0/644: fsync da/d3c/d3f/d57/dcc/f85 0 2024-04-27T07:33:26.016 INFO:tasks.workunit.client.0.smithi082.stdout:8/583: unlink d0/d3/d1b/d53/c72 0 2024-04-27T07:33:26.017 INFO:tasks.workunit.client.0.smithi082.stdout:8/584: readlink d0/d3/d87/l2d 0 2024-04-27T07:33:26.018 INFO:tasks.workunit.client.1.smithi100.stdout:8/107: dwrite d6/f17 [0,4194304] 0 2024-04-27T07:33:26.019 INFO:tasks.workunit.client.1.smithi100.stdout:1/197: dread d0/f26 [0,4194304] 0 2024-04-27T07:33:26.019 INFO:tasks.workunit.client.1.smithi100.stdout:5/63: write d0/d4/f11 [980988,4190] 0 2024-04-27T07:33:26.020 INFO:tasks.workunit.client.0.smithi082.stdout:2/622: truncate d7/d8/d13/fb8 177556 0 2024-04-27T07:33:26.021 INFO:tasks.workunit.client.1.smithi100.stdout:2/144: dread d0/f7 [0,4194304] 0 2024-04-27T07:33:26.022 INFO:tasks.workunit.client.1.smithi100.stdout:7/49: truncate d1/f9 1729345 0 2024-04-27T07:33:26.023 INFO:tasks.workunit.client.0.smithi082.stdout:7/593: symlink d3/d49/d97/lc6 0 2024-04-27T07:33:26.024 INFO:tasks.workunit.client.0.smithi082.stdout:1/586: creat d4/d15/fca x:0 0 0 2024-04-27T07:33:26.025 INFO:tasks.workunit.client.0.smithi082.stdout:3/905: dread f5 [0,4194304] 0 2024-04-27T07:33:26.026 INFO:tasks.workunit.client.0.smithi082.stdout:8/585: symlink d0/d3/lbe 0 2024-04-27T07:33:26.028 INFO:tasks.workunit.client.0.smithi082.stdout:0/645: mkdir da/d28/de6 0 2024-04-27T07:33:26.029 INFO:tasks.workunit.client.1.smithi100.stdout:1/198: truncate d0/d1f/d27/f28 920813 0 2024-04-27T07:33:26.029 INFO:tasks.workunit.client.1.smithi100.stdout:0/61: dwrite d1/fe [0,4194304] 0 2024-04-27T07:33:26.031 INFO:tasks.workunit.client.1.smithi100.stdout:0/62: readlink d1/l12 0 2024-04-27T07:33:26.033 INFO:tasks.workunit.client.0.smithi082.stdout:1/587: symlink d4/d15/d3f/d6d/db7/lcb 0 2024-04-27T07:33:26.033 INFO:tasks.workunit.client.1.smithi100.stdout:0/63: fdatasync d1/d8/fc 0 2024-04-27T07:33:26.034 INFO:tasks.workunit.client.0.smithi082.stdout:2/623: dread d7/d14/f50 [0,4194304] 0 2024-04-27T07:33:26.034 INFO:tasks.workunit.client.0.smithi082.stdout:1/588: write d4/d15/d49/dab/dc3/d3e/d53/d72/fac [342390,65900] 0 2024-04-27T07:33:26.035 INFO:tasks.workunit.client.1.smithi100.stdout:1/199: creat d0/d23/f30 x:0 0 0 2024-04-27T07:33:26.036 INFO:tasks.workunit.client.1.smithi100.stdout:1/200: stat d0/f26 0 2024-04-27T07:33:26.039 INFO:tasks.workunit.client.1.smithi100.stdout:8/108: getdents d6 0 2024-04-27T07:33:26.040 INFO:tasks.workunit.client.1.smithi100.stdout:5/64: dwrite d0/d4/fc [0,4194304] 0 2024-04-27T07:33:26.041 INFO:tasks.workunit.client.1.smithi100.stdout:1/201: readlink d0/l8 0 2024-04-27T07:33:26.042 INFO:tasks.workunit.client.0.smithi082.stdout:1/589: symlink d4/d15/d49/dab/dc3/d3e/d53/d72/lcc 0 2024-04-27T07:33:26.044 INFO:tasks.workunit.client.1.smithi100.stdout:7/50: dread d1/f9 [0,4194304] 0 2024-04-27T07:33:26.044 INFO:tasks.workunit.client.1.smithi100.stdout:0/64: truncate d1/d8/ff 2120780 0 2024-04-27T07:33:26.045 INFO:tasks.workunit.client.0.smithi082.stdout:9/532: sync 2024-04-27T07:33:26.045 INFO:tasks.workunit.client.0.smithi082.stdout:5/730: sync 2024-04-27T07:33:26.047 INFO:tasks.workunit.client.1.smithi100.stdout:8/109: write d6/fb [995768,72872] 0 2024-04-27T07:33:26.048 INFO:tasks.workunit.client.0.smithi082.stdout:0/646: creat da/d28/fe7 x:0 0 0 2024-04-27T07:33:26.049 INFO:tasks.workunit.client.1.smithi100.stdout:7/51: creat d1/fb x:0 0 0 2024-04-27T07:33:26.050 INFO:tasks.workunit.client.0.smithi082.stdout:8/586: getdents d0/d3/d1c/d76/da0 0 2024-04-27T07:33:26.050 INFO:tasks.workunit.client.0.smithi082.stdout:2/624: dwrite d7/d30/d23/fac [0,4194304] 0 2024-04-27T07:33:26.053 INFO:tasks.workunit.client.1.smithi100.stdout:7/52: write d1/f6 [4041703,7091] 0 2024-04-27T07:33:26.053 INFO:tasks.workunit.client.1.smithi100.stdout:1/202: link d0/c5 d0/d1f/c31 0 2024-04-27T07:33:26.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/587: chown d0/f7 447375591 1 2024-04-27T07:33:26.055 INFO:tasks.workunit.client.1.smithi100.stdout:2/145: dwrite d0/da/fd [0,4194304] 0 2024-04-27T07:33:26.057 INFO:tasks.workunit.client.1.smithi100.stdout:7/53: chown d1/c7 87133251 1 2024-04-27T07:33:26.057 INFO:tasks.workunit.client.1.smithi100.stdout:5/65: dwrite d0/f8 [0,4194304] 0 2024-04-27T07:33:26.058 INFO:tasks.workunit.client.0.smithi082.stdout:3/906: dread d8/d9/fae [0,4194304] 0 2024-04-27T07:33:26.059 INFO:tasks.workunit.client.0.smithi082.stdout:9/533: mkdir d9/da/db0 0 2024-04-27T07:33:26.059 INFO:tasks.workunit.client.0.smithi082.stdout:1/590: dwrite d4/d15/d49/d99/d9a/da9/fbe [0,4194304] 0 2024-04-27T07:33:26.060 INFO:tasks.workunit.client.1.smithi100.stdout:7/54: write d1/f6 [3802972,59330] 0 2024-04-27T07:33:26.060 INFO:tasks.workunit.client.1.smithi100.stdout:8/110: dread d6/f7 [0,4194304] 0 2024-04-27T07:33:26.061 INFO:tasks.workunit.client.0.smithi082.stdout:1/591: chown d4/d15/d49/d99 169463 1 2024-04-27T07:33:26.062 INFO:tasks.workunit.client.1.smithi100.stdout:8/111: write d6/f1a [3605996,128108] 0 2024-04-27T07:33:26.064 INFO:tasks.workunit.client.0.smithi082.stdout:5/731: rename d8/d3c/d47/l1e to d8/d14/d7b/d8b/lfa 0 2024-04-27T07:33:26.064 INFO:tasks.workunit.client.0.smithi082.stdout:3/907: symlink d8/d9/d1d/da5/dc4/l13b 0 2024-04-27T07:33:26.064 INFO:tasks.workunit.client.0.smithi082.stdout:5/732: chown d8/d29/dea/da3/fdf 8084441 1 2024-04-27T07:33:26.064 INFO:tasks.workunit.client.1.smithi100.stdout:0/65: link d1/l6 d1/d8/d16/l18 0 2024-04-27T07:33:26.065 INFO:tasks.workunit.client.1.smithi100.stdout:2/146: mknod d0/da/d29/c35 0 2024-04-27T07:33:26.067 INFO:tasks.workunit.client.1.smithi100.stdout:8/112: creat d6/d20/f29 x:0 0 0 2024-04-27T07:33:26.068 INFO:tasks.workunit.client.0.smithi082.stdout:8/588: mkdir d0/d3/d55/d6d/dbf 0 2024-04-27T07:33:26.070 INFO:tasks.workunit.client.1.smithi100.stdout:8/113: write d6/fb [361600,8344] 0 2024-04-27T07:33:26.070 INFO:tasks.workunit.client.1.smithi100.stdout:5/66: symlink d0/l13 0 2024-04-27T07:33:26.070 INFO:tasks.workunit.client.0.smithi082.stdout:2/625: dwrite d7/d31/d54/fab [0,4194304] 0 2024-04-27T07:33:26.071 INFO:tasks.workunit.client.1.smithi100.stdout:8/114: chown d6/f1c 148 1 2024-04-27T07:33:26.072 INFO:tasks.workunit.client.1.smithi100.stdout:2/147: chown d0/da/lc 1351164876 1 2024-04-27T07:33:26.074 INFO:tasks.workunit.client.1.smithi100.stdout:0/66: link d1/d8/d14/f17 d1/d8/d14/f19 0 2024-04-27T07:33:26.074 INFO:tasks.workunit.client.0.smithi082.stdout:3/908: readlink d8/d9/dd/l71 0 2024-04-27T07:33:26.074 INFO:tasks.workunit.client.1.smithi100.stdout:0/67: fdatasync d1/fe 0 2024-04-27T07:33:26.076 INFO:tasks.workunit.client.1.smithi100.stdout:8/115: unlink d6/lc 0 2024-04-27T07:33:26.077 INFO:tasks.workunit.client.0.smithi082.stdout:5/733: write d8/d14/d7b/d8b/fd1 [4530822,13620] 0 2024-04-27T07:33:26.077 INFO:tasks.workunit.client.0.smithi082.stdout:7/594: write d3/db/f32 [4497067,107823] 0 2024-04-27T07:33:26.078 INFO:tasks.workunit.client.0.smithi082.stdout:3/909: readlink d8/d9/d25/d26/d3d/l65 0 2024-04-27T07:33:26.080 INFO:tasks.workunit.client.0.smithi082.stdout:8/589: symlink d0/d3/d1b/d29/lc0 0 2024-04-27T07:33:26.080 INFO:tasks.workunit.client.0.smithi082.stdout:9/534: dwrite d9/da/dc/d35/d4a/d7e/f9b [0,4194304] 0 2024-04-27T07:33:26.080 INFO:tasks.workunit.client.0.smithi082.stdout:8/590: readlink d0/l66 0 2024-04-27T07:33:26.081 INFO:tasks.workunit.client.1.smithi100.stdout:2/148: symlink d0/da/l36 0 2024-04-27T07:33:26.082 INFO:tasks.workunit.client.1.smithi100.stdout:8/116: rename d6/d1b/d26 to d6/d20/d2a 0 2024-04-27T07:33:26.083 INFO:tasks.workunit.client.0.smithi082.stdout:7/595: chown d3/d9/d4f/d9a/fbe 112777 1 2024-04-27T07:33:26.083 INFO:tasks.workunit.client.1.smithi100.stdout:0/68: symlink d1/d8/d16/l1a 0 2024-04-27T07:33:26.084 INFO:tasks.workunit.client.0.smithi082.stdout:8/591: creat d0/d3/fc1 x:0 0 0 2024-04-27T07:33:26.084 INFO:tasks.workunit.client.1.smithi100.stdout:0/69: write d1/d8/ff [624780,65398] 0 2024-04-27T07:33:26.085 INFO:tasks.workunit.client.0.smithi082.stdout:5/734: creat d8/d15/d22/df9/ffb x:0 0 0 2024-04-27T07:33:26.085 INFO:tasks.workunit.client.0.smithi082.stdout:5/735: readlink d8/d15/l9a 0 2024-04-27T07:33:26.086 INFO:tasks.workunit.client.0.smithi082.stdout:9/535: mkdir d9/da/dc/db1 0 2024-04-27T07:33:26.087 INFO:tasks.workunit.client.0.smithi082.stdout:3/910: link d8/d9/dd/de1/f117 d8/d9/d3f/f13c 0 2024-04-27T07:33:26.088 INFO:tasks.workunit.client.0.smithi082.stdout:8/592: creat d0/d2b/d6f/fc2 x:0 0 0 2024-04-27T07:33:26.092 INFO:tasks.workunit.client.0.smithi082.stdout:9/536: dread d9/da/dc/d35/d4a/d7e/f9b [0,4194304] 0 2024-04-27T07:33:26.093 INFO:tasks.workunit.client.0.smithi082.stdout:5/736: rename d8/d3c/d64/l67 to d8/d15/d65/lfc 0 2024-04-27T07:33:26.093 INFO:tasks.workunit.client.0.smithi082.stdout:8/593: read d0/f7 [3534753,16038] 0 2024-04-27T07:33:26.094 INFO:tasks.workunit.client.1.smithi100.stdout:8/117: dwrite d6/f1a [4194304,4194304] 0 2024-04-27T07:33:26.095 INFO:tasks.workunit.client.1.smithi100.stdout:9/113: sync 2024-04-27T07:33:26.095 INFO:tasks.workunit.client.1.smithi100.stdout:4/121: sync 2024-04-27T07:33:26.095 INFO:tasks.workunit.client.0.smithi082.stdout:8/594: dread - d0/d2b/d9a/fad zero size 2024-04-27T07:33:26.096 INFO:tasks.workunit.client.1.smithi100.stdout:0/70: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:26.096 INFO:tasks.workunit.client.0.smithi082.stdout:8/595: readlink d0/d3/l88 0 2024-04-27T07:33:26.097 INFO:tasks.workunit.client.0.smithi082.stdout:9/537: truncate d9/da/dc/d35/d38/da5/d66/f6c 682511 0 2024-04-27T07:33:26.097 INFO:tasks.workunit.client.0.smithi082.stdout:5/737: read - d8/fac zero size 2024-04-27T07:33:26.098 INFO:tasks.workunit.client.1.smithi100.stdout:8/118: write d6/f24 [1659420,1890] 0 2024-04-27T07:33:26.099 INFO:tasks.workunit.client.1.smithi100.stdout:9/114: write d1/f7 [2525134,106454] 0 2024-04-27T07:33:26.099 INFO:tasks.workunit.client.0.smithi082.stdout:3/911: rmdir d8/d9/d25/d26/dea 0 2024-04-27T07:33:26.100 INFO:tasks.workunit.client.1.smithi100.stdout:8/119: write d6/f1a [3717855,78150] 0 2024-04-27T07:33:26.101 INFO:tasks.workunit.client.0.smithi082.stdout:9/538: creat d9/da/dc/d88/da8/fb2 x:0 0 0 2024-04-27T07:33:26.102 INFO:tasks.workunit.client.1.smithi100.stdout:9/115: read d1/d9/db/f11 [975061,29655] 0 2024-04-27T07:33:26.102 INFO:tasks.workunit.client.1.smithi100.stdout:8/120: fdatasync d6/fb 0 2024-04-27T07:33:26.105 INFO:tasks.workunit.client.0.smithi082.stdout:3/912: mkdir d8/d9/d25/d4e/da4/d13d 0 2024-04-27T07:33:26.106 INFO:tasks.workunit.client.1.smithi100.stdout:9/116: mkdir d1/d2a 0 2024-04-27T07:33:26.106 INFO:tasks.workunit.client.1.smithi100.stdout:1/203: rmdir d0 39 2024-04-27T07:33:26.107 INFO:tasks.workunit.client.0.smithi082.stdout:0/647: dwrite da/d3c/f82 [0,4194304] 0 2024-04-27T07:33:26.107 INFO:tasks.workunit.client.0.smithi082.stdout:5/738: mkdir d8/d29/dea/d5f/df6/dfd 0 2024-04-27T07:33:26.107 INFO:tasks.workunit.client.1.smithi100.stdout:9/117: chown d1/d9/db/ff 1 1 2024-04-27T07:33:26.107 INFO:tasks.workunit.client.1.smithi100.stdout:9/118: readlink d1/d9/l10 0 2024-04-27T07:33:26.108 INFO:tasks.workunit.client.1.smithi100.stdout:0/71: link d1/l6 d1/d8/l1b 0 2024-04-27T07:33:26.109 INFO:tasks.workunit.client.0.smithi082.stdout:5/739: dread - d8/d15/d22/fe4 zero size 2024-04-27T07:33:26.110 INFO:tasks.workunit.client.0.smithi082.stdout:8/596: getdents d0/d3/d87/d42/d7f 0 2024-04-27T07:33:26.111 INFO:tasks.workunit.client.1.smithi100.stdout:9/119: mkdir d1/d9/db/d2b 0 2024-04-27T07:33:26.112 INFO:tasks.workunit.client.0.smithi082.stdout:9/539: symlink d9/da/dc/d35/d38/da5/d66/d97/lb3 0 2024-04-27T07:33:26.112 INFO:tasks.workunit.client.1.smithi100.stdout:0/72: unlink d1/cd 0 2024-04-27T07:33:26.113 INFO:tasks.workunit.client.1.smithi100.stdout:1/204: chown d0/d1b/d20/l2a 13218898 1 2024-04-27T07:33:26.114 INFO:tasks.workunit.client.1.smithi100.stdout:9/120: creat d1/f2c x:0 0 0 2024-04-27T07:33:26.114 INFO:tasks.workunit.client.0.smithi082.stdout:9/540: write d9/da/dc/d35/d4a/f84 [699178,20156] 0 2024-04-27T07:33:26.116 INFO:tasks.workunit.client.0.smithi082.stdout:3/913: creat d8/d9/dd/d13/d1b/dbd/f13e x:0 0 0 2024-04-27T07:33:26.117 INFO:tasks.workunit.client.0.smithi082.stdout:0/648: dread da/d28/d36/d40/f49 [0,4194304] 0 2024-04-27T07:33:26.118 INFO:tasks.workunit.client.1.smithi100.stdout:9/121: rename d1/d9/l15 to d1/d9/d1f/l2d 0 2024-04-27T07:33:26.118 INFO:tasks.workunit.client.0.smithi082.stdout:8/597: link d0/d3/d1b/f1e d0/d2b/fc3 0 2024-04-27T07:33:26.119 INFO:tasks.workunit.client.0.smithi082.stdout:8/598: readlink d0/d3/d87/l2d 0 2024-04-27T07:33:26.120 INFO:tasks.workunit.client.0.smithi082.stdout:0/649: mknod da/d38/d7f/d4a/d80/da0/dd5/ce8 0 2024-04-27T07:33:26.121 INFO:tasks.workunit.client.1.smithi100.stdout:9/122: rename d1/f7 to d1/d9/db/f2e 0 2024-04-27T07:33:26.121 INFO:tasks.workunit.client.1.smithi100.stdout:1/205: link d0/d1b/l22 d0/d1b/d20/l32 0 2024-04-27T07:33:26.121 INFO:tasks.workunit.client.0.smithi082.stdout:9/541: read f7 [7544175,109656] 0 2024-04-27T07:33:26.122 INFO:tasks.workunit.client.0.smithi082.stdout:8/599: creat d0/d83/fc4 x:0 0 0 2024-04-27T07:33:26.123 INFO:tasks.workunit.client.0.smithi082.stdout:0/650: dread da/d28/d36/d40/f49 [0,4194304] 0 2024-04-27T07:33:26.123 INFO:tasks.workunit.client.0.smithi082.stdout:3/914: link d8/d9/d1d/da5/db3/ld1 d8/d9/dd/d13/l13f 0 2024-04-27T07:33:26.125 INFO:tasks.workunit.client.0.smithi082.stdout:9/542: creat d9/da/fb4 x:0 0 0 2024-04-27T07:33:26.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/915: fdatasync d8/d9/dd/d13/fa7 0 2024-04-27T07:33:26.125 INFO:tasks.workunit.client.0.smithi082.stdout:9/543: chown d9/d2d/d2b/d46/d76 59 1 2024-04-27T07:33:26.128 INFO:tasks.workunit.client.0.smithi082.stdout:0/651: mkdir da/d3c/d3f/d4c/d95/de9 0 2024-04-27T07:33:26.129 INFO:tasks.workunit.client.1.smithi100.stdout:9/123: chown d1/d9/d1f 54 1 2024-04-27T07:33:26.131 INFO:tasks.workunit.client.0.smithi082.stdout:8/600: creat d0/d2b/d9a/da4/fc5 x:0 0 0 2024-04-27T07:33:26.132 INFO:tasks.workunit.client.0.smithi082.stdout:3/916: dwrite d8/d108/f12e [0,4194304] 0 2024-04-27T07:33:26.133 INFO:tasks.workunit.client.0.smithi082.stdout:9/544: unlink d9/da/dc/d35/d4a/d50/l69 0 2024-04-27T07:33:26.134 INFO:tasks.workunit.client.0.smithi082.stdout:9/545: readlink d9/da/l1c 0 2024-04-27T07:33:26.135 INFO:tasks.workunit.client.0.smithi082.stdout:1/592: write d4/d15/d49/da0/f4a [1278095,64859] 0 2024-04-27T07:33:26.137 INFO:tasks.workunit.client.1.smithi100.stdout:9/124: link d1/d9/d1f/l24 d1/d9/db/d2b/l2f 0 2024-04-27T07:33:26.137 INFO:tasks.workunit.client.0.smithi082.stdout:3/917: mkdir d8/d9/d25/d26/d140 0 2024-04-27T07:33:26.137 INFO:tasks.workunit.client.0.smithi082.stdout:1/593: stat d4/d15/d49/d4e/f5a 0 2024-04-27T07:33:26.139 INFO:tasks.workunit.client.1.smithi100.stdout:5/67: truncate d0/f8 2299369 0 2024-04-27T07:33:26.140 INFO:tasks.workunit.client.0.smithi082.stdout:9/546: creat d9/da/fb5 x:0 0 0 2024-04-27T07:33:26.141 INFO:tasks.workunit.client.1.smithi100.stdout:1/206: dwrite d0/d23/f30 [0,4194304] 0 2024-04-27T07:33:26.142 INFO:tasks.workunit.client.0.smithi082.stdout:9/547: dread - d9/da/dc/d33/f89 zero size 2024-04-27T07:33:26.143 INFO:tasks.workunit.client.1.smithi100.stdout:8/121: rmdir d6/d20/d2a 39 2024-04-27T07:33:26.143 INFO:tasks.workunit.client.1.smithi100.stdout:8/122: dread - d6/f18 zero size 2024-04-27T07:33:26.144 INFO:tasks.workunit.client.1.smithi100.stdout:9/125: dread d1/d9/f25 [0,4194304] 0 2024-04-27T07:33:26.147 INFO:tasks.workunit.client.0.smithi082.stdout:9/548: mkdir d9/d2d/d2b/d46/db6 0 2024-04-27T07:33:26.147 INFO:tasks.workunit.client.1.smithi100.stdout:1/207: creat d0/d1b/f33 x:0 0 0 2024-04-27T07:33:26.149 INFO:tasks.workunit.client.0.smithi082.stdout:3/918: creat d8/d9/d1d/db5/dc7/f141 x:0 0 0 2024-04-27T07:33:26.149 INFO:tasks.workunit.client.1.smithi100.stdout:1/208: chown d0/c17 956915 1 2024-04-27T07:33:26.151 INFO:tasks.workunit.client.1.smithi100.stdout:5/68: creat d0/f14 x:0 0 0 2024-04-27T07:33:26.151 INFO:tasks.workunit.client.0.smithi082.stdout:1/594: rename d4/d15/d49/dab/dc3/d3e/d46/f48 to d4/d15/d49/dab/dc3/fcd 0 2024-04-27T07:33:26.153 INFO:tasks.workunit.client.1.smithi100.stdout:5/69: chown d0/d4/f11 3 1 2024-04-27T07:33:26.154 INFO:tasks.workunit.client.0.smithi082.stdout:3/919: unlink d8/d9/d25/f77 0 2024-04-27T07:33:26.155 INFO:tasks.workunit.client.1.smithi100.stdout:2/149: dwrite d0/da/f28 [0,4194304] 0 2024-04-27T07:33:26.155 INFO:tasks.workunit.client.0.smithi082.stdout:3/920: stat d8/d9/d1f/l5c 0 2024-04-27T07:33:26.155 INFO:tasks.workunit.client.0.smithi082.stdout:9/549: mknod d9/d2d/d2b/d46/db6/cb7 0 2024-04-27T07:33:26.156 INFO:tasks.workunit.client.1.smithi100.stdout:1/209: creat d0/f34 x:0 0 0 2024-04-27T07:33:26.158 INFO:tasks.workunit.client.1.smithi100.stdout:5/70: rename d0/cf to d0/d4/c15 0 2024-04-27T07:33:26.160 INFO:tasks.workunit.client.1.smithi100.stdout:1/210: mkdir d0/d1b/d20/d2d/d35 0 2024-04-27T07:33:26.161 INFO:tasks.workunit.client.0.smithi082.stdout:3/921: creat d8/d9/dd/d13/d1b/dbd/dd8/f142 x:0 0 0 2024-04-27T07:33:26.161 INFO:tasks.workunit.client.1.smithi100.stdout:0/73: truncate d1/f5 1198049 0 2024-04-27T07:33:26.165 INFO:tasks.workunit.client.0.smithi082.stdout:9/550: dwrite d9/da/dc/d73/f95 [0,4194304] 0 2024-04-27T07:33:26.166 INFO:tasks.workunit.client.1.smithi100.stdout:5/71: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:26.166 INFO:tasks.workunit.client.1.smithi100.stdout:1/211: fdatasync d0/f14 0 2024-04-27T07:33:26.170 INFO:tasks.workunit.client.0.smithi082.stdout:1/595: dread d4/f12 [4194304,4194304] 0 2024-04-27T07:33:26.170 INFO:tasks.workunit.client.0.smithi082.stdout:9/551: mkdir d9/da/d32/db8 0 2024-04-27T07:33:26.170 INFO:tasks.workunit.client.0.smithi082.stdout:5/740: dwrite d8/d14/f23 [0,4194304] 0 2024-04-27T07:33:26.172 INFO:tasks.workunit.client.0.smithi082.stdout:5/741: dread - d8/d15/d22/fe4 zero size 2024-04-27T07:33:26.173 INFO:tasks.workunit.client.1.smithi100.stdout:5/72: dread d0/d4/f7 [0,4194304] 0 2024-04-27T07:33:26.173 INFO:tasks.workunit.client.1.smithi100.stdout:1/212: mknod d0/d1f/d27/c36 0 2024-04-27T07:33:26.176 INFO:tasks.workunit.client.1.smithi100.stdout:9/126: write d1/d9/f1b [2976407,12267] 0 2024-04-27T07:33:26.176 INFO:tasks.workunit.client.1.smithi100.stdout:5/73: chown d0/ce 1623910215 1 2024-04-27T07:33:26.178 INFO:tasks.workunit.client.0.smithi082.stdout:1/596: mknod d4/d15/d49/d99/d9a/da9/cce 0 2024-04-27T07:33:26.179 INFO:tasks.workunit.client.1.smithi100.stdout:1/213: dread d0/d23/f29 [0,4194304] 0 2024-04-27T07:33:26.179 INFO:tasks.workunit.client.1.smithi100.stdout:9/127: write d1/d9/db/f2e [1650317,105712] 0 2024-04-27T07:33:26.180 INFO:tasks.workunit.client.0.smithi082.stdout:5/742: creat d8/d29/dea/ffe x:0 0 0 2024-04-27T07:33:26.181 INFO:tasks.workunit.client.1.smithi100.stdout:1/214: dread - d0/d1b/f33 zero size 2024-04-27T07:33:26.181 INFO:tasks.workunit.client.0.smithi082.stdout:0/652: truncate da/d3c/d3f/d4c/f54 2255869 0 2024-04-27T07:33:26.181 INFO:tasks.workunit.client.1.smithi100.stdout:0/74: write d1/d8/d14/f19 [834021,70116] 0 2024-04-27T07:33:26.182 INFO:tasks.workunit.client.0.smithi082.stdout:8/601: truncate d0/d3/d87/d42/d7f/f8d 1070758 0 2024-04-27T07:33:26.183 INFO:tasks.workunit.client.0.smithi082.stdout:5/743: mknod d8/d15/de0/cff 0 2024-04-27T07:33:26.184 INFO:tasks.workunit.client.1.smithi100.stdout:5/74: creat d0/f16 x:0 0 0 2024-04-27T07:33:26.185 INFO:tasks.workunit.client.0.smithi082.stdout:8/602: truncate d0/d2b/d80/fb9 754654 0 2024-04-27T07:33:26.185 INFO:tasks.workunit.client.1.smithi100.stdout:9/128: rename d1/d9/db/f11 to d1/f30 0 2024-04-27T07:33:26.186 INFO:tasks.workunit.client.1.smithi100.stdout:9/129: chown d1/d9/ca 4297 1 2024-04-27T07:33:26.186 INFO:tasks.workunit.client.1.smithi100.stdout:1/215: symlink d0/d23/l37 0 2024-04-27T07:33:26.187 INFO:tasks.workunit.client.0.smithi082.stdout:8/603: stat d0/d3/d55/d6d 0 2024-04-27T07:33:26.187 INFO:tasks.workunit.client.0.smithi082.stdout:5/744: stat d8/d15/d65/lfc 0 2024-04-27T07:33:26.188 INFO:tasks.workunit.client.1.smithi100.stdout:1/216: write d0/d1b/d20/d2d/f2e [447910,27099] 0 2024-04-27T07:33:26.188 INFO:tasks.workunit.client.0.smithi082.stdout:1/597: dwrite d4/d15/d49/dab/dc3/d3e/f55 [0,4194304] 0 2024-04-27T07:33:26.189 INFO:tasks.workunit.client.1.smithi100.stdout:5/75: write d0/f8 [2534351,104517] 0 2024-04-27T07:33:26.193 INFO:tasks.workunit.client.1.smithi100.stdout:9/130: dread d1/fd [0,4194304] 0 2024-04-27T07:33:26.199 INFO:tasks.workunit.client.1.smithi100.stdout:1/217: dread d0/d23/f30 [0,4194304] 0 2024-04-27T07:33:26.202 INFO:tasks.workunit.client.1.smithi100.stdout:5/76: dwrite d0/d4/fc [0,4194304] 0 2024-04-27T07:33:26.203 INFO:tasks.workunit.client.1.smithi100.stdout:1/218: creat d0/d1b/d20/f38 x:0 0 0 2024-04-27T07:33:26.204 INFO:tasks.workunit.client.1.smithi100.stdout:5/77: truncate d0/d4/f11 1150281 0 2024-04-27T07:33:26.206 INFO:tasks.workunit.client.1.smithi100.stdout:1/219: creat d0/d1f/d27/f39 x:0 0 0 2024-04-27T07:33:26.207 INFO:tasks.workunit.client.1.smithi100.stdout:9/131: getdents d1/d9/db 0 2024-04-27T07:33:26.208 INFO:tasks.workunit.client.1.smithi100.stdout:5/78: mkdir d0/d4/d17 0 2024-04-27T07:33:26.210 INFO:tasks.workunit.client.1.smithi100.stdout:5/79: write d0/f16 [1009547,4232] 0 2024-04-27T07:33:26.210 INFO:tasks.workunit.client.1.smithi100.stdout:9/132: mkdir d1/d9/db/d2b/d31 0 2024-04-27T07:33:26.213 INFO:tasks.workunit.client.1.smithi100.stdout:5/80: symlink d0/d4/l18 0 2024-04-27T07:33:26.215 INFO:tasks.workunit.client.1.smithi100.stdout:9/133: symlink d1/d9/db/d2b/l32 0 2024-04-27T07:33:26.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/220: dwrite d0/d1b/d20/d2d/f2e [0,4194304] 0 2024-04-27T07:33:26.220 INFO:tasks.workunit.client.1.smithi100.stdout:9/134: unlink d1/d9/db/d2b/l32 0 2024-04-27T07:33:26.220 INFO:tasks.workunit.client.1.smithi100.stdout:5/81: dread d0/d4/fc [0,4194304] 0 2024-04-27T07:33:26.220 INFO:tasks.workunit.client.1.smithi100.stdout:9/135: dread - d1/f2c zero size 2024-04-27T07:33:26.221 INFO:tasks.workunit.client.1.smithi100.stdout:9/136: dread - d1/f29 zero size 2024-04-27T07:33:26.221 INFO:tasks.workunit.client.1.smithi100.stdout:1/221: mkdir d0/d23/d3a 0 2024-04-27T07:33:26.224 INFO:tasks.workunit.client.1.smithi100.stdout:9/137: mkdir d1/d9/db/d2b/d31/d33 0 2024-04-27T07:33:26.225 INFO:tasks.workunit.client.1.smithi100.stdout:5/82: dread d0/fa [0,4194304] 0 2024-04-27T07:33:26.232 INFO:tasks.workunit.client.1.smithi100.stdout:1/222: dwrite d0/d1b/f2f [0,4194304] 0 2024-04-27T07:33:26.233 INFO:tasks.workunit.client.1.smithi100.stdout:9/138: link d1/f13 d1/d9/db/d2b/f34 0 2024-04-27T07:33:26.239 INFO:tasks.workunit.client.1.smithi100.stdout:9/139: chown d1/d9/d1f/l24 435415775 1 2024-04-27T07:33:26.239 INFO:tasks.workunit.client.1.smithi100.stdout:5/83: link d0/fa d0/d4/f19 0 2024-04-27T07:33:26.239 INFO:tasks.workunit.client.1.smithi100.stdout:0/75: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:26.243 INFO:tasks.workunit.client.1.smithi100.stdout:1/223: rename d0/d1b/d20/c25 to d0/d1b/d20/d2d/d35/c3b 0 2024-04-27T07:33:26.244 INFO:tasks.workunit.client.1.smithi100.stdout:5/84: mkdir d0/d4/d17/d1a 0 2024-04-27T07:33:26.246 INFO:tasks.workunit.client.1.smithi100.stdout:0/76: rename d1/fe to d1/d8/d16/f1c 0 2024-04-27T07:33:26.248 INFO:tasks.workunit.client.1.smithi100.stdout:5/85: creat d0/d4/d17/f1b x:0 0 0 2024-04-27T07:33:26.248 INFO:tasks.workunit.client.1.smithi100.stdout:1/224: mknod d0/c3c 0 2024-04-27T07:33:26.250 INFO:tasks.workunit.client.1.smithi100.stdout:5/86: creat d0/d4/d17/f1c x:0 0 0 2024-04-27T07:33:26.251 INFO:tasks.workunit.client.1.smithi100.stdout:5/87: fsync d0/f16 0 2024-04-27T07:33:26.253 INFO:tasks.workunit.client.1.smithi100.stdout:1/225: dread d0/d1b/f2f [0,4194304] 0 2024-04-27T07:33:26.254 INFO:tasks.workunit.client.1.smithi100.stdout:5/88: creat d0/f1d x:0 0 0 2024-04-27T07:33:26.257 INFO:tasks.workunit.client.1.smithi100.stdout:5/89: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:26.257 INFO:tasks.workunit.client.1.smithi100.stdout:5/90: readlink d0/d4/l18 0 2024-04-27T07:33:26.258 INFO:tasks.workunit.client.1.smithi100.stdout:5/91: read d0/f16 [884795,104880] 0 2024-04-27T07:33:26.258 INFO:tasks.workunit.client.1.smithi100.stdout:5/92: fdatasync d0/d4/d17/f1c 0 2024-04-27T07:33:26.264 INFO:tasks.workunit.client.0.smithi082.stdout:0/653: unlink da/d3c/d3f/d57/dcc/f85 0 2024-04-27T07:33:26.266 INFO:tasks.workunit.client.0.smithi082.stdout:1/598: mkdir d4/d15/d49/dab/dc3/d3e/d46/dcf 0 2024-04-27T07:33:26.267 INFO:tasks.workunit.client.0.smithi082.stdout:8/604: mkdir d0/d2b/d80/da9/dc6 0 2024-04-27T07:33:26.268 INFO:tasks.workunit.client.0.smithi082.stdout:1/599: chown d4/d15/d49/dab/dc3/d3e/d46/l66 37982 1 2024-04-27T07:33:26.268 INFO:tasks.workunit.client.0.smithi082.stdout:0/654: fdatasync da/d2a/fb0 0 2024-04-27T07:33:26.270 INFO:tasks.workunit.client.0.smithi082.stdout:0/655: chown da/d38/d7f/d4a/d80/c8a 5038596 1 2024-04-27T07:33:26.271 INFO:tasks.workunit.client.1.smithi100.stdout:0/77: fdatasync d1/f5 0 2024-04-27T07:33:26.273 INFO:tasks.workunit.client.1.smithi100.stdout:0/78: readlink d1/d8/d16/l18 0 2024-04-27T07:33:26.274 INFO:tasks.workunit.client.1.smithi100.stdout:0/79: read d1/d8/ff [2056488,39271] 0 2024-04-27T07:33:26.275 INFO:tasks.workunit.client.1.smithi100.stdout:5/93: getdents d0/d4/d17 0 2024-04-27T07:33:26.276 INFO:tasks.workunit.client.1.smithi100.stdout:0/80: mknod d1/d8/d14/c1d 0 2024-04-27T07:33:26.277 INFO:tasks.workunit.client.1.smithi100.stdout:0/81: write d1/d8/f11 [236436,102848] 0 2024-04-27T07:33:26.278 INFO:tasks.workunit.client.0.smithi082.stdout:4/693: sync 2024-04-27T07:33:26.278 INFO:tasks.workunit.client.0.smithi082.stdout:6/560: sync 2024-04-27T07:33:26.279 INFO:tasks.workunit.client.1.smithi100.stdout:5/94: rename d0/f16 to d0/d4/f1e 0 2024-04-27T07:33:26.279 INFO:tasks.workunit.client.1.smithi100.stdout:5/95: fdatasync d0/f1d 0 2024-04-27T07:33:26.280 INFO:tasks.workunit.client.1.smithi100.stdout:5/96: chown d0/f8 1 1 2024-04-27T07:33:26.284 INFO:tasks.workunit.client.1.smithi100.stdout:5/97: mknod d0/d4/c1f 0 2024-04-27T07:33:26.284 INFO:tasks.workunit.client.1.smithi100.stdout:0/82: dread d1/d8/ff [0,4194304] 0 2024-04-27T07:33:26.285 INFO:tasks.workunit.client.0.smithi082.stdout:8/605: dwrite d0/d2b/d80/fb9 [0,4194304] 0 2024-04-27T07:33:26.287 INFO:tasks.workunit.client.0.smithi082.stdout:8/606: readlink d0/d3/d1c/l1f 0 2024-04-27T07:33:26.287 INFO:tasks.workunit.client.1.smithi100.stdout:1/226: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:26.288 INFO:tasks.workunit.client.0.smithi082.stdout:1/600: dwrite d4/d15/d29/f33 [0,4194304] 0 2024-04-27T07:33:26.288 INFO:tasks.workunit.client.1.smithi100.stdout:5/98: creat d0/d4/d17/d1a/f20 x:0 0 0 2024-04-27T07:33:26.290 INFO:tasks.workunit.client.1.smithi100.stdout:0/83: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:26.291 INFO:tasks.workunit.client.0.smithi082.stdout:6/561: rmdir d2/d1e/d32/d85 39 2024-04-27T07:33:26.292 INFO:tasks.workunit.client.1.smithi100.stdout:0/84: fsync d1/d8/fc 0 2024-04-27T07:33:26.292 INFO:tasks.workunit.client.0.smithi082.stdout:0/656: mknod da/d38/d7f/d4a/d80/da0/dd5/cea 0 2024-04-27T07:33:26.294 INFO:tasks.workunit.client.0.smithi082.stdout:8/607: mkdir d0/d3/d1c/dc7 0 2024-04-27T07:33:26.294 INFO:tasks.workunit.client.1.smithi100.stdout:0/85: truncate d1/f10 1406759 0 2024-04-27T07:33:26.297 INFO:tasks.workunit.client.0.smithi082.stdout:1/601: write d4/d15/d49/da0/f7f [4697446,41578] 0 2024-04-27T07:33:26.299 INFO:tasks.workunit.client.0.smithi082.stdout:4/694: creat d3/d6/d26/fe3 x:0 0 0 2024-04-27T07:33:26.301 INFO:tasks.workunit.client.1.smithi100.stdout:1/227: creat d0/f3d x:0 0 0 2024-04-27T07:33:26.302 INFO:tasks.workunit.client.0.smithi082.stdout:6/562: symlink d2/d1e/d32/lb3 0 2024-04-27T07:33:26.305 INFO:tasks.workunit.client.0.smithi082.stdout:1/602: mknod d4/d15/d49/dab/dc3/d4c/cd0 0 2024-04-27T07:33:26.305 INFO:tasks.workunit.client.1.smithi100.stdout:1/228: write d0/d1b/f2f [4025817,19556] 0 2024-04-27T07:33:26.307 INFO:tasks.workunit.client.0.smithi082.stdout:4/695: mkdir d3/d6/d16/d98/de4 0 2024-04-27T07:33:26.308 INFO:tasks.workunit.client.1.smithi100.stdout:1/229: dread - d0/d1f/d27/f39 zero size 2024-04-27T07:33:26.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/657: dwrite da/d3c/d3f/f41 [0,4194304] 0 2024-04-27T07:33:26.309 INFO:tasks.workunit.client.1.smithi100.stdout:1/230: dread - d0/d1b/f33 zero size 2024-04-27T07:33:26.309 INFO:tasks.workunit.client.1.smithi100.stdout:0/86: dwrite d1/fa [0,4194304] 0 2024-04-27T07:33:26.310 INFO:tasks.workunit.client.0.smithi082.stdout:5/745: dread d8/d3b/f41 [0,4194304] 0 2024-04-27T07:33:26.310 INFO:tasks.workunit.client.1.smithi100.stdout:0/87: chown d1/f10 391111 1 2024-04-27T07:33:26.311 INFO:tasks.workunit.client.0.smithi082.stdout:8/608: rename d0/d3/d1b/d53/l97 to d0/d3/d87/d42/d7f/dac/lc8 0 2024-04-27T07:33:26.312 INFO:tasks.workunit.client.1.smithi100.stdout:1/231: creat d0/d1b/f3e x:0 0 0 2024-04-27T07:33:26.312 INFO:tasks.workunit.client.1.smithi100.stdout:0/88: mkdir d1/d8/d16/d1e 0 2024-04-27T07:33:26.314 INFO:tasks.workunit.client.1.smithi100.stdout:1/232: fsync d0/f16 0 2024-04-27T07:33:26.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/746: dread - d8/fac zero size 2024-04-27T07:33:26.314 INFO:tasks.workunit.client.0.smithi082.stdout:6/563: dwrite d2/de/d13/f67 [0,4194304] 0 2024-04-27T07:33:26.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/747: stat d8/d14/f23 0 2024-04-27T07:33:26.315 INFO:tasks.workunit.client.0.smithi082.stdout:5/748: stat d8/d14/f49 0 2024-04-27T07:33:26.317 INFO:tasks.workunit.client.1.smithi100.stdout:0/89: symlink d1/l1f 0 2024-04-27T07:33:26.320 INFO:tasks.workunit.client.0.smithi082.stdout:0/658: read - da/d3c/d3f/d57/dcc/f8e zero size 2024-04-27T07:33:26.321 INFO:tasks.workunit.client.1.smithi100.stdout:1/233: link d0/d23/l37 d0/d1b/d20/d2d/l3f 0 2024-04-27T07:33:26.322 INFO:tasks.workunit.client.0.smithi082.stdout:5/749: readlink d8/d3c/d47/l93 0 2024-04-27T07:33:26.323 INFO:tasks.workunit.client.0.smithi082.stdout:1/603: mkdir d4/d15/d3f/d97/dd1 0 2024-04-27T07:33:26.325 INFO:tasks.workunit.client.0.smithi082.stdout:6/564: getdents d2/d2d/d4a/dad 0 2024-04-27T07:33:26.326 INFO:tasks.workunit.client.0.smithi082.stdout:0/659: rename da/d2a/dc4/fd1 to da/d28/d36/feb 0 2024-04-27T07:33:26.326 INFO:tasks.workunit.client.0.smithi082.stdout:6/565: chown d2/d2d 50728 1 2024-04-27T07:33:26.326 INFO:tasks.workunit.client.1.smithi100.stdout:1/234: stat d0/d23/l37 0 2024-04-27T07:33:26.327 INFO:tasks.workunit.client.1.smithi100.stdout:0/90: dwrite d1/f10 [0,4194304] 0 2024-04-27T07:33:26.328 INFO:tasks.workunit.client.0.smithi082.stdout:1/604: fsync d4/f1e 0 2024-04-27T07:33:26.329 INFO:tasks.workunit.client.1.smithi100.stdout:1/235: mkdir d0/d1f/d27/d40 0 2024-04-27T07:33:26.329 INFO:tasks.workunit.client.1.smithi100.stdout:0/91: readlink d1/d8/d16/l18 0 2024-04-27T07:33:26.332 INFO:tasks.workunit.client.0.smithi082.stdout:5/750: rename d8/d2e/d3d/df2 to d8/d29/dea/d5f/d100 0 2024-04-27T07:33:26.332 INFO:tasks.workunit.client.0.smithi082.stdout:4/696: dwrite d3/fb2 [0,4194304] 0 2024-04-27T07:33:26.334 INFO:tasks.workunit.client.0.smithi082.stdout:6/566: mkdir d2/d1e/d32/d7d/d82/db4 0 2024-04-27T07:33:26.336 INFO:tasks.workunit.client.1.smithi100.stdout:1/236: getdents d0/d23 0 2024-04-27T07:33:26.336 INFO:tasks.workunit.client.0.smithi082.stdout:5/751: write d8/d15/de0/ff5 [602994,113939] 0 2024-04-27T07:33:26.337 INFO:tasks.workunit.client.0.smithi082.stdout:1/605: rename d4/d15/d49/da0/lbc to d4/d15/d49/d99/d9a/dc7/ld2 0 2024-04-27T07:33:26.339 INFO:tasks.workunit.client.0.smithi082.stdout:4/697: creat d3/d6/d22/d69/fe5 x:0 0 0 2024-04-27T07:33:26.339 INFO:tasks.workunit.client.1.smithi100.stdout:1/237: write d0/fd [3158503,128824] 0 2024-04-27T07:33:26.340 INFO:tasks.workunit.client.0.smithi082.stdout:1/606: chown d4/d15/d49/d99/db8/fba 57502 1 2024-04-27T07:33:26.340 INFO:tasks.workunit.client.0.smithi082.stdout:0/660: mknod da/d38/d7f/d4a/d80/da0/dd5/ddf/cec 0 2024-04-27T07:33:26.341 INFO:tasks.workunit.client.1.smithi100.stdout:0/92: dwrite d1/fa [0,4194304] 0 2024-04-27T07:33:26.341 INFO:tasks.workunit.client.0.smithi082.stdout:4/698: write f2 [7372473,92602] 0 2024-04-27T07:33:26.343 INFO:tasks.workunit.client.1.smithi100.stdout:5/99: dwrite d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:26.344 INFO:tasks.workunit.client.0.smithi082.stdout:5/752: creat d8/d29/d4e/d90/f101 x:0 0 0 2024-04-27T07:33:26.345 INFO:tasks.workunit.client.0.smithi082.stdout:5/753: fdatasync f5 0 2024-04-27T07:33:26.347 INFO:tasks.workunit.client.0.smithi082.stdout:5/754: read d8/d15/f24 [302218,106640] 0 2024-04-27T07:33:26.348 INFO:tasks.workunit.client.0.smithi082.stdout:4/699: chown d3/d6/d26/d5e/f97 5039566 1 2024-04-27T07:33:26.351 INFO:tasks.workunit.client.1.smithi100.stdout:0/93: dread d1/d8/ff [0,4194304] 0 2024-04-27T07:33:26.351 INFO:tasks.workunit.client.0.smithi082.stdout:5/755: truncate d8/d15/de0/ff4 102006 0 2024-04-27T07:33:26.351 INFO:tasks.workunit.client.0.smithi082.stdout:0/661: rename da/d3c/d3f/d4c/d74/d81/ldb to da/d3c/d3f/d57/led 0 2024-04-27T07:33:26.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/567: dread d2/d3/fd [4194304,4194304] 0 2024-04-27T07:33:26.355 INFO:tasks.workunit.client.1.smithi100.stdout:1/238: dwrite d0/fd [0,4194304] 0 2024-04-27T07:33:26.355 INFO:tasks.workunit.client.0.smithi082.stdout:1/607: mkdir d4/d15/d49/dab/dc3/dd3 0 2024-04-27T07:33:26.357 INFO:tasks.workunit.client.0.smithi082.stdout:0/662: unlink da/d2a/lb1 0 2024-04-27T07:33:26.357 INFO:tasks.workunit.client.1.smithi100.stdout:5/100: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:26.359 INFO:tasks.workunit.client.1.smithi100.stdout:0/94: rename d1/d8/d16 to d1/d8/d20 0 2024-04-27T07:33:26.360 INFO:tasks.workunit.client.0.smithi082.stdout:6/568: symlink d2/d3/d1b/lb5 0 2024-04-27T07:33:26.363 INFO:tasks.workunit.client.1.smithi100.stdout:1/239: dread d0/f14 [0,4194304] 0 2024-04-27T07:33:26.363 INFO:tasks.workunit.client.0.smithi082.stdout:4/700: creat d3/d6/d16/d98/de4/fe6 x:0 0 0 2024-04-27T07:33:26.365 INFO:tasks.workunit.client.0.smithi082.stdout:1/608: fsync d4/f3a 0 2024-04-27T07:33:26.368 INFO:tasks.workunit.client.0.smithi082.stdout:0/663: dwrite da/d28/d36/fd2 [0,4194304] 0 2024-04-27T07:33:26.368 INFO:tasks.workunit.client.1.smithi100.stdout:0/95: dwrite d1/d8/fc [0,4194304] 0 2024-04-27T07:33:26.370 INFO:tasks.workunit.client.1.smithi100.stdout:0/96: chown d1/d8/d20/d1e 6 1 2024-04-27T07:33:26.371 INFO:tasks.workunit.client.1.smithi100.stdout:1/240: rename d0/f34 to d0/d23/d3a/f41 0 2024-04-27T07:33:26.371 INFO:tasks.workunit.client.1.smithi100.stdout:0/97: stat d1/d8/d20/f1c 0 2024-04-27T07:33:26.372 INFO:tasks.workunit.client.1.smithi100.stdout:1/241: symlink d0/d1f/l42 0 2024-04-27T07:33:26.373 INFO:tasks.workunit.client.1.smithi100.stdout:0/98: write d1/d8/d14/f17 [1170468,17775] 0 2024-04-27T07:33:26.373 INFO:tasks.workunit.client.0.smithi082.stdout:1/609: unlink d4/d15/d49/dab/dc3/d4c/c68 0 2024-04-27T07:33:26.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/664: fsync da/d3c/d3f/d57/dcc/da8/fb2 0 2024-04-27T07:33:26.375 INFO:tasks.workunit.client.0.smithi082.stdout:4/701: fdatasync d3/d6/d26/d55/f5f 0 2024-04-27T07:33:26.376 INFO:tasks.workunit.client.0.smithi082.stdout:0/665: readlink da/d38/d7f/d4a/d80/l8b 0 2024-04-27T07:33:26.376 INFO:tasks.workunit.client.0.smithi082.stdout:4/702: readlink d3/d6/d22/l6e 0 2024-04-27T07:33:26.377 INFO:tasks.workunit.client.1.smithi100.stdout:0/99: creat d1/d8/d20/d1e/f21 x:0 0 0 2024-04-27T07:33:26.377 INFO:tasks.workunit.client.0.smithi082.stdout:6/569: rename d2/d1e/d32/d85/d97/l9b to d2/d3/d1b/lb6 0 2024-04-27T07:33:26.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/610: mknod d4/d15/d49/dab/dc3/d3e/d53/d72/cd4 0 2024-04-27T07:33:26.379 INFO:tasks.workunit.client.0.smithi082.stdout:4/703: read - d3/d6/d22/d69/d85/f92 zero size 2024-04-27T07:33:26.381 INFO:tasks.workunit.client.0.smithi082.stdout:4/704: dread - d3/d6/d26/d5e/d21/f80 zero size 2024-04-27T07:33:26.382 INFO:tasks.workunit.client.1.smithi100.stdout:1/242: dwrite d0/fd [0,4194304] 0 2024-04-27T07:33:26.383 INFO:tasks.workunit.client.1.smithi100.stdout:1/243: read d0/d1b/f2f [3117333,38487] 0 2024-04-27T07:33:26.384 INFO:tasks.workunit.client.0.smithi082.stdout:4/705: dread d3/d6/d16/f47 [0,4194304] 0 2024-04-27T07:33:26.386 INFO:tasks.workunit.client.0.smithi082.stdout:1/611: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:26.386 INFO:tasks.workunit.client.1.smithi100.stdout:0/100: dwrite d1/d8/fc [0,4194304] 0 2024-04-27T07:33:26.386 INFO:tasks.workunit.client.0.smithi082.stdout:1/612: stat d4 0 2024-04-27T07:33:26.388 INFO:tasks.workunit.client.0.smithi082.stdout:6/570: link d2/l79 d2/de/d77/lb7 0 2024-04-27T07:33:26.389 INFO:tasks.workunit.client.1.smithi100.stdout:5/101: truncate d0/f9 3761600 0 2024-04-27T07:33:26.389 INFO:tasks.workunit.client.1.smithi100.stdout:1/244: dread d0/f26 [0,4194304] 0 2024-04-27T07:33:26.390 INFO:tasks.workunit.client.1.smithi100.stdout:5/102: fdatasync d0/f8 0 2024-04-27T07:33:26.391 INFO:tasks.workunit.client.0.smithi082.stdout:4/706: symlink d3/d6/d26/d5e/d21/le7 0 2024-04-27T07:33:26.392 INFO:tasks.workunit.client.1.smithi100.stdout:0/101: creat d1/f22 x:0 0 0 2024-04-27T07:33:26.395 INFO:tasks.workunit.client.1.smithi100.stdout:0/102: mknod d1/d8/d14/c23 0 2024-04-27T07:33:26.397 INFO:tasks.workunit.client.0.smithi082.stdout:4/707: symlink d3/d6/d16/le8 0 2024-04-27T07:33:26.399 INFO:tasks.workunit.client.0.smithi082.stdout:1/613: creat d4/d15/d3f/d97/dd1/fd5 x:0 0 0 2024-04-27T07:33:26.401 INFO:tasks.workunit.client.0.smithi082.stdout:6/571: creat d2/d2e/dae/fb8 x:0 0 0 2024-04-27T07:33:26.402 INFO:tasks.workunit.client.1.smithi100.stdout:5/103: dwrite d0/f10 [4194304,4194304] 0 2024-04-27T07:33:26.403 INFO:tasks.workunit.client.0.smithi082.stdout:5/756: dwrite d8/d29/d4e/fb6 [0,4194304] 0 2024-04-27T07:33:26.404 INFO:tasks.workunit.client.0.smithi082.stdout:4/708: mkdir d3/d6/de9 0 2024-04-27T07:33:26.405 INFO:tasks.workunit.client.0.smithi082.stdout:6/572: fsync d2/de/d77/fb0 0 2024-04-27T07:33:26.406 INFO:tasks.workunit.client.1.smithi100.stdout:1/245: dwrite d0/f26 [0,4194304] 0 2024-04-27T07:33:26.406 INFO:tasks.workunit.client.1.smithi100.stdout:5/104: rmdir d0/d4/d17 39 2024-04-27T07:33:26.410 INFO:tasks.workunit.client.1.smithi100.stdout:0/103: dwrite d1/d8/f11 [0,4194304] 0 2024-04-27T07:33:26.411 INFO:tasks.workunit.client.1.smithi100.stdout:1/246: symlink d0/d1b/d20/d2d/d35/l43 0 2024-04-27T07:33:26.412 INFO:tasks.workunit.client.0.smithi082.stdout:1/614: dread d4/d15/d49/dab/dc3/d3e/d53/fad [0,4194304] 0 2024-04-27T07:33:26.413 INFO:tasks.workunit.client.0.smithi082.stdout:4/709: creat d3/d6/d26/d5e/fea x:0 0 0 2024-04-27T07:33:26.415 INFO:tasks.workunit.client.1.smithi100.stdout:1/247: symlink d0/d23/l44 0 2024-04-27T07:33:26.416 INFO:tasks.workunit.client.0.smithi082.stdout:4/710: write d3/d6/d22/fb5 [9657,54213] 0 2024-04-27T07:33:26.416 INFO:tasks.workunit.client.0.smithi082.stdout:5/757: rmdir d8/d29/d4e/dad 39 2024-04-27T07:33:26.416 INFO:tasks.workunit.client.0.smithi082.stdout:0/666: fsync da/d28/d36/fd2 0 2024-04-27T07:33:26.417 INFO:tasks.workunit.client.1.smithi100.stdout:0/104: creat d1/f24 x:0 0 0 2024-04-27T07:33:26.418 INFO:tasks.workunit.client.0.smithi082.stdout:6/573: rename d2/de/d13/faa to d2/d2d/d4a/fb9 0 2024-04-27T07:33:26.418 INFO:tasks.workunit.client.0.smithi082.stdout:4/711: dread - d3/d6/d22/fde zero size 2024-04-27T07:33:26.419 INFO:tasks.workunit.client.1.smithi100.stdout:0/105: fsync d1/d8/ff 0 2024-04-27T07:33:26.420 INFO:tasks.workunit.client.0.smithi082.stdout:1/615: creat d4/d15/d49/d4e/fd6 x:0 0 0 2024-04-27T07:33:26.421 INFO:tasks.workunit.client.1.smithi100.stdout:0/106: mknod d1/d8/d20/c25 0 2024-04-27T07:33:26.423 INFO:tasks.workunit.client.1.smithi100.stdout:0/107: creat d1/d8/d20/f26 x:0 0 0 2024-04-27T07:33:26.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/574: creat d2/d3/da8/fba x:0 0 0 2024-04-27T07:33:26.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/758: mkdir d8/d29/dea/d5f/df6/dfd/d102 0 2024-04-27T07:33:26.427 INFO:tasks.workunit.client.1.smithi100.stdout:0/108: dread d1/d8/d14/f19 [0,4194304] 0 2024-04-27T07:33:26.428 INFO:tasks.workunit.client.0.smithi082.stdout:6/575: unlink d2/f2a 0 2024-04-27T07:33:26.429 INFO:tasks.workunit.client.1.smithi100.stdout:0/109: write d1/d8/d20/f1c [4536547,43324] 0 2024-04-27T07:33:26.431 INFO:tasks.workunit.client.1.smithi100.stdout:0/110: mknod d1/d8/c27 0 2024-04-27T07:33:26.432 INFO:tasks.workunit.client.0.smithi082.stdout:1/616: dwrite d4/d15/d49/dab/dc3/d4c/d7a/fae [0,4194304] 0 2024-04-27T07:33:26.432 INFO:tasks.workunit.client.0.smithi082.stdout:0/667: dread da/d38/f47 [0,4194304] 0 2024-04-27T07:33:26.433 INFO:tasks.workunit.client.0.smithi082.stdout:6/576: creat d2/d2d/d3d/fbb x:0 0 0 2024-04-27T07:33:26.433 INFO:tasks.workunit.client.0.smithi082.stdout:0/668: stat da/d3c/d3f/d57/dcc/da8/cba 0 2024-04-27T07:33:26.434 INFO:tasks.workunit.client.0.smithi082.stdout:5/759: truncate d8/d2e/f37 4008573 0 2024-04-27T07:33:26.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/617: chown d4/d15/d49/dab/dc3/d4c/f6c 83958 1 2024-04-27T07:33:26.435 INFO:tasks.workunit.client.1.smithi100.stdout:0/111: dread d1/d8/d20/f1c [0,4194304] 0 2024-04-27T07:33:26.437 INFO:tasks.workunit.client.0.smithi082.stdout:5/760: mkdir d8/d2e/d85/d103 0 2024-04-27T07:33:26.442 INFO:tasks.workunit.client.1.smithi100.stdout:0/112: dwrite d1/f24 [0,4194304] 0 2024-04-27T07:33:26.444 INFO:tasks.workunit.client.0.smithi082.stdout:4/712: dread d3/d6/d22/fb5 [0,4194304] 0 2024-04-27T07:33:26.448 INFO:tasks.workunit.client.0.smithi082.stdout:4/713: dread d3/d10/f4f [0,4194304] 0 2024-04-27T07:33:26.448 INFO:tasks.workunit.client.0.smithi082.stdout:4/714: dread - d3/d6/d16/d98/de4/fe6 zero size 2024-04-27T07:33:26.452 INFO:tasks.workunit.client.1.smithi100.stdout:0/113: dwrite d1/d8/d14/f17 [0,4194304] 0 2024-04-27T07:33:26.455 INFO:tasks.workunit.client.1.smithi100.stdout:0/114: creat d1/d8/d20/f28 x:0 0 0 2024-04-27T07:33:26.459 INFO:tasks.workunit.client.1.smithi100.stdout:0/115: creat d1/d8/d20/f29 x:0 0 0 2024-04-27T07:33:26.460 INFO:tasks.workunit.client.1.smithi100.stdout:5/105: dwrite d0/f9 [0,4194304] 0 2024-04-27T07:33:26.460 INFO:tasks.workunit.client.1.smithi100.stdout:0/116: dread - d1/d8/d20/f29 zero size 2024-04-27T07:33:26.461 INFO:tasks.workunit.client.1.smithi100.stdout:0/117: rename d1/d8 to d1/d8/d20/d2a 22 2024-04-27T07:33:26.463 INFO:tasks.workunit.client.1.smithi100.stdout:5/106: mkdir d0/d4/d21 0 2024-04-27T07:33:26.468 INFO:tasks.workunit.client.1.smithi100.stdout:5/107: link d0/f9 d0/d4/f22 0 2024-04-27T07:33:26.469 INFO:tasks.workunit.client.1.smithi100.stdout:0/118: dwrite d1/f22 [0,4194304] 0 2024-04-27T07:33:26.471 INFO:tasks.workunit.client.1.smithi100.stdout:0/119: write d1/d8/d14/f17 [484336,27643] 0 2024-04-27T07:33:26.471 INFO:tasks.workunit.client.1.smithi100.stdout:3/50: sync 2024-04-27T07:33:26.473 INFO:tasks.workunit.client.1.smithi100.stdout:3/51: write f6 [1504045,81237] 0 2024-04-27T07:33:26.476 INFO:tasks.workunit.client.1.smithi100.stdout:0/120: creat d1/d8/d20/f2b x:0 0 0 2024-04-27T07:33:26.479 INFO:tasks.workunit.client.1.smithi100.stdout:3/52: mknod d7/d9/cd 0 2024-04-27T07:33:26.479 INFO:tasks.workunit.client.1.smithi100.stdout:3/53: chown d7/d9/lb 0 1 2024-04-27T07:33:26.479 INFO:tasks.workunit.client.1.smithi100.stdout:3/54: rename d7 to d7/d9/de 22 2024-04-27T07:33:26.480 INFO:tasks.workunit.client.1.smithi100.stdout:3/55: read f4 [95416,66186] 0 2024-04-27T07:33:26.481 INFO:tasks.workunit.client.1.smithi100.stdout:5/108: link d0/c3 d0/d4/c23 0 2024-04-27T07:33:26.482 INFO:tasks.workunit.client.1.smithi100.stdout:0/121: mknod d1/c2c 0 2024-04-27T07:33:26.483 INFO:tasks.workunit.client.1.smithi100.stdout:3/56: creat d7/d9/ff x:0 0 0 2024-04-27T07:33:26.483 INFO:tasks.workunit.client.1.smithi100.stdout:0/122: rmdir d1/d8 39 2024-04-27T07:33:26.484 INFO:tasks.workunit.client.1.smithi100.stdout:5/109: mkdir d0/d4/d21/d24 0 2024-04-27T07:33:26.485 INFO:tasks.workunit.client.1.smithi100.stdout:3/57: mkdir d7/d9/d10 0 2024-04-27T07:33:26.486 INFO:tasks.workunit.client.1.smithi100.stdout:3/58: write f6 [2362538,114141] 0 2024-04-27T07:33:26.487 INFO:tasks.workunit.client.1.smithi100.stdout:0/123: dread - d1/d8/d20/f2b zero size 2024-04-27T07:33:26.487 INFO:tasks.workunit.client.1.smithi100.stdout:5/110: write d0/f9 [640330,96620] 0 2024-04-27T07:33:26.489 INFO:tasks.workunit.client.1.smithi100.stdout:5/111: write d0/d4/f11 [1471926,21006] 0 2024-04-27T07:33:26.490 INFO:tasks.workunit.client.1.smithi100.stdout:3/59: rename d7/f8 to d7/d9/d10/f11 0 2024-04-27T07:33:26.493 INFO:tasks.workunit.client.1.smithi100.stdout:0/124: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:26.493 INFO:tasks.workunit.client.1.smithi100.stdout:3/60: mknod d7/d9/d10/c12 0 2024-04-27T07:33:26.495 INFO:tasks.workunit.client.1.smithi100.stdout:5/112: dread d0/f10 [0,4194304] 0 2024-04-27T07:33:26.495 INFO:tasks.workunit.client.1.smithi100.stdout:0/125: symlink d1/d8/d20/l2d 0 2024-04-27T07:33:26.496 INFO:tasks.workunit.client.1.smithi100.stdout:5/113: write d0/f9 [3804379,38299] 0 2024-04-27T07:33:26.498 INFO:tasks.workunit.client.1.smithi100.stdout:3/61: rename d7/d9/ff to d7/f13 0 2024-04-27T07:33:26.502 INFO:tasks.workunit.client.1.smithi100.stdout:0/126: rename d1/f22 to d1/d8/f2e 0 2024-04-27T07:33:26.503 INFO:tasks.workunit.client.1.smithi100.stdout:3/62: write d7/d9/d10/f11 [263100,125425] 0 2024-04-27T07:33:26.504 INFO:tasks.workunit.client.1.smithi100.stdout:3/63: readlink d7/d9/lb 0 2024-04-27T07:33:26.507 INFO:tasks.workunit.client.1.smithi100.stdout:5/114: dwrite d0/f10 [4194304,4194304] 0 2024-04-27T07:33:26.508 INFO:tasks.workunit.client.1.smithi100.stdout:3/64: truncate d7/d9/d10/f11 727796 0 2024-04-27T07:33:26.510 INFO:tasks.workunit.client.1.smithi100.stdout:5/115: symlink d0/l25 0 2024-04-27T07:33:26.510 INFO:tasks.workunit.client.1.smithi100.stdout:3/65: symlink d7/d9/d10/l14 0 2024-04-27T07:33:26.511 INFO:tasks.workunit.client.1.smithi100.stdout:3/66: truncate f6 3229655 0 2024-04-27T07:33:26.511 INFO:tasks.workunit.client.1.smithi100.stdout:3/67: chown d7/d9/d10 16208784 1 2024-04-27T07:33:26.540 INFO:tasks.workunit.client.0.smithi082.stdout:1/618: creat d4/d15/d3f/d6d/fd7 x:0 0 0 2024-04-27T07:33:26.541 INFO:tasks.workunit.client.0.smithi082.stdout:6/577: unlink d2/de/d13/l2b 0 2024-04-27T07:33:26.541 INFO:tasks.workunit.client.0.smithi082.stdout:6/578: fdatasync d2/f8c 0 2024-04-27T07:33:26.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/761: truncate d8/fc3 676206 0 2024-04-27T07:33:26.544 INFO:tasks.workunit.client.0.smithi082.stdout:0/669: rmdir da/d28/de6 0 2024-04-27T07:33:26.545 INFO:tasks.workunit.client.1.smithi100.stdout:5/116: fsync d0/f10 0 2024-04-27T07:33:26.547 INFO:tasks.workunit.client.1.smithi100.stdout:5/117: creat d0/d4/d21/f26 x:0 0 0 2024-04-27T07:33:26.548 INFO:tasks.workunit.client.1.smithi100.stdout:5/118: readlink d0/l13 0 2024-04-27T07:33:26.552 INFO:tasks.workunit.client.1.smithi100.stdout:5/119: truncate d0/f10 7030458 0 2024-04-27T07:33:26.553 INFO:tasks.workunit.client.1.smithi100.stdout:5/120: dread - d0/f1d zero size 2024-04-27T07:33:26.557 INFO:tasks.workunit.client.1.smithi100.stdout:5/121: dwrite d0/d4/f22 [0,4194304] 0 2024-04-27T07:33:26.558 INFO:tasks.workunit.client.1.smithi100.stdout:5/122: readlink d0/l12 0 2024-04-27T07:33:26.559 INFO:tasks.workunit.client.1.smithi100.stdout:5/123: symlink d0/d4/d21/l27 0 2024-04-27T07:33:26.564 INFO:tasks.workunit.client.1.smithi100.stdout:5/124: dwrite d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:26.572 INFO:tasks.workunit.client.1.smithi100.stdout:5/125: dwrite d0/f1d [0,4194304] 0 2024-04-27T07:33:26.573 INFO:tasks.workunit.client.1.smithi100.stdout:5/126: write d0/d4/f19 [3356187,15140] 0 2024-04-27T07:33:26.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:26 smithi082 ceph-mon[26613]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 180 MiB/s wr, 531 op/s 2024-04-27T07:33:26.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/579: mkdir d2/d1e/d32/d7d/dbc 0 2024-04-27T07:33:26.596 INFO:tasks.workunit.client.0.smithi082.stdout:5/762: creat d8/d42/f104 x:0 0 0 2024-04-27T07:33:26.597 INFO:tasks.workunit.client.0.smithi082.stdout:0/670: rmdir da/d28/d36/d40 39 2024-04-27T07:33:26.600 INFO:tasks.workunit.client.0.smithi082.stdout:6/580: rename d2/d2e/f7c to d2/d2d/d4a/fbd 0 2024-04-27T07:33:26.602 INFO:tasks.workunit.client.0.smithi082.stdout:5/763: dwrite d8/d15/f58 [0,4194304] 0 2024-04-27T07:33:26.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/715: link d3/d6/d16/c3b d3/d10/d9c/dc2/ceb 0 2024-04-27T07:33:26.606 INFO:tasks.workunit.client.0.smithi082.stdout:6/581: creat d2/d75/fbe x:0 0 0 2024-04-27T07:33:26.608 INFO:tasks.workunit.client.0.smithi082.stdout:6/582: fsync d2/d1e/d32/d7d/d82/f91 0 2024-04-27T07:33:26.610 INFO:tasks.workunit.client.0.smithi082.stdout:0/671: creat da/d38/d7f/d4a/d80/fee x:0 0 0 2024-04-27T07:33:26.614 INFO:tasks.workunit.client.0.smithi082.stdout:5/764: dwrite d8/d14/f49 [0,4194304] 0 2024-04-27T07:33:26.614 INFO:tasks.workunit.client.0.smithi082.stdout:6/583: creat d2/d3/d9c/fbf x:0 0 0 2024-04-27T07:33:26.615 INFO:tasks.workunit.client.0.smithi082.stdout:6/584: chown d2/d3/fd 46 1 2024-04-27T07:33:26.615 INFO:tasks.workunit.client.0.smithi082.stdout:6/585: chown d2/l4c 29136 1 2024-04-27T07:33:26.616 INFO:tasks.workunit.client.0.smithi082.stdout:0/672: rename da/d3c/d3f/d4c/d74 to da/d3c/d3f/d4c/d95/de9/def 0 2024-04-27T07:33:26.617 INFO:tasks.workunit.client.0.smithi082.stdout:0/673: chown da/d2a/c9e 8296 1 2024-04-27T07:33:26.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/765: creat d8/d2e/d85/daa/f105 x:0 0 0 2024-04-27T07:33:26.620 INFO:tasks.workunit.client.0.smithi082.stdout:6/586: creat d2/d3/d1b/fc0 x:0 0 0 2024-04-27T07:33:26.621 INFO:tasks.workunit.client.0.smithi082.stdout:5/766: creat d8/d42/f106 x:0 0 0 2024-04-27T07:33:26.623 INFO:tasks.workunit.client.0.smithi082.stdout:0/674: creat da/d38/d7f/d4a/d80/da0/dd5/ddf/ff0 x:0 0 0 2024-04-27T07:33:26.631 INFO:tasks.workunit.client.0.smithi082.stdout:0/675: write da/d1d/d6a/f7a [189228,2914] 0 2024-04-27T07:33:26.631 INFO:tasks.workunit.client.0.smithi082.stdout:4/716: write d3/d6/d26/d55/d67/f86 [826417,73677] 0 2024-04-27T07:33:26.633 INFO:tasks.workunit.client.0.smithi082.stdout:0/676: dread - da/d3c/d3f/d4c/d95/de9/def/d81/fe5 zero size 2024-04-27T07:33:26.651 INFO:tasks.workunit.client.0.smithi082.stdout:5/767: mkdir d8/d2e/d107 0 2024-04-27T07:33:26.652 INFO:tasks.workunit.client.0.smithi082.stdout:4/717: creat d3/d6/d22/d69/d85/db8/fec x:0 0 0 2024-04-27T07:33:26.653 INFO:tasks.workunit.client.1.smithi100.stdout:6/41: sync 2024-04-27T07:33:26.655 INFO:tasks.workunit.client.1.smithi100.stdout:6/42: mkdir de 0 2024-04-27T07:33:26.656 INFO:tasks.workunit.client.0.smithi082.stdout:0/677: symlink da/d3c/d3f/d4c/d95/lf1 0 2024-04-27T07:33:26.659 INFO:tasks.workunit.client.0.smithi082.stdout:4/718: creat d3/d9/fed x:0 0 0 2024-04-27T07:33:26.660 INFO:tasks.workunit.client.1.smithi100.stdout:6/43: dwrite fa [0,4194304] 0 2024-04-27T07:33:26.660 INFO:tasks.workunit.client.0.smithi082.stdout:0/678: link da/d38/c92 da/d38/da9/cf2 0 2024-04-27T07:33:26.660 INFO:tasks.workunit.client.0.smithi082.stdout:0/679: read - da/d28/fe7 zero size 2024-04-27T07:33:26.663 INFO:tasks.workunit.client.1.smithi100.stdout:6/44: mknod de/cf 0 2024-04-27T07:33:26.663 INFO:tasks.workunit.client.1.smithi100.stdout:6/45: readlink lb 0 2024-04-27T07:33:26.664 INFO:tasks.workunit.client.0.smithi082.stdout:0/680: unlink da/d28/d36/d40/f64 0 2024-04-27T07:33:26.665 INFO:tasks.workunit.client.1.smithi100.stdout:6/46: creat de/f10 x:0 0 0 2024-04-27T07:33:26.665 INFO:tasks.workunit.client.1.smithi100.stdout:6/47: fdatasync fc 0 2024-04-27T07:33:26.666 INFO:tasks.workunit.client.0.smithi082.stdout:4/719: dread d3/d6/d22/f40 [0,4194304] 0 2024-04-27T07:33:26.666 INFO:tasks.workunit.client.1.smithi100.stdout:6/48: truncate f6 765100 0 2024-04-27T07:33:26.666 INFO:tasks.workunit.client.1.smithi100.stdout:6/49: read f6 [256193,75813] 0 2024-04-27T07:33:26.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:26 smithi100 ceph-mon[34183]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 180 MiB/s wr, 531 op/s 2024-04-27T07:33:26.667 INFO:tasks.workunit.client.1.smithi100.stdout:6/50: dread - de/f10 zero size 2024-04-27T07:33:26.667 INFO:tasks.workunit.client.0.smithi082.stdout:0/681: rename da/d3c/d3f/fac to da/d1d/d6a/ff3 0 2024-04-27T07:33:26.667 INFO:tasks.workunit.client.1.smithi100.stdout:6/51: dread - de/f10 zero size 2024-04-27T07:33:26.669 INFO:tasks.workunit.client.1.smithi100.stdout:6/52: unlink f5 0 2024-04-27T07:33:26.670 INFO:tasks.workunit.client.0.smithi082.stdout:0/682: mknod da/db3/cf4 0 2024-04-27T07:33:26.671 INFO:tasks.workunit.client.0.smithi082.stdout:0/683: mkdir da/df5 0 2024-04-27T07:33:26.675 INFO:tasks.workunit.client.0.smithi082.stdout:6/587: mknod d2/d2e/cc1 0 2024-04-27T07:33:26.677 INFO:tasks.workunit.client.0.smithi082.stdout:0/684: dwrite da/d3c/d3f/d57/fdc [0,4194304] 0 2024-04-27T07:33:26.681 INFO:tasks.workunit.client.0.smithi082.stdout:6/588: mkdir d2/d45/dc2 0 2024-04-27T07:33:26.689 INFO:tasks.workunit.client.1.smithi100.stdout:6/53: dread f8 [0,4194304] 0 2024-04-27T07:33:26.691 INFO:tasks.workunit.client.1.smithi100.stdout:6/54: creat de/f11 x:0 0 0 2024-04-27T07:33:26.691 INFO:tasks.workunit.client.1.smithi100.stdout:6/55: dread - fd zero size 2024-04-27T07:33:26.693 INFO:tasks.workunit.client.1.smithi100.stdout:6/56: creat de/f12 x:0 0 0 2024-04-27T07:33:26.698 INFO:tasks.workunit.client.1.smithi100.stdout:6/57: getdents de 0 2024-04-27T07:33:26.698 INFO:tasks.workunit.client.1.smithi100.stdout:6/58: dread - de/f10 zero size 2024-04-27T07:33:26.699 INFO:tasks.workunit.client.1.smithi100.stdout:6/59: chown fa 76611496 1 2024-04-27T07:33:26.700 INFO:tasks.workunit.client.1.smithi100.stdout:6/60: symlink de/l13 0 2024-04-27T07:33:26.707 INFO:tasks.workunit.client.0.smithi082.stdout:7/596: sync 2024-04-27T07:33:26.708 INFO:tasks.workunit.client.0.smithi082.stdout:3/922: sync 2024-04-27T07:33:26.708 INFO:tasks.workunit.client.0.smithi082.stdout:2/626: sync 2024-04-27T07:33:26.756 INFO:tasks.workunit.client.0.smithi082.stdout:2/627: chown d7 7110800 1 2024-04-27T07:33:26.758 INFO:tasks.workunit.client.0.smithi082.stdout:0/685: write da/d1d/f2d [3480439,117107] 0 2024-04-27T07:33:26.758 INFO:tasks.workunit.client.0.smithi082.stdout:6/589: creat d2/d1e/fc3 x:0 0 0 2024-04-27T07:33:26.760 INFO:tasks.workunit.client.0.smithi082.stdout:3/923: write d8/d9/d25/d26/d4d/d82/dce/d101/f129 [292392,50018] 0 2024-04-27T07:33:26.760 INFO:tasks.workunit.client.0.smithi082.stdout:2/628: mknod d7/d30/ccb 0 2024-04-27T07:33:26.802 INFO:tasks.workunit.client.1.smithi100.stdout:4/122: sync 2024-04-27T07:33:26.803 INFO:tasks.workunit.client.1.smithi100.stdout:7/55: sync 2024-04-27T07:33:26.803 INFO:tasks.workunit.client.1.smithi100.stdout:7/56: write d1/f6 [1872447,91971] 0 2024-04-27T07:33:26.806 INFO:tasks.workunit.client.1.smithi100.stdout:7/57: unlink d1/c7 0 2024-04-27T07:33:26.807 INFO:tasks.workunit.client.0.smithi082.stdout:7/597: creat d3/d9/d4f/fc7 x:0 0 0 2024-04-27T07:33:26.808 INFO:tasks.workunit.client.1.smithi100.stdout:4/123: truncate d5/f6 2438961 0 2024-04-27T07:33:26.809 INFO:tasks.workunit.client.0.smithi082.stdout:7/598: dread - d3/f8c zero size 2024-04-27T07:33:26.809 INFO:tasks.workunit.client.1.smithi100.stdout:4/124: mkdir d5/d16/d1f 0 2024-04-27T07:33:26.809 INFO:tasks.workunit.client.0.smithi082.stdout:0/686: mkdir da/d3c/d3f/d4c/d95/de9/df6 0 2024-04-27T07:33:26.811 INFO:tasks.workunit.client.0.smithi082.stdout:4/720: dwrite d3/d6/d16/f7c [0,4194304] 0 2024-04-27T07:33:26.812 INFO:tasks.workunit.client.0.smithi082.stdout:6/590: dread d2/d3/d1b/f4b [0,4194304] 0 2024-04-27T07:33:26.812 INFO:tasks.workunit.client.0.smithi082.stdout:3/924: dread d8/d9/ffd [0,4194304] 0 2024-04-27T07:33:26.815 INFO:tasks.workunit.client.0.smithi082.stdout:6/591: truncate d2/d3/d1b/f4b 710482 0 2024-04-27T07:33:26.815 INFO:tasks.workunit.client.0.smithi082.stdout:4/721: chown d3/d6/d16/d98/de4 628512 1 2024-04-27T07:33:26.816 INFO:tasks.workunit.client.0.smithi082.stdout:7/599: creat d3/fc8 x:0 0 0 2024-04-27T07:33:26.819 INFO:tasks.workunit.client.0.smithi082.stdout:7/600: fsync d3/d49/d97/f2f 0 2024-04-27T07:33:26.821 INFO:tasks.workunit.client.1.smithi100.stdout:4/125: dwrite d5/fc [0,4194304] 0 2024-04-27T07:33:26.821 INFO:tasks.workunit.client.0.smithi082.stdout:7/601: fsync d3/d49/d97/d3a/f92 0 2024-04-27T07:33:26.823 INFO:tasks.workunit.client.0.smithi082.stdout:4/722: creat d3/fee x:0 0 0 2024-04-27T07:33:26.823 INFO:tasks.workunit.client.1.smithi100.stdout:4/126: mknod d5/d16/c20 0 2024-04-27T07:33:26.824 INFO:tasks.workunit.client.0.smithi082.stdout:0/687: truncate da/d2a/fae 66812 0 2024-04-27T07:33:26.825 INFO:tasks.workunit.client.1.smithi100.stdout:4/127: mkdir d5/d16/d19/d21 0 2024-04-27T07:33:26.828 INFO:tasks.workunit.client.0.smithi082.stdout:7/602: creat d3/d9/d4f/d61/fc9 x:0 0 0 2024-04-27T07:33:26.829 INFO:tasks.workunit.client.0.smithi082.stdout:2/629: dwrite d7/d30/f86 [0,4194304] 0 2024-04-27T07:33:26.832 INFO:tasks.workunit.client.0.smithi082.stdout:0/688: link da/fd3 da/d3c/ff7 0 2024-04-27T07:33:26.833 INFO:tasks.workunit.client.0.smithi082.stdout:2/630: mknod d7/d8/d13/d94/ccc 0 2024-04-27T07:33:26.834 INFO:tasks.workunit.client.0.smithi082.stdout:7/603: truncate d3/f9b 2264988 0 2024-04-27T07:33:26.835 INFO:tasks.workunit.client.0.smithi082.stdout:0/689: dread - da/d3c/d3f/d4c/d95/de9/def/fcd zero size 2024-04-27T07:33:26.835 INFO:tasks.workunit.client.0.smithi082.stdout:2/631: write d7/d8/f2d [835426,82964] 0 2024-04-27T07:33:26.836 INFO:tasks.workunit.client.1.smithi100.stdout:4/128: truncate d5/f6 2934480 0 2024-04-27T07:33:26.836 INFO:tasks.workunit.client.0.smithi082.stdout:0/690: fsync f9 0 2024-04-27T07:33:26.837 INFO:tasks.workunit.client.0.smithi082.stdout:2/632: read d7/d30/f86 [1213370,95282] 0 2024-04-27T07:33:26.839 INFO:tasks.workunit.client.1.smithi100.stdout:4/129: rename d5/d16/d1f to d5/d16/d19/d22 0 2024-04-27T07:33:26.839 INFO:tasks.workunit.client.0.smithi082.stdout:3/925: dread d8/d9/d1f/f4c [0,4194304] 0 2024-04-27T07:33:26.839 INFO:tasks.workunit.client.0.smithi082.stdout:7/604: symlink d3/d9/d7c/lca 0 2024-04-27T07:33:26.840 INFO:tasks.workunit.client.1.smithi100.stdout:4/130: mkdir d5/d23 0 2024-04-27T07:33:26.842 INFO:tasks.workunit.client.0.smithi082.stdout:7/605: fdatasync d3/d49/d97/d3a/f21 0 2024-04-27T07:33:26.843 INFO:tasks.workunit.client.0.smithi082.stdout:0/691: mkdir da/d1d/df8 0 2024-04-27T07:33:26.844 INFO:tasks.workunit.client.1.smithi100.stdout:4/131: dread d5/fc [0,4194304] 0 2024-04-27T07:33:26.845 INFO:tasks.workunit.client.1.smithi100.stdout:4/132: write d5/f8 [3039538,116190] 0 2024-04-27T07:33:26.846 INFO:tasks.workunit.client.1.smithi100.stdout:4/133: read d5/fc [1453405,3801] 0 2024-04-27T07:33:26.848 INFO:tasks.workunit.client.1.smithi100.stdout:4/134: write d5/fc [4921018,110969] 0 2024-04-27T07:33:26.849 INFO:tasks.workunit.client.0.smithi082.stdout:4/723: dwrite d3/d6/d16/f47 [0,4194304] 0 2024-04-27T07:33:26.850 INFO:tasks.workunit.client.1.smithi100.stdout:4/135: mknod d5/d16/d17/c24 0 2024-04-27T07:33:26.853 INFO:tasks.workunit.client.1.smithi100.stdout:4/136: creat d5/d23/f25 x:0 0 0 2024-04-27T07:33:26.853 INFO:tasks.workunit.client.1.smithi100.stdout:4/137: write d5/fc [5431021,5612] 0 2024-04-27T07:33:26.856 INFO:tasks.workunit.client.1.smithi100.stdout:4/138: creat d5/d16/f26 x:0 0 0 2024-04-27T07:33:26.857 INFO:tasks.workunit.client.0.smithi082.stdout:0/692: dwrite da/d28/f61 [4194304,4194304] 0 2024-04-27T07:33:26.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/552: sync 2024-04-27T07:33:26.858 INFO:tasks.workunit.client.0.smithi082.stdout:2/633: truncate d7/d30/d23/fac 3963067 0 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:1/248: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:3/68: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:9/140: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:2/150: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:0/127: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:5/127: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:8/123: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:6/61: sync 2024-04-27T07:33:26.859 INFO:tasks.workunit.client.1.smithi100.stdout:4/139: link d5/d16/c20 d5/d16/c27 0 2024-04-27T07:33:26.861 INFO:tasks.workunit.client.1.smithi100.stdout:2/151: dread - d0/da/f1c zero size 2024-04-27T07:33:26.862 INFO:tasks.workunit.client.0.smithi082.stdout:3/926: dread d8/d9/d25/d26/d4d/f9a [0,4194304] 0 2024-04-27T07:33:26.862 INFO:tasks.workunit.client.0.smithi082.stdout:9/553: write f4 [3222518,118643] 0 2024-04-27T07:33:26.862 INFO:tasks.workunit.client.0.smithi082.stdout:9/554: readlink l8 0 2024-04-27T07:33:26.862 INFO:tasks.workunit.client.0.smithi082.stdout:4/724: rename d3/d10/f4f to d3/d6/d22/fef 0 2024-04-27T07:33:26.862 INFO:tasks.workunit.client.0.smithi082.stdout:3/927: chown d8/d9/d1d/f90 38326739 1 2024-04-27T07:33:26.863 INFO:tasks.workunit.client.0.smithi082.stdout:4/725: readlink d3/d6/d16/l4b 0 2024-04-27T07:33:26.863 INFO:tasks.workunit.client.1.smithi100.stdout:4/140: dread d5/fe [0,4194304] 0 2024-04-27T07:33:26.864 INFO:tasks.workunit.client.1.smithi100.stdout:6/62: rename c4 to de/c14 0 2024-04-27T07:33:26.864 INFO:tasks.workunit.client.0.smithi082.stdout:3/928: dread - d8/d9/d25/d26/d4d/d82/d8b/dfc/f125 zero size 2024-04-27T07:33:26.865 INFO:tasks.workunit.client.0.smithi082.stdout:2/634: rename d7/d30/d23/c7e to d7/d9/d4f/d66/ccd 0 2024-04-27T07:33:26.866 INFO:tasks.workunit.client.0.smithi082.stdout:9/555: rmdir d9/da/dc 39 2024-04-27T07:33:26.866 INFO:tasks.workunit.client.1.smithi100.stdout:2/152: chown d0/d1e/f33 0 1 2024-04-27T07:33:26.868 INFO:tasks.workunit.client.1.smithi100.stdout:0/128: mknod d1/d8/d20/d1e/c2f 0 2024-04-27T07:33:26.868 INFO:tasks.workunit.client.1.smithi100.stdout:9/141: creat d1/d9/db/d2b/d31/f35 x:0 0 0 2024-04-27T07:33:26.869 INFO:tasks.workunit.client.1.smithi100.stdout:2/153: fdatasync d0/da/d29/d26/f2a 0 2024-04-27T07:33:26.869 INFO:tasks.workunit.client.0.smithi082.stdout:3/929: creat d8/d9/dd/d13/d1b/dbd/d8e/f143 x:0 0 0 2024-04-27T07:33:26.870 INFO:tasks.workunit.client.1.smithi100.stdout:5/128: dread d0/f14 [0,4194304] 0 2024-04-27T07:33:26.870 INFO:tasks.workunit.client.1.smithi100.stdout:5/129: chown d0 228133545 1 2024-04-27T07:33:26.871 INFO:tasks.workunit.client.1.smithi100.stdout:8/124: rename d6/f24 to d6/d1b/f2b 0 2024-04-27T07:33:26.872 INFO:tasks.workunit.client.0.smithi082.stdout:4/726: creat d3/dab/ff0 x:0 0 0 2024-04-27T07:33:26.873 INFO:tasks.workunit.client.1.smithi100.stdout:3/69: link d7/f13 d7/d9/d10/f15 0 2024-04-27T07:33:26.873 INFO:tasks.workunit.client.0.smithi082.stdout:0/693: link da/d1d/c67 da/d3c/d3f/d57/dcc/da8/cf9 0 2024-04-27T07:33:26.874 INFO:tasks.workunit.client.0.smithi082.stdout:4/727: fsync d3/d6/d26/d55/f6b 0 2024-04-27T07:33:26.875 INFO:tasks.workunit.client.0.smithi082.stdout:3/930: symlink d8/d9/dd/d13/dc0/de8/l144 0 2024-04-27T07:33:26.876 INFO:tasks.workunit.client.1.smithi100.stdout:6/63: truncate f8 270175 0 2024-04-27T07:33:26.877 INFO:tasks.workunit.client.0.smithi082.stdout:7/606: dread d3/d9/f2d [4194304,4194304] 0 2024-04-27T07:33:26.877 INFO:tasks.workunit.client.0.smithi082.stdout:2/635: fsync d7/f87 0 2024-04-27T07:33:26.878 INFO:tasks.workunit.client.1.smithi100.stdout:6/64: write de/f10 [491319,898] 0 2024-04-27T07:33:26.878 INFO:tasks.workunit.client.1.smithi100.stdout:9/142: creat d1/d9/db/d2b/f36 x:0 0 0 2024-04-27T07:33:26.879 INFO:tasks.workunit.client.1.smithi100.stdout:2/154: fdatasync d0/da/d29/f13 0 2024-04-27T07:33:26.879 INFO:tasks.workunit.client.0.smithi082.stdout:9/556: dwrite d9/da/dc/d35/d38/d65/f77 [0,4194304] 0 2024-04-27T07:33:26.881 INFO:tasks.workunit.client.1.smithi100.stdout:2/155: fsync d0/d1e/f33 0 2024-04-27T07:33:26.882 INFO:tasks.workunit.client.1.smithi100.stdout:2/156: fsync d0/da/fd 0 2024-04-27T07:33:26.882 INFO:tasks.workunit.client.1.smithi100.stdout:0/129: mkdir d1/d30 0 2024-04-27T07:33:26.884 INFO:tasks.workunit.client.1.smithi100.stdout:4/141: rmdir d5/d16/d19/d22 0 2024-04-27T07:33:26.885 INFO:tasks.workunit.client.0.smithi082.stdout:2/636: creat d7/d9/fce x:0 0 0 2024-04-27T07:33:26.887 INFO:tasks.workunit.client.1.smithi100.stdout:6/65: dread f6 [0,4194304] 0 2024-04-27T07:33:26.888 INFO:tasks.workunit.client.1.smithi100.stdout:5/130: mkdir d0/d4/d28 0 2024-04-27T07:33:26.888 INFO:tasks.workunit.client.1.smithi100.stdout:2/157: dread d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:26.888 INFO:tasks.workunit.client.0.smithi082.stdout:3/931: stat d8/d9/d3f/f13c 0 2024-04-27T07:33:26.889 INFO:tasks.workunit.client.1.smithi100.stdout:2/158: chown d0/d1e 12 1 2024-04-27T07:33:26.889 INFO:tasks.workunit.client.0.smithi082.stdout:4/728: dread - d3/d6/d22/d69/fd0 zero size 2024-04-27T07:33:26.889 INFO:tasks.workunit.client.1.smithi100.stdout:2/159: dread - d0/da/f1c zero size 2024-04-27T07:33:26.892 INFO:tasks.workunit.client.0.smithi082.stdout:0/694: dwrite da/d38/d7f/d4a/f58 [0,4194304] 0 2024-04-27T07:33:26.895 INFO:tasks.workunit.client.1.smithi100.stdout:4/142: mknod d5/d16/c28 0 2024-04-27T07:33:26.895 INFO:tasks.workunit.client.0.smithi082.stdout:7/607: dwrite d3/d49/d97/d3a/d71/da0/fa6 [0,4194304] 0 2024-04-27T07:33:26.896 INFO:tasks.workunit.client.0.smithi082.stdout:9/557: fsync d9/d2d/f59 0 2024-04-27T07:33:26.897 INFO:tasks.workunit.client.1.smithi100.stdout:6/66: creat de/f15 x:0 0 0 2024-04-27T07:33:26.898 INFO:tasks.workunit.client.1.smithi100.stdout:6/67: readlink de/l13 0 2024-04-27T07:33:26.899 INFO:tasks.workunit.client.0.smithi082.stdout:4/729: unlink d3/d6/f76 0 2024-04-27T07:33:26.900 INFO:tasks.workunit.client.0.smithi082.stdout:3/932: symlink d8/d9/dd/d13/d1b/l145 0 2024-04-27T07:33:26.900 INFO:tasks.workunit.client.1.smithi100.stdout:5/131: truncate d0/d4/d17/f1c 117782 0 2024-04-27T07:33:26.901 INFO:tasks.workunit.client.1.smithi100.stdout:6/68: truncate de/f11 256544 0 2024-04-27T07:33:26.902 INFO:tasks.workunit.client.1.smithi100.stdout:0/130: symlink d1/d30/l31 0 2024-04-27T07:33:26.903 INFO:tasks.workunit.client.1.smithi100.stdout:4/143: symlink d5/d23/l29 0 2024-04-27T07:33:26.904 INFO:tasks.workunit.client.1.smithi100.stdout:0/131: chown d1/l12 0 1 2024-04-27T07:33:26.904 INFO:tasks.workunit.client.1.smithi100.stdout:8/125: dwrite d6/f8 [0,4194304] 0 2024-04-27T07:33:26.907 INFO:tasks.workunit.client.1.smithi100.stdout:9/143: rmdir d1/d9/db/d2b/d31/d33 0 2024-04-27T07:33:26.907 INFO:tasks.workunit.client.1.smithi100.stdout:8/126: chown d6/c14 48 1 2024-04-27T07:33:26.907 INFO:tasks.workunit.client.1.smithi100.stdout:3/70: link c1 d7/d9/c16 0 2024-04-27T07:33:26.907 INFO:tasks.workunit.client.1.smithi100.stdout:8/127: stat d6/d1b/f2b 0 2024-04-27T07:33:26.908 INFO:tasks.workunit.client.0.smithi082.stdout:3/933: write d8/d9/d25/d26/d4d/fc1 [1164623,59483] 0 2024-04-27T07:33:26.908 INFO:tasks.workunit.client.0.smithi082.stdout:7/608: dwrite d3/f45 [8388608,4194304] 0 2024-04-27T07:33:26.908 INFO:tasks.workunit.client.0.smithi082.stdout:9/558: dread d9/da/dc/d35/d38/d65/f77 [0,4194304] 0 2024-04-27T07:33:26.908 INFO:tasks.workunit.client.0.smithi082.stdout:4/730: creat d3/d6/d26/d55/d67/d9d/ff1 x:0 0 0 2024-04-27T07:33:26.910 INFO:tasks.workunit.client.0.smithi082.stdout:2/637: dwrite d7/d9/d4f/d6e/d82/dc6/f97 [0,4194304] 0 2024-04-27T07:33:26.913 INFO:tasks.workunit.client.1.smithi100.stdout:4/144: rmdir d5/d16/d19 39 2024-04-27T07:33:26.913 INFO:tasks.workunit.client.1.smithi100.stdout:9/144: unlink d1/d9/db/c18 0 2024-04-27T07:33:26.914 INFO:tasks.workunit.client.0.smithi082.stdout:9/559: chown d9/d2d/d72/ca6 6907661 1 2024-04-27T07:33:26.917 INFO:tasks.workunit.client.0.smithi082.stdout:2/638: rmdir d7/d8/d13 39 2024-04-27T07:33:26.918 INFO:tasks.workunit.client.0.smithi082.stdout:2/639: chown d7/d31/l26 12714 1 2024-04-27T07:33:26.921 INFO:tasks.workunit.client.0.smithi082.stdout:7/609: creat d3/fcb x:0 0 0 2024-04-27T07:33:26.922 INFO:tasks.workunit.client.1.smithi100.stdout:3/71: dwrite f6 [0,4194304] 0 2024-04-27T07:33:26.923 INFO:tasks.workunit.client.0.smithi082.stdout:3/934: creat d8/d9/d25/d26/d4d/d82/d8b/da0/d135/f146 x:0 0 0 2024-04-27T07:33:26.925 INFO:tasks.workunit.client.0.smithi082.stdout:9/560: unlink d9/da/dc/c70 0 2024-04-27T07:33:26.926 INFO:tasks.workunit.client.1.smithi100.stdout:0/132: dwrite d1/d8/d14/f17 [0,4194304] 0 2024-04-27T07:33:26.927 INFO:tasks.workunit.client.0.smithi082.stdout:7/610: creat d3/d49/d97/d3a/d71/fcc x:0 0 0 2024-04-27T07:33:26.927 INFO:tasks.workunit.client.0.smithi082.stdout:7/611: dread - d3/f8c zero size 2024-04-27T07:33:26.928 INFO:tasks.workunit.client.1.smithi100.stdout:2/160: getdents d0/da/d29/d26 0 2024-04-27T07:33:26.930 INFO:tasks.workunit.client.0.smithi082.stdout:4/731: rename d3/d6/d26/d5e/d21/dad to d3/d6/d26/df2 0 2024-04-27T07:33:26.930 INFO:tasks.workunit.client.1.smithi100.stdout:0/133: read d1/f24 [582493,84429] 0 2024-04-27T07:33:26.931 INFO:tasks.workunit.client.0.smithi082.stdout:0/695: write da/d28/f66 [160793,76074] 0 2024-04-27T07:33:26.933 INFO:tasks.workunit.client.1.smithi100.stdout:5/132: dwrite d0/d4/fc [0,4194304] 0 2024-04-27T07:33:26.933 INFO:tasks.workunit.client.1.smithi100.stdout:0/134: stat d1/l12 0 2024-04-27T07:33:26.934 INFO:tasks.workunit.client.0.smithi082.stdout:9/561: symlink d9/lb9 0 2024-04-27T07:33:26.934 INFO:tasks.workunit.client.0.smithi082.stdout:7/612: truncate d3/db/f2e 3930640 0 2024-04-27T07:33:26.936 INFO:tasks.workunit.client.0.smithi082.stdout:7/613: write d3/d49/d97/d3a/f68 [354469,126960] 0 2024-04-27T07:33:26.937 INFO:tasks.workunit.client.1.smithi100.stdout:6/69: read f8 [187143,12600] 0 2024-04-27T07:33:26.939 INFO:tasks.workunit.client.0.smithi082.stdout:9/562: mknod d9/d2d/d72/cba 0 2024-04-27T07:33:26.940 INFO:tasks.workunit.client.1.smithi100.stdout:4/145: dwrite d5/fe [0,4194304] 0 2024-04-27T07:33:26.940 INFO:tasks.workunit.client.1.smithi100.stdout:9/145: getdents d1/d2a 0 2024-04-27T07:33:26.941 INFO:tasks.workunit.client.0.smithi082.stdout:2/640: link d7/d8/d13/f2b d7/d30/d23/fcf 0 2024-04-27T07:33:26.943 INFO:tasks.workunit.client.0.smithi082.stdout:4/732: creat d3/d6/dcf/ff3 x:0 0 0 2024-04-27T07:33:26.944 INFO:tasks.workunit.client.0.smithi082.stdout:0/696: symlink da/df5/lfa 0 2024-04-27T07:33:26.946 INFO:tasks.workunit.client.1.smithi100.stdout:6/70: creat de/f16 x:0 0 0 2024-04-27T07:33:26.946 INFO:tasks.workunit.client.0.smithi082.stdout:2/641: chown d7/d8/d13/fb8 1 1 2024-04-27T07:33:26.948 INFO:tasks.workunit.client.0.smithi082.stdout:9/563: mkdir d9/da/dc/d73/dbb 0 2024-04-27T07:33:26.948 INFO:tasks.workunit.client.1.smithi100.stdout:9/146: truncate d1/f13 179800 0 2024-04-27T07:33:26.950 INFO:tasks.workunit.client.0.smithi082.stdout:9/564: write d9/da/dc/d88/da8/fac [148580,111578] 0 2024-04-27T07:33:26.951 INFO:tasks.workunit.client.0.smithi082.stdout:9/565: chown d9/da/l79 17 1 2024-04-27T07:33:26.951 INFO:tasks.workunit.client.0.smithi082.stdout:4/733: read d3/d10/f3d [2773658,82609] 0 2024-04-27T07:33:26.951 INFO:tasks.workunit.client.0.smithi082.stdout:0/697: rename da/d38/da9/cf2 to da/d3c/d3f/d57/cfb 0 2024-04-27T07:33:26.952 INFO:tasks.workunit.client.1.smithi100.stdout:0/135: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:26.952 INFO:tasks.workunit.client.0.smithi082.stdout:8/609: sync 2024-04-27T07:33:26.953 INFO:tasks.workunit.client.1.smithi100.stdout:4/146: rename d5/f13 to d5/d16/d19/f2a 0 2024-04-27T07:33:26.953 INFO:tasks.workunit.client.1.smithi100.stdout:7/58: sync 2024-04-27T07:33:26.955 INFO:tasks.workunit.client.1.smithi100.stdout:5/133: dwrite d0/f1d [4194304,4194304] 0 2024-04-27T07:33:26.955 INFO:tasks.workunit.client.0.smithi082.stdout:0/698: creat da/d3c/d3f/d4c/ffc x:0 0 0 2024-04-27T07:33:26.957 INFO:tasks.workunit.client.0.smithi082.stdout:8/610: symlink d0/d3/d87/d46/lc9 0 2024-04-27T07:33:26.958 INFO:tasks.workunit.client.1.smithi100.stdout:8/128: dwrite f4 [0,4194304] 0 2024-04-27T07:33:26.958 INFO:tasks.workunit.client.1.smithi100.stdout:6/71: link de/f15 de/f17 0 2024-04-27T07:33:26.959 INFO:tasks.workunit.client.0.smithi082.stdout:2/642: dread d7/d8/d13/f60 [0,4194304] 0 2024-04-27T07:33:26.959 INFO:tasks.workunit.client.0.smithi082.stdout:0/699: creat da/d3c/dc7/ffd x:0 0 0 2024-04-27T07:33:26.959 INFO:tasks.workunit.client.1.smithi100.stdout:7/59: creat d1/fc x:0 0 0 2024-04-27T07:33:26.960 INFO:tasks.workunit.client.0.smithi082.stdout:8/611: readlink d0/d2b/d9a/da4/d35/l96 0 2024-04-27T07:33:26.963 INFO:tasks.workunit.client.0.smithi082.stdout:4/734: dwrite d3/dce/fda [0,4194304] 0 2024-04-27T07:33:26.963 INFO:tasks.workunit.client.1.smithi100.stdout:8/129: dread - d6/f1e zero size 2024-04-27T07:33:26.965 INFO:tasks.workunit.client.0.smithi082.stdout:8/612: mkdir d0/d2b/d80/dca 0 2024-04-27T07:33:26.966 INFO:tasks.workunit.client.0.smithi082.stdout:2/643: symlink d7/d8/d99/db4/ld0 0 2024-04-27T07:33:26.968 INFO:tasks.workunit.client.0.smithi082.stdout:9/566: dread d9/d2d/f19 [0,4194304] 0 2024-04-27T07:33:26.969 INFO:tasks.workunit.client.1.smithi100.stdout:5/134: dread d0/d4/f7 [0,4194304] 0 2024-04-27T07:33:26.970 INFO:tasks.workunit.client.0.smithi082.stdout:2/644: write d7/d14/f5c [3590819,49532] 0 2024-04-27T07:33:26.971 INFO:tasks.workunit.client.1.smithi100.stdout:5/135: stat d0/d4 0 2024-04-27T07:33:26.972 INFO:tasks.workunit.client.0.smithi082.stdout:8/613: rename d0/d3/d1c/l1f to d0/d3/d1c/d76/lcb 0 2024-04-27T07:33:26.973 INFO:tasks.workunit.client.1.smithi100.stdout:6/72: dread fa [0,4194304] 0 2024-04-27T07:33:26.978 INFO:tasks.workunit.client.1.smithi100.stdout:6/73: mkdir de/d18 0 2024-04-27T07:33:26.979 INFO:tasks.workunit.client.0.smithi082.stdout:2/645: unlink d7/d14/f9f 0 2024-04-27T07:33:26.980 INFO:tasks.workunit.client.1.smithi100.stdout:5/136: symlink d0/d4/d21/d24/l29 0 2024-04-27T07:33:26.981 INFO:tasks.workunit.client.0.smithi082.stdout:8/614: write d0/d2b/f68 [648682,2206] 0 2024-04-27T07:33:26.981 INFO:tasks.workunit.client.1.smithi100.stdout:7/60: dwrite d1/f2 [0,4194304] 0 2024-04-27T07:33:26.982 INFO:tasks.workunit.client.1.smithi100.stdout:8/130: getdents d6/d1b/d1d 0 2024-04-27T07:33:26.983 INFO:tasks.workunit.client.1.smithi100.stdout:3/72: dwrite d7/f13 [0,4194304] 0 2024-04-27T07:33:26.983 INFO:tasks.workunit.client.0.smithi082.stdout:8/615: chown d0/d3/d1b/l91 7 1 2024-04-27T07:33:26.984 INFO:tasks.workunit.client.1.smithi100.stdout:7/61: chown d1/fc 1717076145 1 2024-04-27T07:33:26.985 INFO:tasks.workunit.client.1.smithi100.stdout:6/74: mknod de/c19 0 2024-04-27T07:33:26.985 INFO:tasks.workunit.client.1.smithi100.stdout:7/62: dread - d1/fb zero size 2024-04-27T07:33:26.987 INFO:tasks.workunit.client.1.smithi100.stdout:8/131: unlink d6/f1c 0 2024-04-27T07:33:26.988 INFO:tasks.workunit.client.1.smithi100.stdout:3/73: rmdir d7/d9/d10 39 2024-04-27T07:33:26.990 INFO:tasks.workunit.client.1.smithi100.stdout:7/63: mkdir d1/dd 0 2024-04-27T07:33:26.991 INFO:tasks.workunit.client.1.smithi100.stdout:7/64: write d1/fb [578230,15687] 0 2024-04-27T07:33:26.991 INFO:tasks.workunit.client.0.smithi082.stdout:2/646: dwrite d7/d8/d13/d94/fad [4194304,4194304] 0 2024-04-27T07:33:26.992 INFO:tasks.workunit.client.0.smithi082.stdout:8/616: creat d0/d3/d1c/d76/da0/fcc x:0 0 0 2024-04-27T07:33:26.993 INFO:tasks.workunit.client.0.smithi082.stdout:7/614: dwrite d3/db/f46 [0,4194304] 0 2024-04-27T07:33:26.993 INFO:tasks.workunit.client.1.smithi100.stdout:7/65: write d1/f6 [3020309,39857] 0 2024-04-27T07:33:26.993 INFO:tasks.workunit.client.1.smithi100.stdout:5/137: creat d0/f2a x:0 0 0 2024-04-27T07:33:26.994 INFO:tasks.workunit.client.1.smithi100.stdout:3/74: mkdir d7/d17 0 2024-04-27T07:33:26.995 INFO:tasks.workunit.client.1.smithi100.stdout:7/66: write d1/fb [1460350,83931] 0 2024-04-27T07:33:26.995 INFO:tasks.workunit.client.1.smithi100.stdout:6/75: creat de/d18/f1a x:0 0 0 2024-04-27T07:33:26.996 INFO:tasks.workunit.client.1.smithi100.stdout:6/76: readlink de/l13 0 2024-04-27T07:33:26.999 INFO:tasks.workunit.client.0.smithi082.stdout:8/617: rmdir d0/d2b/d9a/da4 39 2024-04-27T07:33:27.001 INFO:tasks.workunit.client.1.smithi100.stdout:3/75: chown d7/d9/d10/c12 1371100051 1 2024-04-27T07:33:27.002 INFO:tasks.workunit.client.0.smithi082.stdout:7/615: symlink d3/d9/d4f/d61/lcd 0 2024-04-27T07:33:27.002 INFO:tasks.workunit.client.1.smithi100.stdout:5/138: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:27.003 INFO:tasks.workunit.client.1.smithi100.stdout:7/67: rename d1/fb to d1/dd/fe 0 2024-04-27T07:33:27.004 INFO:tasks.workunit.client.0.smithi082.stdout:0/700: dwrite da/d3c/fa2 [0,4194304] 0 2024-04-27T07:33:27.005 INFO:tasks.workunit.client.1.smithi100.stdout:4/147: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:27.011 INFO:tasks.workunit.client.0.smithi082.stdout:7/616: unlink d3/d9/c6e 0 2024-04-27T07:33:27.011 INFO:tasks.workunit.client.0.smithi082.stdout:9/567: dwrite d9/da/f31 [0,4194304] 0 2024-04-27T07:33:27.011 INFO:tasks.workunit.client.0.smithi082.stdout:8/618: fsync d0/d2b/d9a/da4/fb8 0 2024-04-27T07:33:27.013 INFO:tasks.workunit.client.0.smithi082.stdout:4/735: truncate d3/d9/f8b 55839 0 2024-04-27T07:33:27.013 INFO:tasks.workunit.client.0.smithi082.stdout:8/619: chown d0/d3/d1b/d29/fa1 529 1 2024-04-27T07:33:27.015 INFO:tasks.workunit.client.1.smithi100.stdout:6/77: rename de/f15 to de/d18/f1b 0 2024-04-27T07:33:27.016 INFO:tasks.workunit.client.1.smithi100.stdout:8/132: getdents d6/d1b 0 2024-04-27T07:33:27.017 INFO:tasks.workunit.client.1.smithi100.stdout:8/133: read d6/ff [1519194,126500] 0 2024-04-27T07:33:27.017 INFO:tasks.workunit.client.0.smithi082.stdout:0/701: symlink da/d3c/d3f/dbb/lfe 0 2024-04-27T07:33:27.022 INFO:tasks.workunit.client.0.smithi082.stdout:4/736: truncate d3/d6/d22/f9a 860992 0 2024-04-27T07:33:27.022 INFO:tasks.workunit.client.0.smithi082.stdout:9/568: creat d9/da/dc/db1/fbc x:0 0 0 2024-04-27T07:33:27.022 INFO:tasks.workunit.client.0.smithi082.stdout:7/617: mkdir d3/d49/d97/d3a/d2a/dac/dae/dce 0 2024-04-27T07:33:27.022 INFO:tasks.workunit.client.0.smithi082.stdout:4/737: readlink d3/d6/d26/l2d 0 2024-04-27T07:33:27.023 INFO:tasks.workunit.client.1.smithi100.stdout:7/68: rename d1/f9 to d1/dd/ff 0 2024-04-27T07:33:27.024 INFO:tasks.workunit.client.0.smithi082.stdout:9/569: mknod d9/da/dc/d33/cbd 0 2024-04-27T07:33:27.025 INFO:tasks.workunit.client.1.smithi100.stdout:7/69: write d1/f2 [1816047,33931] 0 2024-04-27T07:33:27.025 INFO:tasks.workunit.client.1.smithi100.stdout:8/134: creat d6/d1b/d1d/f2c x:0 0 0 2024-04-27T07:33:27.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/618: creat d3/d49/d97/d3a/d71/da0/fcf x:0 0 0 2024-04-27T07:33:27.027 INFO:tasks.workunit.client.0.smithi082.stdout:4/738: mknod d3/d6/d26/d55/d67/cf4 0 2024-04-27T07:33:27.027 INFO:tasks.workunit.client.0.smithi082.stdout:0/702: dread da/d3c/fbd [0,4194304] 0 2024-04-27T07:33:27.028 INFO:tasks.workunit.client.1.smithi100.stdout:4/148: getdents d5/d16/d17 0 2024-04-27T07:33:27.029 INFO:tasks.workunit.client.0.smithi082.stdout:7/619: mkdir d3/d9/d4f/d61/dd0 0 2024-04-27T07:33:27.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/703: dread - da/d3c/fd8 zero size 2024-04-27T07:33:27.029 INFO:tasks.workunit.client.0.smithi082.stdout:4/739: write d3/d6/d16/d98/fa0 [3381057,126015] 0 2024-04-27T07:33:27.030 INFO:tasks.workunit.client.1.smithi100.stdout:8/135: creat d6/d1b/f2d x:0 0 0 2024-04-27T07:33:27.031 INFO:tasks.workunit.client.0.smithi082.stdout:7/620: write d3/d49/d97/d3a/fad [759051,93653] 0 2024-04-27T07:33:27.031 INFO:tasks.workunit.client.0.smithi082.stdout:9/570: creat d9/da/fbe x:0 0 0 2024-04-27T07:33:27.031 INFO:tasks.workunit.client.1.smithi100.stdout:6/78: rename c9 to de/d18/c1c 0 2024-04-27T07:33:27.032 INFO:tasks.workunit.client.1.smithi100.stdout:7/70: dwrite d1/f2 [0,4194304] 0 2024-04-27T07:33:27.033 INFO:tasks.workunit.client.0.smithi082.stdout:4/740: mkdir d3/d6/d22/d69/df5 0 2024-04-27T07:33:27.033 INFO:tasks.workunit.client.1.smithi100.stdout:4/149: rmdir d5 39 2024-04-27T07:33:27.034 INFO:tasks.workunit.client.0.smithi082.stdout:4/741: chown d3/d6/d26/d55/d67/d9d 483171 1 2024-04-27T07:33:27.034 INFO:tasks.workunit.client.1.smithi100.stdout:7/71: write d1/fc [64737,44583] 0 2024-04-27T07:33:27.035 INFO:tasks.workunit.client.1.smithi100.stdout:8/136: symlink d6/d1b/d1d/l2e 0 2024-04-27T07:33:27.036 INFO:tasks.workunit.client.1.smithi100.stdout:8/137: truncate d6/f27 378896 0 2024-04-27T07:33:27.036 INFO:tasks.workunit.client.0.smithi082.stdout:7/621: symlink d3/d9/d4f/ld1 0 2024-04-27T07:33:27.037 INFO:tasks.workunit.client.0.smithi082.stdout:9/571: symlink d9/da/dc/d35/d38/lbf 0 2024-04-27T07:33:27.038 INFO:tasks.workunit.client.1.smithi100.stdout:8/138: chown d6/d1b/d1d/f2c 5 1 2024-04-27T07:33:27.039 INFO:tasks.workunit.client.1.smithi100.stdout:8/139: truncate f4 4451282 0 2024-04-27T07:33:27.039 INFO:tasks.workunit.client.0.smithi082.stdout:0/704: rename da/d28/d36/d40/f49 to da/d38/d7f/d4a/d80/fff 0 2024-04-27T07:33:27.042 INFO:tasks.workunit.client.1.smithi100.stdout:7/72: dwrite d1/fc [0,4194304] 0 2024-04-27T07:33:27.042 INFO:tasks.workunit.client.0.smithi082.stdout:4/742: creat d3/d6/d22/d69/d85/ff6 x:0 0 0 2024-04-27T07:33:27.042 INFO:tasks.workunit.client.1.smithi100.stdout:7/73: chown d1/dd 471532 1 2024-04-27T07:33:27.042 INFO:tasks.workunit.client.0.smithi082.stdout:4/743: dread - d3/fba zero size 2024-04-27T07:33:27.043 INFO:tasks.workunit.client.1.smithi100.stdout:4/150: mkdir d5/d16/d19/d21/d2b 0 2024-04-27T07:33:27.045 INFO:tasks.workunit.client.1.smithi100.stdout:8/140: mknod d6/c2f 0 2024-04-27T07:33:27.046 INFO:tasks.workunit.client.0.smithi082.stdout:7/622: symlink d3/db/dc1/ld2 0 2024-04-27T07:33:27.046 INFO:tasks.workunit.client.1.smithi100.stdout:4/151: chown d5/d23/l29 104346541 1 2024-04-27T07:33:27.049 INFO:tasks.workunit.client.0.smithi082.stdout:9/572: link d9/d2d/l2c d9/d2d/lc0 0 2024-04-27T07:33:27.050 INFO:tasks.workunit.client.1.smithi100.stdout:4/152: mkdir d5/d1b/d2c 0 2024-04-27T07:33:27.051 INFO:tasks.workunit.client.1.smithi100.stdout:6/79: getdents de 0 2024-04-27T07:33:27.053 INFO:tasks.workunit.client.1.smithi100.stdout:7/74: fsync d1/f2 0 2024-04-27T07:33:27.054 INFO:tasks.workunit.client.0.smithi082.stdout:4/744: dwrite d3/d6/d22/d69/fd8 [0,4194304] 0 2024-04-27T07:33:27.054 INFO:tasks.workunit.client.1.smithi100.stdout:3/76: truncate d7/f13 2817444 0 2024-04-27T07:33:27.055 INFO:tasks.workunit.client.0.smithi082.stdout:9/573: creat d9/da/dc/d88/d93/fc1 x:0 0 0 2024-04-27T07:33:27.056 INFO:tasks.workunit.client.1.smithi100.stdout:6/80: symlink de/d18/l1d 0 2024-04-27T07:33:27.057 INFO:tasks.workunit.client.1.smithi100.stdout:4/153: creat d5/d16/d19/d21/d2b/f2d x:0 0 0 2024-04-27T07:33:27.058 INFO:tasks.workunit.client.1.smithi100.stdout:5/139: dwrite d0/f10 [0,4194304] 0 2024-04-27T07:33:27.061 INFO:tasks.workunit.client.1.smithi100.stdout:7/75: mknod d1/c10 0 2024-04-27T07:33:27.061 INFO:tasks.workunit.client.0.smithi082.stdout:7/623: dwrite d3/d49/d97/f79 [0,4194304] 0 2024-04-27T07:33:27.061 INFO:tasks.workunit.client.0.smithi082.stdout:9/574: creat d9/da/dc/d35/d4a/d50/fc2 x:0 0 0 2024-04-27T07:33:27.063 INFO:tasks.workunit.client.0.smithi082.stdout:2/647: dwrite d7/f3c [0,4194304] 0 2024-04-27T07:33:27.064 INFO:tasks.workunit.client.1.smithi100.stdout:6/81: write f8 [1236641,117341] 0 2024-04-27T07:33:27.064 INFO:tasks.workunit.client.0.smithi082.stdout:4/745: dread d3/d6/d16/fae [0,4194304] 0 2024-04-27T07:33:27.065 INFO:tasks.workunit.client.0.smithi082.stdout:5/768: sync 2024-04-27T07:33:27.065 INFO:tasks.workunit.client.0.smithi082.stdout:1/619: sync 2024-04-27T07:33:27.065 INFO:tasks.workunit.client.0.smithi082.stdout:6/592: sync 2024-04-27T07:33:27.067 INFO:tasks.workunit.client.0.smithi082.stdout:2/648: dread - d7/d8/d99/db4/fbe zero size 2024-04-27T07:33:27.068 INFO:tasks.workunit.client.0.smithi082.stdout:9/575: write d9/d2d/d72/f8a [166604,100411] 0 2024-04-27T07:33:27.070 INFO:tasks.workunit.client.0.smithi082.stdout:4/746: chown d3/d6/d26/d55/d67/cf4 163932314 1 2024-04-27T07:33:27.071 INFO:tasks.workunit.client.1.smithi100.stdout:7/76: creat d1/dd/f11 x:0 0 0 2024-04-27T07:33:27.072 INFO:tasks.workunit.client.1.smithi100.stdout:4/154: mkdir d5/d16/d2e 0 2024-04-27T07:33:27.072 INFO:tasks.workunit.client.1.smithi100.stdout:5/140: dread d0/d4/f11 [0,4194304] 0 2024-04-27T07:33:27.073 INFO:tasks.workunit.client.1.smithi100.stdout:1/249: sync 2024-04-27T07:33:27.073 INFO:tasks.workunit.client.0.smithi082.stdout:8/620: dwrite d0/d2b/fc3 [0,4194304] 0 2024-04-27T07:33:27.074 INFO:tasks.workunit.client.1.smithi100.stdout:6/82: readlink lb 0 2024-04-27T07:33:27.074 INFO:tasks.workunit.client.1.smithi100.stdout:1/250: write d0/f18 [1454366,22621] 0 2024-04-27T07:33:27.076 INFO:tasks.workunit.client.1.smithi100.stdout:7/77: creat d1/dd/f12 x:0 0 0 2024-04-27T07:33:27.077 INFO:tasks.workunit.client.0.smithi082.stdout:8/621: write d0/d3/d87/d42/d7f/d82/fb1 [365144,16896] 0 2024-04-27T07:33:27.078 INFO:tasks.workunit.client.1.smithi100.stdout:8/141: truncate d6/f17 1149435 0 2024-04-27T07:33:27.078 INFO:tasks.workunit.client.0.smithi082.stdout:7/624: mknod d3/db/dbb/cd3 0 2024-04-27T07:33:27.079 INFO:tasks.workunit.client.0.smithi082.stdout:4/747: readlink d3/d6/d22/l63 0 2024-04-27T07:33:27.080 INFO:tasks.workunit.client.1.smithi100.stdout:5/141: dread d0/d4/f22 [0,4194304] 0 2024-04-27T07:33:27.081 INFO:tasks.workunit.client.1.smithi100.stdout:3/77: rename d7/f13 to d7/f18 0 2024-04-27T07:33:27.081 INFO:tasks.workunit.client.0.smithi082.stdout:2/649: mkdir d7/d9/d4f/d66/dae/dd1 0 2024-04-27T07:33:27.083 INFO:tasks.workunit.client.1.smithi100.stdout:3/78: truncate d7/d9/fc 882517 0 2024-04-27T07:33:27.084 INFO:tasks.workunit.client.1.smithi100.stdout:6/83: creat de/f1e x:0 0 0 2024-04-27T07:33:27.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/593: creat d2/d45/dc2/fc4 x:0 0 0 2024-04-27T07:33:27.084 INFO:tasks.workunit.client.0.smithi082.stdout:2/650: fdatasync d7/d9/d4f/f9d 0 2024-04-27T07:33:27.085 INFO:tasks.workunit.client.0.smithi082.stdout:5/769: truncate d8/d3c/d47/f27 5813333 0 2024-04-27T07:33:27.086 INFO:tasks.workunit.client.1.smithi100.stdout:1/251: mknod d0/d23/c45 0 2024-04-27T07:33:27.087 INFO:tasks.workunit.client.0.smithi082.stdout:7/625: mknod d3/d49/d97/d7d/cd4 0 2024-04-27T07:33:27.087 INFO:tasks.workunit.client.0.smithi082.stdout:0/705: dwrite da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:27.088 INFO:tasks.workunit.client.1.smithi100.stdout:7/78: mknod d1/c13 0 2024-04-27T07:33:27.089 INFO:tasks.workunit.client.1.smithi100.stdout:8/142: write d6/f7 [2309781,86289] 0 2024-04-27T07:33:27.089 INFO:tasks.workunit.client.0.smithi082.stdout:4/748: creat d3/d6/d26/d55/dc5/ff7 x:0 0 0 2024-04-27T07:33:27.090 INFO:tasks.workunit.client.0.smithi082.stdout:1/620: link d4/d15/d29/f47 d4/d15/d3f/d98/fd8 0 2024-04-27T07:33:27.091 INFO:tasks.workunit.client.1.smithi100.stdout:1/252: creat d0/d1b/f46 x:0 0 0 2024-04-27T07:33:27.093 INFO:tasks.workunit.client.0.smithi082.stdout:0/706: chown da/d38/d7f/d4a/c6b 1528808 1 2024-04-27T07:33:27.094 INFO:tasks.workunit.client.0.smithi082.stdout:7/626: read d3/d9/d4f/d61/f86 [2799977,94440] 0 2024-04-27T07:33:27.094 INFO:tasks.workunit.client.1.smithi100.stdout:4/155: rename d5/lb to d5/d16/l2f 0 2024-04-27T07:33:27.096 INFO:tasks.workunit.client.1.smithi100.stdout:8/143: mknod d6/d1b/c30 0 2024-04-27T07:33:27.096 INFO:tasks.workunit.client.0.smithi082.stdout:9/576: rename d9/da/dc/d35/d38/da5/c52 to d9/da/dc/d35/d38/cc3 0 2024-04-27T07:33:27.097 INFO:tasks.workunit.client.1.smithi100.stdout:5/142: mknod d0/c2b 0 2024-04-27T07:33:27.098 INFO:tasks.workunit.client.0.smithi082.stdout:8/622: creat d0/d3/d1b/fcd x:0 0 0 2024-04-27T07:33:27.098 INFO:tasks.workunit.client.1.smithi100.stdout:3/79: symlink d7/d9/l19 0 2024-04-27T07:33:27.099 INFO:tasks.workunit.client.0.smithi082.stdout:4/749: rmdir d3/d6/d16/d98 39 2024-04-27T07:33:27.099 INFO:tasks.workunit.client.0.smithi082.stdout:1/621: dwrite d4/d15/f18 [0,4194304] 0 2024-04-27T07:33:27.099 INFO:tasks.workunit.client.1.smithi100.stdout:5/143: write d0/d4/fc [2542210,23404] 0 2024-04-27T07:33:27.101 INFO:tasks.workunit.client.1.smithi100.stdout:7/79: unlink d1/dd/ff 0 2024-04-27T07:33:27.101 INFO:tasks.workunit.client.0.smithi082.stdout:2/651: mknod d7/d8/d13/cd2 0 2024-04-27T07:33:27.102 INFO:tasks.workunit.client.0.smithi082.stdout:6/594: link d2/d2d/d3d/fbb d2/d1e/d32/d7d/fc5 0 2024-04-27T07:33:27.102 INFO:tasks.workunit.client.0.smithi082.stdout:2/652: write d7/d31/d54/f6d [2739081,35066] 0 2024-04-27T07:33:27.103 INFO:tasks.workunit.client.0.smithi082.stdout:6/595: dread - d2/d2d/d4a/fbd zero size 2024-04-27T07:33:27.104 INFO:tasks.workunit.client.1.smithi100.stdout:6/84: rename fa to de/f1f 0 2024-04-27T07:33:27.105 INFO:tasks.workunit.client.1.smithi100.stdout:7/80: truncate d1/dd/f12 364450 0 2024-04-27T07:33:27.105 INFO:tasks.workunit.client.0.smithi082.stdout:0/707: rename da/d3c/d3f/d57/fdc to da/d3c/d3f/d4c/d95/f100 0 2024-04-27T07:33:27.105 INFO:tasks.workunit.client.1.smithi100.stdout:8/144: truncate f1 2853636 0 2024-04-27T07:33:27.106 INFO:tasks.workunit.client.1.smithi100.stdout:4/156: dwrite d5/d16/d19/d21/d2b/f2d [0,4194304] 0 2024-04-27T07:33:27.108 INFO:tasks.workunit.client.0.smithi082.stdout:4/750: creat d3/d6/d26/d5e/d21/ff8 x:0 0 0 2024-04-27T07:33:27.110 INFO:tasks.workunit.client.0.smithi082.stdout:7/627: mknod d3/d49/d97/d3a/cd5 0 2024-04-27T07:33:27.113 INFO:tasks.workunit.client.1.smithi100.stdout:7/81: dread - d1/dd/f11 zero size 2024-04-27T07:33:27.114 INFO:tasks.workunit.client.0.smithi082.stdout:6/596: creat d2/d45/fc6 x:0 0 0 2024-04-27T07:33:27.115 INFO:tasks.workunit.client.1.smithi100.stdout:4/157: unlink c3 0 2024-04-27T07:33:27.116 INFO:tasks.workunit.client.1.smithi100.stdout:5/144: symlink d0/d4/l2c 0 2024-04-27T07:33:27.117 INFO:tasks.workunit.client.1.smithi100.stdout:3/80: dwrite f6 [0,4194304] 0 2024-04-27T07:33:27.117 INFO:tasks.workunit.client.1.smithi100.stdout:6/85: creat de/d18/f20 x:0 0 0 2024-04-27T07:33:27.118 INFO:tasks.workunit.client.0.smithi082.stdout:6/597: truncate d2/d1e/d32/d85/f94 4342589 0 2024-04-27T07:33:27.121 INFO:tasks.workunit.client.1.smithi100.stdout:2/161: sync 2024-04-27T07:33:27.121 INFO:tasks.workunit.client.1.smithi100.stdout:7/82: mknod d1/dd/c14 0 2024-04-27T07:33:27.121 INFO:tasks.workunit.client.0.smithi082.stdout:9/577: creat d9/da/d85/fc4 x:0 0 0 2024-04-27T07:33:27.121 INFO:tasks.workunit.client.1.smithi100.stdout:1/253: dwrite d0/d23/d3a/f41 [0,4194304] 0 2024-04-27T07:33:27.123 INFO:tasks.workunit.client.0.smithi082.stdout:7/628: rmdir d3/d9/d4f/d9a 39 2024-04-27T07:33:27.126 INFO:tasks.workunit.client.0.smithi082.stdout:2/653: unlink d7/l3a 0 2024-04-27T07:33:27.128 INFO:tasks.workunit.client.0.smithi082.stdout:6/598: symlink d2/d1e/d32/d85/d8a/lc7 0 2024-04-27T07:33:27.130 INFO:tasks.workunit.client.0.smithi082.stdout:1/622: creat d4/d15/fd9 x:0 0 0 2024-04-27T07:33:27.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/770: dread d8/d14/f21 [4194304,4194304] 0 2024-04-27T07:33:27.131 INFO:tasks.workunit.client.1.smithi100.stdout:3/81: mknod d7/d9/c1a 0 2024-04-27T07:33:27.132 INFO:tasks.workunit.client.1.smithi100.stdout:1/254: mknod d0/d1b/c47 0 2024-04-27T07:33:27.132 INFO:tasks.workunit.client.0.smithi082.stdout:6/599: dread - d2/d75/fbe zero size 2024-04-27T07:33:27.133 INFO:tasks.workunit.client.1.smithi100.stdout:8/145: dwrite d6/f8 [0,4194304] 0 2024-04-27T07:33:27.134 INFO:tasks.workunit.client.0.smithi082.stdout:2/654: mknod d7/d31/d54/cd3 0 2024-04-27T07:33:27.134 INFO:tasks.workunit.client.1.smithi100.stdout:5/145: dread d0/d4/f7 [0,4194304] 0 2024-04-27T07:33:27.135 INFO:tasks.workunit.client.1.smithi100.stdout:7/83: rename d1/dd/f11 to d1/f15 0 2024-04-27T07:33:27.135 INFO:tasks.workunit.client.1.smithi100.stdout:4/158: dwrite d5/f10 [0,4194304] 0 2024-04-27T07:33:27.136 INFO:tasks.workunit.client.1.smithi100.stdout:6/86: dread de/f1f [0,4194304] 0 2024-04-27T07:33:27.137 INFO:tasks.workunit.client.0.smithi082.stdout:4/751: creat d3/d6/d22/ff9 x:0 0 0 2024-04-27T07:33:27.139 INFO:tasks.workunit.client.1.smithi100.stdout:2/162: mknod d0/da/c37 0 2024-04-27T07:33:27.139 INFO:tasks.workunit.client.1.smithi100.stdout:8/146: truncate d6/d1b/f2d 511811 0 2024-04-27T07:33:27.143 INFO:tasks.workunit.client.0.smithi082.stdout:1/623: mknod d4/d15/d49/dab/dc3/d4c/d7a/cda 0 2024-04-27T07:33:27.145 INFO:tasks.workunit.client.1.smithi100.stdout:7/84: mkdir d1/dd/d16 0 2024-04-27T07:33:27.146 INFO:tasks.workunit.client.1.smithi100.stdout:7/85: chown d1/l4 26717595 1 2024-04-27T07:33:27.146 INFO:tasks.workunit.client.0.smithi082.stdout:6/600: creat d2/d1e/d32/d85/d97/fc8 x:0 0 0 2024-04-27T07:33:27.147 INFO:tasks.workunit.client.1.smithi100.stdout:7/86: truncate d1/fc 4230704 0 2024-04-27T07:33:27.147 INFO:tasks.workunit.client.1.smithi100.stdout:6/87: mkdir de/d18/d21 0 2024-04-27T07:33:27.148 INFO:tasks.workunit.client.0.smithi082.stdout:2/655: unlink d7/d30/d23/l2e 0 2024-04-27T07:33:27.149 INFO:tasks.workunit.client.0.smithi082.stdout:2/656: chown d7/d31/d54/cd3 32841 1 2024-04-27T07:33:27.149 INFO:tasks.workunit.client.1.smithi100.stdout:4/159: creat d5/d16/d19/f30 x:0 0 0 2024-04-27T07:33:27.150 INFO:tasks.workunit.client.0.smithi082.stdout:4/752: rmdir d3/dab 39 2024-04-27T07:33:27.154 INFO:tasks.workunit.client.1.smithi100.stdout:5/146: mknod d0/c2d 0 2024-04-27T07:33:27.154 INFO:tasks.workunit.client.0.smithi082.stdout:6/601: dwrite d2/d3/d1b/fc0 [0,4194304] 0 2024-04-27T07:33:27.154 INFO:tasks.workunit.client.0.smithi082.stdout:9/578: rename d9/da/d32 to d9/da/dc/d35/d38/dc5 0 2024-04-27T07:33:27.156 INFO:tasks.workunit.client.1.smithi100.stdout:4/160: dwrite d5/f10 [0,4194304] 0 2024-04-27T07:33:27.156 INFO:tasks.workunit.client.1.smithi100.stdout:2/163: mknod d0/c38 0 2024-04-27T07:33:27.158 INFO:tasks.workunit.client.1.smithi100.stdout:4/161: read - d5/d23/f25 zero size 2024-04-27T07:33:27.159 INFO:tasks.workunit.client.0.smithi082.stdout:2/657: creat d7/d8/d99/fd4 x:0 0 0 2024-04-27T07:33:27.159 INFO:tasks.workunit.client.1.smithi100.stdout:4/162: readlink d5/d16/d19/l1a 0 2024-04-27T07:33:27.163 INFO:tasks.workunit.client.0.smithi082.stdout:9/579: fdatasync d9/da/dc/d35/d38/dc5/f39 0 2024-04-27T07:33:27.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/580: read - d9/d2d/d72/f9c zero size 2024-04-27T07:33:27.165 INFO:tasks.workunit.client.0.smithi082.stdout:9/581: fsync d9/da/f64 0 2024-04-27T07:33:27.166 INFO:tasks.workunit.client.0.smithi082.stdout:6/602: rename d2/d81/ca7 to d2/d1e/d32/d7d/cc9 0 2024-04-27T07:33:27.167 INFO:tasks.workunit.client.0.smithi082.stdout:9/582: write d9/da/dc/d35/d4b/f74 [990363,79611] 0 2024-04-27T07:33:27.168 INFO:tasks.workunit.client.0.smithi082.stdout:1/624: mkdir d4/d15/ddb 0 2024-04-27T07:33:27.170 INFO:tasks.workunit.client.0.smithi082.stdout:4/753: creat d3/d6/d16/d98/de4/ffa x:0 0 0 2024-04-27T07:33:27.170 INFO:tasks.workunit.client.0.smithi082.stdout:9/583: write d9/d2d/d2b/d46/d5d/d6f/f86 [482929,130917] 0 2024-04-27T07:33:27.172 INFO:tasks.workunit.client.0.smithi082.stdout:0/708: write da/f6c [912232,26456] 0 2024-04-27T07:33:27.179 INFO:tasks.workunit.client.0.smithi082.stdout:4/754: fsync d3/d6/d22/f9a 0 2024-04-27T07:33:27.180 INFO:tasks.workunit.client.0.smithi082.stdout:9/584: creat d9/da/dc/d35/d38/da5/fc6 x:0 0 0 2024-04-27T07:33:27.181 INFO:tasks.workunit.client.0.smithi082.stdout:4/755: stat d3/d6/d26/df2 0 2024-04-27T07:33:27.182 INFO:tasks.workunit.client.0.smithi082.stdout:0/709: rename da/df5 to da/d3c/d3f/d4c/d95/de9/def/d81/de3/d101 0 2024-04-27T07:33:27.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/603: dwrite d2/d3/da8/faf [0,4194304] 0 2024-04-27T07:33:27.185 INFO:tasks.workunit.client.0.smithi082.stdout:7/629: dwrite d3/d49/d97/d7d/da1/fbd [0,4194304] 0 2024-04-27T07:33:27.190 INFO:tasks.workunit.client.1.smithi100.stdout:8/147: truncate d6/f10 3944641 0 2024-04-27T07:33:27.192 INFO:tasks.workunit.client.1.smithi100.stdout:1/255: write d0/d1b/f2f [3786066,56323] 0 2024-04-27T07:33:27.195 INFO:tasks.workunit.client.1.smithi100.stdout:6/88: write de/f17 [803283,71933] 0 2024-04-27T07:33:27.195 INFO:tasks.workunit.client.0.smithi082.stdout:2/658: creat d7/d30/d61/fd5 x:0 0 0 2024-04-27T07:33:27.195 INFO:tasks.workunit.client.1.smithi100.stdout:1/256: read d0/d1b/f2f [2472195,86388] 0 2024-04-27T07:33:27.198 INFO:tasks.workunit.client.1.smithi100.stdout:1/257: chown d0/fd 3842 1 2024-04-27T07:33:27.199 INFO:tasks.workunit.client.0.smithi082.stdout:0/710: creat da/d3c/d3f/d57/dcc/f102 x:0 0 0 2024-04-27T07:33:27.200 INFO:tasks.workunit.client.1.smithi100.stdout:6/89: dread de/f11 [0,4194304] 0 2024-04-27T07:33:27.201 INFO:tasks.workunit.client.0.smithi082.stdout:7/630: creat d3/d49/d97/d3a/d71/da0/fd6 x:0 0 0 2024-04-27T07:33:27.201 INFO:tasks.workunit.client.1.smithi100.stdout:4/163: dwrite d5/f8 [0,4194304] 0 2024-04-27T07:33:27.201 INFO:tasks.workunit.client.0.smithi082.stdout:5/771: dwrite d8/d3c/fb2 [0,4194304] 0 2024-04-27T07:33:27.202 INFO:tasks.workunit.client.1.smithi100.stdout:6/90: readlink de/l13 0 2024-04-27T07:33:27.202 INFO:tasks.workunit.client.0.smithi082.stdout:9/585: dwrite d9/d2d/d72/f8a [0,4194304] 0 2024-04-27T07:33:27.203 INFO:tasks.workunit.client.1.smithi100.stdout:5/147: truncate d0/f10 760535 0 2024-04-27T07:33:27.207 INFO:tasks.workunit.client.1.smithi100.stdout:3/82: dwrite d7/f18 [0,4194304] 0 2024-04-27T07:33:27.209 INFO:tasks.workunit.client.0.smithi082.stdout:7/631: readlink d3/d49/d97/d7d/da1/da3/la4 0 2024-04-27T07:33:27.209 INFO:tasks.workunit.client.1.smithi100.stdout:2/164: getdents d0/d1e 0 2024-04-27T07:33:27.209 INFO:tasks.workunit.client.1.smithi100.stdout:4/164: symlink d5/d16/d19/l31 0 2024-04-27T07:33:27.210 INFO:tasks.workunit.client.1.smithi100.stdout:1/258: rmdir d0/d1b/d20/d2d 39 2024-04-27T07:33:27.211 INFO:tasks.workunit.client.0.smithi082.stdout:9/586: creat d9/da/dc/d35/d38/d65/fc7 x:0 0 0 2024-04-27T07:33:27.213 INFO:tasks.workunit.client.1.smithi100.stdout:5/148: creat d0/d4/d21/f2e x:0 0 0 2024-04-27T07:33:27.213 INFO:tasks.workunit.client.1.smithi100.stdout:6/91: creat de/d18/f22 x:0 0 0 2024-04-27T07:33:27.214 INFO:tasks.workunit.client.0.smithi082.stdout:1/625: truncate d4/f86 644184 0 2024-04-27T07:33:27.215 INFO:tasks.workunit.client.1.smithi100.stdout:6/92: write de/f12 [1048212,84941] 0 2024-04-27T07:33:27.216 INFO:tasks.workunit.client.0.smithi082.stdout:4/756: dread d3/d6/d26/d5e/d21/fdb [0,4194304] 0 2024-04-27T07:33:27.219 INFO:tasks.workunit.client.0.smithi082.stdout:5/772: symlink d8/d15/l108 0 2024-04-27T07:33:27.220 INFO:tasks.workunit.client.1.smithi100.stdout:8/148: getdents d6/d1b/d1d 0 2024-04-27T07:33:27.221 INFO:tasks.workunit.client.1.smithi100.stdout:4/165: creat d5/f32 x:0 0 0 2024-04-27T07:33:27.222 INFO:tasks.workunit.client.1.smithi100.stdout:3/83: mknod d7/d17/c1b 0 2024-04-27T07:33:27.223 INFO:tasks.workunit.client.1.smithi100.stdout:5/149: write d0/d4/f11 [1587651,54520] 0 2024-04-27T07:33:27.224 INFO:tasks.workunit.client.1.smithi100.stdout:2/165: dwrite d0/da/fd [0,4194304] 0 2024-04-27T07:33:27.224 INFO:tasks.workunit.client.0.smithi082.stdout:9/587: creat d9/da/d85/fc8 x:0 0 0 2024-04-27T07:33:27.226 INFO:tasks.workunit.client.0.smithi082.stdout:3/935: sync 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:8/149: creat d6/f31 x:0 0 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:2/166: write d0/d1e/ff [268675,119724] 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:3/84: chown d7/d9/d10/f15 139620611 1 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:6/93: mkdir de/d18/d21/d23 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:4/166: mkdir d5/d23/d33 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:1/259: dwrite d0/d23/f29 [4194304,4194304] 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:2/167: stat d0/c38 0 2024-04-27T07:33:27.231 INFO:tasks.workunit.client.1.smithi100.stdout:5/150: fsync d0/d4/f7 0 2024-04-27T07:33:27.232 INFO:tasks.workunit.client.0.smithi082.stdout:2/659: truncate d7/f3c 3065058 0 2024-04-27T07:33:27.233 INFO:tasks.workunit.client.1.smithi100.stdout:3/85: creat d7/f1c x:0 0 0 2024-04-27T07:33:27.234 INFO:tasks.workunit.client.1.smithi100.stdout:2/168: fsync d0/f7 0 2024-04-27T07:33:27.235 INFO:tasks.workunit.client.1.smithi100.stdout:3/86: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:27.235 INFO:tasks.workunit.client.1.smithi100.stdout:3/87: dread - d7/f1c zero size 2024-04-27T07:33:27.236 INFO:tasks.workunit.client.1.smithi100.stdout:4/167: symlink d5/d16/d19/l34 0 2024-04-27T07:33:27.237 INFO:tasks.workunit.client.0.smithi082.stdout:7/632: creat d3/d9/d4f/d9a/fd7 x:0 0 0 2024-04-27T07:33:27.237 INFO:tasks.workunit.client.1.smithi100.stdout:5/151: mkdir d0/d4/d21/d24/d2f 0 2024-04-27T07:33:27.238 INFO:tasks.workunit.client.1.smithi100.stdout:5/152: write d0/d4/d21/f26 [925301,15382] 0 2024-04-27T07:33:27.243 INFO:tasks.workunit.client.0.smithi082.stdout:9/588: write d9/da/dc/d35/d4a/d7e/f9b [1623874,106777] 0 2024-04-27T07:33:27.244 INFO:tasks.workunit.client.1.smithi100.stdout:5/153: mkdir d0/d4/d17/d1a/d30 0 2024-04-27T07:33:27.245 INFO:tasks.workunit.client.1.smithi100.stdout:4/168: symlink d5/d16/d2e/l35 0 2024-04-27T07:33:27.245 INFO:tasks.workunit.client.0.smithi082.stdout:0/711: getdents da/d3c/d3f/d57/dcc/da8 0 2024-04-27T07:33:27.245 INFO:tasks.workunit.client.0.smithi082.stdout:6/604: dread d2/d1e/d32/f4e [0,4194304] 0 2024-04-27T07:33:27.249 INFO:tasks.workunit.client.0.smithi082.stdout:2/660: dwrite d7/d9/d4f/d6e/d82/dc6/f98 [0,4194304] 0 2024-04-27T07:33:27.250 INFO:tasks.workunit.client.1.smithi100.stdout:6/94: dread de/f12 [0,4194304] 0 2024-04-27T07:33:27.250 INFO:tasks.workunit.client.0.smithi082.stdout:9/589: chown d9/d2d/d2b/d46/d5d/d6f/f86 2631883 1 2024-04-27T07:33:27.250 INFO:tasks.workunit.client.0.smithi082.stdout:6/605: fdatasync d2/de/d77/fb0 0 2024-04-27T07:33:27.252 INFO:tasks.workunit.client.0.smithi082.stdout:7/633: rename d3/l96 to d3/db/dc1/ld8 0 2024-04-27T07:33:27.252 INFO:tasks.workunit.client.1.smithi100.stdout:6/95: mkdir de/d18/d21/d24 0 2024-04-27T07:33:27.252 INFO:tasks.workunit.client.1.smithi100.stdout:8/150: fsync d6/f31 0 2024-04-27T07:33:27.253 INFO:tasks.workunit.client.1.smithi100.stdout:8/151: dread - d6/f1e zero size 2024-04-27T07:33:27.253 INFO:tasks.workunit.client.0.smithi082.stdout:4/757: creat d3/d6/d16/ffb x:0 0 0 2024-04-27T07:33:27.254 INFO:tasks.workunit.client.0.smithi082.stdout:1/626: link d4/d15/d49/dab/dc3/d3e/c75 d4/d15/d3f/d6d/d93/cdc 0 2024-04-27T07:33:27.256 INFO:tasks.workunit.client.0.smithi082.stdout:7/634: dread - d3/d49/d97/d3a/d2a/f88 zero size 2024-04-27T07:33:27.260 INFO:tasks.workunit.client.1.smithi100.stdout:6/96: link f7 de/d18/d21/d24/f25 0 2024-04-27T07:33:27.260 INFO:tasks.workunit.client.0.smithi082.stdout:7/635: read d3/d49/d97/d7d/da1/fbd [2793253,115103] 0 2024-04-27T07:33:27.260 INFO:tasks.workunit.client.0.smithi082.stdout:4/758: creat d3/d6/d26/d55/ffc x:0 0 0 2024-04-27T07:33:27.261 INFO:tasks.workunit.client.1.smithi100.stdout:4/169: dread d5/fc [4194304,4194304] 0 2024-04-27T07:33:27.261 INFO:tasks.workunit.client.1.smithi100.stdout:8/152: link d6/f31 d6/d1b/d1d/f32 0 2024-04-27T07:33:27.261 INFO:tasks.workunit.client.1.smithi100.stdout:8/153: dread - d6/f31 zero size 2024-04-27T07:33:27.262 INFO:tasks.workunit.client.0.smithi082.stdout:2/661: fsync d7/d8/d13/d94/fad 0 2024-04-27T07:33:27.262 INFO:tasks.workunit.client.0.smithi082.stdout:1/627: mknod d4/d15/da7/cdd 0 2024-04-27T07:33:27.263 INFO:tasks.workunit.client.1.smithi100.stdout:3/88: rmdir d7 39 2024-04-27T07:33:27.263 INFO:tasks.workunit.client.0.smithi082.stdout:6/606: dwrite d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:27.266 INFO:tasks.workunit.client.0.smithi082.stdout:0/712: creat da/d38/d7f/d4a/f103 x:0 0 0 2024-04-27T07:33:27.266 INFO:tasks.workunit.client.0.smithi082.stdout:9/590: creat d9/da/dc/d35/d38/fc9 x:0 0 0 2024-04-27T07:33:27.268 INFO:tasks.workunit.client.1.smithi100.stdout:4/170: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:27.268 INFO:tasks.workunit.client.0.smithi082.stdout:1/628: chown d4/d15/d49/dab/dc3/d4c/f92 524870712 1 2024-04-27T07:33:27.270 INFO:tasks.workunit.client.1.smithi100.stdout:6/97: dwrite de/f10 [0,4194304] 0 2024-04-27T07:33:27.271 INFO:tasks.workunit.client.1.smithi100.stdout:1/260: dread d0/f18 [0,4194304] 0 2024-04-27T07:33:27.272 INFO:tasks.workunit.client.1.smithi100.stdout:3/89: rmdir d7/d9 39 2024-04-27T07:33:27.274 INFO:tasks.workunit.client.0.smithi082.stdout:6/607: unlink d2/d1e/d32/l37 0 2024-04-27T07:33:27.274 INFO:tasks.workunit.client.1.smithi100.stdout:4/171: read d5/f15 [995891,45714] 0 2024-04-27T07:33:27.275 INFO:tasks.workunit.client.0.smithi082.stdout:3/936: truncate d8/d9/d1f/f94 1672914 0 2024-04-27T07:33:27.275 INFO:tasks.workunit.client.1.smithi100.stdout:6/98: creat de/d18/d21/f26 x:0 0 0 2024-04-27T07:33:27.276 INFO:tasks.workunit.client.0.smithi082.stdout:1/629: dwrite d4/d15/d49/dab/dc3/d4c/f92 [0,4194304] 0 2024-04-27T07:33:27.277 INFO:tasks.workunit.client.1.smithi100.stdout:2/169: truncate d0/d1e/ff 35670 0 2024-04-27T07:33:27.278 INFO:tasks.workunit.client.1.smithi100.stdout:4/172: dread - d5/d16/f26 zero size 2024-04-27T07:33:27.279 INFO:tasks.workunit.client.1.smithi100.stdout:4/173: chown d5/f32 394043952 1 2024-04-27T07:33:27.279 INFO:tasks.workunit.client.0.smithi082.stdout:1/630: stat d4/d15/d49/dab/dc3/d4c/cd0 0 2024-04-27T07:33:27.280 INFO:tasks.workunit.client.1.smithi100.stdout:1/261: chown d0/c5 902 1 2024-04-27T07:33:27.280 INFO:tasks.workunit.client.1.smithi100.stdout:3/90: chown d7/d9/d10/f11 1759 1 2024-04-27T07:33:27.281 INFO:tasks.workunit.client.1.smithi100.stdout:3/91: fsync d7/d9/d10/f11 0 2024-04-27T07:33:27.281 INFO:tasks.workunit.client.1.smithi100.stdout:4/174: symlink d5/d23/l36 0 2024-04-27T07:33:27.282 INFO:tasks.workunit.client.1.smithi100.stdout:6/99: creat de/d18/d21/d24/f27 x:0 0 0 2024-04-27T07:33:27.283 INFO:tasks.workunit.client.0.smithi082.stdout:6/608: dread d2/d1e/d32/f4e [0,4194304] 0 2024-04-27T07:33:27.283 INFO:tasks.workunit.client.0.smithi082.stdout:9/591: unlink d9/da/fb4 0 2024-04-27T07:33:27.283 INFO:tasks.workunit.client.1.smithi100.stdout:1/262: mknod d0/d23/d3a/c48 0 2024-04-27T07:33:27.283 INFO:tasks.workunit.client.1.smithi100.stdout:6/100: read de/f12 [18139,62644] 0 2024-04-27T07:33:27.284 INFO:tasks.workunit.client.1.smithi100.stdout:2/170: mkdir d0/da/d39 0 2024-04-27T07:33:27.285 INFO:tasks.workunit.client.1.smithi100.stdout:2/171: write d0/da/d29/d26/f2a [802419,41116] 0 2024-04-27T07:33:27.286 INFO:tasks.workunit.client.0.smithi082.stdout:0/713: mkdir da/d38/d7f/d4a/d80/da0/d104 0 2024-04-27T07:33:27.286 INFO:tasks.workunit.client.1.smithi100.stdout:2/172: dread - d0/d1e/f27 zero size 2024-04-27T07:33:27.287 INFO:tasks.workunit.client.1.smithi100.stdout:3/92: symlink d7/d17/l1d 0 2024-04-27T07:33:27.288 INFO:tasks.workunit.client.0.smithi082.stdout:3/937: rmdir d8/d9/dd/d11e 39 2024-04-27T07:33:27.290 INFO:tasks.workunit.client.1.smithi100.stdout:0/136: sync 2024-04-27T07:33:27.290 INFO:tasks.workunit.client.1.smithi100.stdout:9/147: sync 2024-04-27T07:33:27.290 INFO:tasks.workunit.client.1.smithi100.stdout:6/101: fdatasync f6 0 2024-04-27T07:33:27.291 INFO:tasks.workunit.client.1.smithi100.stdout:0/137: chown d1/d8/d14/f17 1 1 2024-04-27T07:33:27.292 INFO:tasks.workunit.client.0.smithi082.stdout:1/631: rename d4/d15/d49/dab/dc3/d3e/d53/fad to d4/d15/d3f/d6d/d93/fde 0 2024-04-27T07:33:27.293 INFO:tasks.workunit.client.0.smithi082.stdout:0/714: rmdir da/d3c/d3f/d4c/d95/de9/def/d81/de3/d101 39 2024-04-27T07:33:27.294 INFO:tasks.workunit.client.1.smithi100.stdout:4/175: mknod d5/d23/d33/c37 0 2024-04-27T07:33:27.295 INFO:tasks.workunit.client.1.smithi100.stdout:4/176: truncate d5/d23/f25 760327 0 2024-04-27T07:33:27.295 INFO:tasks.workunit.client.0.smithi082.stdout:0/715: write da/d3c/d3f/d57/dcc/da8/fb2 [3807896,119072] 0 2024-04-27T07:33:27.295 INFO:tasks.workunit.client.1.smithi100.stdout:3/93: unlink d7/d9/l19 0 2024-04-27T07:33:27.296 INFO:tasks.workunit.client.0.smithi082.stdout:3/938: mknod d8/d108/c147 0 2024-04-27T07:33:27.297 INFO:tasks.workunit.client.1.smithi100.stdout:0/138: dread d1/f5 [0,4194304] 0 2024-04-27T07:33:27.297 INFO:tasks.workunit.client.0.smithi082.stdout:7/636: link d3/d49/c76 d3/d49/d97/d3a/d2a/dac/cd9 0 2024-04-27T07:33:27.300 INFO:tasks.workunit.client.1.smithi100.stdout:6/102: mkdir de/d18/d28 0 2024-04-27T07:33:27.302 INFO:tasks.workunit.client.0.smithi082.stdout:6/609: rename d2/d2d/d4a/dad to d2/de/d77/dca 0 2024-04-27T07:33:27.302 INFO:tasks.workunit.client.1.smithi100.stdout:2/173: mkdir d0/da/d3a 0 2024-04-27T07:33:27.304 INFO:tasks.workunit.client.1.smithi100.stdout:8/154: truncate f4 4350524 0 2024-04-27T07:33:27.305 INFO:tasks.workunit.client.0.smithi082.stdout:0/716: dwrite da/d3c/d3f/f41 [4194304,4194304] 0 2024-04-27T07:33:27.306 INFO:tasks.workunit.client.1.smithi100.stdout:6/103: dread f6 [0,4194304] 0 2024-04-27T07:33:27.306 INFO:tasks.workunit.client.1.smithi100.stdout:1/263: mknod d0/d1b/d20/d2d/c49 0 2024-04-27T07:33:27.306 INFO:tasks.workunit.client.1.smithi100.stdout:9/148: dwrite d1/d9/d1f/f27 [0,4194304] 0 2024-04-27T07:33:27.307 INFO:tasks.workunit.client.0.smithi082.stdout:2/662: write d7/f87 [3766802,37837] 0 2024-04-27T07:33:27.309 INFO:tasks.workunit.client.0.smithi082.stdout:2/663: write d7/d31/d54/fbd [210224,61389] 0 2024-04-27T07:33:27.310 INFO:tasks.workunit.client.1.smithi100.stdout:3/94: dwrite d7/f18 [0,4194304] 0 2024-04-27T07:33:27.311 INFO:tasks.workunit.client.1.smithi100.stdout:4/177: creat d5/d16/d2e/f38 x:0 0 0 2024-04-27T07:33:27.312 INFO:tasks.workunit.client.1.smithi100.stdout:9/149: chown d1/d9/f1b 43405706 1 2024-04-27T07:33:27.313 INFO:tasks.workunit.client.1.smithi100.stdout:0/139: symlink d1/d8/d14/l32 0 2024-04-27T07:33:27.314 INFO:tasks.workunit.client.0.smithi082.stdout:4/759: getdents d3/d81 0 2024-04-27T07:33:27.314 INFO:tasks.workunit.client.1.smithi100.stdout:0/140: chown d1/l12 0 1 2024-04-27T07:33:27.316 INFO:tasks.workunit.client.0.smithi082.stdout:6/610: creat d2/d45/dc2/fcb x:0 0 0 2024-04-27T07:33:27.317 INFO:tasks.workunit.client.0.smithi082.stdout:7/637: mkdir d3/d9/dda 0 2024-04-27T07:33:27.318 INFO:tasks.workunit.client.0.smithi082.stdout:7/638: chown d3/d49/d97/d3a/d2a/l40 14 1 2024-04-27T07:33:27.319 INFO:tasks.workunit.client.1.smithi100.stdout:8/155: rmdir d6 39 2024-04-27T07:33:27.319 INFO:tasks.workunit.client.0.smithi082.stdout:0/717: mkdir da/d3c/d3f/d4c/d105 0 2024-04-27T07:33:27.320 INFO:tasks.workunit.client.1.smithi100.stdout:4/178: mknod d5/c39 0 2024-04-27T07:33:27.321 INFO:tasks.workunit.client.0.smithi082.stdout:2/664: mkdir d7/d9/d4f/d66/dd6 0 2024-04-27T07:33:27.321 INFO:tasks.workunit.client.1.smithi100.stdout:3/95: mknod d7/d17/c1e 0 2024-04-27T07:33:27.323 INFO:tasks.workunit.client.1.smithi100.stdout:6/104: creat de/d18/f29 x:0 0 0 2024-04-27T07:33:27.324 INFO:tasks.workunit.client.1.smithi100.stdout:6/105: chown de/c19 0 1 2024-04-27T07:33:27.324 INFO:tasks.workunit.client.0.smithi082.stdout:3/939: link d8/d9/dd/d13/d1b/dbd/d8e/f113 d8/d9/d25/d26/d4d/f148 0 2024-04-27T07:33:27.326 INFO:tasks.workunit.client.0.smithi082.stdout:6/611: dwrite d2/f60 [0,4194304] 0 2024-04-27T07:33:27.327 INFO:tasks.workunit.client.1.smithi100.stdout:0/141: rename d1/d8/d14/f19 to d1/d30/f33 0 2024-04-27T07:33:27.328 INFO:tasks.workunit.client.0.smithi082.stdout:2/665: chown d7/l6c 80686511 1 2024-04-27T07:33:27.329 INFO:tasks.workunit.client.0.smithi082.stdout:2/666: fsync d7/d9/f18 0 2024-04-27T07:33:27.329 INFO:tasks.workunit.client.0.smithi082.stdout:0/718: fdatasync da/d28/d36/d40/f90 0 2024-04-27T07:33:27.330 INFO:tasks.workunit.client.1.smithi100.stdout:1/264: symlink d0/d1f/d27/d40/l4a 0 2024-04-27T07:33:27.332 INFO:tasks.workunit.client.0.smithi082.stdout:9/592: rename d9/da/dc/d35/d38/da5/f99 to d9/da/dc/d35/d4a/fca 0 2024-04-27T07:33:27.332 INFO:tasks.workunit.client.1.smithi100.stdout:4/179: write d5/f9 [2670858,30429] 0 2024-04-27T07:33:27.334 INFO:tasks.workunit.client.0.smithi082.stdout:4/760: symlink d3/d9/lfd 0 2024-04-27T07:33:27.335 INFO:tasks.workunit.client.0.smithi082.stdout:7/639: creat d3/d9/dda/fdb x:0 0 0 2024-04-27T07:33:27.337 INFO:tasks.workunit.client.1.smithi100.stdout:6/106: dwrite de/d18/f1a [0,4194304] 0 2024-04-27T07:33:27.338 INFO:tasks.workunit.client.1.smithi100.stdout:1/265: truncate d0/d1b/f3e 538892 0 2024-04-27T07:33:27.340 INFO:tasks.workunit.client.1.smithi100.stdout:1/266: fdatasync d0/f16 0 2024-04-27T07:33:27.341 INFO:tasks.workunit.client.0.smithi082.stdout:0/719: creat da/d3c/d3f/d57/dcc/f106 x:0 0 0 2024-04-27T07:33:27.343 INFO:tasks.workunit.client.0.smithi082.stdout:2/667: creat d7/d9/d4f/d6e/fd7 x:0 0 0 2024-04-27T07:33:27.344 INFO:tasks.workunit.client.0.smithi082.stdout:2/668: dread - d7/d8/d99/fd4 zero size 2024-04-27T07:33:27.345 INFO:tasks.workunit.client.1.smithi100.stdout:6/107: symlink de/d18/d21/l2a 0 2024-04-27T07:33:27.347 INFO:tasks.workunit.client.0.smithi082.stdout:1/632: rename d4/d15/d49/d99/d9a/fa3 to d4/d15/d1c/fdf 0 2024-04-27T07:33:27.348 INFO:tasks.workunit.client.0.smithi082.stdout:8/623: sync 2024-04-27T07:33:27.349 INFO:tasks.workunit.client.1.smithi100.stdout:1/267: unlink d0/d23/f30 0 2024-04-27T07:33:27.349 INFO:tasks.workunit.client.0.smithi082.stdout:8/624: dread - d0/d3/d1b/fa6 zero size 2024-04-27T07:33:27.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/593: truncate d9/f4c 1171885 0 2024-04-27T07:33:27.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/640: mkdir d3/d49/d97/d6c/ddc 0 2024-04-27T07:33:27.351 INFO:tasks.workunit.client.1.smithi100.stdout:0/142: link d1/l12 d1/d8/d20/d1e/l34 0 2024-04-27T07:33:27.351 INFO:tasks.workunit.client.1.smithi100.stdout:8/156: creat d6/d20/f33 x:0 0 0 2024-04-27T07:33:27.352 INFO:tasks.workunit.client.1.smithi100.stdout:3/96: getdents d7/d9 0 2024-04-27T07:33:27.354 INFO:tasks.workunit.client.1.smithi100.stdout:2/174: dwrite d0/f11 [0,4194304] 0 2024-04-27T07:33:27.356 INFO:tasks.workunit.client.1.smithi100.stdout:6/108: dwrite de/f17 [0,4194304] 0 2024-04-27T07:33:27.359 INFO:tasks.workunit.client.1.smithi100.stdout:8/157: creat d6/d1b/f34 x:0 0 0 2024-04-27T07:33:27.360 INFO:tasks.workunit.client.1.smithi100.stdout:0/143: write d1/d8/d14/f17 [2874204,104418] 0 2024-04-27T07:33:27.362 INFO:tasks.workunit.client.1.smithi100.stdout:1/268: dread d0/f18 [0,4194304] 0 2024-04-27T07:33:27.363 INFO:tasks.workunit.client.1.smithi100.stdout:2/175: read d0/da/d29/d26/f2a [213246,89998] 0 2024-04-27T07:33:27.363 INFO:tasks.workunit.client.1.smithi100.stdout:1/269: write d0/d23/f29 [2402815,70300] 0 2024-04-27T07:33:27.364 INFO:tasks.workunit.client.0.smithi082.stdout:8/625: dread d0/d3/d1b/d29/d6a/f6b [0,4194304] 0 2024-04-27T07:33:27.365 INFO:tasks.workunit.client.1.smithi100.stdout:2/176: stat d0/da/d29/c2f 0 2024-04-27T07:33:27.365 INFO:tasks.workunit.client.1.smithi100.stdout:3/97: creat d7/f1f x:0 0 0 2024-04-27T07:33:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:8/626: fsync d0/d2b/d80/fb9 0 2024-04-27T07:33:27.367 INFO:tasks.workunit.client.1.smithi100.stdout:9/150: fsync d1/d9/db/d2b/f34 0 2024-04-27T07:33:27.367 INFO:tasks.workunit.client.1.smithi100.stdout:9/151: dread - d1/d9/f21 zero size 2024-04-27T07:33:27.368 INFO:tasks.workunit.client.0.smithi082.stdout:8/627: truncate d0/d3/d1c/d76/da0/fcc 181115 0 2024-04-27T07:33:27.369 INFO:tasks.workunit.client.1.smithi100.stdout:9/152: dread - d1/f2c zero size 2024-04-27T07:33:27.369 INFO:tasks.workunit.client.0.smithi082.stdout:8/628: readlink d0/l66 0 2024-04-27T07:33:27.369 INFO:tasks.workunit.client.0.smithi082.stdout:6/612: rename d2/de to d2/d75/d7a/dcc 0 2024-04-27T07:33:27.369 INFO:tasks.workunit.client.0.smithi082.stdout:8/629: fsync d0/d3/f1d 0 2024-04-27T07:33:27.370 INFO:tasks.workunit.client.1.smithi100.stdout:0/144: symlink d1/l35 0 2024-04-27T07:33:27.370 INFO:tasks.workunit.client.0.smithi082.stdout:8/630: fdatasync d0/d2b/d9a/da4/fb8 0 2024-04-27T07:33:27.371 INFO:tasks.workunit.client.0.smithi082.stdout:4/761: symlink d3/d6/d22/lfe 0 2024-04-27T07:33:27.371 INFO:tasks.workunit.client.1.smithi100.stdout:0/145: dread - d1/d8/d20/f2b zero size 2024-04-27T07:33:27.372 INFO:tasks.workunit.client.1.smithi100.stdout:3/98: creat d7/d17/f20 x:0 0 0 2024-04-27T07:33:27.373 INFO:tasks.workunit.client.0.smithi082.stdout:1/633: symlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/le0 0 2024-04-27T07:33:27.373 INFO:tasks.workunit.client.0.smithi082.stdout:1/634: chown d4/d15/l2e 99121220 1 2024-04-27T07:33:27.374 INFO:tasks.workunit.client.1.smithi100.stdout:2/177: creat d0/d1e/f3b x:0 0 0 2024-04-27T07:33:27.376 INFO:tasks.workunit.client.0.smithi082.stdout:3/940: getdents d8/d9/d25/d26/d4d 0 2024-04-27T07:33:27.377 INFO:tasks.workunit.client.1.smithi100.stdout:1/270: rename d0/d1f/c31 to d0/d1f/d27/d40/c4b 0 2024-04-27T07:33:27.377 INFO:tasks.workunit.client.0.smithi082.stdout:7/641: mknod d3/db/dc1/cdd 0 2024-04-27T07:33:27.379 INFO:tasks.workunit.client.1.smithi100.stdout:1/271: read d0/d1f/f2b [82107,71428] 0 2024-04-27T07:33:27.379 INFO:tasks.workunit.client.1.smithi100.stdout:8/158: fsync d6/f17 0 2024-04-27T07:33:27.380 INFO:tasks.workunit.client.1.smithi100.stdout:1/272: truncate d0/d1b/d20/f38 995083 0 2024-04-27T07:33:27.381 INFO:tasks.workunit.client.1.smithi100.stdout:9/153: creat d1/d9/db/d2b/f37 x:0 0 0 2024-04-27T07:33:27.381 INFO:tasks.workunit.client.1.smithi100.stdout:4/180: truncate d5/d16/d19/d21/d2b/f2d 1387226 0 2024-04-27T07:33:27.382 INFO:tasks.workunit.client.1.smithi100.stdout:9/154: write d1/d9/db/f2e [150598,93765] 0 2024-04-27T07:33:27.383 INFO:tasks.workunit.client.1.smithi100.stdout:3/99: creat d7/d9/f21 x:0 0 0 2024-04-27T07:33:27.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/720: dread da/f6c [0,4194304] 0 2024-04-27T07:33:27.384 INFO:tasks.workunit.client.1.smithi100.stdout:9/155: chown d1/d9/db/f2e 41964 1 2024-04-27T07:33:27.384 INFO:tasks.workunit.client.1.smithi100.stdout:2/178: creat d0/da/d29/f3c x:0 0 0 2024-04-27T07:33:27.385 INFO:tasks.workunit.client.1.smithi100.stdout:2/179: fdatasync d0/da/d29/f3c 0 2024-04-27T07:33:27.386 INFO:tasks.workunit.client.0.smithi082.stdout:8/631: readlink d0/d3/d87/d42/d7f/l9c 0 2024-04-27T07:33:27.386 INFO:tasks.workunit.client.1.smithi100.stdout:9/156: write d1/f13 [814560,79737] 0 2024-04-27T07:33:27.387 INFO:tasks.workunit.client.1.smithi100.stdout:9/157: stat d1/d9/f25 0 2024-04-27T07:33:27.387 INFO:tasks.workunit.client.1.smithi100.stdout:8/159: rename d6/f1e to d6/f35 0 2024-04-27T07:33:27.387 INFO:tasks.workunit.client.1.smithi100.stdout:9/158: readlink d1/d9/db/l17 0 2024-04-27T07:33:27.388 INFO:tasks.workunit.client.0.smithi082.stdout:9/594: getdents d9/da/db0 0 2024-04-27T07:33:27.388 INFO:tasks.workunit.client.0.smithi082.stdout:7/642: dwrite d3/d49/d97/d3a/d2a/f81 [0,4194304] 0 2024-04-27T07:33:27.389 INFO:tasks.workunit.client.0.smithi082.stdout:8/632: write d0/d3/d1c/d76/da0/fb3 [233815,15023] 0 2024-04-27T07:33:27.390 INFO:tasks.workunit.client.0.smithi082.stdout:7/643: fsync d3/d49/d97/d3a/d71/da0/fd6 0 2024-04-27T07:33:27.392 INFO:tasks.workunit.client.1.smithi100.stdout:2/180: creat d0/da/d29/d26/f3d x:0 0 0 2024-04-27T07:33:27.394 INFO:tasks.workunit.client.1.smithi100.stdout:8/160: chown f1 148 1 2024-04-27T07:33:27.395 INFO:tasks.workunit.client.0.smithi082.stdout:6/613: fsync d2/d75/d7a/dcc/f72 0 2024-04-27T07:33:27.395 INFO:tasks.workunit.client.0.smithi082.stdout:9/595: dwrite d9/da/dc/d35/d4a/f84 [0,4194304] 0 2024-04-27T07:33:27.396 INFO:tasks.workunit.client.1.smithi100.stdout:9/159: symlink d1/d9/l38 0 2024-04-27T07:33:27.396 INFO:tasks.workunit.client.0.smithi082.stdout:6/614: dread - d2/d3/d9c/fbf zero size 2024-04-27T07:33:27.397 INFO:tasks.workunit.client.0.smithi082.stdout:9/596: dread - d9/da/d85/fc4 zero size 2024-04-27T07:33:27.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/721: rename da/d3c/fa2 to da/d1d/d6a/f107 0 2024-04-27T07:33:27.400 INFO:tasks.workunit.client.1.smithi100.stdout:8/161: symlink d6/d1b/d1d/l36 0 2024-04-27T07:33:27.401 INFO:tasks.workunit.client.0.smithi082.stdout:7/644: rmdir d3/db 39 2024-04-27T07:33:27.402 INFO:tasks.workunit.client.1.smithi100.stdout:8/162: write d6/d1b/f22 [6103,57993] 0 2024-04-27T07:33:27.402 INFO:tasks.workunit.client.1.smithi100.stdout:9/160: creat d1/d9/d1f/f39 x:0 0 0 2024-04-27T07:33:27.402 INFO:tasks.workunit.client.1.smithi100.stdout:2/181: getdents d0/da/d39 0 2024-04-27T07:33:27.406 INFO:tasks.workunit.client.1.smithi100.stdout:2/182: mkdir d0/da/d29/d26/d3e 0 2024-04-27T07:33:27.407 INFO:tasks.workunit.client.0.smithi082.stdout:0/722: chown da/d28/l78 7743 1 2024-04-27T07:33:27.408 INFO:tasks.workunit.client.1.smithi100.stdout:2/183: write d0/da/f28 [243600,20089] 0 2024-04-27T07:33:27.409 INFO:tasks.workunit.client.0.smithi082.stdout:4/762: link d3/d6/d26/f90 d3/d6/d26/df2/fff 0 2024-04-27T07:33:27.410 INFO:tasks.workunit.client.1.smithi100.stdout:9/161: link d1/d9/f25 d1/d9/d1f/f3a 0 2024-04-27T07:33:27.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/645: truncate d3/d49/d97/d3a/d2a/f72 290223 0 2024-04-27T07:33:27.411 INFO:tasks.workunit.client.1.smithi100.stdout:2/184: mknod d0/d1e/c3f 0 2024-04-27T07:33:27.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/646: chown d3/d9/f2d 333 1 2024-04-27T07:33:27.412 INFO:tasks.workunit.client.0.smithi082.stdout:1/635: getdents d4/d15/d49/d4e 0 2024-04-27T07:33:27.412 INFO:tasks.workunit.client.1.smithi100.stdout:2/185: write d0/da/d29/f3c [350128,62285] 0 2024-04-27T07:33:27.413 INFO:tasks.workunit.client.0.smithi082.stdout:0/723: creat da/d3c/d3f/d4c/d95/f108 x:0 0 0 2024-04-27T07:33:27.414 INFO:tasks.workunit.client.0.smithi082.stdout:4/763: creat d3/d6/d26/d5e/d21/f100 x:0 0 0 2024-04-27T07:33:27.415 INFO:tasks.workunit.client.1.smithi100.stdout:9/162: link d1/d9/l10 d1/d9/db/d2b/l3b 0 2024-04-27T07:33:27.415 INFO:tasks.workunit.client.0.smithi082.stdout:7/647: mknod d3/d9/d7c/cde 0 2024-04-27T07:33:27.416 INFO:tasks.workunit.client.1.smithi100.stdout:9/163: read d1/f4 [1535720,127789] 0 2024-04-27T07:33:27.417 INFO:tasks.workunit.client.0.smithi082.stdout:4/764: chown d3/d10/l23 15958005 1 2024-04-27T07:33:27.419 INFO:tasks.workunit.client.0.smithi082.stdout:7/648: rmdir d3/d49/d97/d7d/da1/da3 39 2024-04-27T07:33:27.419 INFO:tasks.workunit.client.0.smithi082.stdout:4/765: chown d3/d6/f8e 27608 1 2024-04-27T07:33:27.420 INFO:tasks.workunit.client.0.smithi082.stdout:6/615: dread d2/d1e/d32/d85/f94 [0,4194304] 0 2024-04-27T07:33:27.421 INFO:tasks.workunit.client.1.smithi100.stdout:2/186: dwrite d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:27.421 INFO:tasks.workunit.client.0.smithi082.stdout:0/724: mkdir da/d28/d109 0 2024-04-27T07:33:27.422 INFO:tasks.workunit.client.0.smithi082.stdout:3/941: truncate d8/d9/d25/d26/d4d/fc1 4032557 0 2024-04-27T07:33:27.424 INFO:tasks.workunit.client.0.smithi082.stdout:0/725: stat da/d3c/d3f/d4c/d95/de9/def/ca1 0 2024-04-27T07:33:27.425 INFO:tasks.workunit.client.0.smithi082.stdout:7/649: mkdir d3/d49/d97/d3a/d71/da0/ddf 0 2024-04-27T07:33:27.426 INFO:tasks.workunit.client.1.smithi100.stdout:9/164: dwrite d1/f14 [0,4194304] 0 2024-04-27T07:33:27.428 INFO:tasks.workunit.client.0.smithi082.stdout:6/616: creat d2/d1e/d32/d7d/d82/da0/fcd x:0 0 0 2024-04-27T07:33:27.430 INFO:tasks.workunit.client.0.smithi082.stdout:7/650: dread - d3/d49/d97/d3a/d2a/dac/d91/f98 zero size 2024-04-27T07:33:27.431 INFO:tasks.workunit.client.0.smithi082.stdout:0/726: dread da/d38/f47 [0,4194304] 0 2024-04-27T07:33:27.435 INFO:tasks.workunit.client.0.smithi082.stdout:0/727: dread - da/d3c/d3f/d4c/ffc zero size 2024-04-27T07:33:27.440 INFO:tasks.workunit.client.0.smithi082.stdout:6/617: creat d2/d2e/dae/fce x:0 0 0 2024-04-27T07:33:27.440 INFO:tasks.workunit.client.1.smithi100.stdout:3/100: mkdir d7/d9/d10/d22 0 2024-04-27T07:33:27.441 INFO:tasks.workunit.client.1.smithi100.stdout:3/101: fdatasync f5 0 2024-04-27T07:33:27.442 INFO:tasks.workunit.client.0.smithi082.stdout:7/651: rename d3/d9/d7c/l80 to d3/d49/d97/d7d/da1/db6/le0 0 2024-04-27T07:33:27.442 INFO:tasks.workunit.client.0.smithi082.stdout:6/618: readlink d2/d2d/d3d/l64 0 2024-04-27T07:33:27.442 INFO:tasks.workunit.client.0.smithi082.stdout:0/728: fdatasync da/d3c/d3f/d57/f86 0 2024-04-27T07:33:27.442 INFO:tasks.workunit.client.0.smithi082.stdout:1/636: dwrite d4/d15/d29/f47 [4194304,4194304] 0 2024-04-27T07:33:27.448 INFO:tasks.workunit.client.0.smithi082.stdout:4/766: dread d3/d9/f65 [0,4194304] 0 2024-04-27T07:33:27.449 INFO:tasks.workunit.client.0.smithi082.stdout:1/637: creat d4/d15/d49/dab/dc3/d4c/fe1 x:0 0 0 2024-04-27T07:33:27.452 INFO:tasks.workunit.client.1.smithi100.stdout:8/163: dwrite f1 [0,4194304] 0 2024-04-27T07:33:27.457 INFO:tasks.workunit.client.0.smithi082.stdout:1/638: creat d4/d15/d49/dab/fe2 x:0 0 0 2024-04-27T07:33:27.459 INFO:tasks.workunit.client.0.smithi082.stdout:0/729: link da/f62 da/d3c/f10a 0 2024-04-27T07:33:27.459 INFO:tasks.workunit.client.0.smithi082.stdout:3/942: write d8/d9/dd/d13/d1b/dbd/d8e/ff7 [883415,6317] 0 2024-04-27T07:33:27.460 INFO:tasks.workunit.client.1.smithi100.stdout:8/164: creat d6/d20/d2a/f37 x:0 0 0 2024-04-27T07:33:27.461 INFO:tasks.workunit.client.1.smithi100.stdout:8/165: dread - d6/d1b/f34 zero size 2024-04-27T07:33:27.461 INFO:tasks.workunit.client.1.smithi100.stdout:8/166: stat d6/l12 0 2024-04-27T07:33:27.464 INFO:tasks.workunit.client.1.smithi100.stdout:8/167: creat d6/d1b/f38 x:0 0 0 2024-04-27T07:33:27.464 INFO:tasks.workunit.client.1.smithi100.stdout:8/168: chown d6/c2f 8115811 1 2024-04-27T07:33:27.465 INFO:tasks.workunit.client.1.smithi100.stdout:8/169: stat d6/cd 0 2024-04-27T07:33:27.467 INFO:tasks.workunit.client.1.smithi100.stdout:4/181: dwrite d5/d16/d19/d21/d2b/f2d [0,4194304] 0 2024-04-27T07:33:27.468 INFO:tasks.workunit.client.0.smithi082.stdout:6/619: dread d2/d3/d1b/f5c [0,4194304] 0 2024-04-27T07:33:27.469 INFO:tasks.workunit.client.0.smithi082.stdout:1/639: dread d4/f22 [0,4194304] 0 2024-04-27T07:33:27.469 INFO:tasks.workunit.client.0.smithi082.stdout:0/730: rename da/d3c/d3f/d4c/c89 to da/d38/d7f/d4a/d80/da0/d104/c10b 0 2024-04-27T07:33:27.471 INFO:tasks.workunit.client.0.smithi082.stdout:1/640: chown d4/d15/d49/dab/dc3/d3e/f87 3 1 2024-04-27T07:33:27.471 INFO:tasks.workunit.client.0.smithi082.stdout:3/943: creat d8/d9/dd/f149 x:0 0 0 2024-04-27T07:33:27.473 INFO:tasks.workunit.client.1.smithi100.stdout:4/182: creat d5/d16/d19/d21/f3a x:0 0 0 2024-04-27T07:33:27.474 INFO:tasks.workunit.client.1.smithi100.stdout:4/183: chown d5/d16/d19/d21/f3a 2205 1 2024-04-27T07:33:27.474 INFO:tasks.workunit.client.0.smithi082.stdout:6/620: creat d2/d2d/d4a/fcf x:0 0 0 2024-04-27T07:33:27.476 INFO:tasks.workunit.client.0.smithi082.stdout:6/621: read - d2/d1e/fc3 zero size 2024-04-27T07:33:27.476 INFO:tasks.workunit.client.1.smithi100.stdout:4/184: creat d5/d16/d19/d21/f3b x:0 0 0 2024-04-27T07:33:27.477 INFO:tasks.workunit.client.1.smithi100.stdout:4/185: fdatasync d5/d16/d19/f30 0 2024-04-27T07:33:27.479 INFO:tasks.workunit.client.0.smithi082.stdout:4/767: dwrite d3/d6/d26/f33 [4194304,4194304] 0 2024-04-27T07:33:27.480 INFO:tasks.workunit.client.1.smithi100.stdout:4/186: creat d5/d23/f3c x:0 0 0 2024-04-27T07:33:27.480 INFO:tasks.workunit.client.1.smithi100.stdout:4/187: chown d5/d16/f26 87 1 2024-04-27T07:33:27.480 INFO:tasks.workunit.client.0.smithi082.stdout:6/622: stat d2/d1e/d32/d7d/d82 0 2024-04-27T07:33:27.481 INFO:tasks.workunit.client.0.smithi082.stdout:0/731: mkdir da/d38/d7f/d4a/d10c 0 2024-04-27T07:33:27.483 INFO:tasks.workunit.client.0.smithi082.stdout:3/944: creat d8/d9/d25/f14a x:0 0 0 2024-04-27T07:33:27.483 INFO:tasks.workunit.client.1.smithi100.stdout:4/188: creat d5/d16/d19/f3d x:0 0 0 2024-04-27T07:33:27.484 INFO:tasks.workunit.client.1.smithi100.stdout:4/189: fdatasync d5/d16/d19/f30 0 2024-04-27T07:33:27.485 INFO:tasks.workunit.client.1.smithi100.stdout:8/170: getdents d6/d20/d2a 0 2024-04-27T07:33:27.487 INFO:tasks.workunit.client.0.smithi082.stdout:0/732: rmdir da/d38/d7f/d4a/d80/da0/d104 39 2024-04-27T07:33:27.487 INFO:tasks.workunit.client.1.smithi100.stdout:3/102: dwrite d7/d9/fc [0,4194304] 0 2024-04-27T07:33:27.488 INFO:tasks.workunit.client.1.smithi100.stdout:8/171: truncate d6/d1b/f34 805876 0 2024-04-27T07:33:27.489 INFO:tasks.workunit.client.0.smithi082.stdout:3/945: fdatasync d8/d9/d1f/fca 0 2024-04-27T07:33:27.491 INFO:tasks.workunit.client.1.smithi100.stdout:3/103: dread f4 [0,4194304] 0 2024-04-27T07:33:27.492 INFO:tasks.workunit.client.1.smithi100.stdout:8/172: creat d6/d1b/d1d/f39 x:0 0 0 2024-04-27T07:33:27.492 INFO:tasks.workunit.client.0.smithi082.stdout:6/623: mkdir d2/d2e/d55/dd0 0 2024-04-27T07:33:27.493 INFO:tasks.workunit.client.1.smithi100.stdout:8/173: dread - d6/f35 zero size 2024-04-27T07:33:27.493 INFO:tasks.workunit.client.1.smithi100.stdout:3/104: write d7/f18 [1505904,88489] 0 2024-04-27T07:33:27.494 INFO:tasks.workunit.client.1.smithi100.stdout:3/105: fdatasync d7/d17/f20 0 2024-04-27T07:33:27.494 INFO:tasks.workunit.client.1.smithi100.stdout:3/106: chown d7/d9/d10/f15 59 1 2024-04-27T07:33:27.495 INFO:tasks.workunit.client.0.smithi082.stdout:1/641: write d4/f16 [153602,50161] 0 2024-04-27T07:33:27.495 INFO:tasks.workunit.client.1.smithi100.stdout:3/107: fdatasync f6 0 2024-04-27T07:33:27.496 INFO:tasks.workunit.client.1.smithi100.stdout:3/108: write d7/d9/d10/f11 [1421404,49606] 0 2024-04-27T07:33:27.496 INFO:tasks.workunit.client.1.smithi100.stdout:3/109: write d7/f1f [150172,11707] 0 2024-04-27T07:33:27.500 INFO:tasks.workunit.client.0.smithi082.stdout:3/946: creat d8/d9/d25/d26/d4d/d9f/f14b x:0 0 0 2024-04-27T07:33:27.500 INFO:tasks.workunit.client.1.smithi100.stdout:7/87: sync 2024-04-27T07:33:27.500 INFO:tasks.workunit.client.1.smithi100.stdout:7/88: chown d1/dd 5328 1 2024-04-27T07:33:27.501 INFO:tasks.workunit.client.1.smithi100.stdout:7/89: fdatasync d1/f2 0 2024-04-27T07:33:27.501 INFO:tasks.workunit.client.0.smithi082.stdout:3/947: chown d8/f74 145728036 1 2024-04-27T07:33:27.501 INFO:tasks.workunit.client.0.smithi082.stdout:1/642: creat d4/d15/d29/fe3 x:0 0 0 2024-04-27T07:33:27.502 INFO:tasks.workunit.client.1.smithi100.stdout:9/165: rename d1/d9/f20 to d1/d9/d1f/f3c 0 2024-04-27T07:33:27.503 INFO:tasks.workunit.client.0.smithi082.stdout:6/624: getdents d2/d75/d7a/dcc 0 2024-04-27T07:33:27.504 INFO:tasks.workunit.client.0.smithi082.stdout:1/643: dread - d4/d15/d49/dab/dc3/d3e/d57/da5/fbb zero size 2024-04-27T07:33:27.504 INFO:tasks.workunit.client.0.smithi082.stdout:3/948: getdents d8/d9/d1d/da5/d10a/d116 0 2024-04-27T07:33:27.505 INFO:tasks.workunit.client.0.smithi082.stdout:6/625: read - d2/d3/d9c/fa6 zero size 2024-04-27T07:33:27.505 INFO:tasks.workunit.client.1.smithi100.stdout:3/110: chown d7/d9/c16 1436633403 1 2024-04-27T07:33:27.507 INFO:tasks.workunit.client.1.smithi100.stdout:3/111: dread f4 [0,4194304] 0 2024-04-27T07:33:27.507 INFO:tasks.workunit.client.0.smithi082.stdout:0/733: truncate da/d28/d36/f65 303513 0 2024-04-27T07:33:27.507 INFO:tasks.workunit.client.0.smithi082.stdout:6/626: write d2/d45/fc6 [12714,68620] 0 2024-04-27T07:33:27.508 INFO:tasks.workunit.client.1.smithi100.stdout:4/190: rename d5/d16/d19/f2a to d5/d16/d19/d21/f3e 0 2024-04-27T07:33:27.509 INFO:tasks.workunit.client.1.smithi100.stdout:9/166: symlink d1/d9/db/l3d 0 2024-04-27T07:33:27.509 INFO:tasks.workunit.client.1.smithi100.stdout:4/191: dread - d5/d16/d19/d21/f3a zero size 2024-04-27T07:33:27.509 INFO:tasks.workunit.client.0.smithi082.stdout:1/644: unlink d4/d15/d49/d99/d9a/da9/faa 0 2024-04-27T07:33:27.510 INFO:tasks.workunit.client.1.smithi100.stdout:9/167: dread - d1/f22 zero size 2024-04-27T07:33:27.510 INFO:tasks.workunit.client.1.smithi100.stdout:3/112: rename d7/d9/d10/l14 to d7/d9/d10/l23 0 2024-04-27T07:33:27.511 INFO:tasks.workunit.client.1.smithi100.stdout:3/113: fdatasync d7/f1f 0 2024-04-27T07:33:27.512 INFO:tasks.workunit.client.1.smithi100.stdout:8/174: rename d6/f1a to d6/d20/d2a/f3a 0 2024-04-27T07:33:27.513 INFO:tasks.workunit.client.0.smithi082.stdout:4/768: dwrite d3/f4e [0,4194304] 0 2024-04-27T07:33:27.514 INFO:tasks.workunit.client.1.smithi100.stdout:4/192: write d5/fc [3035966,107674] 0 2024-04-27T07:33:27.515 INFO:tasks.workunit.client.1.smithi100.stdout:9/168: creat d1/f3e x:0 0 0 2024-04-27T07:33:27.515 INFO:tasks.workunit.client.0.smithi082.stdout:6/627: unlink d2/d2d/d4a/l53 0 2024-04-27T07:33:27.517 INFO:tasks.workunit.client.1.smithi100.stdout:7/90: rename d1/dd/f12 to d1/f17 0 2024-04-27T07:33:27.518 INFO:tasks.workunit.client.1.smithi100.stdout:7/91: readlink d1/l4 0 2024-04-27T07:33:27.518 INFO:tasks.workunit.client.0.smithi082.stdout:1/645: rename d4/d15/da7/cdd to d4/d15/d49/d99/d9a/dc7/ce4 0 2024-04-27T07:33:27.519 INFO:tasks.workunit.client.0.smithi082.stdout:6/628: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:27.519 INFO:tasks.workunit.client.1.smithi100.stdout:8/175: creat d6/f3b x:0 0 0 2024-04-27T07:33:27.520 INFO:tasks.workunit.client.1.smithi100.stdout:8/176: fsync d6/d1b/f2d 0 2024-04-27T07:33:27.520 INFO:tasks.workunit.client.0.smithi082.stdout:4/769: fdatasync d3/d9/f45 0 2024-04-27T07:33:27.523 INFO:tasks.workunit.client.1.smithi100.stdout:9/169: creat d1/d9/db/f3f x:0 0 0 2024-04-27T07:33:27.523 INFO:tasks.workunit.client.1.smithi100.stdout:4/193: mkdir d5/d1b/d2c/d3f 0 2024-04-27T07:33:27.524 INFO:tasks.workunit.client.1.smithi100.stdout:7/92: fsync d1/dd/fe 0 2024-04-27T07:33:27.526 INFO:tasks.workunit.client.1.smithi100.stdout:9/170: write d1/d9/db/d2b/f37 [960604,131072] 0 2024-04-27T07:33:27.526 INFO:tasks.workunit.client.1.smithi100.stdout:4/194: symlink d5/d16/d2e/l40 0 2024-04-27T07:33:27.527 INFO:tasks.workunit.client.1.smithi100.stdout:4/195: fsync d5/f10 0 2024-04-27T07:33:27.528 INFO:tasks.workunit.client.0.smithi082.stdout:1/646: dwrite d4/d15/d3f/d98/fd8 [4194304,4194304] 0 2024-04-27T07:33:27.529 INFO:tasks.workunit.client.1.smithi100.stdout:8/177: dwrite d6/d1b/d1d/f2c [0,4194304] 0 2024-04-27T07:33:27.530 INFO:tasks.workunit.client.1.smithi100.stdout:4/196: creat d5/d16/d19/d21/f41 x:0 0 0 2024-04-27T07:33:27.531 INFO:tasks.workunit.client.0.smithi082.stdout:4/770: rename d3/d6/d22 to d3/d6/d26/d55/d67/d9d/d101 0 2024-04-27T07:33:27.533 INFO:tasks.workunit.client.0.smithi082.stdout:1/647: unlink d4/d15/f17 0 2024-04-27T07:33:27.535 INFO:tasks.workunit.client.0.smithi082.stdout:4/771: symlink d3/d6/d26/d55/l102 0 2024-04-27T07:33:27.539 INFO:tasks.workunit.client.0.smithi082.stdout:4/772: link d3/d6/d26/d55/f72 d3/d6/d26/d55/f103 0 2024-04-27T07:33:27.544 INFO:tasks.workunit.client.1.smithi100.stdout:3/114: rename d7/d9/d10/l23 to d7/d9/l24 0 2024-04-27T07:33:27.551 INFO:tasks.workunit.client.1.smithi100.stdout:4/197: dwrite d5/f6 [0,4194304] 0 2024-04-27T07:33:27.554 INFO:tasks.workunit.client.1.smithi100.stdout:4/198: getdents d5/d23 0 2024-04-27T07:33:27.555 INFO:tasks.workunit.client.1.smithi100.stdout:4/199: write d5/d16/d19/f3d [237337,102052] 0 2024-04-27T07:33:27.556 INFO:tasks.workunit.client.1.smithi100.stdout:4/200: readlink d5/la 0 2024-04-27T07:33:27.557 INFO:tasks.workunit.client.1.smithi100.stdout:4/201: chown d5/d16/d2e 6950 1 2024-04-27T07:33:27.559 INFO:tasks.workunit.client.1.smithi100.stdout:4/202: creat d5/d23/f42 x:0 0 0 2024-04-27T07:33:27.559 INFO:tasks.workunit.client.0.smithi082.stdout:5/773: sync 2024-04-27T07:33:27.560 INFO:tasks.workunit.client.0.smithi082.stdout:0/734: dread da/d38/d7f/d4a/fa4 [0,4194304] 0 2024-04-27T07:33:27.562 INFO:tasks.workunit.client.0.smithi082.stdout:0/735: dread - da/d3c/fd8 zero size 2024-04-27T07:33:27.563 INFO:tasks.workunit.client.1.smithi100.stdout:4/203: unlink d5/d16/d19/d21/f3b 0 2024-04-27T07:33:27.564 INFO:tasks.workunit.client.0.smithi082.stdout:3/949: dread d8/d9/d3f/f80 [0,4194304] 0 2024-04-27T07:33:27.564 INFO:tasks.workunit.client.0.smithi082.stdout:1/648: dread d4/f35 [0,4194304] 0 2024-04-27T07:33:27.565 INFO:tasks.workunit.client.1.smithi100.stdout:4/204: mkdir d5/d16/d19/d21/d43 0 2024-04-27T07:33:27.566 INFO:tasks.workunit.client.0.smithi082.stdout:4/773: dwrite d3/d6/d16/f47 [4194304,4194304] 0 2024-04-27T07:33:27.569 INFO:tasks.workunit.client.1.smithi100.stdout:3/115: dread f5 [4194304,4194304] 0 2024-04-27T07:33:27.569 INFO:tasks.workunit.client.1.smithi100.stdout:4/205: getdents d5/d1b 0 2024-04-27T07:33:27.570 INFO:tasks.workunit.client.1.smithi100.stdout:3/116: stat d7/d17/l1d 0 2024-04-27T07:33:27.570 INFO:tasks.workunit.client.0.smithi082.stdout:0/736: rename da/d2a/f87 to da/d3c/d3f/d4c/d95/de9/f10d 0 2024-04-27T07:33:27.572 INFO:tasks.workunit.client.1.smithi100.stdout:4/206: mknod d5/d23/d33/c44 0 2024-04-27T07:33:27.572 INFO:tasks.workunit.client.1.smithi100.stdout:4/207: stat d5/c14 0 2024-04-27T07:33:27.574 INFO:tasks.workunit.client.1.smithi100.stdout:4/208: dread - d5/d16/d19/d21/f3e zero size 2024-04-27T07:33:27.574 INFO:tasks.workunit.client.0.smithi082.stdout:4/774: dwrite d3/d6/f8e [0,4194304] 0 2024-04-27T07:33:27.577 INFO:tasks.workunit.client.0.smithi082.stdout:6/629: dread d2/d75/d7a/dcc/d13/f67 [0,4194304] 0 2024-04-27T07:33:27.577 INFO:tasks.workunit.client.0.smithi082.stdout:4/775: stat d3/dce/fda 0 2024-04-27T07:33:27.579 INFO:tasks.workunit.client.0.smithi082.stdout:6/630: dread - d2/d2d/d4a/fcf zero size 2024-04-27T07:33:27.580 INFO:tasks.workunit.client.1.smithi100.stdout:3/117: dwrite d7/d9/d10/f11 [0,4194304] 0 2024-04-27T07:33:27.581 INFO:tasks.workunit.client.1.smithi100.stdout:3/118: write d7/d9/f21 [168994,117518] 0 2024-04-27T07:33:27.583 INFO:tasks.workunit.client.1.smithi100.stdout:3/119: readlink d7/d9/lb 0 2024-04-27T07:33:27.585 INFO:tasks.workunit.client.0.smithi082.stdout:6/631: symlink d2/d75/ld1 0 2024-04-27T07:33:27.586 INFO:tasks.workunit.client.1.smithi100.stdout:3/120: symlink d7/d17/l25 0 2024-04-27T07:33:27.587 INFO:tasks.workunit.client.1.smithi100.stdout:3/121: fsync f4 0 2024-04-27T07:33:27.587 INFO:tasks.workunit.client.0.smithi082.stdout:1/649: getdents d4/d15/d49/dab/dc3/d3e/d53 0 2024-04-27T07:33:27.588 INFO:tasks.workunit.client.1.smithi100.stdout:3/122: truncate d7/d17/f20 347284 0 2024-04-27T07:33:27.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/737: creat da/d1d/df8/f10e x:0 0 0 2024-04-27T07:33:27.591 INFO:tasks.workunit.client.0.smithi082.stdout:1/650: write d4/d15/d29/fe3 [602148,108491] 0 2024-04-27T07:33:27.592 INFO:tasks.workunit.client.0.smithi082.stdout:4/776: creat d3/d6/d26/d55/d67/d9d/d101/d69/df5/f104 x:0 0 0 2024-04-27T07:33:27.593 INFO:tasks.workunit.client.0.smithi082.stdout:6/632: creat d2/d1e/d32/d7d/dbc/fd2 x:0 0 0 2024-04-27T07:33:27.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/633: chown d2/d2e 60119 1 2024-04-27T07:33:27.595 INFO:tasks.workunit.client.0.smithi082.stdout:1/651: write d4/d15/d49/d4e/fd6 [885622,10637] 0 2024-04-27T07:33:27.598 INFO:tasks.workunit.client.0.smithi082.stdout:1/652: write d4/d15/d3f/fc9 [144194,69641] 0 2024-04-27T07:33:27.599 INFO:tasks.workunit.client.0.smithi082.stdout:6/634: mkdir d2/d75/d7a/dcc/d77/dd3 0 2024-04-27T07:33:27.601 INFO:tasks.workunit.client.0.smithi082.stdout:3/950: dread d8/d9/d1d/db5/dc7/fd3 [0,4194304] 0 2024-04-27T07:33:27.603 INFO:tasks.workunit.client.1.smithi100.stdout:4/209: getdents d5/d16/d19/d21 0 2024-04-27T07:33:27.604 INFO:tasks.workunit.client.0.smithi082.stdout:6/635: creat d2/d81/fd4 x:0 0 0 2024-04-27T07:33:27.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/777: dwrite d3/d6/d26/d55/f6b [4194304,4194304] 0 2024-04-27T07:33:27.605 INFO:tasks.workunit.client.1.smithi100.stdout:3/123: truncate d7/f18 2097066 0 2024-04-27T07:33:27.608 INFO:tasks.workunit.client.1.smithi100.stdout:3/124: unlink f5 0 2024-04-27T07:33:27.609 INFO:tasks.workunit.client.1.smithi100.stdout:4/210: getdents d5 0 2024-04-27T07:33:27.610 INFO:tasks.workunit.client.0.smithi082.stdout:6/636: read d2/d75/d7a/dcc/f17 [4029990,93540] 0 2024-04-27T07:33:27.610 INFO:tasks.workunit.client.0.smithi082.stdout:1/653: getdents d4/d15/d49/dab/dc3/dd3 0 2024-04-27T07:33:27.611 INFO:tasks.workunit.client.1.smithi100.stdout:4/211: write d5/d16/d19/d21/f3e [442785,106827] 0 2024-04-27T07:33:27.613 INFO:tasks.workunit.client.1.smithi100.stdout:4/212: write d5/f10 [2198961,23425] 0 2024-04-27T07:33:27.613 INFO:tasks.workunit.client.0.smithi082.stdout:1/654: rmdir d4/d15/d49/dab/dc3/d3e 39 2024-04-27T07:33:27.614 INFO:tasks.workunit.client.1.smithi100.stdout:3/125: mkdir d7/d9/d26 0 2024-04-27T07:33:27.615 INFO:tasks.workunit.client.1.smithi100.stdout:3/126: write f6 [3452302,82149] 0 2024-04-27T07:33:27.617 INFO:tasks.workunit.client.1.smithi100.stdout:4/213: link d5/d16/d17/c18 d5/d1b/c45 0 2024-04-27T07:33:27.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/127: rename d7/d9/d10/c12 to d7/d9/d10/c27 0 2024-04-27T07:33:27.619 INFO:tasks.workunit.client.0.smithi082.stdout:3/951: dread d8/d9/d25/d26/d4d/f148 [0,4194304] 0 2024-04-27T07:33:27.620 INFO:tasks.workunit.client.1.smithi100.stdout:3/128: mkdir d7/d9/d10/d28 0 2024-04-27T07:33:27.622 INFO:tasks.workunit.client.0.smithi082.stdout:0/738: dwrite da/d28/d36/d40/f90 [0,4194304] 0 2024-04-27T07:33:27.624 INFO:tasks.workunit.client.1.smithi100.stdout:4/214: dwrite d5/d16/d19/f3d [0,4194304] 0 2024-04-27T07:33:27.627 INFO:tasks.workunit.client.0.smithi082.stdout:6/637: dwrite d2/f74 [0,4194304] 0 2024-04-27T07:33:27.629 INFO:tasks.workunit.client.0.smithi082.stdout:1/655: creat d4/d15/d49/dab/dc3/d3e/d53/d72/fe5 x:0 0 0 2024-04-27T07:33:27.629 INFO:tasks.workunit.client.0.smithi082.stdout:4/778: dwrite d3/d6/d26/d55/d67/d9d/d101/d69/d85/ff6 [0,4194304] 0 2024-04-27T07:33:27.629 INFO:tasks.workunit.client.1.smithi100.stdout:4/215: unlink d5/d16/d19/d21/d2b/f2d 0 2024-04-27T07:33:27.632 INFO:tasks.workunit.client.1.smithi100.stdout:4/216: mkdir d5/d16/d19/d46 0 2024-04-27T07:33:27.635 INFO:tasks.workunit.client.1.smithi100.stdout:4/217: symlink d5/d16/d2e/l47 0 2024-04-27T07:33:27.636 INFO:tasks.workunit.client.1.smithi100.stdout:3/129: chown d7/f18 5604672 1 2024-04-27T07:33:27.637 INFO:tasks.workunit.client.0.smithi082.stdout:6/638: write d2/d75/d7a/dcc/f24 [2229631,112690] 0 2024-04-27T07:33:27.637 INFO:tasks.workunit.client.1.smithi100.stdout:4/218: symlink d5/d1b/d2c/d3f/l48 0 2024-04-27T07:33:27.638 INFO:tasks.workunit.client.0.smithi082.stdout:3/952: write d8/d9/dd/d13/d1b/dbd/d8e/f113 [58013,108794] 0 2024-04-27T07:33:27.639 INFO:tasks.workunit.client.1.smithi100.stdout:3/130: truncate d7/d17/f20 892230 0 2024-04-27T07:33:27.639 INFO:tasks.workunit.client.1.smithi100.stdout:4/219: write d5/f10 [4108890,18311] 0 2024-04-27T07:33:27.639 INFO:tasks.workunit.client.0.smithi082.stdout:1/656: chown d4/d15/d49/d99/d9a/ca8 0 1 2024-04-27T07:33:27.644 INFO:tasks.workunit.client.1.smithi100.stdout:5/154: sync 2024-04-27T07:33:27.647 INFO:tasks.workunit.client.1.smithi100.stdout:4/220: dwrite d5/d16/d19/f3d [0,4194304] 0 2024-04-27T07:33:27.648 INFO:tasks.workunit.client.1.smithi100.stdout:4/221: fdatasync d5/d16/d2e/f38 0 2024-04-27T07:33:27.650 INFO:tasks.workunit.client.0.smithi082.stdout:3/953: dwrite d8/d9/d25/d26/d4d/f97 [0,4194304] 0 2024-04-27T07:33:27.650 INFO:tasks.workunit.client.1.smithi100.stdout:4/222: rename d5/l12 to d5/d16/d2e/l49 0 2024-04-27T07:33:27.652 INFO:tasks.workunit.client.1.smithi100.stdout:4/223: creat d5/d16/d19/d46/f4a x:0 0 0 2024-04-27T07:33:27.653 INFO:tasks.workunit.client.0.smithi082.stdout:3/954: chown d8/d9/dd/d13/d1b/dbd/d8e/ff7 30166653 1 2024-04-27T07:33:27.654 INFO:tasks.workunit.client.1.smithi100.stdout:4/224: truncate d5/d16/d19/d21/f3e 1393120 0 2024-04-27T07:33:27.656 INFO:tasks.workunit.client.1.smithi100.stdout:4/225: creat d5/d1b/f4b x:0 0 0 2024-04-27T07:33:27.656 INFO:tasks.workunit.client.0.smithi082.stdout:6/639: fsync d2/d1e/d32/f4e 0 2024-04-27T07:33:27.661 INFO:tasks.workunit.client.0.smithi082.stdout:3/955: mknod d8/d9/d1d/df1/d131/c14c 0 2024-04-27T07:33:27.662 INFO:tasks.workunit.client.0.smithi082.stdout:6/640: creat d2/d75/d7a/fd5 x:0 0 0 2024-04-27T07:33:27.663 INFO:tasks.workunit.client.0.smithi082.stdout:3/956: fdatasync d8/d9/d1d/da5/db3/fde 0 2024-04-27T07:33:27.664 INFO:tasks.workunit.client.0.smithi082.stdout:1/657: link d4/f35 d4/d15/d3f/d6d/d93/fe6 0 2024-04-27T07:33:27.666 INFO:tasks.workunit.client.0.smithi082.stdout:6/641: mkdir d2/d75/d7a/dcc/d77/dca/dd6 0 2024-04-27T07:33:27.667 INFO:tasks.workunit.client.0.smithi082.stdout:1/658: readlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/lb0 0 2024-04-27T07:33:27.669 INFO:tasks.workunit.client.0.smithi082.stdout:3/957: rename d8/d9/d25/d4e/f96 to d8/d9/d1d/da5/d10a/f14d 0 2024-04-27T07:33:27.672 INFO:tasks.workunit.client.0.smithi082.stdout:6/642: symlink d2/d75/d7a/dcc/d77/dca/ld7 0 2024-04-27T07:33:27.674 INFO:tasks.workunit.client.0.smithi082.stdout:1/659: mkdir d4/d15/d49/dab/dc3/d4c/d7a/de7 0 2024-04-27T07:33:27.675 INFO:tasks.workunit.client.0.smithi082.stdout:4/779: dread d3/fb2 [0,4194304] 0 2024-04-27T07:33:27.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/958: readlink d8/d9/l11 0 2024-04-27T07:33:27.677 INFO:tasks.workunit.client.0.smithi082.stdout:6/643: creat d2/d3/da8/fd8 x:0 0 0 2024-04-27T07:33:27.680 INFO:tasks.workunit.client.0.smithi082.stdout:6/644: rmdir d2/d3 39 2024-04-27T07:33:27.699 INFO:tasks.workunit.client.0.smithi082.stdout:0/739: truncate da/d28/f66 1050754 0 2024-04-27T07:33:27.700 INFO:tasks.workunit.client.0.smithi082.stdout:3/959: truncate d8/d9/dd/d13/d1b/dbd/dd8/f142 525384 0 2024-04-27T07:33:27.700 INFO:tasks.workunit.client.0.smithi082.stdout:2/669: sync 2024-04-27T07:33:27.702 INFO:tasks.workunit.client.0.smithi082.stdout:1/660: dread d4/d15/d49/dab/dc3/d4c/f92 [0,4194304] 0 2024-04-27T07:33:27.703 INFO:tasks.workunit.client.0.smithi082.stdout:4/780: dwrite d3/d6/d26/d55/dc5/ff7 [0,4194304] 0 2024-04-27T07:33:27.704 INFO:tasks.workunit.client.0.smithi082.stdout:6/645: symlink d2/d75/d7a/dcc/d77/dca/ld9 0 2024-04-27T07:33:27.704 INFO:tasks.workunit.client.0.smithi082.stdout:1/661: read - d4/d15/d49/fc2 zero size 2024-04-27T07:33:27.706 INFO:tasks.workunit.client.0.smithi082.stdout:1/662: chown d4/d15/d3f/d6d/fd7 3 1 2024-04-27T07:33:27.706 INFO:tasks.workunit.client.0.smithi082.stdout:3/960: unlink d8/d9/d1d/da5/c111 0 2024-04-27T07:33:27.707 INFO:tasks.workunit.client.0.smithi082.stdout:2/670: getdents d7/d9/d4f/d6e/d82/da4 0 2024-04-27T07:33:27.708 INFO:tasks.workunit.client.0.smithi082.stdout:2/671: write d7/d8/d99/fd4 [928930,86734] 0 2024-04-27T07:33:27.730 INFO:tasks.workunit.client.0.smithi082.stdout:4/781: creat d3/d6/d16/d98/f105 x:0 0 0 2024-04-27T07:33:27.731 INFO:tasks.workunit.client.0.smithi082.stdout:1/663: dread d4/d15/d3f/fc9 [0,4194304] 0 2024-04-27T07:33:27.733 INFO:tasks.workunit.client.0.smithi082.stdout:6/646: creat d2/d3/da8/fda x:0 0 0 2024-04-27T07:33:27.734 INFO:tasks.workunit.client.0.smithi082.stdout:3/961: creat d8/d9/d25/d26/d4d/d82/f14e x:0 0 0 2024-04-27T07:33:27.736 INFO:tasks.workunit.client.0.smithi082.stdout:2/672: rename d7/d30/d23/f49 to d7/d9/fd8 0 2024-04-27T07:33:27.737 INFO:tasks.workunit.client.0.smithi082.stdout:2/673: write d7/d8/d99/db4/fbe [241893,50878] 0 2024-04-27T07:33:27.739 INFO:tasks.workunit.client.0.smithi082.stdout:1/664: mkdir d4/d15/d49/d99/de8 0 2024-04-27T07:33:27.740 INFO:tasks.workunit.client.0.smithi082.stdout:6/647: stat d2/d2e/l7f 0 2024-04-27T07:33:27.741 INFO:tasks.workunit.client.0.smithi082.stdout:1/665: dread - d4/d15/d49/d99/db8/fba zero size 2024-04-27T07:33:27.741 INFO:tasks.workunit.client.0.smithi082.stdout:0/740: truncate da/d1d/f24 582166 0 2024-04-27T07:33:27.742 INFO:tasks.workunit.client.0.smithi082.stdout:6/648: chown d2/d1e/d32/d7d/d82/f91 285061 1 2024-04-27T07:33:27.742 INFO:tasks.workunit.client.0.smithi082.stdout:3/962: symlink d8/d9/d25/d4e/da4/l14f 0 2024-04-27T07:33:27.746 INFO:tasks.workunit.client.0.smithi082.stdout:4/782: creat d3/d6/d16/f106 x:0 0 0 2024-04-27T07:33:27.747 INFO:tasks.workunit.client.0.smithi082.stdout:2/674: mkdir d7/d8/dd9 0 2024-04-27T07:33:27.749 INFO:tasks.workunit.client.0.smithi082.stdout:0/741: symlink da/d38/da9/ddd/l10f 0 2024-04-27T07:33:27.751 INFO:tasks.workunit.client.0.smithi082.stdout:3/963: dwrite d8/d9/dd/f1a [0,4194304] 0 2024-04-27T07:33:27.753 INFO:tasks.workunit.client.0.smithi082.stdout:2/675: unlink d7/d14/f50 0 2024-04-27T07:33:27.754 INFO:tasks.workunit.client.0.smithi082.stdout:0/742: rmdir da/d3c/d3f/d57/dcc/da8 39 2024-04-27T07:33:27.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/783: unlink d3/d6/d26/d55/d67/d9d/d101/fde 0 2024-04-27T07:33:27.760 INFO:tasks.workunit.client.0.smithi082.stdout:2/676: creat d7/d8/d99/fda x:0 0 0 2024-04-27T07:33:27.763 INFO:tasks.workunit.client.0.smithi082.stdout:3/964: dwrite d8/d9/d25/d26/d3d/f38 [4194304,4194304] 0 2024-04-27T07:33:27.763 INFO:tasks.workunit.client.0.smithi082.stdout:4/784: mknod d3/d6/d16/d98/c107 0 2024-04-27T07:33:27.765 INFO:tasks.workunit.client.0.smithi082.stdout:2/677: write d7/d30/d23/fb7 [120518,109297] 0 2024-04-27T07:33:27.766 INFO:tasks.workunit.client.0.smithi082.stdout:6/649: dwrite d2/d1e/f34 [0,4194304] 0 2024-04-27T07:33:27.769 INFO:tasks.workunit.client.0.smithi082.stdout:6/650: fsync d2/d3/d1b/fc0 0 2024-04-27T07:33:27.770 INFO:tasks.workunit.client.0.smithi082.stdout:6/651: chown d2/d3/l12 725130685 1 2024-04-27T07:33:27.770 INFO:tasks.workunit.client.0.smithi082.stdout:3/965: mkdir d8/d9/d1d/df1/d150 0 2024-04-27T07:33:27.777 INFO:tasks.workunit.client.0.smithi082.stdout:0/743: write da/d28/fde [2682642,56301] 0 2024-04-27T07:33:27.779 INFO:tasks.workunit.client.0.smithi082.stdout:4/785: creat d3/f108 x:0 0 0 2024-04-27T07:33:27.782 INFO:tasks.workunit.client.0.smithi082.stdout:0/744: creat da/d38/d7f/d4a/d80/da0/dd5/ddf/f110 x:0 0 0 2024-04-27T07:33:27.783 INFO:tasks.workunit.client.0.smithi082.stdout:4/786: fsync d3/d6/d26/f90 0 2024-04-27T07:33:27.784 INFO:tasks.workunit.client.0.smithi082.stdout:0/745: dread da/d3c/fbd [0,4194304] 0 2024-04-27T07:33:27.784 INFO:tasks.workunit.client.0.smithi082.stdout:6/652: link d2/d2e/d55/l7b d2/d1e/d32/d85/d93/ldb 0 2024-04-27T07:33:27.785 INFO:tasks.workunit.client.0.smithi082.stdout:3/966: getdents d8/d9/d25/d26 0 2024-04-27T07:33:27.787 INFO:tasks.workunit.client.0.smithi082.stdout:0/746: chown da/d3c/d3f/d4c/d95/de9/def/l97 124 1 2024-04-27T07:33:27.788 INFO:tasks.workunit.client.0.smithi082.stdout:0/747: stat da/d1d/d6a/f107 0 2024-04-27T07:33:27.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/787: rename d3/d10/d9c/dc2 to d3/d6/d26/d55/d67/d109 0 2024-04-27T07:33:27.791 INFO:tasks.workunit.client.0.smithi082.stdout:4/788: fsync d3/d9/f45 0 2024-04-27T07:33:27.791 INFO:tasks.workunit.client.0.smithi082.stdout:3/967: write d8/d9/d25/d26/d4d/d82/d8b/da0/fb4 [1191126,101024] 0 2024-04-27T07:33:27.792 INFO:tasks.workunit.client.0.smithi082.stdout:2/678: truncate d7/f56 3074061 0 2024-04-27T07:33:27.793 INFO:tasks.workunit.client.0.smithi082.stdout:0/748: write da/d28/d36/feb [711885,120996] 0 2024-04-27T07:33:27.793 INFO:tasks.workunit.client.0.smithi082.stdout:6/653: dwrite d2/d3/d1b/f4b [0,4194304] 0 2024-04-27T07:33:27.797 INFO:tasks.workunit.client.0.smithi082.stdout:2/679: unlink d7/d30/lbb 0 2024-04-27T07:33:27.798 INFO:tasks.workunit.client.0.smithi082.stdout:4/789: mkdir d3/d6/d26/d55/d67/d9d/d101/d69/df5/d10a 0 2024-04-27T07:33:27.802 INFO:tasks.workunit.client.0.smithi082.stdout:6/654: fsync d2/d2e/f30 0 2024-04-27T07:33:27.803 INFO:tasks.workunit.client.1.smithi100.stdout:6/109: sync 2024-04-27T07:33:27.803 INFO:tasks.workunit.client.0.smithi082.stdout:4/790: mkdir d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10b 0 2024-04-27T07:33:27.805 INFO:tasks.workunit.client.1.smithi100.stdout:6/110: creat de/d18/d21/d24/f2b x:0 0 0 2024-04-27T07:33:27.806 INFO:tasks.workunit.client.0.smithi082.stdout:4/791: truncate d3/d6/d26/fe3 802086 0 2024-04-27T07:33:27.807 INFO:tasks.workunit.client.1.smithi100.stdout:6/111: truncate de/d18/d21/d24/f25 838358 0 2024-04-27T07:33:27.809 INFO:tasks.workunit.client.0.smithi082.stdout:2/680: dwrite d7/d30/d61/f85 [0,4194304] 0 2024-04-27T07:33:27.810 INFO:tasks.workunit.client.1.smithi100.stdout:6/112: creat de/d18/d28/f2c x:0 0 0 2024-04-27T07:33:27.810 INFO:tasks.workunit.client.0.smithi082.stdout:4/792: dread - d3/d6/d26/d55/d67/d9d/d101/d69/fe5 zero size 2024-04-27T07:33:27.810 INFO:tasks.workunit.client.1.smithi100.stdout:6/113: chown de/cf 47571 1 2024-04-27T07:33:27.812 INFO:tasks.workunit.client.1.smithi100.stdout:6/114: creat de/d18/d28/f2d x:0 0 0 2024-04-27T07:33:27.812 INFO:tasks.workunit.client.0.smithi082.stdout:6/655: dwrite d2/f18 [0,4194304] 0 2024-04-27T07:33:27.813 INFO:tasks.workunit.client.1.smithi100.stdout:6/115: mkdir de/d2e 0 2024-04-27T07:33:27.814 INFO:tasks.workunit.client.1.smithi100.stdout:6/116: write fc [936106,47713] 0 2024-04-27T07:33:27.821 INFO:tasks.workunit.client.0.smithi082.stdout:4/793: rename d3/d6/d16 to d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10c 0 2024-04-27T07:33:27.821 INFO:tasks.workunit.client.1.smithi100.stdout:6/117: dwrite de/d18/f20 [0,4194304] 0 2024-04-27T07:33:27.822 INFO:tasks.workunit.client.0.smithi082.stdout:2/681: creat d7/d8/d13/fdb x:0 0 0 2024-04-27T07:33:27.823 INFO:tasks.workunit.client.0.smithi082.stdout:6/656: dwrite d2/d2e/f3b [4194304,4194304] 0 2024-04-27T07:33:27.824 INFO:tasks.workunit.client.0.smithi082.stdout:2/682: rename d7/d9/d4f to d7/d9/d4f/d66/dae/dd1/ddc 22 2024-04-27T07:33:27.825 INFO:tasks.workunit.client.0.smithi082.stdout:2/683: chown d7/d9/d4f/f80 428987978 1 2024-04-27T07:33:27.829 INFO:tasks.workunit.client.1.smithi100.stdout:6/118: dwrite fc [0,4194304] 0 2024-04-27T07:33:27.832 INFO:tasks.workunit.client.1.smithi100.stdout:6/119: creat de/d18/d28/f2f x:0 0 0 2024-04-27T07:33:27.834 INFO:tasks.workunit.client.1.smithi100.stdout:6/120: getdents de/d2e 0 2024-04-27T07:33:27.835 INFO:tasks.workunit.client.0.smithi082.stdout:6/657: dread d2/d3/fd [4194304,4194304] 0 2024-04-27T07:33:27.835 INFO:tasks.workunit.client.1.smithi100.stdout:6/121: creat de/d18/d28/f30 x:0 0 0 2024-04-27T07:33:27.835 INFO:tasks.workunit.client.0.smithi082.stdout:2/684: dwrite d7/d31/d54/fb2 [0,4194304] 0 2024-04-27T07:33:27.837 INFO:tasks.workunit.client.1.smithi100.stdout:6/122: mknod de/d18/d28/c31 0 2024-04-27T07:33:27.837 INFO:tasks.workunit.client.1.smithi100.stdout:6/123: chown de/d18/d21/d24/f27 16809 1 2024-04-27T07:33:27.838 INFO:tasks.workunit.client.1.smithi100.stdout:6/124: dread - de/f16 zero size 2024-04-27T07:33:27.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/685: dread d7/d9/d4f/d6e/d82/dc6/f98 [0,4194304] 0 2024-04-27T07:33:27.842 INFO:tasks.workunit.client.0.smithi082.stdout:6/658: truncate d2/d1e/d32/f4e 3808198 0 2024-04-27T07:33:27.844 INFO:tasks.workunit.client.0.smithi082.stdout:2/686: symlink d7/d9/d4f/d6e/ldd 0 2024-04-27T07:33:27.844 INFO:tasks.workunit.client.1.smithi100.stdout:6/125: getdents de/d18 0 2024-04-27T07:33:27.844 INFO:tasks.workunit.client.1.smithi100.stdout:6/126: fsync de/f17 0 2024-04-27T07:33:27.845 INFO:tasks.workunit.client.0.smithi082.stdout:2/687: truncate d7/d9/d4f/f9d 306835 0 2024-04-27T07:33:27.845 INFO:tasks.workunit.client.0.smithi082.stdout:6/659: mknod d2/d3/d9c/cdc 0 2024-04-27T07:33:27.846 INFO:tasks.workunit.client.0.smithi082.stdout:6/660: write d2/d75/d7a/dcc/d13/f16 [1137254,65817] 0 2024-04-27T07:33:27.849 INFO:tasks.workunit.client.1.smithi100.stdout:6/127: creat de/d18/d21/f32 x:0 0 0 2024-04-27T07:33:27.850 INFO:tasks.workunit.client.0.smithi082.stdout:6/661: rmdir d2/d75/d7a/dcc/d77 39 2024-04-27T07:33:27.851 INFO:tasks.workunit.client.1.smithi100.stdout:6/128: symlink de/d18/d21/d24/l33 0 2024-04-27T07:33:27.851 INFO:tasks.workunit.client.1.smithi100.stdout:6/129: chown de/f16 408 1 2024-04-27T07:33:27.852 INFO:tasks.workunit.client.0.smithi082.stdout:6/662: mknod d2/d3/cdd 0 2024-04-27T07:33:27.855 INFO:tasks.workunit.client.1.smithi100.stdout:0/146: sync 2024-04-27T07:33:27.857 INFO:tasks.workunit.client.1.smithi100.stdout:0/147: rmdir d1/d8 39 2024-04-27T07:33:27.857 INFO:tasks.workunit.client.1.smithi100.stdout:6/130: dwrite de/f16 [0,4194304] 0 2024-04-27T07:33:27.858 INFO:tasks.workunit.client.1.smithi100.stdout:6/131: chown f6 24 1 2024-04-27T07:33:27.858 INFO:tasks.workunit.client.0.smithi082.stdout:6/663: rename d2/d3/d9c/f9f to d2/d75/d7a/dcc/d77/dca/dd6/fde 0 2024-04-27T07:33:27.858 INFO:tasks.workunit.client.1.smithi100.stdout:6/132: chown de/d2e 21723 1 2024-04-27T07:33:27.859 INFO:tasks.workunit.client.0.smithi082.stdout:6/664: readlink d2/d2d/d3d/l64 0 2024-04-27T07:33:27.859 INFO:tasks.workunit.client.1.smithi100.stdout:6/133: chown de/f10 34 1 2024-04-27T07:33:27.860 INFO:tasks.workunit.client.1.smithi100.stdout:6/134: truncate de/d18/f22 296955 0 2024-04-27T07:33:27.861 INFO:tasks.workunit.client.1.smithi100.stdout:6/135: truncate de/f10 4697941 0 2024-04-27T07:33:27.863 INFO:tasks.workunit.client.1.smithi100.stdout:6/136: mknod de/d18/c34 0 2024-04-27T07:33:27.870 INFO:tasks.workunit.client.0.smithi082.stdout:2/688: dread d7/f5b [0,4194304] 0 2024-04-27T07:33:27.871 INFO:tasks.workunit.client.0.smithi082.stdout:2/689: chown d7/d8/d13/f60 13 1 2024-04-27T07:33:27.871 INFO:tasks.workunit.client.1.smithi100.stdout:6/137: dwrite de/d18/f29 [0,4194304] 0 2024-04-27T07:33:27.872 INFO:tasks.workunit.client.1.smithi100.stdout:6/138: chown de/d18/c34 1 1 2024-04-27T07:33:27.873 INFO:tasks.workunit.client.1.smithi100.stdout:0/148: dwrite d1/f24 [0,4194304] 0 2024-04-27T07:33:27.876 INFO:tasks.workunit.client.1.smithi100.stdout:6/139: creat de/d18/f35 x:0 0 0 2024-04-27T07:33:27.877 INFO:tasks.workunit.client.1.smithi100.stdout:6/140: write fc [1395809,51945] 0 2024-04-27T07:33:27.878 INFO:tasks.workunit.client.0.smithi082.stdout:2/690: dwrite d7/d30/d61/f65 [4194304,4194304] 0 2024-04-27T07:33:27.878 INFO:tasks.workunit.client.1.smithi100.stdout:0/149: dread - d1/d8/d20/f2b zero size 2024-04-27T07:33:27.879 INFO:tasks.workunit.client.0.smithi082.stdout:2/691: chown d7/d9/d4f/f9d 3422665 1 2024-04-27T07:33:27.879 INFO:tasks.workunit.client.1.smithi100.stdout:0/150: read d1/d8/d20/f1c [1907835,36403] 0 2024-04-27T07:33:27.881 INFO:tasks.workunit.client.1.smithi100.stdout:6/141: rename de/f1f to de/d18/f36 0 2024-04-27T07:33:27.882 INFO:tasks.workunit.client.1.smithi100.stdout:0/151: creat d1/d30/f36 x:0 0 0 2024-04-27T07:33:27.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/692: mkdir d7/d31/dde 0 2024-04-27T07:33:27.883 INFO:tasks.workunit.client.1.smithi100.stdout:0/152: read d1/d8/fc [3615726,9925] 0 2024-04-27T07:33:27.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/693: fsync f3 0 2024-04-27T07:33:27.886 INFO:tasks.workunit.client.0.smithi082.stdout:2/694: truncate d7/d9/d4f/d66/fb3 1485323 0 2024-04-27T07:33:27.886 INFO:tasks.workunit.client.0.smithi082.stdout:6/665: dread d2/d75/d7a/dcc/d13/f21 [0,4194304] 0 2024-04-27T07:33:27.887 INFO:tasks.workunit.client.0.smithi082.stdout:6/666: truncate d2/d2d/d4a/fbd 43852 0 2024-04-27T07:33:27.888 INFO:tasks.workunit.client.0.smithi082.stdout:2/695: rename d7/d8/d13/ca2 to d7/d31/d54/cdf 0 2024-04-27T07:33:27.889 INFO:tasks.workunit.client.1.smithi100.stdout:0/153: rename d1/d8/f11 to d1/d8/d20/f37 0 2024-04-27T07:33:27.891 INFO:tasks.workunit.client.0.smithi082.stdout:6/667: getdents d2/d75 0 2024-04-27T07:33:27.891 INFO:tasks.workunit.client.1.smithi100.stdout:0/154: fsync d1/d8/d20/f1c 0 2024-04-27T07:33:27.892 INFO:tasks.workunit.client.0.smithi082.stdout:2/696: mkdir d7/d9/d4f/d6e/d82/da4/de0 0 2024-04-27T07:33:27.892 INFO:tasks.workunit.client.0.smithi082.stdout:2/697: readlink d7/d8/l6a 0 2024-04-27T07:33:27.893 INFO:tasks.workunit.client.0.smithi082.stdout:6/668: symlink d2/d3/d9c/ldf 0 2024-04-27T07:33:27.894 INFO:tasks.workunit.client.0.smithi082.stdout:6/669: dread - d2/d1e/d32/d85/d97/fc8 zero size 2024-04-27T07:33:27.895 INFO:tasks.workunit.client.1.smithi100.stdout:0/155: mkdir d1/d38 0 2024-04-27T07:33:27.895 INFO:tasks.workunit.client.0.smithi082.stdout:2/698: rename d7/l7d to d7/d9/d4f/d66/dd6/le1 0 2024-04-27T07:33:27.896 INFO:tasks.workunit.client.0.smithi082.stdout:6/670: rmdir d2/d3/d1b 39 2024-04-27T07:33:27.898 INFO:tasks.workunit.client.1.smithi100.stdout:0/156: creat d1/f39 x:0 0 0 2024-04-27T07:33:27.898 INFO:tasks.workunit.client.0.smithi082.stdout:2/699: getdents d7/d8/dd9 0 2024-04-27T07:33:27.898 INFO:tasks.workunit.client.0.smithi082.stdout:2/700: chown d7/d8 1704529146 1 2024-04-27T07:33:27.899 INFO:tasks.workunit.client.1.smithi100.stdout:0/157: mkdir d1/d38/d3a 0 2024-04-27T07:33:27.899 INFO:tasks.workunit.client.1.smithi100.stdout:0/158: chown d1/d8/d20/f2b 1 1 2024-04-27T07:33:27.900 INFO:tasks.workunit.client.0.smithi082.stdout:6/671: rename d2/d75/c66 to d2/d2d/ce0 0 2024-04-27T07:33:27.901 INFO:tasks.workunit.client.1.smithi100.stdout:0/159: write d1/d8/d20/d1e/f21 [984278,129426] 0 2024-04-27T07:33:27.901 INFO:tasks.workunit.client.0.smithi082.stdout:6/672: chown d2/d3/cdd 16649 1 2024-04-27T07:33:27.901 INFO:tasks.workunit.client.0.smithi082.stdout:2/701: symlink d7/d9/d4f/d6e/d82/da4/de0/le2 0 2024-04-27T07:33:27.901 INFO:tasks.workunit.client.1.smithi100.stdout:0/160: creat d1/d8/d20/f3b x:0 0 0 2024-04-27T07:33:27.902 INFO:tasks.workunit.client.0.smithi082.stdout:6/673: creat d2/d1e/fe1 x:0 0 0 2024-04-27T07:33:27.902 INFO:tasks.workunit.client.1.smithi100.stdout:0/161: chown d1/d8/ff 163 1 2024-04-27T07:33:27.902 INFO:tasks.workunit.client.1.smithi100.stdout:0/162: write d1/d8/d20/d1e/f21 [552591,96982] 0 2024-04-27T07:33:27.903 INFO:tasks.workunit.client.1.smithi100.stdout:0/163: chown d1/d8/d14/c1d 6523 1 2024-04-27T07:33:27.914 INFO:tasks.workunit.client.1.smithi100.stdout:9/171: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:2/187: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:1/273: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:8/178: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:7/93: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:3/131: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:5/155: sync 2024-04-27T07:33:27.915 INFO:tasks.workunit.client.1.smithi100.stdout:4/226: sync 2024-04-27T07:33:27.918 INFO:tasks.workunit.client.1.smithi100.stdout:5/156: chown d0/c2d 419714768 1 2024-04-27T07:33:27.919 INFO:tasks.workunit.client.1.smithi100.stdout:7/94: write d1/f17 [388035,116113] 0 2024-04-27T07:33:27.920 INFO:tasks.workunit.client.1.smithi100.stdout:5/157: stat d0/d4/f19 0 2024-04-27T07:33:27.921 INFO:tasks.workunit.client.1.smithi100.stdout:3/132: creat d7/d9/d10/f29 x:0 0 0 2024-04-27T07:33:27.921 INFO:tasks.workunit.client.1.smithi100.stdout:0/164: getdents d1/d30 0 2024-04-27T07:33:27.922 INFO:tasks.workunit.client.1.smithi100.stdout:6/142: write f7 [92015,85522] 0 2024-04-27T07:33:27.922 INFO:tasks.workunit.client.1.smithi100.stdout:2/188: unlink d0/da/d29/d26/f3d 0 2024-04-27T07:33:27.923 INFO:tasks.workunit.client.1.smithi100.stdout:4/227: chown d5/f8 3 1 2024-04-27T07:33:27.924 INFO:tasks.workunit.client.0.smithi082.stdout:6/674: truncate d2/d3/f27 1802719 0 2024-04-27T07:33:27.925 INFO:tasks.workunit.client.1.smithi100.stdout:7/95: truncate d1/f6 4401579 0 2024-04-27T07:33:27.926 INFO:tasks.workunit.client.0.smithi082.stdout:6/675: write d2/d75/d7a/dcc/d13/f67 [4440275,45163] 0 2024-04-27T07:33:27.926 INFO:tasks.workunit.client.1.smithi100.stdout:6/143: fsync de/d18/d21/f32 0 2024-04-27T07:33:27.927 INFO:tasks.workunit.client.1.smithi100.stdout:1/274: creat d0/d1b/d20/d2d/d35/f4c x:0 0 0 2024-04-27T07:33:27.928 INFO:tasks.workunit.client.1.smithi100.stdout:8/179: dwrite f1 [0,4194304] 0 2024-04-27T07:33:27.929 INFO:tasks.workunit.client.1.smithi100.stdout:2/189: write d0/d1e/f33 [1028415,6083] 0 2024-04-27T07:33:27.930 INFO:tasks.workunit.client.1.smithi100.stdout:7/96: read d1/fc [3958126,119301] 0 2024-04-27T07:33:27.930 INFO:tasks.workunit.client.1.smithi100.stdout:1/275: read d0/d1b/d20/f38 [154896,130962] 0 2024-04-27T07:33:27.931 INFO:tasks.workunit.client.1.smithi100.stdout:5/158: mkdir d0/d4/d17/d1a/d31 0 2024-04-27T07:33:27.933 INFO:tasks.workunit.client.1.smithi100.stdout:8/180: chown d6/d1b/d1d 33381215 1 2024-04-27T07:33:27.934 INFO:tasks.workunit.client.1.smithi100.stdout:7/97: rename d1/dd/d16 to d1/dd/d16/d18 22 2024-04-27T07:33:27.935 INFO:tasks.workunit.client.1.smithi100.stdout:1/276: chown d0/d23/d3a/f41 183799939 1 2024-04-27T07:33:27.937 INFO:tasks.workunit.client.1.smithi100.stdout:3/133: truncate d7/d9/d10/f15 947145 0 2024-04-27T07:33:27.937 INFO:tasks.workunit.client.1.smithi100.stdout:2/190: write d0/d1e/f3b [175654,116960] 0 2024-04-27T07:33:27.938 INFO:tasks.workunit.client.1.smithi100.stdout:5/159: symlink d0/d4/d21/l32 0 2024-04-27T07:33:27.938 INFO:tasks.workunit.client.1.smithi100.stdout:6/144: dread f8 [0,4194304] 0 2024-04-27T07:33:27.939 INFO:tasks.workunit.client.1.smithi100.stdout:0/165: link d1/d8/d20/f2b d1/d38/d3a/f3c 0 2024-04-27T07:33:27.941 INFO:tasks.workunit.client.1.smithi100.stdout:4/228: mkdir d5/d16/d4c 0 2024-04-27T07:33:27.941 INFO:tasks.workunit.client.1.smithi100.stdout:0/166: write d1/d8/d20/f29 [980651,101361] 0 2024-04-27T07:33:27.942 INFO:tasks.workunit.client.1.smithi100.stdout:4/229: fdatasync d5/f10 0 2024-04-27T07:33:27.943 INFO:tasks.workunit.client.1.smithi100.stdout:0/167: fsync d1/d30/f33 0 2024-04-27T07:33:27.943 INFO:tasks.workunit.client.1.smithi100.stdout:9/172: dread d1/d9/db/f2e [0,4194304] 0 2024-04-27T07:33:27.947 INFO:tasks.workunit.client.1.smithi100.stdout:7/98: symlink d1/dd/l19 0 2024-04-27T07:33:27.947 INFO:tasks.workunit.client.1.smithi100.stdout:0/168: dread - d1/d8/d20/f2b zero size 2024-04-27T07:33:27.949 INFO:tasks.workunit.client.1.smithi100.stdout:3/134: rename d7/d17 to d7/d9/d26/d2a 0 2024-04-27T07:33:27.953 INFO:tasks.workunit.client.1.smithi100.stdout:4/230: dwrite d5/d16/d19/d46/f4a [0,4194304] 0 2024-04-27T07:33:27.960 INFO:tasks.workunit.client.1.smithi100.stdout:2/191: mknod d0/da/c40 0 2024-04-27T07:33:27.961 INFO:tasks.workunit.client.1.smithi100.stdout:7/99: unlink d1/c13 0 2024-04-27T07:33:27.962 INFO:tasks.workunit.client.1.smithi100.stdout:7/100: chown d1/dd/l19 5363694 1 2024-04-27T07:33:27.963 INFO:tasks.workunit.client.1.smithi100.stdout:0/169: creat d1/d30/f3d x:0 0 0 2024-04-27T07:33:27.964 INFO:tasks.workunit.client.1.smithi100.stdout:0/170: stat d1/d30/l31 0 2024-04-27T07:33:27.966 INFO:tasks.workunit.client.1.smithi100.stdout:6/145: link de/d18/d28/f2d de/d18/f37 0 2024-04-27T07:33:27.966 INFO:tasks.workunit.client.1.smithi100.stdout:6/146: read de/d18/f20 [821599,55202] 0 2024-04-27T07:33:27.968 INFO:tasks.workunit.client.1.smithi100.stdout:5/160: symlink d0/d4/d17/d1a/d30/l33 0 2024-04-27T07:33:27.970 INFO:tasks.workunit.client.1.smithi100.stdout:4/231: rename d5/la to d5/d16/d19/d46/l4d 0 2024-04-27T07:33:27.971 INFO:tasks.workunit.client.1.smithi100.stdout:4/232: chown d5/f6 7874 1 2024-04-27T07:33:27.973 INFO:tasks.workunit.client.1.smithi100.stdout:4/233: write d5/d23/f25 [10119,89] 0 2024-04-27T07:33:27.973 INFO:tasks.workunit.client.1.smithi100.stdout:9/173: dwrite d1/d9/f23 [0,4194304] 0 2024-04-27T07:33:27.974 INFO:tasks.workunit.client.0.smithi082.stdout:8/633: sync 2024-04-27T07:33:27.975 INFO:tasks.workunit.client.0.smithi082.stdout:8/634: dread - d0/d3/d1c/fb0 zero size 2024-04-27T07:33:27.975 INFO:tasks.workunit.client.1.smithi100.stdout:3/135: unlink d7/d9/l24 0 2024-04-27T07:33:27.976 INFO:tasks.workunit.client.1.smithi100.stdout:0/171: symlink d1/d38/l3e 0 2024-04-27T07:33:27.978 INFO:tasks.workunit.client.1.smithi100.stdout:3/136: fsync d7/d9/d26/d2a/f20 0 2024-04-27T07:33:27.982 INFO:tasks.workunit.client.1.smithi100.stdout:4/234: dread d5/d16/d19/d21/f3e [0,4194304] 0 2024-04-27T07:33:27.984 INFO:tasks.workunit.client.1.smithi100.stdout:9/174: dwrite d1/d9/db/ff [0,4194304] 0 2024-04-27T07:33:27.986 INFO:tasks.workunit.client.0.smithi082.stdout:8/635: dwrite d0/d2b/d6f/f78 [0,4194304] 0 2024-04-27T07:33:27.988 INFO:tasks.workunit.client.0.smithi082.stdout:8/636: write d0/d3/d1b/f1e [328622,18629] 0 2024-04-27T07:33:27.991 INFO:tasks.workunit.client.1.smithi100.stdout:4/235: dwrite d5/d16/d19/d46/f4a [0,4194304] 0 2024-04-27T07:33:27.992 INFO:tasks.workunit.client.0.smithi082.stdout:8/637: creat d0/d83/d90/fce x:0 0 0 2024-04-27T07:33:27.995 INFO:tasks.workunit.client.1.smithi100.stdout:9/175: creat d1/d9/db/d2b/f40 x:0 0 0 2024-04-27T07:33:27.996 INFO:tasks.workunit.client.1.smithi100.stdout:0/172: mknod d1/d38/d3a/c3f 0 2024-04-27T07:33:27.996 INFO:tasks.workunit.client.1.smithi100.stdout:4/236: dread d5/fc [0,4194304] 0 2024-04-27T07:33:27.997 INFO:tasks.workunit.client.1.smithi100.stdout:0/173: write d1/d30/f33 [3884844,7066] 0 2024-04-27T07:33:28.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/137: symlink d7/d9/d10/d22/l2b 0 2024-04-27T07:33:28.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/138: fsync f4 0 2024-04-27T07:33:28.001 INFO:tasks.workunit.client.1.smithi100.stdout:3/139: stat d7 0 2024-04-27T07:33:28.004 INFO:tasks.workunit.client.1.smithi100.stdout:6/147: truncate f8 644349 0 2024-04-27T07:33:28.004 INFO:tasks.workunit.client.1.smithi100.stdout:2/192: link d0/c17 d0/da/c41 0 2024-04-27T07:33:28.005 INFO:tasks.workunit.client.1.smithi100.stdout:2/193: stat d0/d1e/ff 0 2024-04-27T07:33:28.011 INFO:tasks.workunit.client.1.smithi100.stdout:3/140: dread d7/d9/d10/f15 [0,4194304] 0 2024-04-27T07:33:28.015 INFO:tasks.workunit.client.1.smithi100.stdout:4/237: link d5/d16/d19/l31 d5/d16/l4e 0 2024-04-27T07:33:28.015 INFO:tasks.workunit.client.1.smithi100.stdout:5/161: dwrite d0/f10 [0,4194304] 0 2024-04-27T07:33:28.017 INFO:tasks.workunit.client.1.smithi100.stdout:0/174: getdents d1 0 2024-04-27T07:33:28.019 INFO:tasks.workunit.client.0.smithi082.stdout:8/638: dwrite d0/d3/d1b/f3c [0,4194304] 0 2024-04-27T07:33:28.020 INFO:tasks.workunit.client.1.smithi100.stdout:0/175: chown d1/d38/l3e 5253157 1 2024-04-27T07:33:28.020 INFO:tasks.workunit.client.0.smithi082.stdout:8/639: chown d0/d2b/d9a/da4/d35/f75 784 1 2024-04-27T07:33:28.021 INFO:tasks.workunit.client.1.smithi100.stdout:6/148: getdents de/d18/d21/d24 0 2024-04-27T07:33:28.021 INFO:tasks.workunit.client.0.smithi082.stdout:8/640: readlink d0/d3/d87/l2d 0 2024-04-27T07:33:28.022 INFO:tasks.workunit.client.1.smithi100.stdout:2/194: dwrite d0/f11 [0,4194304] 0 2024-04-27T07:33:28.022 INFO:tasks.workunit.client.0.smithi082.stdout:8/641: rmdir d0/d3/d1b/d53 39 2024-04-27T07:33:28.023 INFO:tasks.workunit.client.1.smithi100.stdout:3/141: mkdir d7/d9/d10/d28/d2c 0 2024-04-27T07:33:28.028 INFO:tasks.workunit.client.1.smithi100.stdout:6/149: write de/d18/d21/f32 [533434,54474] 0 2024-04-27T07:33:28.033 INFO:tasks.workunit.client.1.smithi100.stdout:2/195: dread d0/f11 [0,4194304] 0 2024-04-27T07:33:28.034 INFO:tasks.workunit.client.1.smithi100.stdout:0/176: unlink d1/d8/d20/d1e/c2f 0 2024-04-27T07:33:28.035 INFO:tasks.workunit.client.1.smithi100.stdout:3/142: rename d7 to d7/d2d 22 2024-04-27T07:33:28.038 INFO:tasks.workunit.client.1.smithi100.stdout:6/150: symlink de/d18/d28/l38 0 2024-04-27T07:33:28.040 INFO:tasks.workunit.client.1.smithi100.stdout:0/177: creat d1/d38/f40 x:0 0 0 2024-04-27T07:33:28.042 INFO:tasks.workunit.client.1.smithi100.stdout:2/196: mknod d0/da/d29/d26/d3e/c42 0 2024-04-27T07:33:28.043 INFO:tasks.workunit.client.1.smithi100.stdout:2/197: read - d0/d1e/f31 zero size 2024-04-27T07:33:28.044 INFO:tasks.workunit.client.1.smithi100.stdout:5/162: getdents d0 0 2024-04-27T07:33:28.045 INFO:tasks.workunit.client.1.smithi100.stdout:0/178: truncate d1/d8/fc 1518558 0 2024-04-27T07:33:28.045 INFO:tasks.workunit.client.1.smithi100.stdout:5/163: read d0/f14 [314843,21715] 0 2024-04-27T07:33:28.046 INFO:tasks.workunit.client.1.smithi100.stdout:6/151: creat de/d18/d21/d23/f39 x:0 0 0 2024-04-27T07:33:28.047 INFO:tasks.workunit.client.0.smithi082.stdout:8/642: dread d0/d3/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:28.048 INFO:tasks.workunit.client.1.smithi100.stdout:2/198: rename d0/d1e/ff to d0/da/d29/d26/d3e/f43 0 2024-04-27T07:33:28.049 INFO:tasks.workunit.client.1.smithi100.stdout:0/179: creat d1/d8/d14/f41 x:0 0 0 2024-04-27T07:33:28.050 INFO:tasks.workunit.client.0.smithi082.stdout:8/643: rename d0/d2b/d9a/fad to d0/d3/d55/fcf 0 2024-04-27T07:33:28.050 INFO:tasks.workunit.client.1.smithi100.stdout:3/143: getdents d7/d9/d10/d22 0 2024-04-27T07:33:28.052 INFO:tasks.workunit.client.0.smithi082.stdout:8/644: creat d0/d2b/d9a/fd0 x:0 0 0 2024-04-27T07:33:28.052 INFO:tasks.workunit.client.1.smithi100.stdout:6/152: symlink de/d18/d28/l3a 0 2024-04-27T07:33:28.054 INFO:tasks.workunit.client.1.smithi100.stdout:2/199: mknod d0/d1e/c44 0 2024-04-27T07:33:28.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/645: rename d0/d3/d1b/l31 to d0/d2b/d80/da9/dc6/ld1 0 2024-04-27T07:33:28.055 INFO:tasks.workunit.client.1.smithi100.stdout:0/180: creat d1/d8/d20/f42 x:0 0 0 2024-04-27T07:33:28.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/646: truncate d0/d3/d1b/fa6 258401 0 2024-04-27T07:33:28.056 INFO:tasks.workunit.client.0.smithi082.stdout:8/647: fsync d0/d3/d87/f3e 0 2024-04-27T07:33:28.057 INFO:tasks.workunit.client.1.smithi100.stdout:0/181: fdatasync d1/d8/d14/f17 0 2024-04-27T07:33:28.058 INFO:tasks.workunit.client.1.smithi100.stdout:4/238: truncate d5/fe 3849593 0 2024-04-27T07:33:28.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/648: mkdir d0/d3/d55/d6d/dbf/dd2 0 2024-04-27T07:33:28.059 INFO:tasks.workunit.client.1.smithi100.stdout:2/200: stat d0/da/l2e 0 2024-04-27T07:33:28.060 INFO:tasks.workunit.client.1.smithi100.stdout:3/144: dwrite d7/f1c [0,4194304] 0 2024-04-27T07:33:28.062 INFO:tasks.workunit.client.1.smithi100.stdout:6/153: creat de/d2e/f3b x:0 0 0 2024-04-27T07:33:28.064 INFO:tasks.workunit.client.1.smithi100.stdout:0/182: rename d1/l9 to d1/d30/l43 0 2024-04-27T07:33:28.067 INFO:tasks.workunit.client.1.smithi100.stdout:2/201: creat d0/da/d29/d26/f45 x:0 0 0 2024-04-27T07:33:28.068 INFO:tasks.workunit.client.1.smithi100.stdout:4/239: dread d5/d16/d19/d21/f3e [0,4194304] 0 2024-04-27T07:33:28.068 INFO:tasks.workunit.client.1.smithi100.stdout:6/154: creat de/f3c x:0 0 0 2024-04-27T07:33:28.072 INFO:tasks.workunit.client.1.smithi100.stdout:3/145: rename d7/f18 to d7/d9/d10/d28/d2c/f2e 0 2024-04-27T07:33:28.075 INFO:tasks.workunit.client.1.smithi100.stdout:2/202: mknod d0/da/d29/c46 0 2024-04-27T07:33:28.076 INFO:tasks.workunit.client.1.smithi100.stdout:2/203: stat d0/da/l2e 0 2024-04-27T07:33:28.076 INFO:tasks.workunit.client.1.smithi100.stdout:6/155: dwrite de/d18/d21/d24/f2b [0,4194304] 0 2024-04-27T07:33:28.077 INFO:tasks.workunit.client.1.smithi100.stdout:4/240: symlink d5/d16/d19/l4f 0 2024-04-27T07:33:28.077 INFO:tasks.workunit.client.1.smithi100.stdout:2/204: truncate d0/f12 4986803 0 2024-04-27T07:33:28.082 INFO:tasks.workunit.client.1.smithi100.stdout:2/205: mkdir d0/da/d29/d47 0 2024-04-27T07:33:28.083 INFO:tasks.workunit.client.0.smithi082.stdout:8/649: dread d0/d2b/d9a/da4/d35/f49 [0,4194304] 0 2024-04-27T07:33:28.085 INFO:tasks.workunit.client.1.smithi100.stdout:4/241: mkdir d5/d1b/d2c/d50 0 2024-04-27T07:33:28.086 INFO:tasks.workunit.client.1.smithi100.stdout:6/156: dwrite fd [0,4194304] 0 2024-04-27T07:33:28.086 INFO:tasks.workunit.client.1.smithi100.stdout:3/146: mkdir d7/d9/d2f 0 2024-04-27T07:33:28.088 INFO:tasks.workunit.client.1.smithi100.stdout:4/242: write d5/d16/d19/f30 [945142,11070] 0 2024-04-27T07:33:28.090 INFO:tasks.workunit.client.0.smithi082.stdout:8/650: dwrite d0/d83/d90/fce [0,4194304] 0 2024-04-27T07:33:28.090 INFO:tasks.workunit.client.1.smithi100.stdout:6/157: write fd [923027,54238] 0 2024-04-27T07:33:28.090 INFO:tasks.workunit.client.1.smithi100.stdout:3/147: readlink d7/d9/d26/d2a/l1d 0 2024-04-27T07:33:28.095 INFO:tasks.workunit.client.1.smithi100.stdout:2/206: creat d0/da/d3a/f48 x:0 0 0 2024-04-27T07:33:28.097 INFO:tasks.workunit.client.1.smithi100.stdout:3/148: dread d7/d9/d10/f11 [0,4194304] 0 2024-04-27T07:33:28.101 INFO:tasks.workunit.client.1.smithi100.stdout:6/158: mknod de/d18/d21/d24/c3d 0 2024-04-27T07:33:28.101 INFO:tasks.workunit.client.0.smithi082.stdout:8/651: write d0/d2b/d9a/da4/d35/f75 [973300,127903] 0 2024-04-27T07:33:28.101 INFO:tasks.workunit.client.0.smithi082.stdout:8/652: fdatasync d0/d3/d87/f28 0 2024-04-27T07:33:28.103 INFO:tasks.workunit.client.1.smithi100.stdout:4/243: rename d5/d16/d19/d46/f4a to d5/d16/d19/d21/d2b/f51 0 2024-04-27T07:33:28.106 INFO:tasks.workunit.client.1.smithi100.stdout:0/183: chown d1/d38/l3e 103767069 1 2024-04-27T07:33:28.107 INFO:tasks.workunit.client.0.smithi082.stdout:8/653: dread d0/d3/d87/d42/fab [0,4194304] 0 2024-04-27T07:33:28.108 INFO:tasks.workunit.client.1.smithi100.stdout:3/149: creat d7/d9/d10/f30 x:0 0 0 2024-04-27T07:33:28.110 INFO:tasks.workunit.client.1.smithi100.stdout:6/159: dwrite de/d18/d21/f32 [0,4194304] 0 2024-04-27T07:33:28.110 INFO:tasks.workunit.client.1.smithi100.stdout:3/150: fsync d7/d9/d26/d2a/f20 0 2024-04-27T07:33:28.112 INFO:tasks.workunit.client.1.smithi100.stdout:4/244: symlink d5/d16/d17/l52 0 2024-04-27T07:33:28.112 INFO:tasks.workunit.client.1.smithi100.stdout:6/160: chown de/d18/d28/l3a 214700 1 2024-04-27T07:33:28.113 INFO:tasks.workunit.client.1.smithi100.stdout:0/184: stat d1/c2c 0 2024-04-27T07:33:28.113 INFO:tasks.workunit.client.1.smithi100.stdout:6/161: stat de/d18/l1d 0 2024-04-27T07:33:28.116 INFO:tasks.workunit.client.1.smithi100.stdout:6/162: write de/d18/d21/f32 [832967,130482] 0 2024-04-27T07:33:28.118 INFO:tasks.workunit.client.1.smithi100.stdout:3/151: symlink d7/d9/d10/d28/d2c/l31 0 2024-04-27T07:33:28.119 INFO:tasks.workunit.client.1.smithi100.stdout:6/163: readlink de/d18/d28/l3a 0 2024-04-27T07:33:28.122 INFO:tasks.workunit.client.1.smithi100.stdout:2/207: rename d0/da/d29/c35 to d0/c49 0 2024-04-27T07:33:28.123 INFO:tasks.workunit.client.1.smithi100.stdout:4/245: dwrite d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:28.125 INFO:tasks.workunit.client.1.smithi100.stdout:6/164: creat de/d18/d21/d23/f3e x:0 0 0 2024-04-27T07:33:28.129 INFO:tasks.workunit.client.1.smithi100.stdout:4/246: mkdir d5/d16/d19/d46/d53 0 2024-04-27T07:33:28.133 INFO:tasks.workunit.client.1.smithi100.stdout:2/208: getdents d0/da/d39 0 2024-04-27T07:33:28.134 INFO:tasks.workunit.client.1.smithi100.stdout:0/185: dwrite d1/d8/d20/f42 [0,4194304] 0 2024-04-27T07:33:28.135 INFO:tasks.workunit.client.1.smithi100.stdout:4/247: symlink d5/d16/d19/d21/l54 0 2024-04-27T07:33:28.136 INFO:tasks.workunit.client.0.smithi082.stdout:8/654: dread d0/d3/f9 [0,4194304] 0 2024-04-27T07:33:28.136 INFO:tasks.workunit.client.1.smithi100.stdout:3/152: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:28.138 INFO:tasks.workunit.client.1.smithi100.stdout:0/186: readlink d1/d8/l15 0 2024-04-27T07:33:28.138 INFO:tasks.workunit.client.0.smithi082.stdout:8/655: getdents d0/d3/d55/d6d/dbf 0 2024-04-27T07:33:28.139 INFO:tasks.workunit.client.1.smithi100.stdout:6/165: dwrite de/f3c [0,4194304] 0 2024-04-27T07:33:28.139 INFO:tasks.workunit.client.0.smithi082.stdout:8/656: fdatasync d0/d3/d1b/f3c 0 2024-04-27T07:33:28.140 INFO:tasks.workunit.client.1.smithi100.stdout:2/209: write d0/da/d29/d26/f45 [292997,83565] 0 2024-04-27T07:33:28.141 INFO:tasks.workunit.client.1.smithi100.stdout:4/248: symlink d5/d16/d2e/l55 0 2024-04-27T07:33:28.142 INFO:tasks.workunit.client.0.smithi082.stdout:8/657: creat d0/d3/d1b/d53/fd3 x:0 0 0 2024-04-27T07:33:28.143 INFO:tasks.workunit.client.1.smithi100.stdout:3/153: creat d7/d9/d26/f32 x:0 0 0 2024-04-27T07:33:28.143 INFO:tasks.workunit.client.1.smithi100.stdout:2/210: truncate d0/d1e/f31 507431 0 2024-04-27T07:33:28.143 INFO:tasks.workunit.client.1.smithi100.stdout:6/166: truncate de/d18/f1b 4394780 0 2024-04-27T07:33:28.146 INFO:tasks.workunit.client.0.smithi082.stdout:8/658: rename d0/d2b/d9a/da4/d35/f49 to d0/d2b/d6f/fd4 0 2024-04-27T07:33:28.146 INFO:tasks.workunit.client.1.smithi100.stdout:6/167: mkdir de/d2e/d3f 0 2024-04-27T07:33:28.146 INFO:tasks.workunit.client.1.smithi100.stdout:0/187: link d1/d8/d20/c25 d1/d8/c44 0 2024-04-27T07:33:28.147 INFO:tasks.workunit.client.0.smithi082.stdout:8/659: chown d0/d3/d1b/d29/d65/fa2 140316 1 2024-04-27T07:33:28.147 INFO:tasks.workunit.client.0.smithi082.stdout:8/660: stat d0/d3/d87/d42/d7f/d82 0 2024-04-27T07:33:28.149 INFO:tasks.workunit.client.0.smithi082.stdout:8/661: read d0/d3/f1a [243408,65399] 0 2024-04-27T07:33:28.151 INFO:tasks.workunit.client.1.smithi100.stdout:4/249: dwrite d5/d16/f26 [0,4194304] 0 2024-04-27T07:33:28.152 INFO:tasks.workunit.client.0.smithi082.stdout:8/662: mkdir d0/d2b/dd5 0 2024-04-27T07:33:28.154 INFO:tasks.workunit.client.1.smithi100.stdout:6/168: dwrite de/d18/d28/f30 [0,4194304] 0 2024-04-27T07:33:28.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/663: creat d0/d2b/d80/da9/dc6/fd6 x:0 0 0 2024-04-27T07:33:28.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/664: dread - d0/d3/d87/d42/f9b zero size 2024-04-27T07:33:28.157 INFO:tasks.workunit.client.0.smithi082.stdout:8/665: symlink d0/d2b/d9a/da4/ld7 0 2024-04-27T07:33:28.159 INFO:tasks.workunit.client.0.smithi082.stdout:8/666: symlink d0/d2b/d9a/ld8 0 2024-04-27T07:33:28.161 INFO:tasks.workunit.client.1.smithi100.stdout:6/169: dwrite de/d18/d28/f2c [0,4194304] 0 2024-04-27T07:33:28.162 INFO:tasks.workunit.client.1.smithi100.stdout:6/170: fdatasync de/d18/f1a 0 2024-04-27T07:33:28.163 INFO:tasks.workunit.client.0.smithi082.stdout:8/667: rename d0/d2b/d9a/lb5 to d0/d3/d55/d6d/dbf/dd2/ld9 0 2024-04-27T07:33:28.165 INFO:tasks.workunit.client.0.smithi082.stdout:8/668: symlink d0/d3/d55/d6d/dbf/lda 0 2024-04-27T07:33:28.166 INFO:tasks.workunit.client.1.smithi100.stdout:8/181: sync 2024-04-27T07:33:28.166 INFO:tasks.workunit.client.0.smithi082.stdout:8/669: fsync d0/d2b/d9a/da4/fbc 0 2024-04-27T07:33:28.167 INFO:tasks.workunit.client.0.smithi082.stdout:8/670: write d0/d2b/d80/fb9 [3030306,96352] 0 2024-04-27T07:33:28.169 INFO:tasks.workunit.client.1.smithi100.stdout:2/211: creat d0/da/d29/d47/f4a x:0 0 0 2024-04-27T07:33:28.176 INFO:tasks.workunit.client.1.smithi100.stdout:4/250: rename d5/d1b/f4b to d5/d16/d17/f56 0 2024-04-27T07:33:28.178 INFO:tasks.workunit.client.1.smithi100.stdout:4/251: write d5/d16/d19/d21/f3a [179237,15429] 0 2024-04-27T07:33:28.180 INFO:tasks.workunit.client.1.smithi100.stdout:0/188: dwrite d1/d8/f2e [0,4194304] 0 2024-04-27T07:33:28.181 INFO:tasks.workunit.client.1.smithi100.stdout:8/182: rename d6/d1b/f2b to d6/d20/d2a/f3c 0 2024-04-27T07:33:28.182 INFO:tasks.workunit.client.1.smithi100.stdout:8/183: readlink d6/d1b/d1d/l36 0 2024-04-27T07:33:28.184 INFO:tasks.workunit.client.1.smithi100.stdout:4/252: rmdir d5/d16/d19/d21/d43 0 2024-04-27T07:33:28.187 INFO:tasks.workunit.client.1.smithi100.stdout:8/184: mknod d6/d1b/d1d/c3d 0 2024-04-27T07:33:28.187 INFO:tasks.workunit.client.1.smithi100.stdout:2/212: dread d0/f24 [0,4194304] 0 2024-04-27T07:33:28.191 INFO:tasks.workunit.client.1.smithi100.stdout:2/213: creat d0/da/d29/d26/f4b x:0 0 0 2024-04-27T07:33:28.193 INFO:tasks.workunit.client.1.smithi100.stdout:0/189: dwrite d1/d38/f40 [0,4194304] 0 2024-04-27T07:33:28.196 INFO:tasks.workunit.client.1.smithi100.stdout:3/154: truncate d7/d9/fc 315912 0 2024-04-27T07:33:28.198 INFO:tasks.workunit.client.1.smithi100.stdout:2/214: symlink d0/d1e/l4c 0 2024-04-27T07:33:28.199 INFO:tasks.workunit.client.1.smithi100.stdout:3/155: write f4 [484395,35089] 0 2024-04-27T07:33:28.201 INFO:tasks.workunit.client.1.smithi100.stdout:2/215: chown d0/l18 109350131 1 2024-04-27T07:33:28.202 INFO:tasks.workunit.client.1.smithi100.stdout:4/253: dwrite d5/d16/d19/d21/d2b/f51 [4194304,4194304] 0 2024-04-27T07:33:28.203 INFO:tasks.workunit.client.1.smithi100.stdout:8/185: dwrite d6/d20/f29 [0,4194304] 0 2024-04-27T07:33:28.203 INFO:tasks.workunit.client.1.smithi100.stdout:0/190: chown d1/d30/l43 32 1 2024-04-27T07:33:28.203 INFO:tasks.workunit.client.1.smithi100.stdout:6/171: write de/d18/f20 [4190613,20874] 0 2024-04-27T07:33:28.205 INFO:tasks.workunit.client.1.smithi100.stdout:0/191: dread - d1/d30/f3d zero size 2024-04-27T07:33:28.209 INFO:tasks.workunit.client.1.smithi100.stdout:3/156: mkdir d7/d9/d10/d33 0 2024-04-27T07:33:28.212 INFO:tasks.workunit.client.1.smithi100.stdout:4/254: creat d5/d1b/d2c/d3f/f57 x:0 0 0 2024-04-27T07:33:28.213 INFO:tasks.workunit.client.1.smithi100.stdout:3/157: chown d7/d9/d26/d2a/c1e 104 1 2024-04-27T07:33:28.213 INFO:tasks.workunit.client.1.smithi100.stdout:2/216: symlink d0/da/d39/l4d 0 2024-04-27T07:33:28.216 INFO:tasks.workunit.client.1.smithi100.stdout:0/192: symlink d1/d8/l45 0 2024-04-27T07:33:28.217 INFO:tasks.workunit.client.1.smithi100.stdout:8/186: dwrite d6/d20/f29 [0,4194304] 0 2024-04-27T07:33:28.218 INFO:tasks.workunit.client.1.smithi100.stdout:8/187: stat d6/d20/d2a 0 2024-04-27T07:33:28.218 INFO:tasks.workunit.client.1.smithi100.stdout:6/172: dwrite de/d18/f1b [0,4194304] 0 2024-04-27T07:33:28.222 INFO:tasks.workunit.client.1.smithi100.stdout:4/255: creat d5/d16/d19/d21/d2b/f58 x:0 0 0 2024-04-27T07:33:28.223 INFO:tasks.workunit.client.1.smithi100.stdout:3/158: creat d7/d9/d10/d28/d2c/f34 x:0 0 0 2024-04-27T07:33:28.228 INFO:tasks.workunit.client.1.smithi100.stdout:6/173: symlink de/d18/d21/l40 0 2024-04-27T07:33:28.231 INFO:tasks.workunit.client.1.smithi100.stdout:4/256: unlink d5/d16/d17/l52 0 2024-04-27T07:33:28.233 INFO:tasks.workunit.client.1.smithi100.stdout:3/159: dwrite f6 [0,4194304] 0 2024-04-27T07:33:28.235 INFO:tasks.workunit.client.1.smithi100.stdout:3/160: truncate d7/f1c 4911505 0 2024-04-27T07:33:28.240 INFO:tasks.workunit.client.1.smithi100.stdout:3/161: rmdir d7/d9/d26/d2a 39 2024-04-27T07:33:28.241 INFO:tasks.workunit.client.1.smithi100.stdout:2/217: write d0/f24 [1446594,59289] 0 2024-04-27T07:33:28.243 INFO:tasks.workunit.client.1.smithi100.stdout:6/174: dwrite de/d18/f22 [0,4194304] 0 2024-04-27T07:33:28.246 INFO:tasks.workunit.client.1.smithi100.stdout:3/162: chown d7/d9/d10/d22/l2b 3254134 1 2024-04-27T07:33:28.247 INFO:tasks.workunit.client.1.smithi100.stdout:2/218: mknod d0/da/d39/c4e 0 2024-04-27T07:33:28.248 INFO:tasks.workunit.client.1.smithi100.stdout:4/257: dwrite d5/d16/d19/d21/d2b/f51 [0,4194304] 0 2024-04-27T07:33:28.250 INFO:tasks.workunit.client.1.smithi100.stdout:3/163: write d7/f1f [1026285,38494] 0 2024-04-27T07:33:28.251 INFO:tasks.workunit.client.1.smithi100.stdout:6/175: symlink de/d2e/d3f/l41 0 2024-04-27T07:33:28.256 INFO:tasks.workunit.client.1.smithi100.stdout:8/188: dwrite d6/f17 [0,4194304] 0 2024-04-27T07:33:28.256 INFO:tasks.workunit.client.1.smithi100.stdout:4/258: fdatasync d5/fe 0 2024-04-27T07:33:28.257 INFO:tasks.workunit.client.1.smithi100.stdout:6/176: chown de/d18/d21/d24/f25 5009351 1 2024-04-27T07:33:28.259 INFO:tasks.workunit.client.1.smithi100.stdout:8/189: fdatasync d6/d1b/f2d 0 2024-04-27T07:33:28.261 INFO:tasks.workunit.client.1.smithi100.stdout:6/177: symlink de/d2e/l42 0 2024-04-27T07:33:28.262 INFO:tasks.workunit.client.1.smithi100.stdout:2/219: dwrite d0/f24 [0,4194304] 0 2024-04-27T07:33:28.262 INFO:tasks.workunit.client.1.smithi100.stdout:4/259: symlink d5/d16/d19/d21/l59 0 2024-04-27T07:33:28.264 INFO:tasks.workunit.client.1.smithi100.stdout:4/260: fdatasync d5/d16/d19/f3d 0 2024-04-27T07:33:28.266 INFO:tasks.workunit.client.1.smithi100.stdout:0/193: dread d1/f10 [0,4194304] 0 2024-04-27T07:33:28.266 INFO:tasks.workunit.client.1.smithi100.stdout:2/220: dread - d0/da/d29/d26/f4b zero size 2024-04-27T07:33:28.266 INFO:tasks.workunit.client.1.smithi100.stdout:4/261: chown d5/f15 26897 1 2024-04-27T07:33:28.266 INFO:tasks.workunit.client.0.smithi082.stdout:9/597: sync 2024-04-27T07:33:28.267 INFO:tasks.workunit.client.1.smithi100.stdout:6/178: truncate de/d18/f35 411762 0 2024-04-27T07:33:28.267 INFO:tasks.workunit.client.1.smithi100.stdout:4/262: readlink d5/d16/d2e/l55 0 2024-04-27T07:33:28.268 INFO:tasks.workunit.client.1.smithi100.stdout:8/190: symlink d6/d20/l3e 0 2024-04-27T07:33:28.269 INFO:tasks.workunit.client.0.smithi082.stdout:9/598: mkdir d9/d2d/d2b/d46/d76/dcb 0 2024-04-27T07:33:28.270 INFO:tasks.workunit.client.1.smithi100.stdout:3/164: write d7/d9/d10/f11 [2391072,68930] 0 2024-04-27T07:33:28.271 INFO:tasks.workunit.client.0.smithi082.stdout:9/599: creat d9/d2d/d2b/d46/db6/fcc x:0 0 0 2024-04-27T07:33:28.272 INFO:tasks.workunit.client.1.smithi100.stdout:0/194: rename d1/d38/d3a/c3f to d1/d38/c46 0 2024-04-27T07:33:28.273 INFO:tasks.workunit.client.1.smithi100.stdout:2/221: rmdir d0 39 2024-04-27T07:33:28.274 INFO:tasks.workunit.client.1.smithi100.stdout:4/263: mkdir d5/d16/d2e/d5a 0 2024-04-27T07:33:28.275 INFO:tasks.workunit.client.0.smithi082.stdout:9/600: rename d9/da/dc/d35/l5a to d9/da/dc/lcd 0 2024-04-27T07:33:28.277 INFO:tasks.workunit.client.1.smithi100.stdout:4/264: write d5/f6 [3011953,61446] 0 2024-04-27T07:33:28.277 INFO:tasks.workunit.client.1.smithi100.stdout:0/195: fdatasync d1/f5 0 2024-04-27T07:33:28.277 INFO:tasks.workunit.client.0.smithi082.stdout:9/601: symlink d9/da/db0/lce 0 2024-04-27T07:33:28.280 INFO:tasks.workunit.client.1.smithi100.stdout:6/179: link de/d18/d21/d24/f27 de/d2e/d3f/f43 0 2024-04-27T07:33:28.281 INFO:tasks.workunit.client.1.smithi100.stdout:0/196: read - d1/d8/d14/f41 zero size 2024-04-27T07:33:28.282 INFO:tasks.workunit.client.1.smithi100.stdout:8/191: dwrite d6/d1b/f22 [0,4194304] 0 2024-04-27T07:33:28.283 INFO:tasks.workunit.client.1.smithi100.stdout:2/222: creat d0/da/d29/d47/f4f x:0 0 0 2024-04-27T07:33:28.284 INFO:tasks.workunit.client.1.smithi100.stdout:6/180: fsync de/d18/f1a 0 2024-04-27T07:33:28.285 INFO:tasks.workunit.client.1.smithi100.stdout:3/165: dwrite d7/d9/d10/f11 [0,4194304] 0 2024-04-27T07:33:28.287 INFO:tasks.workunit.client.1.smithi100.stdout:0/197: creat d1/d38/f47 x:0 0 0 2024-04-27T07:33:28.291 INFO:tasks.workunit.client.1.smithi100.stdout:6/181: chown de/d18/d21/d24/f2b 271479704 1 2024-04-27T07:33:28.295 INFO:tasks.workunit.client.1.smithi100.stdout:2/223: creat d0/da/f50 x:0 0 0 2024-04-27T07:33:28.295 INFO:tasks.workunit.client.1.smithi100.stdout:4/265: dwrite d5/f32 [0,4194304] 0 2024-04-27T07:33:28.295 INFO:tasks.workunit.client.1.smithi100.stdout:7/101: sync 2024-04-27T07:33:28.296 INFO:tasks.workunit.client.1.smithi100.stdout:1/277: sync 2024-04-27T07:33:28.298 INFO:tasks.workunit.client.1.smithi100.stdout:4/266: stat d5/d23/l29 0 2024-04-27T07:33:28.299 INFO:tasks.workunit.client.1.smithi100.stdout:7/102: write d1/f6 [2359493,98935] 0 2024-04-27T07:33:28.299 INFO:tasks.workunit.client.1.smithi100.stdout:1/278: chown d0/d23/c45 2096 1 2024-04-27T07:33:28.300 INFO:tasks.workunit.client.1.smithi100.stdout:0/198: link d1/d8/d20/f1c d1/d38/d3a/f48 0 2024-04-27T07:33:28.300 INFO:tasks.workunit.client.1.smithi100.stdout:8/192: dwrite d6/d20/d2a/f37 [0,4194304] 0 2024-04-27T07:33:28.301 INFO:tasks.workunit.client.1.smithi100.stdout:2/224: mkdir d0/d1e/d51 0 2024-04-27T07:33:28.302 INFO:tasks.workunit.client.1.smithi100.stdout:4/267: fsync d5/d23/f3c 0 2024-04-27T07:33:28.302 INFO:tasks.workunit.client.1.smithi100.stdout:7/103: chown d1/ca 6 1 2024-04-27T07:33:28.303 INFO:tasks.workunit.client.1.smithi100.stdout:1/279: fdatasync d0/d1b/f3e 0 2024-04-27T07:33:28.305 INFO:tasks.workunit.client.1.smithi100.stdout:7/104: read - d1/f15 zero size 2024-04-27T07:33:28.306 INFO:tasks.workunit.client.1.smithi100.stdout:0/199: mknod d1/d38/c49 0 2024-04-27T07:33:28.309 INFO:tasks.workunit.client.1.smithi100.stdout:2/225: dread d0/d1e/f3b [0,4194304] 0 2024-04-27T07:33:28.310 INFO:tasks.workunit.client.1.smithi100.stdout:2/226: fsync d0/d1e/f31 0 2024-04-27T07:33:28.316 INFO:tasks.workunit.client.1.smithi100.stdout:0/200: creat d1/d38/f4a x:0 0 0 2024-04-27T07:33:28.318 INFO:tasks.workunit.client.1.smithi100.stdout:6/182: dwrite de/d18/d21/d24/f27 [0,4194304] 0 2024-04-27T07:33:28.320 INFO:tasks.workunit.client.1.smithi100.stdout:6/183: readlink de/d18/d21/l40 0 2024-04-27T07:33:28.321 INFO:tasks.workunit.client.1.smithi100.stdout:7/105: link d1/f15 d1/f1a 0 2024-04-27T07:33:28.322 INFO:tasks.workunit.client.1.smithi100.stdout:0/201: dread d1/d8/d20/f1c [0,4194304] 0 2024-04-27T07:33:28.323 INFO:tasks.workunit.client.1.smithi100.stdout:2/227: creat d0/d1e/d51/f52 x:0 0 0 2024-04-27T07:33:28.324 INFO:tasks.workunit.client.1.smithi100.stdout:2/228: dread - d0/da/d29/f23 zero size 2024-04-27T07:33:28.326 INFO:tasks.workunit.client.1.smithi100.stdout:0/202: creat d1/d8/d20/f4b x:0 0 0 2024-04-27T07:33:28.331 INFO:tasks.workunit.client.1.smithi100.stdout:0/203: rmdir d1/d8/d20/d1e 39 2024-04-27T07:33:28.331 INFO:tasks.workunit.client.1.smithi100.stdout:4/268: write d5/d16/d19/d21/f3e [2024937,39474] 0 2024-04-27T07:33:28.333 INFO:tasks.workunit.client.1.smithi100.stdout:7/106: dwrite d1/f1a [0,4194304] 0 2024-04-27T07:33:28.334 INFO:tasks.workunit.client.1.smithi100.stdout:2/229: rename d0/da/d29/c2c to d0/d1e/c53 0 2024-04-27T07:33:28.335 INFO:tasks.workunit.client.1.smithi100.stdout:7/107: chown d1/f1a 3 1 2024-04-27T07:33:28.336 INFO:tasks.workunit.client.1.smithi100.stdout:8/193: truncate f1 4053057 0 2024-04-27T07:33:28.337 INFO:tasks.workunit.client.1.smithi100.stdout:8/194: dread - d6/f3b zero size 2024-04-27T07:33:28.337 INFO:tasks.workunit.client.1.smithi100.stdout:0/204: mknod d1/d38/c4c 0 2024-04-27T07:33:28.339 INFO:tasks.workunit.client.1.smithi100.stdout:2/230: write d0/da/d29/d26/f2a [1535335,51928] 0 2024-04-27T07:33:28.339 INFO:tasks.workunit.client.1.smithi100.stdout:4/269: mknod d5/d1b/d2c/d3f/c5b 0 2024-04-27T07:33:28.341 INFO:tasks.workunit.client.1.smithi100.stdout:1/280: dread d0/d1b/d20/d2d/f2e [0,4194304] 0 2024-04-27T07:33:28.342 INFO:tasks.workunit.client.1.smithi100.stdout:1/281: stat d0/f14 0 2024-04-27T07:33:28.343 INFO:tasks.workunit.client.1.smithi100.stdout:8/195: mkdir d6/d20/d2a/d3f 0 2024-04-27T07:33:28.344 INFO:tasks.workunit.client.1.smithi100.stdout:1/282: write d0/f26 [2571910,72186] 0 2024-04-27T07:33:28.345 INFO:tasks.workunit.client.1.smithi100.stdout:7/108: creat d1/dd/d16/f1b x:0 0 0 2024-04-27T07:33:28.349 INFO:tasks.workunit.client.1.smithi100.stdout:2/231: dwrite d0/da/d29/d26/f4b [0,4194304] 0 2024-04-27T07:33:28.349 INFO:tasks.workunit.client.1.smithi100.stdout:8/196: chown f4 61715 1 2024-04-27T07:33:28.350 INFO:tasks.workunit.client.1.smithi100.stdout:0/205: mknod d1/d8/d20/c4d 0 2024-04-27T07:33:28.351 INFO:tasks.workunit.client.1.smithi100.stdout:4/270: creat d5/d1b/d2c/d50/f5c x:0 0 0 2024-04-27T07:33:28.351 INFO:tasks.workunit.client.1.smithi100.stdout:0/206: fsync d1/d8/d20/f29 0 2024-04-27T07:33:28.353 INFO:tasks.workunit.client.1.smithi100.stdout:7/109: dread d1/f15 [0,4194304] 0 2024-04-27T07:33:28.353 INFO:tasks.workunit.client.1.smithi100.stdout:0/207: dread - d1/d8/d20/f28 zero size 2024-04-27T07:33:28.353 INFO:tasks.workunit.client.1.smithi100.stdout:4/271: chown d5/d16/d2e/f38 61278113 1 2024-04-27T07:33:28.355 INFO:tasks.workunit.client.1.smithi100.stdout:1/283: mkdir d0/d1b/d20/d2d/d35/d4d 0 2024-04-27T07:33:28.356 INFO:tasks.workunit.client.1.smithi100.stdout:2/232: symlink d0/da/d29/l54 0 2024-04-27T07:33:28.361 INFO:tasks.workunit.client.1.smithi100.stdout:1/284: mkdir d0/d1f/d27/d4e 0 2024-04-27T07:33:28.365 INFO:tasks.workunit.client.1.smithi100.stdout:0/208: rename d1/fa to d1/d30/f4e 0 2024-04-27T07:33:28.368 INFO:tasks.workunit.client.1.smithi100.stdout:1/285: stat d0/d23/l37 0 2024-04-27T07:33:28.370 INFO:tasks.workunit.client.1.smithi100.stdout:2/233: unlink d0/d1e/c53 0 2024-04-27T07:33:28.375 INFO:tasks.workunit.client.1.smithi100.stdout:7/110: rename d1/dd/d16/f1b to d1/f1c 0 2024-04-27T07:33:28.378 INFO:tasks.workunit.client.1.smithi100.stdout:8/197: getdents d6/d1b 0 2024-04-27T07:33:28.380 INFO:tasks.workunit.client.1.smithi100.stdout:2/234: symlink d0/d1e/l55 0 2024-04-27T07:33:28.381 INFO:tasks.workunit.client.1.smithi100.stdout:2/235: chown d0/f24 0 1 2024-04-27T07:33:28.382 INFO:tasks.workunit.client.1.smithi100.stdout:2/236: dread - d0/da/d3a/f48 zero size 2024-04-27T07:33:28.382 INFO:tasks.workunit.client.1.smithi100.stdout:7/111: dread d1/f17 [0,4194304] 0 2024-04-27T07:33:28.382 INFO:tasks.workunit.client.1.smithi100.stdout:4/272: truncate d5/f6 3669644 0 2024-04-27T07:33:28.383 INFO:tasks.workunit.client.1.smithi100.stdout:2/237: readlink d0/da/d29/l54 0 2024-04-27T07:33:28.383 INFO:tasks.workunit.client.1.smithi100.stdout:7/112: readlink d1/dd/l19 0 2024-04-27T07:33:28.387 INFO:tasks.workunit.client.1.smithi100.stdout:1/286: rename d0/d23/d3a/c48 to d0/d1b/d20/d2d/d35/c4f 0 2024-04-27T07:33:28.388 INFO:tasks.workunit.client.1.smithi100.stdout:1/287: readlink d0/l8 0 2024-04-27T07:33:28.389 INFO:tasks.workunit.client.1.smithi100.stdout:0/209: write d1/f24 [2893954,30288] 0 2024-04-27T07:33:28.391 INFO:tasks.workunit.client.1.smithi100.stdout:7/113: symlink d1/l1d 0 2024-04-27T07:33:28.392 INFO:tasks.workunit.client.1.smithi100.stdout:1/288: write d0/f16 [7822112,20508] 0 2024-04-27T07:33:28.394 INFO:tasks.workunit.client.1.smithi100.stdout:1/289: readlink d0/d1f/l42 0 2024-04-27T07:33:28.394 INFO:tasks.workunit.client.1.smithi100.stdout:4/273: dwrite d5/d16/d19/d21/d2b/f58 [0,4194304] 0 2024-04-27T07:33:28.397 INFO:tasks.workunit.client.1.smithi100.stdout:7/114: rename d1/f17 to d1/dd/f1e 0 2024-04-27T07:33:28.398 INFO:tasks.workunit.client.1.smithi100.stdout:0/210: mknod d1/d8/c4f 0 2024-04-27T07:33:28.398 INFO:tasks.workunit.client.1.smithi100.stdout:7/115: dread d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:28.399 INFO:tasks.workunit.client.1.smithi100.stdout:4/274: stat d5/d16/d17/c18 0 2024-04-27T07:33:28.399 INFO:tasks.workunit.client.1.smithi100.stdout:0/211: fsync d1/d8/d20/f1c 0 2024-04-27T07:33:28.400 INFO:tasks.workunit.client.1.smithi100.stdout:1/290: dread d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:28.401 INFO:tasks.workunit.client.1.smithi100.stdout:7/116: mkdir d1/dd/d16/d1f 0 2024-04-27T07:33:28.401 INFO:tasks.workunit.client.1.smithi100.stdout:1/291: write d0/d1f/f2b [297002,74403] 0 2024-04-27T07:33:28.403 INFO:tasks.workunit.client.1.smithi100.stdout:7/117: write d1/f2 [4185229,103525] 0 2024-04-27T07:33:28.403 INFO:tasks.workunit.client.1.smithi100.stdout:0/212: chown d1/d38/d3a/f3c 0 1 2024-04-27T07:33:28.406 INFO:tasks.workunit.client.1.smithi100.stdout:7/118: mkdir d1/d20 0 2024-04-27T07:33:28.408 INFO:tasks.workunit.client.1.smithi100.stdout:0/213: rmdir d1/d8/d20/d1e 39 2024-04-27T07:33:28.409 INFO:tasks.workunit.client.1.smithi100.stdout:4/275: dread d5/fc [0,4194304] 0 2024-04-27T07:33:28.411 INFO:tasks.workunit.client.1.smithi100.stdout:1/292: dwrite d0/d1f/d27/f39 [0,4194304] 0 2024-04-27T07:33:28.412 INFO:tasks.workunit.client.1.smithi100.stdout:0/214: creat d1/d8/d14/f50 x:0 0 0 2024-04-27T07:33:28.412 INFO:tasks.workunit.client.1.smithi100.stdout:4/276: readlink d5/d16/l2f 0 2024-04-27T07:33:28.413 INFO:tasks.workunit.client.1.smithi100.stdout:1/293: dread - d0/f3d zero size 2024-04-27T07:33:28.415 INFO:tasks.workunit.client.1.smithi100.stdout:4/277: write d5/d16/d19/d21/d2b/f58 [847116,125867] 0 2024-04-27T07:33:28.417 INFO:tasks.workunit.client.1.smithi100.stdout:7/119: dread d1/fc [0,4194304] 0 2024-04-27T07:33:28.423 INFO:tasks.workunit.client.1.smithi100.stdout:0/215: dread d1/d38/f40 [0,4194304] 0 2024-04-27T07:33:28.423 INFO:tasks.workunit.client.1.smithi100.stdout:4/278: unlink d5/d16/d17/f56 0 2024-04-27T07:33:28.425 INFO:tasks.workunit.client.1.smithi100.stdout:0/216: read - d1/d8/d14/f41 zero size 2024-04-27T07:33:28.425 INFO:tasks.workunit.client.1.smithi100.stdout:1/294: dwrite d0/f3d [0,4194304] 0 2024-04-27T07:33:28.427 INFO:tasks.workunit.client.1.smithi100.stdout:1/295: chown d0/l1d 4073 1 2024-04-27T07:33:28.428 INFO:tasks.workunit.client.1.smithi100.stdout:0/217: truncate d1/d8/f2e 5186173 0 2024-04-27T07:33:28.435 INFO:tasks.workunit.client.1.smithi100.stdout:0/218: mknod d1/d8/d20/c51 0 2024-04-27T07:33:28.435 INFO:tasks.workunit.client.1.smithi100.stdout:7/120: rmdir d1/dd/d16 39 2024-04-27T07:33:28.436 INFO:tasks.workunit.client.1.smithi100.stdout:1/296: symlink d0/d1b/d20/d2d/d35/d4d/l50 0 2024-04-27T07:33:28.437 INFO:tasks.workunit.client.1.smithi100.stdout:9/176: sync 2024-04-27T07:33:28.438 INFO:tasks.workunit.client.1.smithi100.stdout:4/279: dwrite d5/d16/d19/d21/f3a [0,4194304] 0 2024-04-27T07:33:28.440 INFO:tasks.workunit.client.1.smithi100.stdout:5/164: sync 2024-04-27T07:33:28.441 INFO:tasks.workunit.client.1.smithi100.stdout:2/238: dwrite d0/da/f1c [0,4194304] 0 2024-04-27T07:33:28.442 INFO:tasks.workunit.client.1.smithi100.stdout:9/177: write d1/fd [3608419,27913] 0 2024-04-27T07:33:28.443 INFO:tasks.workunit.client.1.smithi100.stdout:0/219: creat d1/d30/f52 x:0 0 0 2024-04-27T07:33:28.444 INFO:tasks.workunit.client.1.smithi100.stdout:0/220: rename d1 to d1/d38/d3a/d53 22 2024-04-27T07:33:28.448 INFO:tasks.workunit.client.1.smithi100.stdout:5/165: mkdir d0/d4/d17/d1a/d34 0 2024-04-27T07:33:28.449 INFO:tasks.workunit.client.1.smithi100.stdout:5/166: write d0/d4/d21/f2e [507804,89018] 0 2024-04-27T07:33:28.449 INFO:tasks.workunit.client.1.smithi100.stdout:1/297: creat d0/d1b/d20/f51 x:0 0 0 2024-04-27T07:33:28.480 INFO:tasks.workunit.client.1.smithi100.stdout:5/167: write d0/f2a [545844,101428] 0 2024-04-27T07:33:28.481 INFO:tasks.workunit.client.1.smithi100.stdout:9/178: unlink d1/d9/db/c1c 0 2024-04-27T07:33:28.481 INFO:tasks.workunit.client.1.smithi100.stdout:4/280: creat d5/d16/d4c/f5d x:0 0 0 2024-04-27T07:33:28.482 INFO:tasks.workunit.client.1.smithi100.stdout:0/221: mkdir d1/d38/d3a/d54 0 2024-04-27T07:33:28.482 INFO:tasks.workunit.client.1.smithi100.stdout:7/121: truncate d1/f15 3125762 0 2024-04-27T07:33:28.485 INFO:tasks.workunit.client.1.smithi100.stdout:5/168: rename d0/c2d to d0/d4/d28/c35 0 2024-04-27T07:33:28.500 INFO:tasks.workunit.client.1.smithi100.stdout:4/281: rmdir d5/d23/d33 39 2024-04-27T07:33:28.501 INFO:tasks.workunit.client.1.smithi100.stdout:9/179: truncate d1/d9/d1f/f3c 407921 0 2024-04-27T07:33:28.502 INFO:tasks.workunit.client.1.smithi100.stdout:1/298: dwrite d0/fd [0,4194304] 0 2024-04-27T07:33:28.503 INFO:tasks.workunit.client.1.smithi100.stdout:4/282: dread - d5/d23/f42 zero size 2024-04-27T07:33:28.506 INFO:tasks.workunit.client.1.smithi100.stdout:4/283: chown d5/d1b/d2c/d3f 678 1 2024-04-27T07:33:28.506 INFO:tasks.workunit.client.1.smithi100.stdout:1/299: write d0/d1b/f46 [239317,1628] 0 2024-04-27T07:33:28.510 INFO:tasks.workunit.client.1.smithi100.stdout:0/222: dwrite d1/d38/f47 [0,4194304] 0 2024-04-27T07:33:28.513 INFO:tasks.workunit.client.1.smithi100.stdout:5/169: fdatasync d0/d4/f22 0 2024-04-27T07:33:28.519 INFO:tasks.workunit.client.1.smithi100.stdout:5/170: fsync d0/d4/f7 0 2024-04-27T07:33:28.520 INFO:tasks.workunit.client.1.smithi100.stdout:7/122: dwrite d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:28.527 INFO:tasks.workunit.client.1.smithi100.stdout:9/180: dwrite d1/d9/db/f2e [0,4194304] 0 2024-04-27T07:33:28.527 INFO:tasks.workunit.client.1.smithi100.stdout:0/223: truncate d1/d8/d14/f17 1297195 0 2024-04-27T07:33:28.528 INFO:tasks.workunit.client.1.smithi100.stdout:4/284: dwrite d5/f8 [0,4194304] 0 2024-04-27T07:33:28.533 INFO:tasks.workunit.client.1.smithi100.stdout:1/300: dwrite d0/d1b/d20/d2d/f2e [0,4194304] 0 2024-04-27T07:33:28.539 INFO:tasks.workunit.client.1.smithi100.stdout:1/301: creat d0/d1b/d20/d2d/f52 x:0 0 0 2024-04-27T07:33:28.539 INFO:tasks.workunit.client.1.smithi100.stdout:4/285: chown d5/d16/d19/d21/d2b/f58 3551279 1 2024-04-27T07:33:28.541 INFO:tasks.workunit.client.1.smithi100.stdout:0/224: creat d1/f55 x:0 0 0 2024-04-27T07:33:28.544 INFO:tasks.workunit.client.1.smithi100.stdout:1/302: mknod d0/d1f/d27/d4e/c53 0 2024-04-27T07:33:28.544 INFO:tasks.workunit.client.1.smithi100.stdout:5/171: dwrite d0/d4/d21/f26 [0,4194304] 0 2024-04-27T07:33:28.545 INFO:tasks.workunit.client.1.smithi100.stdout:7/123: dwrite d1/f6 [0,4194304] 0 2024-04-27T07:33:28.549 INFO:tasks.workunit.client.1.smithi100.stdout:4/286: rename d5/c1e to d5/d16/d19/d46/c5e 0 2024-04-27T07:33:28.554 INFO:tasks.workunit.client.1.smithi100.stdout:5/172: getdents d0/d4/d17 0 2024-04-27T07:33:28.556 INFO:tasks.workunit.client.1.smithi100.stdout:9/181: write d1/d9/f25 [658032,51676] 0 2024-04-27T07:33:28.558 INFO:tasks.workunit.client.0.smithi082.stdout:7/652: sync 2024-04-27T07:33:28.560 INFO:tasks.workunit.client.1.smithi100.stdout:5/173: readlink d0/d4/d21/l27 0 2024-04-27T07:33:28.560 INFO:tasks.workunit.client.1.smithi100.stdout:7/124: truncate d1/f1a 1611502 0 2024-04-27T07:33:28.560 INFO:tasks.workunit.client.0.smithi082.stdout:7/653: mkdir d3/d9/d4f/d9a/de1 0 2024-04-27T07:33:28.562 INFO:tasks.workunit.client.0.smithi082.stdout:7/654: creat d3/d49/fe2 x:0 0 0 2024-04-27T07:33:28.562 INFO:tasks.workunit.client.1.smithi100.stdout:0/225: dwrite d1/d30/f52 [0,4194304] 0 2024-04-27T07:33:28.562 INFO:tasks.workunit.client.1.smithi100.stdout:1/303: dwrite d0/d1b/f3e [0,4194304] 0 2024-04-27T07:33:28.564 INFO:tasks.workunit.client.1.smithi100.stdout:9/182: unlink d1/d9/d1f/f39 0 2024-04-27T07:33:28.564 INFO:tasks.workunit.client.1.smithi100.stdout:5/174: fdatasync d0/d4/f7 0 2024-04-27T07:33:28.568 INFO:tasks.workunit.client.1.smithi100.stdout:5/175: truncate d0/d4/d17/f1c 593869 0 2024-04-27T07:33:28.568 INFO:tasks.workunit.client.1.smithi100.stdout:1/304: creat d0/d23/f54 x:0 0 0 2024-04-27T07:33:28.569 INFO:tasks.workunit.client.0.smithi082.stdout:7/655: dwrite d3/f45 [4194304,4194304] 0 2024-04-27T07:33:28.569 INFO:tasks.workunit.client.1.smithi100.stdout:1/305: chown d0/d23/f29 59955120 1 2024-04-27T07:33:28.570 INFO:tasks.workunit.client.1.smithi100.stdout:0/226: fdatasync d1/f10 0 2024-04-27T07:33:28.571 INFO:tasks.workunit.client.1.smithi100.stdout:1/306: read - d0/d1b/d20/d2d/d35/f4c zero size 2024-04-27T07:33:28.578 INFO:tasks.workunit.client.1.smithi100.stdout:9/183: rmdir d1/d2a 0 2024-04-27T07:33:28.583 INFO:tasks.workunit.client.1.smithi100.stdout:5/176: creat d0/d4/f36 x:0 0 0 2024-04-27T07:33:28.584 INFO:tasks.workunit.client.1.smithi100.stdout:0/227: unlink d1/d8/d20/c25 0 2024-04-27T07:33:28.584 INFO:tasks.workunit.client.1.smithi100.stdout:5/177: stat d0/d4/d17/d1a 0 2024-04-27T07:33:28.587 INFO:tasks.workunit.client.1.smithi100.stdout:9/184: dwrite d1/d9/db/d2b/f36 [0,4194304] 0 2024-04-27T07:33:28.589 INFO:tasks.workunit.client.1.smithi100.stdout:5/178: rename d0/d4/d17 to d0/d4/d28/d37 0 2024-04-27T07:33:28.591 INFO:tasks.workunit.client.1.smithi100.stdout:9/185: creat d1/d9/f41 x:0 0 0 2024-04-27T07:33:28.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:28 smithi082 ceph-mon[26613]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 142 MiB/s wr, 339 op/s 2024-04-27T07:33:28.593 INFO:tasks.workunit.client.1.smithi100.stdout:9/186: fsync d1/d9/db/d2b/f37 0 2024-04-27T07:33:28.593 INFO:tasks.workunit.client.1.smithi100.stdout:5/179: creat d0/d4/d28/d37/d1a/d34/f38 x:0 0 0 2024-04-27T07:33:28.594 INFO:tasks.workunit.client.1.smithi100.stdout:5/180: fsync d0/d4/d28/d37/f1c 0 2024-04-27T07:33:28.596 INFO:tasks.workunit.client.1.smithi100.stdout:9/187: rename d1/f14 to d1/d9/f42 0 2024-04-27T07:33:28.599 INFO:tasks.workunit.client.0.smithi082.stdout:7/656: dread d3/f1f [0,4194304] 0 2024-04-27T07:33:28.601 INFO:tasks.workunit.client.1.smithi100.stdout:9/188: symlink d1/d9/l43 0 2024-04-27T07:33:28.602 INFO:tasks.workunit.client.0.smithi082.stdout:7/657: unlink d3/d49/d97/f36 0 2024-04-27T07:33:28.602 INFO:tasks.workunit.client.0.smithi082.stdout:7/658: read - d3/d49/fe2 zero size 2024-04-27T07:33:28.602 INFO:tasks.workunit.client.1.smithi100.stdout:5/181: mkdir d0/d4/d21/d24/d2f/d39 0 2024-04-27T07:33:28.603 INFO:tasks.workunit.client.1.smithi100.stdout:7/125: truncate d1/f6 1958770 0 2024-04-27T07:33:28.605 INFO:tasks.workunit.client.0.smithi082.stdout:7/659: getdents d3/d49/d97/d3a/d2a 0 2024-04-27T07:33:28.605 INFO:tasks.workunit.client.1.smithi100.stdout:5/182: creat d0/d4/d21/f3a x:0 0 0 2024-04-27T07:33:28.606 INFO:tasks.workunit.client.1.smithi100.stdout:1/307: truncate d0/f14 1616393 0 2024-04-27T07:33:28.606 INFO:tasks.workunit.client.0.smithi082.stdout:7/660: dread d3/d49/d97/d3a/f38 [0,4194304] 0 2024-04-27T07:33:28.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/661: dread - d3/d49/d97/d3a/d71/da0/fcf zero size 2024-04-27T07:33:28.609 INFO:tasks.workunit.client.1.smithi100.stdout:1/308: read d0/f26 [1474958,47310] 0 2024-04-27T07:33:28.609 INFO:tasks.workunit.client.1.smithi100.stdout:9/189: dwrite d1/d9/db/d2b/d31/f35 [0,4194304] 0 2024-04-27T07:33:28.610 INFO:tasks.workunit.client.0.smithi082.stdout:7/662: creat d3/d49/d97/fe3 x:0 0 0 2024-04-27T07:33:28.612 INFO:tasks.workunit.client.1.smithi100.stdout:5/183: mknod d0/d4/d28/d37/d1a/d30/c3b 0 2024-04-27T07:33:28.613 INFO:tasks.workunit.client.1.smithi100.stdout:5/184: stat d0/d4/d28/d37/d1a 0 2024-04-27T07:33:28.616 INFO:tasks.workunit.client.1.smithi100.stdout:1/309: mknod d0/d1f/d27/d4e/c55 0 2024-04-27T07:33:28.617 INFO:tasks.workunit.client.1.smithi100.stdout:9/190: symlink d1/d9/d1f/l44 0 2024-04-27T07:33:28.617 INFO:tasks.workunit.client.1.smithi100.stdout:9/191: chown d1/f3e 697212621 1 2024-04-27T07:33:28.618 INFO:tasks.workunit.client.1.smithi100.stdout:1/310: dread d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:28.618 INFO:tasks.workunit.client.1.smithi100.stdout:9/192: truncate d1/f4 4802413 0 2024-04-27T07:33:28.620 INFO:tasks.workunit.client.1.smithi100.stdout:5/185: read d0/f2a [149462,6843] 0 2024-04-27T07:33:28.622 INFO:tasks.workunit.client.1.smithi100.stdout:1/311: stat d0/d1b/d20/l32 0 2024-04-27T07:33:28.626 INFO:tasks.workunit.client.1.smithi100.stdout:9/193: rename d1/d9/db/l17 to d1/d9/db/d2b/d31/l45 0 2024-04-27T07:33:28.627 INFO:tasks.workunit.client.1.smithi100.stdout:5/186: symlink d0/d4/d28/d37/l3c 0 2024-04-27T07:33:28.628 INFO:tasks.workunit.client.0.smithi082.stdout:5/774: sync 2024-04-27T07:33:28.631 INFO:tasks.workunit.client.0.smithi082.stdout:5/775: unlink d8/d2e/ca8 0 2024-04-27T07:33:28.632 INFO:tasks.workunit.client.0.smithi082.stdout:7/663: write d3/d49/d97/d3a/d2a/f30 [916363,92836] 0 2024-04-27T07:33:28.632 INFO:tasks.workunit.client.0.smithi082.stdout:5/776: dread - d8/d2e/d85/daa/f105 zero size 2024-04-27T07:33:28.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/664: unlink d3/d49/c5f 0 2024-04-27T07:33:28.636 INFO:tasks.workunit.client.1.smithi100.stdout:1/312: getdents d0/d23 0 2024-04-27T07:33:28.637 INFO:tasks.workunit.client.1.smithi100.stdout:9/194: dwrite d1/d9/f21 [0,4194304] 0 2024-04-27T07:33:28.639 INFO:tasks.workunit.client.1.smithi100.stdout:7/126: dwrite d1/fc [0,4194304] 0 2024-04-27T07:33:28.639 INFO:tasks.workunit.client.0.smithi082.stdout:5/777: creat d8/d29/dea/d5f/d100/f109 x:0 0 0 2024-04-27T07:33:28.641 INFO:tasks.workunit.client.1.smithi100.stdout:7/127: chown d1/dd/l19 0 1 2024-04-27T07:33:28.642 INFO:tasks.workunit.client.1.smithi100.stdout:1/313: creat d0/d23/d3a/f56 x:0 0 0 2024-04-27T07:33:28.643 INFO:tasks.workunit.client.1.smithi100.stdout:5/187: dwrite d0/d4/f1e [0,4194304] 0 2024-04-27T07:33:28.643 INFO:tasks.workunit.client.1.smithi100.stdout:7/128: chown d1/l1d 4457 1 2024-04-27T07:33:28.645 INFO:tasks.workunit.client.1.smithi100.stdout:9/195: unlink d1/d9/db/d2b/f37 0 2024-04-27T07:33:28.647 INFO:tasks.workunit.client.1.smithi100.stdout:5/188: mkdir d0/d4/d21/d3d 0 2024-04-27T07:33:28.652 INFO:tasks.workunit.client.1.smithi100.stdout:9/196: creat d1/f46 x:0 0 0 2024-04-27T07:33:28.653 INFO:tasks.workunit.client.1.smithi100.stdout:9/197: chown d1/d9/db/f3f 9 1 2024-04-27T07:33:28.653 INFO:tasks.workunit.client.1.smithi100.stdout:5/189: mkdir d0/d4/d28/d3e 0 2024-04-27T07:33:28.655 INFO:tasks.workunit.client.1.smithi100.stdout:7/129: rmdir d1/d20 0 2024-04-27T07:33:28.657 INFO:tasks.workunit.client.1.smithi100.stdout:1/314: creat d0/d1b/d20/f57 x:0 0 0 2024-04-27T07:33:28.658 INFO:tasks.workunit.client.1.smithi100.stdout:1/315: write d0/f3d [2191948,48266] 0 2024-04-27T07:33:28.659 INFO:tasks.workunit.client.1.smithi100.stdout:3/166: sync 2024-04-27T07:33:28.659 INFO:tasks.workunit.client.1.smithi100.stdout:7/130: rename d1/f2 to d1/f21 0 2024-04-27T07:33:28.660 INFO:tasks.workunit.client.1.smithi100.stdout:7/131: stat d1/fc 0 2024-04-27T07:33:28.660 INFO:tasks.workunit.client.1.smithi100.stdout:3/167: write d7/d9/d10/f30 [394417,115815] 0 2024-04-27T07:33:28.663 INFO:tasks.workunit.client.1.smithi100.stdout:1/316: mknod d0/d1f/c58 0 2024-04-27T07:33:28.665 INFO:tasks.workunit.client.1.smithi100.stdout:5/190: link d0/f10 d0/d4/d28/d37/f3f 0 2024-04-27T07:33:28.665 INFO:tasks.workunit.client.1.smithi100.stdout:5/191: readlink d0/d4/d21/l32 0 2024-04-27T07:33:28.666 INFO:tasks.workunit.client.1.smithi100.stdout:9/198: getdents d1/d9/db/d2b/d31 0 2024-04-27T07:33:28.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:28 smithi100 ceph-mon[34183]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 142 MiB/s wr, 339 op/s 2024-04-27T07:33:28.667 INFO:tasks.workunit.client.1.smithi100.stdout:3/168: read d7/d9/d10/d28/d2c/f2e [841871,4547] 0 2024-04-27T07:33:28.668 INFO:tasks.workunit.client.1.smithi100.stdout:3/169: write d7/d9/d26/f32 [767829,3668] 0 2024-04-27T07:33:28.670 INFO:tasks.workunit.client.1.smithi100.stdout:9/199: mknod d1/d9/db/c47 0 2024-04-27T07:33:28.670 INFO:tasks.workunit.client.1.smithi100.stdout:5/192: read d0/f8 [1799599,53479] 0 2024-04-27T07:33:28.671 INFO:tasks.workunit.client.0.smithi082.stdout:7/665: rename d3/d9/d4f/d61/d77 to d3/d49/d97/d3a/d2a/dac/dae/dce/de4 0 2024-04-27T07:33:28.672 INFO:tasks.workunit.client.0.smithi082.stdout:7/666: read d3/d49/d97/d3a/d2a/f81 [1954020,98527] 0 2024-04-27T07:33:28.672 INFO:tasks.workunit.client.1.smithi100.stdout:9/200: stat d1/d9/db/d2b/f34 0 2024-04-27T07:33:28.672 INFO:tasks.workunit.client.1.smithi100.stdout:1/317: getdents d0/d23 0 2024-04-27T07:33:28.673 INFO:tasks.workunit.client.0.smithi082.stdout:7/667: stat d3/d49/d97/c58 0 2024-04-27T07:33:28.673 INFO:tasks.workunit.client.0.smithi082.stdout:7/668: readlink d3/d49/d97/d3a/d2a/l47 0 2024-04-27T07:33:28.674 INFO:tasks.workunit.client.1.smithi100.stdout:5/193: symlink d0/d4/d28/d3e/l40 0 2024-04-27T07:33:28.676 INFO:tasks.workunit.client.1.smithi100.stdout:1/318: creat d0/d23/d3a/f59 x:0 0 0 2024-04-27T07:33:28.676 INFO:tasks.workunit.client.0.smithi082.stdout:7/669: mknod d3/db/ce5 0 2024-04-27T07:33:28.677 INFO:tasks.workunit.client.1.smithi100.stdout:3/170: dwrite d7/d9/d10/f30 [0,4194304] 0 2024-04-27T07:33:28.678 INFO:tasks.workunit.client.0.smithi082.stdout:7/670: creat d3/d49/d97/d3a/d71/fe6 x:0 0 0 2024-04-27T07:33:28.681 INFO:tasks.workunit.client.1.smithi100.stdout:1/319: symlink d0/d1f/l5a 0 2024-04-27T07:33:28.686 INFO:tasks.workunit.client.1.smithi100.stdout:7/132: truncate d1/dd/f1e 1778760 0 2024-04-27T07:33:28.688 INFO:tasks.workunit.client.1.smithi100.stdout:1/320: rename d0/d1b/d20/d2d/d35/c4f to d0/d23/c5b 0 2024-04-27T07:33:28.691 INFO:tasks.workunit.client.0.smithi082.stdout:5/778: truncate d8/d15/d65/f9b 100835 0 2024-04-27T07:33:28.691 INFO:tasks.workunit.client.1.smithi100.stdout:1/321: unlink d0/l1a 0 2024-04-27T07:33:28.693 INFO:tasks.workunit.client.1.smithi100.stdout:1/322: dread d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:28.694 INFO:tasks.workunit.client.0.smithi082.stdout:5/779: symlink d8/d42/l10a 0 2024-04-27T07:33:28.695 INFO:tasks.workunit.client.1.smithi100.stdout:9/201: truncate d1/d9/d1f/f28 3362494 0 2024-04-27T07:33:28.696 INFO:tasks.workunit.client.0.smithi082.stdout:5/780: mkdir d8/d2e/d85/d10b 0 2024-04-27T07:33:28.696 INFO:tasks.workunit.client.0.smithi082.stdout:7/671: rmdir d3/d49/d97/d3a/d71 39 2024-04-27T07:33:28.696 INFO:tasks.workunit.client.1.smithi100.stdout:9/202: truncate d1/f46 146870 0 2024-04-27T07:33:28.697 INFO:tasks.workunit.client.0.smithi082.stdout:5/781: fsync d8/d14/f49 0 2024-04-27T07:33:28.697 INFO:tasks.workunit.client.1.smithi100.stdout:9/203: readlink d1/d9/db/d2b/d31/l45 0 2024-04-27T07:33:28.698 INFO:tasks.workunit.client.1.smithi100.stdout:1/323: rename d0/l8 to d0/d23/d3a/l5c 0 2024-04-27T07:33:28.699 INFO:tasks.workunit.client.0.smithi082.stdout:5/782: creat d8/d42/f10c x:0 0 0 2024-04-27T07:33:28.699 INFO:tasks.workunit.client.0.smithi082.stdout:5/783: write d8/fc3 [799011,29921] 0 2024-04-27T07:33:28.700 INFO:tasks.workunit.client.1.smithi100.stdout:9/204: write d1/d9/d1f/f27 [1510899,129404] 0 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:2/702: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:4/794: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:6/676: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:9/602: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:3/968: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:0/749: sync 2024-04-27T07:33:28.703 INFO:tasks.workunit.client.0.smithi082.stdout:1/666: sync 2024-04-27T07:33:28.704 INFO:tasks.workunit.client.0.smithi082.stdout:8/671: sync 2024-04-27T07:33:28.704 INFO:tasks.workunit.client.1.smithi100.stdout:9/205: symlink d1/d9/l48 0 2024-04-27T07:33:28.706 INFO:tasks.workunit.client.0.smithi082.stdout:7/672: link d3/d9/d4f/d9a/fc2 d3/d9/d4f/d9a/fe7 0 2024-04-27T07:33:28.707 INFO:tasks.workunit.client.1.smithi100.stdout:5/194: dread d0/d4/fc [0,4194304] 0 2024-04-27T07:33:28.707 INFO:tasks.workunit.client.1.smithi100.stdout:3/171: dwrite d7/d9/d10/f15 [0,4194304] 0 2024-04-27T07:33:28.709 INFO:tasks.workunit.client.1.smithi100.stdout:5/195: stat d0/d4/d21 0 2024-04-27T07:33:28.711 INFO:tasks.workunit.client.0.smithi082.stdout:6/677: read d2/d3/f6 [106708,44393] 0 2024-04-27T07:33:28.711 INFO:tasks.workunit.client.0.smithi082.stdout:8/672: creat d0/d3/d1b/d53/fdb x:0 0 0 2024-04-27T07:33:28.712 INFO:tasks.workunit.client.1.smithi100.stdout:3/172: truncate d7/d9/d10/d28/d2c/f34 652501 0 2024-04-27T07:33:28.713 INFO:tasks.workunit.client.0.smithi082.stdout:0/750: stat da/d2a/fb0 0 2024-04-27T07:33:28.714 INFO:tasks.workunit.client.1.smithi100.stdout:3/173: write d7/f1f [665934,124196] 0 2024-04-27T07:33:28.715 INFO:tasks.workunit.client.0.smithi082.stdout:2/703: mknod d7/d9/d4f/d66/dae/dd1/ce3 0 2024-04-27T07:33:28.716 INFO:tasks.workunit.client.1.smithi100.stdout:1/324: link d0/d1f/d27/d40/l4a d0/d1b/d20/d2d/d35/d4d/l5d 0 2024-04-27T07:33:28.716 INFO:tasks.workunit.client.1.smithi100.stdout:9/206: creat d1/d9/f49 x:0 0 0 2024-04-27T07:33:28.717 INFO:tasks.workunit.client.0.smithi082.stdout:5/784: dwrite d8/d3c/fa0 [0,4194304] 0 2024-04-27T07:33:28.718 INFO:tasks.workunit.client.1.smithi100.stdout:7/133: dwrite d1/f15 [0,4194304] 0 2024-04-27T07:33:28.720 INFO:tasks.workunit.client.1.smithi100.stdout:5/196: mknod d0/d4/d28/d37/d1a/d30/c41 0 2024-04-27T07:33:28.721 INFO:tasks.workunit.client.0.smithi082.stdout:8/673: chown d0/d2b/d80/fbb 131061 1 2024-04-27T07:33:28.721 INFO:tasks.workunit.client.0.smithi082.stdout:3/969: dread - d8/d9/d25/d26/d3d/f104 zero size 2024-04-27T07:33:28.722 INFO:tasks.workunit.client.1.smithi100.stdout:3/174: creat d7/d9/d10/d22/f35 x:0 0 0 2024-04-27T07:33:28.723 INFO:tasks.workunit.client.0.smithi082.stdout:9/603: write d9/d2d/f23 [2525723,93288] 0 2024-04-27T07:33:28.723 INFO:tasks.workunit.client.0.smithi082.stdout:6/678: mkdir d2/d1e/d32/d85/d97/de2 0 2024-04-27T07:33:28.724 INFO:tasks.workunit.client.1.smithi100.stdout:1/325: creat d0/d1f/f5e x:0 0 0 2024-04-27T07:33:28.726 INFO:tasks.workunit.client.1.smithi100.stdout:1/326: rename d0/d1f/d27 to d0/d1f/d27/d4e/d5f 22 2024-04-27T07:33:28.728 INFO:tasks.workunit.client.0.smithi082.stdout:0/751: mknod da/d3c/d3f/d57/dcc/da8/c111 0 2024-04-27T07:33:28.730 INFO:tasks.workunit.client.0.smithi082.stdout:8/674: stat d0/d83/la5 0 2024-04-27T07:33:28.730 INFO:tasks.workunit.client.0.smithi082.stdout:6/679: chown d2/d75/fbe 8 1 2024-04-27T07:33:28.731 INFO:tasks.workunit.client.0.smithi082.stdout:5/785: symlink d8/d29/dea/d5f/df6/dfd/l10d 0 2024-04-27T07:33:28.731 INFO:tasks.workunit.client.1.smithi100.stdout:3/175: symlink d7/d9/d10/d33/l36 0 2024-04-27T07:33:28.732 INFO:tasks.workunit.client.0.smithi082.stdout:4/795: creat d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10c/f10d x:0 0 0 2024-04-27T07:33:28.734 INFO:tasks.workunit.client.1.smithi100.stdout:5/197: mkdir d0/d42 0 2024-04-27T07:33:28.735 INFO:tasks.workunit.client.0.smithi082.stdout:2/704: rename d7/d31/d54/f6d to d7/d9/d4f/d6e/d82/da4/fe4 0 2024-04-27T07:33:28.735 INFO:tasks.workunit.client.0.smithi082.stdout:3/970: truncate d8/d9/d25/d91/fb7 3263562 0 2024-04-27T07:33:28.736 INFO:tasks.workunit.client.0.smithi082.stdout:1/667: dwrite d4/d15/d49/dab/dc3/d3e/d46/f50 [0,4194304] 0 2024-04-27T07:33:28.739 INFO:tasks.workunit.client.1.smithi100.stdout:7/134: symlink d1/dd/d16/d1f/l22 0 2024-04-27T07:33:28.742 INFO:tasks.workunit.client.0.smithi082.stdout:8/675: mkdir d0/d2b/d9a/da4/d35/ddc 0 2024-04-27T07:33:28.742 INFO:tasks.workunit.client.0.smithi082.stdout:1/668: stat d4/d15/d29/fc6 0 2024-04-27T07:33:28.743 INFO:tasks.workunit.client.1.smithi100.stdout:5/198: dwrite d0/d4/f11 [0,4194304] 0 2024-04-27T07:33:28.744 INFO:tasks.workunit.client.0.smithi082.stdout:4/796: symlink d3/d6/d26/d55/d67/d9d/d101/d69/l10e 0 2024-04-27T07:33:28.746 INFO:tasks.workunit.client.0.smithi082.stdout:6/680: dwrite d2/d3/da8/fda [0,4194304] 0 2024-04-27T07:33:28.747 INFO:tasks.workunit.client.1.smithi100.stdout:1/327: read d0/d1b/d20/f38 [132223,19049] 0 2024-04-27T07:33:28.748 INFO:tasks.workunit.client.0.smithi082.stdout:8/676: creat d0/d2b/fdd x:0 0 0 2024-04-27T07:33:28.749 INFO:tasks.workunit.client.1.smithi100.stdout:7/135: creat d1/dd/d16/d1f/f23 x:0 0 0 2024-04-27T07:33:28.750 INFO:tasks.workunit.client.0.smithi082.stdout:6/681: fsync d2/d1e/d32/d7d/d82/f91 0 2024-04-27T07:33:28.753 INFO:tasks.workunit.client.1.smithi100.stdout:3/176: link d7/d9/d10/c27 d7/d9/d10/c37 0 2024-04-27T07:33:28.755 INFO:tasks.workunit.client.1.smithi100.stdout:3/177: chown d7/d9/d10 40165 1 2024-04-27T07:33:28.755 INFO:tasks.workunit.client.0.smithi082.stdout:3/971: dread d8/d9/d25/d26/d4d/d82/dce/d101/f129 [0,4194304] 0 2024-04-27T07:33:28.756 INFO:tasks.workunit.client.1.smithi100.stdout:5/199: link d0/d4/l2c d0/d4/d21/l43 0 2024-04-27T07:33:28.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/797: dwrite d3/d6/d26/d55/f6b [4194304,4194304] 0 2024-04-27T07:33:28.757 INFO:tasks.workunit.client.0.smithi082.stdout:6/682: unlink d2/d3/d1b/f4b 0 2024-04-27T07:33:28.757 INFO:tasks.workunit.client.1.smithi100.stdout:1/328: dwrite d0/d23/d3a/f56 [0,4194304] 0 2024-04-27T07:33:28.758 INFO:tasks.workunit.client.1.smithi100.stdout:5/200: stat d0/d4/d21 0 2024-04-27T07:33:28.759 INFO:tasks.workunit.client.1.smithi100.stdout:1/329: write d0/d23/f54 [649709,34688] 0 2024-04-27T07:33:28.760 INFO:tasks.workunit.client.1.smithi100.stdout:5/201: write d0/d4/d28/d37/d1a/d34/f38 [932501,1050] 0 2024-04-27T07:33:28.763 INFO:tasks.workunit.client.0.smithi082.stdout:6/683: creat d2/d1e/d32/d85/d97/fe3 x:0 0 0 2024-04-27T07:33:28.766 INFO:tasks.workunit.client.1.smithi100.stdout:5/202: symlink d0/d4/d28/d37/d1a/d30/l44 0 2024-04-27T07:33:28.769 INFO:tasks.workunit.client.0.smithi082.stdout:6/684: rename d2/d75/d7a to d2/d2d/d4a/de4 0 2024-04-27T07:33:28.770 INFO:tasks.workunit.client.1.smithi100.stdout:3/178: dwrite d7/d9/d10/d22/f35 [0,4194304] 0 2024-04-27T07:33:28.771 INFO:tasks.workunit.client.0.smithi082.stdout:6/685: chown d2/d1e/d32/lb3 4 1 2024-04-27T07:33:28.771 INFO:tasks.workunit.client.0.smithi082.stdout:7/673: dwrite d3/d49/d97/d3a/d2a/f2b [0,4194304] 0 2024-04-27T07:33:28.773 INFO:tasks.workunit.client.1.smithi100.stdout:1/330: mkdir d0/d1b/d20/d2d/d35/d4d/d60 0 2024-04-27T07:33:28.773 INFO:tasks.workunit.client.0.smithi082.stdout:0/752: write da/d3c/d3f/d57/dcc/fc0 [902259,9626] 0 2024-04-27T07:33:28.775 INFO:tasks.workunit.client.1.smithi100.stdout:9/207: truncate d1/d9/db/d2b/f36 4088534 0 2024-04-27T07:33:28.778 INFO:tasks.workunit.client.1.smithi100.stdout:1/331: mkdir d0/d1f/d27/d40/d61 0 2024-04-27T07:33:28.778 INFO:tasks.workunit.client.0.smithi082.stdout:9/604: truncate d9/da/f67 669838 0 2024-04-27T07:33:28.779 INFO:tasks.workunit.client.0.smithi082.stdout:7/674: truncate d3/d49/d97/d3a/d2a/f72 599685 0 2024-04-27T07:33:28.781 INFO:tasks.workunit.client.0.smithi082.stdout:2/705: write d7/d8/d13/fb8 [109825,109967] 0 2024-04-27T07:33:28.783 INFO:tasks.workunit.client.1.smithi100.stdout:9/208: unlink d1/f3e 0 2024-04-27T07:33:28.784 INFO:tasks.workunit.client.0.smithi082.stdout:0/753: link da/c68 da/d28/d36/d40/c112 0 2024-04-27T07:33:28.784 INFO:tasks.workunit.client.1.smithi100.stdout:1/332: truncate d0/d1b/f2f 5042595 0 2024-04-27T07:33:28.785 INFO:tasks.workunit.client.1.smithi100.stdout:5/203: dwrite d0/fa [4194304,4194304] 0 2024-04-27T07:33:28.785 INFO:tasks.workunit.client.1.smithi100.stdout:3/179: creat d7/d9/d26/f38 x:0 0 0 2024-04-27T07:33:28.787 INFO:tasks.workunit.client.0.smithi082.stdout:2/706: creat d7/d30/d23/fe5 x:0 0 0 2024-04-27T07:33:28.788 INFO:tasks.workunit.client.0.smithi082.stdout:0/754: chown da/d28/l75 4435 1 2024-04-27T07:33:28.788 INFO:tasks.workunit.client.1.smithi100.stdout:7/136: fdatasync d1/dd/f1e 0 2024-04-27T07:33:28.790 INFO:tasks.workunit.client.0.smithi082.stdout:9/605: dwrite d9/da/dc/d35/d38/da5/f8f [0,4194304] 0 2024-04-27T07:33:28.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/675: dwrite d3/d49/d97/f2f [0,4194304] 0 2024-04-27T07:33:28.792 INFO:tasks.workunit.client.0.smithi082.stdout:0/755: chown da/d28/d36/d40/c88 26237 1 2024-04-27T07:33:28.793 INFO:tasks.workunit.client.1.smithi100.stdout:1/333: creat d0/d1b/f62 x:0 0 0 2024-04-27T07:33:28.793 INFO:tasks.workunit.client.1.smithi100.stdout:3/180: write d7/d9/d10/f11 [1862955,1396] 0 2024-04-27T07:33:28.795 INFO:tasks.workunit.client.1.smithi100.stdout:9/209: dwrite d1/f22 [0,4194304] 0 2024-04-27T07:33:28.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/137: rmdir d1 39 2024-04-27T07:33:28.797 INFO:tasks.workunit.client.0.smithi082.stdout:2/707: link d7/d30/d23/c73 d7/d9/d4f/ce6 0 2024-04-27T07:33:28.798 INFO:tasks.workunit.client.0.smithi082.stdout:7/676: creat d3/d9/d7c/fe8 x:0 0 0 2024-04-27T07:33:28.798 INFO:tasks.workunit.client.1.smithi100.stdout:5/204: symlink d0/d4/d28/d37/d1a/d34/l45 0 2024-04-27T07:33:28.799 INFO:tasks.workunit.client.1.smithi100.stdout:5/205: chown d0/d4/f1e 0 1 2024-04-27T07:33:28.800 INFO:tasks.workunit.client.0.smithi082.stdout:9/606: dread d9/da/dc/d88/da8/fac [0,4194304] 0 2024-04-27T07:33:28.801 INFO:tasks.workunit.client.0.smithi082.stdout:2/708: creat d7/d9/fe7 x:0 0 0 2024-04-27T07:33:28.803 INFO:tasks.workunit.client.0.smithi082.stdout:0/756: dwrite da/d28/d36/d40/f44 [0,4194304] 0 2024-04-27T07:33:28.803 INFO:tasks.workunit.client.1.smithi100.stdout:1/334: mkdir d0/d1b/d20/d2d/d63 0 2024-04-27T07:33:28.804 INFO:tasks.workunit.client.0.smithi082.stdout:2/709: write d7/d30/d61/f65 [2519585,35734] 0 2024-04-27T07:33:28.805 INFO:tasks.workunit.client.1.smithi100.stdout:9/210: mkdir d1/d9/d1f/d4a 0 2024-04-27T07:33:28.805 INFO:tasks.workunit.client.1.smithi100.stdout:1/335: truncate d0/d23/f54 1683102 0 2024-04-27T07:33:28.807 INFO:tasks.workunit.client.0.smithi082.stdout:9/607: creat d9/da/dc/d73/dbb/fcf x:0 0 0 2024-04-27T07:33:28.810 INFO:tasks.workunit.client.0.smithi082.stdout:9/608: fdatasync d9/da/dc/d33/f89 0 2024-04-27T07:33:28.811 INFO:tasks.workunit.client.1.smithi100.stdout:7/138: symlink d1/dd/d16/l24 0 2024-04-27T07:33:28.812 INFO:tasks.workunit.client.1.smithi100.stdout:5/206: dwrite d0/d4/d21/f26 [0,4194304] 0 2024-04-27T07:33:28.812 INFO:tasks.workunit.client.0.smithi082.stdout:2/710: rename d7/d9/c90 to d7/d31/d54/ce8 0 2024-04-27T07:33:28.813 INFO:tasks.workunit.client.0.smithi082.stdout:2/711: write d7/d9/fe7 [673334,80388] 0 2024-04-27T07:33:28.813 INFO:tasks.workunit.client.0.smithi082.stdout:9/609: creat d9/d2d/fd0 x:0 0 0 2024-04-27T07:33:28.814 INFO:tasks.workunit.client.1.smithi100.stdout:9/211: symlink d1/d9/db/d2b/l4b 0 2024-04-27T07:33:28.814 INFO:tasks.workunit.client.1.smithi100.stdout:3/181: link d7/d9/d10/c27 d7/d9/d10/d22/c39 0 2024-04-27T07:33:28.815 INFO:tasks.workunit.client.0.smithi082.stdout:2/712: stat d7/d31/l53 0 2024-04-27T07:33:28.817 INFO:tasks.workunit.client.1.smithi100.stdout:3/182: chown d7/d9/f21 1746027 1 2024-04-27T07:33:28.817 INFO:tasks.workunit.client.0.smithi082.stdout:2/713: write d7/d31/d54/fb2 [703884,67969] 0 2024-04-27T07:33:28.817 INFO:tasks.workunit.client.1.smithi100.stdout:7/139: creat d1/dd/d16/d1f/f25 x:0 0 0 2024-04-27T07:33:28.819 INFO:tasks.workunit.client.1.smithi100.stdout:3/183: fdatasync d7/d9/d10/f15 0 2024-04-27T07:33:28.819 INFO:tasks.workunit.client.0.smithi082.stdout:9/610: creat d9/da/dc/d88/fd1 x:0 0 0 2024-04-27T07:33:28.820 INFO:tasks.workunit.client.1.smithi100.stdout:9/212: mknod d1/d9/db/d2b/c4c 0 2024-04-27T07:33:28.821 INFO:tasks.workunit.client.1.smithi100.stdout:1/336: dread d0/d1f/d27/f39 [0,4194304] 0 2024-04-27T07:33:28.821 INFO:tasks.workunit.client.1.smithi100.stdout:7/140: creat d1/dd/d16/f26 x:0 0 0 2024-04-27T07:33:28.824 INFO:tasks.workunit.client.0.smithi082.stdout:9/611: mknod d9/da/dc/db1/cd2 0 2024-04-27T07:33:28.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/677: dwrite d0/d3/f1a [0,4194304] 0 2024-04-27T07:33:28.828 INFO:tasks.workunit.client.0.smithi082.stdout:3/972: dwrite d8/d9/d1d/f79 [0,4194304] 0 2024-04-27T07:33:28.829 INFO:tasks.workunit.client.1.smithi100.stdout:5/207: getdents d0/d4 0 2024-04-27T07:33:28.829 INFO:tasks.workunit.client.1.smithi100.stdout:1/337: creat d0/d1b/d20/d2d/d35/d4d/d60/f64 x:0 0 0 2024-04-27T07:33:28.830 INFO:tasks.workunit.client.0.smithi082.stdout:4/798: write d3/d10/f7b [229534,102150] 0 2024-04-27T07:33:28.831 INFO:tasks.workunit.client.0.smithi082.stdout:8/678: symlink d0/d3/d87/d42/d7f/dac/lde 0 2024-04-27T07:33:28.833 INFO:tasks.workunit.client.1.smithi100.stdout:5/208: mkdir d0/d4/d21/d24/d46 0 2024-04-27T07:33:28.834 INFO:tasks.workunit.client.0.smithi082.stdout:6/686: rmdir d2 39 2024-04-27T07:33:28.835 INFO:tasks.workunit.client.1.smithi100.stdout:1/338: rename d0/d1b/d20/d2d/d63 to d0/d1b/d20/d2d/d35/d65 0 2024-04-27T07:33:28.838 INFO:tasks.workunit.client.0.smithi082.stdout:6/687: stat d2/d3/d1b/c70 0 2024-04-27T07:33:28.839 INFO:tasks.workunit.client.0.smithi082.stdout:9/612: dwrite d9/d2d/d2b/d46/f8b [0,4194304] 0 2024-04-27T07:33:28.844 INFO:tasks.workunit.client.0.smithi082.stdout:4/799: mknod d3/d6/d26/d55/d67/d9d/d101/d69/df5/d10a/c10f 0 2024-04-27T07:33:28.846 INFO:tasks.workunit.client.0.smithi082.stdout:3/973: dread d8/d9/dd/de1/f117 [0,4194304] 0 2024-04-27T07:33:28.847 INFO:tasks.workunit.client.1.smithi100.stdout:1/339: dwrite d0/d1f/f2b [0,4194304] 0 2024-04-27T07:33:28.848 INFO:tasks.workunit.client.0.smithi082.stdout:3/974: readlink d8/d9/dd/d13/l4f 0 2024-04-27T07:33:28.850 INFO:tasks.workunit.client.0.smithi082.stdout:4/800: mkdir d3/d6/dcf/d110 0 2024-04-27T07:33:28.851 INFO:tasks.workunit.client.0.smithi082.stdout:2/714: dread d7/d9/f18 [0,4194304] 0 2024-04-27T07:33:28.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/715: truncate d7/d8/d99/fd4 1191281 0 2024-04-27T07:33:28.854 INFO:tasks.workunit.client.0.smithi082.stdout:4/801: mkdir d3/d6/d26/d55/d67/d9d/d101/d111 0 2024-04-27T07:33:28.856 INFO:tasks.workunit.client.1.smithi100.stdout:1/340: creat d0/d1f/d27/d40/d61/f66 x:0 0 0 2024-04-27T07:33:28.858 INFO:tasks.workunit.client.0.smithi082.stdout:2/716: mknod d7/d8/ce9 0 2024-04-27T07:33:28.858 INFO:tasks.workunit.client.0.smithi082.stdout:0/757: dread f7 [0,4194304] 0 2024-04-27T07:33:28.862 INFO:tasks.workunit.client.1.smithi100.stdout:1/341: rename d0/d1b/c47 to d0/d1b/d20/d2d/d35/d65/c67 0 2024-04-27T07:33:28.863 INFO:tasks.workunit.client.0.smithi082.stdout:2/717: symlink d7/d9/d4f/d6e/lea 0 2024-04-27T07:33:28.865 INFO:tasks.workunit.client.0.smithi082.stdout:4/802: link d3/d10/la6 d3/d6/dcf/l112 0 2024-04-27T07:33:28.866 INFO:tasks.workunit.client.1.smithi100.stdout:1/342: mknod d0/d1f/d27/d40/c68 0 2024-04-27T07:33:28.868 INFO:tasks.workunit.client.0.smithi082.stdout:0/758: dwrite da/d3c/d3f/d57/dcc/f102 [0,4194304] 0 2024-04-27T07:33:28.869 INFO:tasks.workunit.client.1.smithi100.stdout:3/184: rmdir d7/d9/d10/d22 39 2024-04-27T07:33:28.871 INFO:tasks.workunit.client.1.smithi100.stdout:3/185: read d7/d9/d10/f30 [960871,49065] 0 2024-04-27T07:33:28.871 INFO:tasks.workunit.client.1.smithi100.stdout:1/343: creat d0/d1b/d20/d2d/d35/f69 x:0 0 0 2024-04-27T07:33:28.872 INFO:tasks.workunit.client.0.smithi082.stdout:7/677: rmdir d3/d9/d7c 39 2024-04-27T07:33:28.873 INFO:tasks.workunit.client.0.smithi082.stdout:7/678: write d3/d9/f37 [2334305,65194] 0 2024-04-27T07:33:28.874 INFO:tasks.workunit.client.1.smithi100.stdout:5/209: dread d0/f1d [0,4194304] 0 2024-04-27T07:33:28.874 INFO:tasks.workunit.client.1.smithi100.stdout:3/186: fdatasync d7/d9/d10/d28/d2c/f34 0 2024-04-27T07:33:28.875 INFO:tasks.workunit.client.0.smithi082.stdout:0/759: rename da/d38/d7f/c73 to da/d28/d36/d40/c113 0 2024-04-27T07:33:28.879 INFO:tasks.workunit.client.0.smithi082.stdout:7/679: dread - d3/d49/d97/d3a/d71/fcc zero size 2024-04-27T07:33:28.879 INFO:tasks.workunit.client.0.smithi082.stdout:7/680: stat d3/d49/fe2 0 2024-04-27T07:33:28.880 INFO:tasks.workunit.client.1.smithi100.stdout:9/213: rmdir d1/d9 39 2024-04-27T07:33:28.881 INFO:tasks.workunit.client.0.smithi082.stdout:0/760: dread da/d28/d36/f7b [0,4194304] 0 2024-04-27T07:33:28.881 INFO:tasks.workunit.client.0.smithi082.stdout:4/803: getdents d3/d6/d26/df2 0 2024-04-27T07:33:28.882 INFO:tasks.workunit.client.0.smithi082.stdout:0/761: write da/d3c/f82 [2952273,73096] 0 2024-04-27T07:33:28.884 INFO:tasks.workunit.client.0.smithi082.stdout:4/804: fdatasync d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10c/f7c 0 2024-04-27T07:33:28.885 INFO:tasks.workunit.client.1.smithi100.stdout:1/344: dwrite d0/d23/d3a/f41 [0,4194304] 0 2024-04-27T07:33:28.885 INFO:tasks.workunit.client.0.smithi082.stdout:4/805: stat d3/d10/l11 0 2024-04-27T07:33:28.891 INFO:tasks.workunit.client.1.smithi100.stdout:3/187: unlink d7/d9/d10/d22/f35 0 2024-04-27T07:33:28.891 INFO:tasks.workunit.client.1.smithi100.stdout:5/210: dwrite d0/d4/d28/d37/d1a/f20 [0,4194304] 0 2024-04-27T07:33:28.894 INFO:tasks.workunit.client.0.smithi082.stdout:9/613: dread d9/f21 [0,4194304] 0 2024-04-27T07:33:28.895 INFO:tasks.workunit.client.1.smithi100.stdout:7/141: dwrite d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:28.895 INFO:tasks.workunit.client.0.smithi082.stdout:4/806: creat d3/d6/d26/d5e/f113 x:0 0 0 2024-04-27T07:33:28.897 INFO:tasks.workunit.client.1.smithi100.stdout:1/345: symlink d0/d1f/d27/d4e/l6a 0 2024-04-27T07:33:28.897 INFO:tasks.workunit.client.0.smithi082.stdout:6/688: truncate d2/d3/da8/faf 481681 0 2024-04-27T07:33:28.898 INFO:tasks.workunit.client.1.smithi100.stdout:6/184: sync 2024-04-27T07:33:28.898 INFO:tasks.workunit.client.1.smithi100.stdout:9/214: creat d1/d9/d1f/d4a/f4d x:0 0 0 2024-04-27T07:33:28.899 INFO:tasks.workunit.client.0.smithi082.stdout:8/679: dwrite d0/d3/d1b/f2e [0,4194304] 0 2024-04-27T07:33:28.900 INFO:tasks.workunit.client.0.smithi082.stdout:9/614: mknod d9/da/d85/cd3 0 2024-04-27T07:33:28.901 INFO:tasks.workunit.client.0.smithi082.stdout:3/975: write d8/d9/d25/d4e/da4/f112 [209213,7240] 0 2024-04-27T07:33:28.901 INFO:tasks.workunit.client.1.smithi100.stdout:3/188: mkdir d7/d9/d10/d28/d2c/d3a 0 2024-04-27T07:33:28.902 INFO:tasks.workunit.client.0.smithi082.stdout:9/615: fsync d9/da/f64 0 2024-04-27T07:33:28.909 INFO:tasks.workunit.client.0.smithi082.stdout:2/718: truncate d7/d31/d54/fab 3925753 0 2024-04-27T07:33:28.909 INFO:tasks.workunit.client.1.smithi100.stdout:9/215: creat d1/d9/db/f4e x:0 0 0 2024-04-27T07:33:28.910 INFO:tasks.workunit.client.0.smithi082.stdout:3/976: read d8/d9/d1d/da5/db3/fde [3513295,37696] 0 2024-04-27T07:33:28.910 INFO:tasks.workunit.client.1.smithi100.stdout:1/346: dwrite d0/d23/f2c [0,4194304] 0 2024-04-27T07:33:28.914 INFO:tasks.workunit.client.1.smithi100.stdout:7/142: dwrite d1/f1c [0,4194304] 0 2024-04-27T07:33:28.914 INFO:tasks.workunit.client.0.smithi082.stdout:9/616: creat d9/da/dc/d35/d38/dc5/fd4 x:0 0 0 2024-04-27T07:33:28.915 INFO:tasks.workunit.client.1.smithi100.stdout:7/143: chown d1/dd/d16/d1f 12373 1 2024-04-27T07:33:28.915 INFO:tasks.workunit.client.0.smithi082.stdout:9/617: stat d9/d2d/d72/ca6 0 2024-04-27T07:33:28.918 INFO:tasks.workunit.client.1.smithi100.stdout:3/189: mknod d7/d9/d10/d22/c3b 0 2024-04-27T07:33:28.919 INFO:tasks.workunit.client.0.smithi082.stdout:3/977: creat d8/d9/d25/d26/d4d/d9f/f151 x:0 0 0 2024-04-27T07:33:28.920 INFO:tasks.workunit.client.0.smithi082.stdout:2/719: mknod d7/d9/d4f/d6e/d82/da4/de0/ceb 0 2024-04-27T07:33:28.920 INFO:tasks.workunit.client.0.smithi082.stdout:4/807: truncate d3/d6/d26/d55/f72 283562 0 2024-04-27T07:33:28.921 INFO:tasks.workunit.client.1.smithi100.stdout:3/190: dread d7/d9/d10/d28/d2c/f34 [0,4194304] 0 2024-04-27T07:33:28.922 INFO:tasks.workunit.client.1.smithi100.stdout:7/144: rmdir d1/dd/d16 39 2024-04-27T07:33:28.924 INFO:tasks.workunit.client.0.smithi082.stdout:2/720: readlink d7/d8/l32 0 2024-04-27T07:33:28.924 INFO:tasks.workunit.client.0.smithi082.stdout:0/762: dwrite da/d3c/ff7 [0,4194304] 0 2024-04-27T07:33:28.926 INFO:tasks.workunit.client.1.smithi100.stdout:7/145: creat d1/f27 x:0 0 0 2024-04-27T07:33:28.927 INFO:tasks.workunit.client.0.smithi082.stdout:7/681: dread d3/d9/d7c/fb4 [0,4194304] 0 2024-04-27T07:33:28.927 INFO:tasks.workunit.client.0.smithi082.stdout:0/763: fsync da/fe 0 2024-04-27T07:33:28.927 INFO:tasks.workunit.client.1.smithi100.stdout:3/191: mknod d7/d9/d10/d28/d2c/c3c 0 2024-04-27T07:33:28.928 INFO:tasks.workunit.client.0.smithi082.stdout:9/618: chown d9/da/dc/d35/d38/dc5/c44 20228 1 2024-04-27T07:33:28.930 INFO:tasks.workunit.client.0.smithi082.stdout:0/764: chown da/d1d/d6a/fbf 7312 1 2024-04-27T07:33:28.930 INFO:tasks.workunit.client.0.smithi082.stdout:4/808: write d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10c/f10d [603545,47965] 0 2024-04-27T07:33:28.932 INFO:tasks.workunit.client.0.smithi082.stdout:2/721: mkdir d7/d9/d4f/d6e/d82/da4/de0/dec 0 2024-04-27T07:33:28.932 INFO:tasks.workunit.client.0.smithi082.stdout:4/809: write d3/d6/d26/d55/f6b [7882290,29698] 0 2024-04-27T07:33:28.934 INFO:tasks.workunit.client.1.smithi100.stdout:6/185: dread de/d18/f1a [0,4194304] 0 2024-04-27T07:33:28.934 INFO:tasks.workunit.client.0.smithi082.stdout:9/619: unlink d9/da/dc/d33/l9e 0 2024-04-27T07:33:28.935 INFO:tasks.workunit.client.1.smithi100.stdout:7/146: dwrite d1/fc [0,4194304] 0 2024-04-27T07:33:28.936 INFO:tasks.workunit.client.0.smithi082.stdout:0/765: fdatasync da/d3c/d3f/d57/dcc/f8e 0 2024-04-27T07:33:28.937 INFO:tasks.workunit.client.0.smithi082.stdout:2/722: mknod d7/d9/d4f/d6e/ced 0 2024-04-27T07:33:28.939 INFO:tasks.workunit.client.0.smithi082.stdout:2/723: write d7/d9/d4f/f9d [547540,18905] 0 2024-04-27T07:33:28.940 INFO:tasks.workunit.client.0.smithi082.stdout:0/766: mknod da/d3c/c114 0 2024-04-27T07:33:28.940 INFO:tasks.workunit.client.1.smithi100.stdout:6/186: creat de/d2e/d3f/f44 x:0 0 0 2024-04-27T07:33:28.941 INFO:tasks.workunit.client.1.smithi100.stdout:6/187: chown de/f10 1016661 1 2024-04-27T07:33:28.941 INFO:tasks.workunit.client.0.smithi082.stdout:2/724: chown d7/d9/d4f/d6e/d82/da4/de0/ceb 1 1 2024-04-27T07:33:28.944 INFO:tasks.workunit.client.0.smithi082.stdout:4/810: creat d3/f114 x:0 0 0 2024-04-27T07:33:28.945 INFO:tasks.workunit.client.1.smithi100.stdout:3/192: link d7/d9/d26/d2a/f20 d7/d9/d10/f3d 0 2024-04-27T07:33:28.947 INFO:tasks.workunit.client.0.smithi082.stdout:9/620: getdents d9/da/dc 0 2024-04-27T07:33:28.947 INFO:tasks.workunit.client.0.smithi082.stdout:4/811: creat d3/d6/d26/d55/d67/f115 x:0 0 0 2024-04-27T07:33:28.948 INFO:tasks.workunit.client.0.smithi082.stdout:2/725: symlink d7/d31/lee 0 2024-04-27T07:33:28.949 INFO:tasks.workunit.client.0.smithi082.stdout:2/726: fdatasync d7/d9/f18 0 2024-04-27T07:33:28.950 INFO:tasks.workunit.client.0.smithi082.stdout:2/727: fdatasync d7/d8/d13/fb5 0 2024-04-27T07:33:28.951 INFO:tasks.workunit.client.0.smithi082.stdout:4/812: unlink d3/d6/d26/fe3 0 2024-04-27T07:33:28.951 INFO:tasks.workunit.client.0.smithi082.stdout:9/621: truncate d9/da/dc/d35/d38/dc5/fd4 891370 0 2024-04-27T07:33:28.952 INFO:tasks.workunit.client.1.smithi100.stdout:7/147: getdents d1/dd/d16/d1f 0 2024-04-27T07:33:28.952 INFO:tasks.workunit.client.1.smithi100.stdout:6/188: fsync de/d2e/d3f/f44 0 2024-04-27T07:33:28.952 INFO:tasks.workunit.client.0.smithi082.stdout:0/767: getdents da/d28 0 2024-04-27T07:33:28.953 INFO:tasks.workunit.client.1.smithi100.stdout:6/189: chown de/d18/f1a 787918 1 2024-04-27T07:33:28.953 INFO:tasks.workunit.client.1.smithi100.stdout:3/193: mkdir d7/d9/d10/d3e 0 2024-04-27T07:33:28.953 INFO:tasks.workunit.client.1.smithi100.stdout:6/190: fdatasync de/d18/f1a 0 2024-04-27T07:33:28.954 INFO:tasks.workunit.client.1.smithi100.stdout:7/148: symlink d1/l28 0 2024-04-27T07:33:28.954 INFO:tasks.workunit.client.0.smithi082.stdout:4/813: fsync d3/fb2 0 2024-04-27T07:33:28.955 INFO:tasks.workunit.client.0.smithi082.stdout:9/622: rmdir d9/da/dc 39 2024-04-27T07:33:28.956 INFO:tasks.workunit.client.1.smithi100.stdout:6/191: symlink de/d2e/l45 0 2024-04-27T07:33:28.956 INFO:tasks.workunit.client.1.smithi100.stdout:6/192: chown de 872182270 1 2024-04-27T07:33:28.956 INFO:tasks.workunit.client.0.smithi082.stdout:4/814: write d3/fba [216621,11463] 0 2024-04-27T07:33:28.957 INFO:tasks.workunit.client.1.smithi100.stdout:3/194: creat d7/d9/d26/d2a/f3f x:0 0 0 2024-04-27T07:33:28.958 INFO:tasks.workunit.client.1.smithi100.stdout:7/149: creat d1/dd/d16/f29 x:0 0 0 2024-04-27T07:33:28.958 INFO:tasks.workunit.client.1.smithi100.stdout:3/195: dread - d7/d9/d10/f29 zero size 2024-04-27T07:33:28.958 INFO:tasks.workunit.client.0.smithi082.stdout:3/978: dread d8/d9/d1d/f11c [0,4194304] 0 2024-04-27T07:33:28.959 INFO:tasks.workunit.client.1.smithi100.stdout:7/150: stat d1/dd/f1e 0 2024-04-27T07:33:28.959 INFO:tasks.workunit.client.1.smithi100.stdout:6/193: creat de/d18/d21/d24/f46 x:0 0 0 2024-04-27T07:33:28.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/768: dread da/d28/d36/d40/f44 [0,4194304] 0 2024-04-27T07:33:28.960 INFO:tasks.workunit.client.0.smithi082.stdout:2/728: mkdir d7/d31/dde/def 0 2024-04-27T07:33:28.961 INFO:tasks.workunit.client.1.smithi100.stdout:7/151: chown d1/dd/d16/d1f/f25 3 1 2024-04-27T07:33:28.961 INFO:tasks.workunit.client.1.smithi100.stdout:6/194: chown de/d18/d21/l2a 9 1 2024-04-27T07:33:28.961 INFO:tasks.workunit.client.1.smithi100.stdout:7/152: chown d1/f1c 1 1 2024-04-27T07:33:28.963 INFO:tasks.workunit.client.1.smithi100.stdout:6/195: truncate de/d18/d28/f2d 455148 0 2024-04-27T07:33:28.964 INFO:tasks.workunit.client.0.smithi082.stdout:6/689: write d2/d3/f27 [389083,97411] 0 2024-04-27T07:33:28.967 INFO:tasks.workunit.client.1.smithi100.stdout:6/196: creat de/d18/d28/f47 x:0 0 0 2024-04-27T07:33:28.968 INFO:tasks.workunit.client.1.smithi100.stdout:6/197: creat de/d2e/d3f/f48 x:0 0 0 2024-04-27T07:33:28.969 INFO:tasks.workunit.client.1.smithi100.stdout:6/198: read - de/d18/d28/f2f zero size 2024-04-27T07:33:28.970 INFO:tasks.workunit.client.1.smithi100.stdout:3/196: write d7/d9/fc [452683,19087] 0 2024-04-27T07:33:28.970 INFO:tasks.workunit.client.1.smithi100.stdout:7/153: truncate d1/fc 1784965 0 2024-04-27T07:33:28.971 INFO:tasks.workunit.client.1.smithi100.stdout:3/197: fdatasync d7/d9/f21 0 2024-04-27T07:33:28.972 INFO:tasks.workunit.client.1.smithi100.stdout:6/199: creat de/d18/d21/f49 x:0 0 0 2024-04-27T07:33:28.974 INFO:tasks.workunit.client.1.smithi100.stdout:7/154: unlink d1/dd/d16/d1f/f23 0 2024-04-27T07:33:28.974 INFO:tasks.workunit.client.1.smithi100.stdout:3/198: symlink d7/d9/d10/d22/l40 0 2024-04-27T07:33:28.975 INFO:tasks.workunit.client.0.smithi082.stdout:6/690: write d2/d2e/f30 [2948328,73210] 0 2024-04-27T07:33:28.976 INFO:tasks.workunit.client.0.smithi082.stdout:4/815: dwrite d3/d6/d26/d55/ffc [0,4194304] 0 2024-04-27T07:33:28.976 INFO:tasks.workunit.client.1.smithi100.stdout:6/200: mknod de/d18/d21/c4a 0 2024-04-27T07:33:28.977 INFO:tasks.workunit.client.0.smithi082.stdout:8/680: dwrite d0/d2b/d9a/da4/f41 [0,4194304] 0 2024-04-27T07:33:28.977 INFO:tasks.workunit.client.0.smithi082.stdout:3/979: unlink d8/d9/dd/d11e/l123 0 2024-04-27T07:33:28.979 INFO:tasks.workunit.client.0.smithi082.stdout:6/691: chown d2/d2d/d4a/de4 1 1 2024-04-27T07:33:28.980 INFO:tasks.workunit.client.1.smithi100.stdout:7/155: mkdir d1/dd/d2a 0 2024-04-27T07:33:28.980 INFO:tasks.workunit.client.1.smithi100.stdout:3/199: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:28.981 INFO:tasks.workunit.client.0.smithi082.stdout:0/769: creat da/d3c/d3f/d4c/d95/de9/def/f115 x:0 0 0 2024-04-27T07:33:28.984 INFO:tasks.workunit.client.1.smithi100.stdout:7/156: mkdir d1/dd/d16/d2b 0 2024-04-27T07:33:28.985 INFO:tasks.workunit.client.1.smithi100.stdout:3/200: write d7/d9/d10/f30 [722152,58044] 0 2024-04-27T07:33:28.986 INFO:tasks.workunit.client.0.smithi082.stdout:3/980: mknod d8/d9/dd/d13/d1b/dbd/dd8/c152 0 2024-04-27T07:33:28.987 INFO:tasks.workunit.client.0.smithi082.stdout:7/682: write d3/d9/d4f/faa [910469,49984] 0 2024-04-27T07:33:28.987 INFO:tasks.workunit.client.1.smithi100.stdout:7/157: mkdir d1/dd/d2a/d2c 0 2024-04-27T07:33:28.988 INFO:tasks.workunit.client.1.smithi100.stdout:7/158: dread - d1/dd/d16/d1f/f25 zero size 2024-04-27T07:33:28.989 INFO:tasks.workunit.client.0.smithi082.stdout:0/770: mkdir da/d38/d7f/d4a/d80/da0/dd5/d116 0 2024-04-27T07:33:28.990 INFO:tasks.workunit.client.0.smithi082.stdout:7/683: fsync d3/d49/d97/d3a/f52 0 2024-04-27T07:33:28.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/681: dwrite d0/d3/d87/f3e [0,4194304] 0 2024-04-27T07:33:28.992 INFO:tasks.workunit.client.0.smithi082.stdout:7/684: readlink d3/d49/d97/l66 0 2024-04-27T07:33:28.992 INFO:tasks.workunit.client.1.smithi100.stdout:3/201: creat d7/d9/d10/d33/f41 x:0 0 0 2024-04-27T07:33:28.992 INFO:tasks.workunit.client.0.smithi082.stdout:3/981: mkdir d8/d9/d25/d26/d3d/dad/d153 0 2024-04-27T07:33:28.993 INFO:tasks.workunit.client.1.smithi100.stdout:7/159: unlink d1/l28 0 2024-04-27T07:33:28.994 INFO:tasks.workunit.client.0.smithi082.stdout:8/682: chown d0/d3/f18 270 1 2024-04-27T07:33:28.995 INFO:tasks.workunit.client.1.smithi100.stdout:3/202: chown d7/d9/d10/d28/d2c/c3c 0 1 2024-04-27T07:33:28.995 INFO:tasks.workunit.client.0.smithi082.stdout:8/683: dread - d0/d3/d1c/fb0 zero size 2024-04-27T07:33:28.995 INFO:tasks.workunit.client.1.smithi100.stdout:3/203: chown d7/d9/d10/d28 175351 1 2024-04-27T07:33:28.997 INFO:tasks.workunit.client.0.smithi082.stdout:7/685: readlink d3/d9/l9f 0 2024-04-27T07:33:28.999 INFO:tasks.workunit.client.0.smithi082.stdout:6/692: getdents d2/d45 0 2024-04-27T07:33:29.002 INFO:tasks.workunit.client.1.smithi100.stdout:6/201: dwrite de/d18/f37 [0,4194304] 0 2024-04-27T07:33:29.003 INFO:tasks.workunit.client.0.smithi082.stdout:0/771: symlink da/d3c/d3f/d4c/d95/de9/def/l117 0 2024-04-27T07:33:29.003 INFO:tasks.workunit.client.1.smithi100.stdout:6/202: fdatasync de/d18/d21/d23/f3e 0 2024-04-27T07:33:29.004 INFO:tasks.workunit.client.1.smithi100.stdout:3/204: link d7/d9/d10/d28/d2c/c3c d7/c42 0 2024-04-27T07:33:29.005 INFO:tasks.workunit.client.0.smithi082.stdout:8/684: truncate d0/d3/d1c/f85 328439 0 2024-04-27T07:33:29.006 INFO:tasks.workunit.client.0.smithi082.stdout:6/693: write d2/d3/fd [240199,44333] 0 2024-04-27T07:33:29.008 INFO:tasks.workunit.client.0.smithi082.stdout:0/772: creat da/d38/da9/ddd/f118 x:0 0 0 2024-04-27T07:33:29.009 INFO:tasks.workunit.client.1.smithi100.stdout:3/205: creat d7/d9/d26/d2a/f43 x:0 0 0 2024-04-27T07:33:29.009 INFO:tasks.workunit.client.0.smithi082.stdout:6/694: write d2/d2d/d4a/de4/dcc/d13/f16 [1916038,123231] 0 2024-04-27T07:33:29.010 INFO:tasks.workunit.client.0.smithi082.stdout:7/686: mkdir d3/de9 0 2024-04-27T07:33:29.014 INFO:tasks.workunit.client.1.smithi100.stdout:6/203: dwrite de/d18/d21/f49 [0,4194304] 0 2024-04-27T07:33:29.015 INFO:tasks.workunit.client.0.smithi082.stdout:0/773: mkdir da/d3c/d3f/d4c/d119 0 2024-04-27T07:33:29.016 INFO:tasks.workunit.client.0.smithi082.stdout:9/623: write d9/d2d/d2b/d46/f58 [1938583,76809] 0 2024-04-27T07:33:29.016 INFO:tasks.workunit.client.1.smithi100.stdout:6/204: fsync de/d2e/d3f/f44 0 2024-04-27T07:33:29.017 INFO:tasks.workunit.client.0.smithi082.stdout:4/816: dread d3/fa5 [0,4194304] 0 2024-04-27T07:33:29.018 INFO:tasks.workunit.client.0.smithi082.stdout:6/695: dwrite d2/d1e/fc3 [0,4194304] 0 2024-04-27T07:33:29.021 INFO:tasks.workunit.client.1.smithi100.stdout:7/160: dread d1/fc [0,4194304] 0 2024-04-27T07:33:29.023 INFO:tasks.workunit.client.1.smithi100.stdout:6/205: dread de/d18/d21/d24/f27 [0,4194304] 0 2024-04-27T07:33:29.025 INFO:tasks.workunit.client.1.smithi100.stdout:7/161: dread d1/f6 [0,4194304] 0 2024-04-27T07:33:29.025 INFO:tasks.workunit.client.1.smithi100.stdout:3/206: creat d7/d9/d26/f44 x:0 0 0 2024-04-27T07:33:29.028 INFO:tasks.workunit.client.1.smithi100.stdout:6/206: dread - de/d2e/d3f/f44 zero size 2024-04-27T07:33:29.028 INFO:tasks.workunit.client.1.smithi100.stdout:3/207: truncate f4 765926 0 2024-04-27T07:33:29.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/982: write d8/d9/d25/d26/d4d/d82/d8b/f10f [234472,1732] 0 2024-04-27T07:33:29.029 INFO:tasks.workunit.client.0.smithi082.stdout:4/817: read d3/d6/d26/d55/d67/d9d/d101/fb5 [32228,68671] 0 2024-04-27T07:33:29.031 INFO:tasks.workunit.client.0.smithi082.stdout:0/774: creat da/d3c/d3f/d4c/d119/f11a x:0 0 0 2024-04-27T07:33:29.032 INFO:tasks.workunit.client.0.smithi082.stdout:3/983: truncate d8/d9/d3f/f80 4433093 0 2024-04-27T07:33:29.033 INFO:tasks.workunit.client.1.smithi100.stdout:3/208: mkdir d7/d9/d26/d45 0 2024-04-27T07:33:29.034 INFO:tasks.workunit.client.1.smithi100.stdout:3/209: truncate d7/d9/d26/f38 863208 0 2024-04-27T07:33:29.035 INFO:tasks.workunit.client.0.smithi082.stdout:8/685: write d0/d3/f9 [149212,15687] 0 2024-04-27T07:33:29.036 INFO:tasks.workunit.client.0.smithi082.stdout:4/818: creat d3/dce/f116 x:0 0 0 2024-04-27T07:33:29.037 INFO:tasks.workunit.client.1.smithi100.stdout:7/162: write d1/dd/d16/d1f/f25 [3879,121802] 0 2024-04-27T07:33:29.037 INFO:tasks.workunit.client.1.smithi100.stdout:6/207: link de/d18/d21/d24/f25 de/d18/d21/d23/f4b 0 2024-04-27T07:33:29.038 INFO:tasks.workunit.client.0.smithi082.stdout:0/775: read da/d3c/d3f/d4c/f9c [1240342,17309] 0 2024-04-27T07:33:29.039 INFO:tasks.workunit.client.1.smithi100.stdout:7/163: chown d1/dd/c14 2757 1 2024-04-27T07:33:29.039 INFO:tasks.workunit.client.0.smithi082.stdout:8/686: symlink d0/d3/d55/ldf 0 2024-04-27T07:33:29.040 INFO:tasks.workunit.client.1.smithi100.stdout:6/208: dread - de/d18/d21/d23/f3e zero size 2024-04-27T07:33:29.040 INFO:tasks.workunit.client.1.smithi100.stdout:7/164: chown d1/dd/fe 1447006735 1 2024-04-27T07:33:29.041 INFO:tasks.workunit.client.0.smithi082.stdout:8/687: read - d0/d2b/d80/da9/dc6/fd6 zero size 2024-04-27T07:33:29.042 INFO:tasks.workunit.client.0.smithi082.stdout:3/984: truncate d8/d9/d3f/f4a 4917449 0 2024-04-27T07:33:29.042 INFO:tasks.workunit.client.0.smithi082.stdout:4/819: truncate d3/d6/d26/d55/d67/d9d/d101/fb0 2070638 0 2024-04-27T07:33:29.044 INFO:tasks.workunit.client.1.smithi100.stdout:3/210: dwrite d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:29.044 INFO:tasks.workunit.client.1.smithi100.stdout:7/165: creat d1/dd/d16/f2d x:0 0 0 2024-04-27T07:33:29.045 INFO:tasks.workunit.client.1.smithi100.stdout:7/166: chown d1 24 1 2024-04-27T07:33:29.045 INFO:tasks.workunit.client.0.smithi082.stdout:0/776: symlink da/d3c/d3f/d4c/d95/de9/df6/l11b 0 2024-04-27T07:33:29.046 INFO:tasks.workunit.client.1.smithi100.stdout:6/209: mknod de/d18/d21/d24/c4c 0 2024-04-27T07:33:29.047 INFO:tasks.workunit.client.0.smithi082.stdout:4/820: unlink d3/d6/d26/d55/cb7 0 2024-04-27T07:33:29.048 INFO:tasks.workunit.client.1.smithi100.stdout:6/210: write de/f1e [198882,112919] 0 2024-04-27T07:33:29.051 INFO:tasks.workunit.client.0.smithi082.stdout:6/696: truncate d2/d3/f27 1070255 0 2024-04-27T07:33:29.053 INFO:tasks.workunit.client.0.smithi082.stdout:7/687: dwrite d3/f9b [0,4194304] 0 2024-04-27T07:33:29.053 INFO:tasks.workunit.client.0.smithi082.stdout:4/821: unlink d3/d10/l38 0 2024-04-27T07:33:29.053 INFO:tasks.workunit.client.1.smithi100.stdout:3/211: mkdir d7/d46 0 2024-04-27T07:33:29.054 INFO:tasks.workunit.client.0.smithi082.stdout:3/985: dread d8/ff [0,4194304] 0 2024-04-27T07:33:29.054 INFO:tasks.workunit.client.0.smithi082.stdout:8/688: dwrite d0/d3/d87/f3e [4194304,4194304] 0 2024-04-27T07:33:29.054 INFO:tasks.workunit.client.1.smithi100.stdout:7/167: creat d1/dd/d2a/d2c/f2e x:0 0 0 2024-04-27T07:33:29.055 INFO:tasks.workunit.client.0.smithi082.stdout:0/777: mknod da/d28/d109/c11c 0 2024-04-27T07:33:29.055 INFO:tasks.workunit.client.1.smithi100.stdout:6/211: dwrite de/d18/d28/f2c [0,4194304] 0 2024-04-27T07:33:29.055 INFO:tasks.workunit.client.1.smithi100.stdout:7/168: read d1/f1c [2039967,103753] 0 2024-04-27T07:33:29.056 INFO:tasks.workunit.client.0.smithi082.stdout:5/786: sync 2024-04-27T07:33:29.056 INFO:tasks.workunit.client.0.smithi082.stdout:1/669: sync 2024-04-27T07:33:29.058 INFO:tasks.workunit.client.0.smithi082.stdout:7/688: stat d3/db/l16 0 2024-04-27T07:33:29.058 INFO:tasks.workunit.client.0.smithi082.stdout:1/670: fdatasync d4/d15/d49/dab/dc3/d3e/d57/da5/fbb 0 2024-04-27T07:33:29.059 INFO:tasks.workunit.client.1.smithi100.stdout:3/212: mkdir d7/d9/d10/d33/d47 0 2024-04-27T07:33:29.059 INFO:tasks.workunit.client.1.smithi100.stdout:7/169: chown d1/dd/d16/d1f/f25 37289 1 2024-04-27T07:33:29.061 INFO:tasks.workunit.client.1.smithi100.stdout:6/212: creat de/d18/d28/f4d x:0 0 0 2024-04-27T07:33:29.061 INFO:tasks.workunit.client.0.smithi082.stdout:4/822: write d3/d6/d26/d55/dc5/fc9 [1132140,39883] 0 2024-04-27T07:33:29.062 INFO:tasks.workunit.client.1.smithi100.stdout:7/170: mkdir d1/d2f 0 2024-04-27T07:33:29.062 INFO:tasks.workunit.client.0.smithi082.stdout:5/787: truncate d8/d14/f4d 1602495 0 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:1/671: symlink d4/d15/d29/le9 0 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/788: read - d8/d29/d4e/d90/fc2 zero size 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:7/689: creat d3/d9/d4f/d9a/fea x:0 0 0 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/789: dread - d8/d29/dea/da3/fdf zero size 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:6/697: rename d2/d1e/f22 to d2/d3/fe5 0 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:3/986: truncate d8/d9/d25/d4e/da4/fe9 1029612 0 2024-04-27T07:33:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/790: write d8/d2e/d85/daa/fe1 [983351,125448] 0 2024-04-27T07:33:29.069 INFO:tasks.workunit.client.1.smithi100.stdout:7/171: dread - d1/f27 zero size 2024-04-27T07:33:29.069 INFO:tasks.workunit.client.1.smithi100.stdout:6/213: truncate de/d18/d21/f26 535919 0 2024-04-27T07:33:29.069 INFO:tasks.workunit.client.1.smithi100.stdout:6/214: chown de/d18/f29 411 1 2024-04-27T07:33:29.069 INFO:tasks.workunit.client.0.smithi082.stdout:9/624: dread d9/da/dc/d73/f95 [0,4194304] 0 2024-04-27T07:33:29.070 INFO:tasks.workunit.client.0.smithi082.stdout:6/698: write d2/d2e/dae/fb8 [178816,125980] 0 2024-04-27T07:33:29.071 INFO:tasks.workunit.client.1.smithi100.stdout:3/213: dwrite d7/d9/d26/f38 [0,4194304] 0 2024-04-27T07:33:29.071 INFO:tasks.workunit.client.0.smithi082.stdout:7/690: creat d3/de9/feb x:0 0 0 2024-04-27T07:33:29.071 INFO:tasks.workunit.client.0.smithi082.stdout:5/791: write d8/d3c/d47/fe2 [1506040,23259] 0 2024-04-27T07:33:29.072 INFO:tasks.workunit.client.0.smithi082.stdout:9/625: chown d9/da/dc 52 1 2024-04-27T07:33:29.073 INFO:tasks.workunit.client.0.smithi082.stdout:1/672: creat d4/d15/d3f/fea x:0 0 0 2024-04-27T07:33:29.074 INFO:tasks.workunit.client.1.smithi100.stdout:6/215: symlink de/d18/d28/l4e 0 2024-04-27T07:33:29.074 INFO:tasks.workunit.client.0.smithi082.stdout:3/987: mkdir d8/d9/d25/d26/d4d/d82/d8b/d154 0 2024-04-27T07:33:29.075 INFO:tasks.workunit.client.0.smithi082.stdout:6/699: symlink d2/d2d/d4a/le6 0 2024-04-27T07:33:29.076 INFO:tasks.workunit.client.0.smithi082.stdout:1/673: readlink d4/d15/d49/dab/dc3/d3e/d57/da5/lb1 0 2024-04-27T07:33:29.077 INFO:tasks.workunit.client.0.smithi082.stdout:7/691: creat d3/d49/d97/d3a/d2a/dac/d91/fec x:0 0 0 2024-04-27T07:33:29.077 INFO:tasks.workunit.client.1.smithi100.stdout:7/172: symlink d1/d2f/l30 0 2024-04-27T07:33:29.078 INFO:tasks.workunit.client.0.smithi082.stdout:1/674: chown d4/d15/d3f/d6d/f85 118075450 1 2024-04-27T07:33:29.078 INFO:tasks.workunit.client.0.smithi082.stdout:9/626: creat d9/da/dc/d35/d38/da5/d66/d97/fd5 x:0 0 0 2024-04-27T07:33:29.079 INFO:tasks.workunit.client.1.smithi100.stdout:7/173: write d1/dd/d16/f29 [644171,58132] 0 2024-04-27T07:33:29.079 INFO:tasks.workunit.client.1.smithi100.stdout:3/214: mknod d7/d9/d10/d33/d47/c48 0 2024-04-27T07:33:29.080 INFO:tasks.workunit.client.0.smithi082.stdout:7/692: write d3/d9/d4f/d9a/fd7 [577754,16801] 0 2024-04-27T07:33:29.080 INFO:tasks.workunit.client.0.smithi082.stdout:6/700: mkdir d2/d2d/d3d/de7 0 2024-04-27T07:33:29.083 INFO:tasks.workunit.client.0.smithi082.stdout:3/988: unlink d8/d9/d25/d26/d4d/d82/d8b/fcf 0 2024-04-27T07:33:29.084 INFO:tasks.workunit.client.1.smithi100.stdout:7/174: mkdir d1/dd/d16/d31 0 2024-04-27T07:33:29.086 INFO:tasks.workunit.client.0.smithi082.stdout:1/675: creat d4/d15/d49/dab/feb x:0 0 0 2024-04-27T07:33:29.087 INFO:tasks.workunit.client.1.smithi100.stdout:6/216: rename de/d2e/d3f/f44 to de/d18/d28/f4f 0 2024-04-27T07:33:29.088 INFO:tasks.workunit.client.1.smithi100.stdout:3/215: dread d7/d9/d26/f38 [0,4194304] 0 2024-04-27T07:33:29.089 INFO:tasks.workunit.client.1.smithi100.stdout:7/175: creat d1/f32 x:0 0 0 2024-04-27T07:33:29.090 INFO:tasks.workunit.client.0.smithi082.stdout:6/701: rmdir d2/d1e/d32/d7d/d82/da0 39 2024-04-27T07:33:29.092 INFO:tasks.workunit.client.0.smithi082.stdout:5/792: dread d8/d15/ff [0,4194304] 0 2024-04-27T07:33:29.093 INFO:tasks.workunit.client.0.smithi082.stdout:9/627: dwrite d9/da/dc/d35/d38/da5/d66/f6c [0,4194304] 0 2024-04-27T07:33:29.094 INFO:tasks.workunit.client.0.smithi082.stdout:7/693: rename d3/db/f32 to d3/d49/d97/d3a/d2a/dac/fed 0 2024-04-27T07:33:29.095 INFO:tasks.workunit.client.1.smithi100.stdout:7/176: creat d1/f33 x:0 0 0 2024-04-27T07:33:29.096 INFO:tasks.workunit.client.1.smithi100.stdout:3/216: unlink d7/d9/d10/c27 0 2024-04-27T07:33:29.097 INFO:tasks.workunit.client.0.smithi082.stdout:8/689: write d0/f99 [213511,111076] 0 2024-04-27T07:33:29.097 INFO:tasks.workunit.client.0.smithi082.stdout:0/778: write da/d3c/d3f/d4c/d95/faf [564397,31675] 0 2024-04-27T07:33:29.100 INFO:tasks.workunit.client.0.smithi082.stdout:9/628: mkdir d9/d48/dd6 0 2024-04-27T07:33:29.101 INFO:tasks.workunit.client.0.smithi082.stdout:7/694: creat d3/db1/fee x:0 0 0 2024-04-27T07:33:29.101 INFO:tasks.workunit.client.0.smithi082.stdout:9/629: dread - d9/d2d/fd0 zero size 2024-04-27T07:33:29.102 INFO:tasks.workunit.client.0.smithi082.stdout:7/695: write d3/f8 [152141,107491] 0 2024-04-27T07:33:29.105 INFO:tasks.workunit.client.0.smithi082.stdout:9/630: write d9/d2d/d72/f9c [234615,53083] 0 2024-04-27T07:33:29.105 INFO:tasks.workunit.client.0.smithi082.stdout:5/793: rename d8/d14/d7b to d8/d29/dea/d5f/df6/dfd/d102/d10e 0 2024-04-27T07:33:29.106 INFO:tasks.workunit.client.1.smithi100.stdout:6/217: link de/d2e/d3f/f43 de/d18/d21/d23/f50 0 2024-04-27T07:33:29.108 INFO:tasks.workunit.client.1.smithi100.stdout:7/177: mknod d1/dd/d2a/c34 0 2024-04-27T07:33:29.108 INFO:tasks.workunit.client.1.smithi100.stdout:8/198: sync 2024-04-27T07:33:29.108 INFO:tasks.workunit.client.0.smithi082.stdout:8/690: creat d0/d3/d55/fe0 x:0 0 0 2024-04-27T07:33:29.112 INFO:tasks.workunit.client.0.smithi082.stdout:9/631: creat d9/da/dc/fd7 x:0 0 0 2024-04-27T07:33:29.112 INFO:tasks.workunit.client.0.smithi082.stdout:3/989: link d8/d9/d1d/c61 d8/d9/db0/df9/d107/c155 0 2024-04-27T07:33:29.112 INFO:tasks.workunit.client.0.smithi082.stdout:9/632: fdatasync d9/da/fb5 0 2024-04-27T07:33:29.113 INFO:tasks.workunit.client.1.smithi100.stdout:6/218: symlink de/d2e/l51 0 2024-04-27T07:33:29.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/990: write d8/d9/d1d/da5/db3/f102 [1416658,5234] 0 2024-04-27T07:33:29.115 INFO:tasks.workunit.client.0.smithi082.stdout:4/823: dread f2 [4194304,4194304] 0 2024-04-27T07:33:29.115 INFO:tasks.workunit.client.0.smithi082.stdout:7/696: mknod d3/db/cef 0 2024-04-27T07:33:29.117 INFO:tasks.workunit.client.0.smithi082.stdout:5/794: getdents d8/d15/d65/dc7 0 2024-04-27T07:33:29.118 INFO:tasks.workunit.client.0.smithi082.stdout:1/676: dread d4/d15/d49/dab/dc3/d4c/f92 [0,4194304] 0 2024-04-27T07:33:29.120 INFO:tasks.workunit.client.1.smithi100.stdout:6/219: mknod de/d18/d28/c52 0 2024-04-27T07:33:29.120 INFO:tasks.workunit.client.0.smithi082.stdout:8/691: creat d0/d2b/d9a/da4/d35/ddc/fe1 x:0 0 0 2024-04-27T07:33:29.121 INFO:tasks.workunit.client.1.smithi100.stdout:6/220: dread - de/d18/d21/d23/f39 zero size 2024-04-27T07:33:29.121 INFO:tasks.workunit.client.1.smithi100.stdout:8/199: creat d6/d20/f40 x:0 0 0 2024-04-27T07:33:29.122 INFO:tasks.workunit.client.1.smithi100.stdout:6/221: dread - de/d18/d21/d23/f3e zero size 2024-04-27T07:33:29.123 INFO:tasks.workunit.client.1.smithi100.stdout:6/222: dread - de/d2e/f3b zero size 2024-04-27T07:33:29.123 INFO:tasks.workunit.client.1.smithi100.stdout:8/200: chown d6/d1b/f22 47141 1 2024-04-27T07:33:29.124 INFO:tasks.workunit.client.0.smithi082.stdout:9/633: getdents d9/d2d/d72/dae 0 2024-04-27T07:33:29.124 INFO:tasks.workunit.client.0.smithi082.stdout:8/692: write d0/d3/d1b/fa6 [1006413,14743] 0 2024-04-27T07:33:29.124 INFO:tasks.workunit.client.1.smithi100.stdout:7/178: link d1/d2f/l30 d1/dd/d16/d1f/l35 0 2024-04-27T07:33:29.126 INFO:tasks.workunit.client.0.smithi082.stdout:4/824: write d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10c/d98/f105 [855066,76004] 0 2024-04-27T07:33:29.126 INFO:tasks.workunit.client.1.smithi100.stdout:7/179: read d1/dd/f1e [2637649,58163] 0 2024-04-27T07:33:29.127 INFO:tasks.workunit.client.0.smithi082.stdout:5/795: rename d8/d15/dca/dce/ld0 to d8/d2e/d85/d103/l10f 0 2024-04-27T07:33:29.127 INFO:tasks.workunit.client.1.smithi100.stdout:3/217: dread d7/f1c [0,4194304] 0 2024-04-27T07:33:29.130 INFO:tasks.workunit.client.0.smithi082.stdout:9/634: dread f5 [0,4194304] 0 2024-04-27T07:33:29.131 INFO:tasks.workunit.client.0.smithi082.stdout:3/991: dwrite d8/d9/fae [0,4194304] 0 2024-04-27T07:33:29.133 INFO:tasks.workunit.client.1.smithi100.stdout:7/180: creat d1/d2f/f36 x:0 0 0 2024-04-27T07:33:29.134 INFO:tasks.workunit.client.1.smithi100.stdout:7/181: write d1/f1a [879865,30542] 0 2024-04-27T07:33:29.135 INFO:tasks.workunit.client.0.smithi082.stdout:9/635: write d9/d2d/d72/f8a [3491120,70516] 0 2024-04-27T07:33:29.135 INFO:tasks.workunit.client.0.smithi082.stdout:3/992: dread - d8/d9/dd/d13/d1b/da8/f137 zero size 2024-04-27T07:33:29.136 INFO:tasks.workunit.client.0.smithi082.stdout:7/697: dread d3/d9/f37 [0,4194304] 0 2024-04-27T07:33:29.137 INFO:tasks.workunit.client.1.smithi100.stdout:3/218: creat d7/d9/d26/d45/f49 x:0 0 0 2024-04-27T07:33:29.141 INFO:tasks.workunit.client.0.smithi082.stdout:5/796: mkdir d8/d29/dea/d5f/df6/dfd/d102/d10e/d110 0 2024-04-27T07:33:29.143 INFO:tasks.workunit.client.0.smithi082.stdout:8/693: rename d0/d3/c15 to d0/ce2 0 2024-04-27T07:33:29.145 INFO:tasks.workunit.client.1.smithi100.stdout:6/223: dread de/d18/f1b [0,4194304] 0 2024-04-27T07:33:29.147 INFO:tasks.workunit.client.1.smithi100.stdout:6/224: dread - de/d18/d21/d23/f3e zero size 2024-04-27T07:33:29.147 INFO:tasks.workunit.client.0.smithi082.stdout:3/993: dwrite d8/d9/d25/d4e/da4/f112 [0,4194304] 0 2024-04-27T07:33:29.149 INFO:tasks.workunit.client.0.smithi082.stdout:4/825: rename d3/d6/d26/d55/d67/d9d/d101/d69/lcd to d3/d6/dcf/d110/l117 0 2024-04-27T07:33:29.150 INFO:tasks.workunit.client.1.smithi100.stdout:7/182: mknod d1/dd/d16/d2b/c37 0 2024-04-27T07:33:29.150 INFO:tasks.workunit.client.0.smithi082.stdout:1/677: dread d4/d15/d3f/d6d/d93/fe6 [0,4194304] 0 2024-04-27T07:33:29.151 INFO:tasks.workunit.client.1.smithi100.stdout:6/225: mknod de/d18/d21/d24/c53 0 2024-04-27T07:33:29.153 INFO:tasks.workunit.client.0.smithi082.stdout:5/797: symlink d8/d29/dea/d5f/df6/dfd/d102/d10e/d8b/l111 0 2024-04-27T07:33:29.154 INFO:tasks.workunit.client.1.smithi100.stdout:7/183: symlink d1/dd/l38 0 2024-04-27T07:33:29.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/694: mkdir d0/d3/d1b/d29/d65/de3 0 2024-04-27T07:33:29.155 INFO:tasks.workunit.client.0.smithi082.stdout:1/678: chown d4/d15/d49/dab/dc3/d3e/f55 452 1 2024-04-27T07:33:29.158 INFO:tasks.workunit.client.0.smithi082.stdout:7/698: creat d3/d49/d97/d7d/da1/da3/ff0 x:0 0 0 2024-04-27T07:33:29.159 INFO:tasks.workunit.client.0.smithi082.stdout:8/695: fdatasync d0/d2b/d80/fb9 0 2024-04-27T07:33:29.160 INFO:tasks.workunit.client.0.smithi082.stdout:6/702: dwrite d2/d1e/f90 [0,4194304] 0 2024-04-27T07:33:29.161 INFO:tasks.workunit.client.1.smithi100.stdout:6/226: write de/d18/d21/d24/f27 [824661,37851] 0 2024-04-27T07:33:29.162 INFO:tasks.workunit.client.0.smithi082.stdout:4/826: creat d3/d6/d26/d55/dc5/f118 x:0 0 0 2024-04-27T07:33:29.164 INFO:tasks.workunit.client.1.smithi100.stdout:3/219: creat d7/d9/d10/d3e/f4a x:0 0 0 2024-04-27T07:33:29.164 INFO:tasks.workunit.client.1.smithi100.stdout:7/184: getdents d1/d2f 0 2024-04-27T07:33:29.165 INFO:tasks.workunit.client.0.smithi082.stdout:3/994: fdatasync d8/d9/d3f/f4a 0 2024-04-27T07:33:29.166 INFO:tasks.workunit.client.1.smithi100.stdout:6/227: creat de/d18/d21/d24/f54 x:0 0 0 2024-04-27T07:33:29.167 INFO:tasks.workunit.client.0.smithi082.stdout:5/798: dwrite d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:29.167 INFO:tasks.workunit.client.0.smithi082.stdout:0/779: truncate da/d3c/f82 537413 0 2024-04-27T07:33:29.168 INFO:tasks.workunit.client.0.smithi082.stdout:1/679: truncate d4/d15/d3f/fc9 908872 0 2024-04-27T07:33:29.169 INFO:tasks.workunit.client.1.smithi100.stdout:7/185: unlink d1/dd/d16/f29 0 2024-04-27T07:33:29.170 INFO:tasks.workunit.client.0.smithi082.stdout:5/799: chown d8/d29/d4e/c99 61 1 2024-04-27T07:33:29.171 INFO:tasks.workunit.client.0.smithi082.stdout:8/696: rename d0/d2b/d9a/da4/d35/ddc/fe1 to d0/d2b/d9a/da4/fe4 0 2024-04-27T07:33:29.173 INFO:tasks.workunit.client.1.smithi100.stdout:6/228: rename de/d18/d21/d23/f50 to de/d2e/f55 0 2024-04-27T07:33:29.174 INFO:tasks.workunit.client.1.smithi100.stdout:3/220: read - d7/d9/d10/d33/f41 zero size 2024-04-27T07:33:29.177 INFO:tasks.workunit.client.1.smithi100.stdout:3/221: stat d7/d9/d10/f3d 0 2024-04-27T07:33:29.177 INFO:tasks.workunit.client.0.smithi082.stdout:5/800: dwrite d8/d15/fdb [0,4194304] 0 2024-04-27T07:33:29.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/699: fsync d3/d9/d4f/d9a/fc2 0 2024-04-27T07:33:29.178 INFO:tasks.workunit.client.0.smithi082.stdout:8/697: dread d0/f99 [0,4194304] 0 2024-04-27T07:33:29.181 INFO:tasks.workunit.client.1.smithi100.stdout:7/186: dwrite d1/dd/d16/d1f/f25 [0,4194304] 0 2024-04-27T07:33:29.181 INFO:tasks.workunit.client.0.smithi082.stdout:3/995: dread - d8/d9/d1d/db5/dc7/fe5 zero size 2024-04-27T07:33:29.182 INFO:tasks.workunit.client.1.smithi100.stdout:6/229: dread de/d18/d21/d24/f27 [0,4194304] 0 2024-04-27T07:33:29.183 INFO:tasks.workunit.client.1.smithi100.stdout:7/187: write d1/f6 [576021,103856] 0 2024-04-27T07:33:29.184 INFO:tasks.workunit.client.0.smithi082.stdout:0/780: write da/d1d/d6a/f107 [5188134,7868] 0 2024-04-27T07:33:29.184 INFO:tasks.workunit.client.0.smithi082.stdout:3/996: readlink d8/d9/dd/d13/d1b/dbd/d8e/lab 0 2024-04-27T07:33:29.185 INFO:tasks.workunit.client.1.smithi100.stdout:7/188: write d1/f33 [78822,21939] 0 2024-04-27T07:33:29.186 INFO:tasks.workunit.client.1.smithi100.stdout:6/230: write de/d18/d21/d24/f27 [4808613,18090] 0 2024-04-27T07:33:29.188 INFO:tasks.workunit.client.1.smithi100.stdout:6/231: stat de/d18/d21/d24/f27 0 2024-04-27T07:33:29.188 INFO:tasks.workunit.client.1.smithi100.stdout:3/222: dwrite d7/d9/d10/d28/d2c/f2e [0,4194304] 0 2024-04-27T07:33:29.189 INFO:tasks.workunit.client.1.smithi100.stdout:6/232: stat de/d18/d28/f4d 0 2024-04-27T07:33:29.189 INFO:tasks.workunit.client.1.smithi100.stdout:7/189: unlink d1/l1d 0 2024-04-27T07:33:29.190 INFO:tasks.workunit.client.1.smithi100.stdout:6/233: chown de/d18/d21/d24/l33 19 1 2024-04-27T07:33:29.190 INFO:tasks.workunit.client.1.smithi100.stdout:7/190: fdatasync d1/dd/d2a/d2c/f2e 0 2024-04-27T07:33:29.191 INFO:tasks.workunit.client.1.smithi100.stdout:6/234: chown de/f1e 120498673 1 2024-04-27T07:33:29.192 INFO:tasks.workunit.client.1.smithi100.stdout:7/191: truncate d1/f32 960489 0 2024-04-27T07:33:29.192 INFO:tasks.workunit.client.0.smithi082.stdout:7/700: dwrite d3/d49/d97/d3a/d2a/f2b [0,4194304] 0 2024-04-27T07:33:29.193 INFO:tasks.workunit.client.1.smithi100.stdout:3/223: getdents d7/d9/d10 0 2024-04-27T07:33:29.193 INFO:tasks.workunit.client.1.smithi100.stdout:7/192: chown d1/f21 3 1 2024-04-27T07:33:29.193 INFO:tasks.workunit.client.1.smithi100.stdout:6/235: creat de/f56 x:0 0 0 2024-04-27T07:33:29.194 INFO:tasks.workunit.client.0.smithi082.stdout:6/703: link d2/d1e/d32/d7d/d82/da0/fcd d2/d2e/d55/fe8 0 2024-04-27T07:33:29.194 INFO:tasks.workunit.client.1.smithi100.stdout:6/236: chown de/d18/d21/d24 705 1 2024-04-27T07:33:29.195 INFO:tasks.workunit.client.1.smithi100.stdout:7/193: read - d1/d2f/f36 zero size 2024-04-27T07:33:29.196 INFO:tasks.workunit.client.0.smithi082.stdout:6/704: fsync d2/d1e/d32/d85/d97/fc8 0 2024-04-27T07:33:29.196 INFO:tasks.workunit.client.1.smithi100.stdout:3/224: unlink d7/d9/d26/d2a/f43 0 2024-04-27T07:33:29.197 INFO:tasks.workunit.client.0.smithi082.stdout:9/636: mkdir d9/da/dc/d35/d38/dd8 0 2024-04-27T07:33:29.198 INFO:tasks.workunit.client.1.smithi100.stdout:7/194: rmdir d1/dd/d16/d2b 39 2024-04-27T07:33:29.200 INFO:tasks.workunit.client.0.smithi082.stdout:9/637: readlink d9/da/dc/d35/d38/da5/d66/l6d 0 2024-04-27T07:33:29.201 INFO:tasks.workunit.client.1.smithi100.stdout:7/195: truncate d1/dd/d16/f26 207797 0 2024-04-27T07:33:29.201 INFO:tasks.workunit.client.1.smithi100.stdout:6/237: dread de/d18/d28/f2c [0,4194304] 0 2024-04-27T07:33:29.201 INFO:tasks.workunit.client.1.smithi100.stdout:7/196: readlink d1/l4 0 2024-04-27T07:33:29.201 INFO:tasks.workunit.client.1.smithi100.stdout:3/225: symlink d7/d9/l4b 0 2024-04-27T07:33:29.201 INFO:tasks.workunit.client.1.smithi100.stdout:6/238: chown de/d2e/l45 28414 1 2024-04-27T07:33:29.202 INFO:tasks.workunit.client.0.smithi082.stdout:3/997: mknod d8/d9/d1d/da5/d10a/c156 0 2024-04-27T07:33:29.202 INFO:tasks.workunit.client.1.smithi100.stdout:7/197: write d1/dd/d16/f26 [519490,61008] 0 2024-04-27T07:33:29.203 INFO:tasks.workunit.client.1.smithi100.stdout:3/226: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:29.204 INFO:tasks.workunit.client.0.smithi082.stdout:3/998: readlink d8/d9/dd/d13/dc0/de8/l127 0 2024-04-27T07:33:29.205 INFO:tasks.workunit.client.0.smithi082.stdout:6/705: dwrite d2/d2e/dae/fb8 [0,4194304] 0 2024-04-27T07:33:29.206 INFO:tasks.workunit.client.1.smithi100.stdout:6/239: mknod de/d2e/d3f/c57 0 2024-04-27T07:33:29.207 INFO:tasks.workunit.client.1.smithi100.stdout:7/198: mknod d1/dd/d16/d1f/c39 0 2024-04-27T07:33:29.208 INFO:tasks.workunit.client.0.smithi082.stdout:5/801: truncate d8/fb5 525785 0 2024-04-27T07:33:29.209 INFO:tasks.workunit.client.0.smithi082.stdout:5/802: chown d8/d3c/l40 1048017187 1 2024-04-27T07:33:29.210 INFO:tasks.workunit.client.0.smithi082.stdout:7/701: mknod d3/d9/d4f/d9a/cf1 0 2024-04-27T07:33:29.212 INFO:tasks.workunit.client.1.smithi100.stdout:7/199: dread d1/fc [0,4194304] 0 2024-04-27T07:33:29.213 INFO:tasks.workunit.client.1.smithi100.stdout:7/200: truncate d1/f33 217046 0 2024-04-27T07:33:29.217 INFO:tasks.workunit.client.0.smithi082.stdout:9/638: symlink d9/d2d/d2b/d46/d5d/ld9 0 2024-04-27T07:33:29.219 INFO:tasks.workunit.client.0.smithi082.stdout:4/827: getdents d3/d6/d26/d55/d67/d9d 0 2024-04-27T07:33:29.219 INFO:tasks.workunit.client.1.smithi100.stdout:7/201: creat d1/dd/d16/f3a x:0 0 0 2024-04-27T07:33:29.220 INFO:tasks.workunit.client.0.smithi082.stdout:9/639: write d9/da/dc/d35/d38/da5/d66/f6c [3540433,109884] 0 2024-04-27T07:33:29.220 INFO:tasks.workunit.client.1.smithi100.stdout:7/202: write d1/f27 [386221,66709] 0 2024-04-27T07:33:29.221 INFO:tasks.workunit.client.1.smithi100.stdout:7/203: read d1/fc [1680521,103763] 0 2024-04-27T07:33:29.222 INFO:tasks.workunit.client.0.smithi082.stdout:9/640: stat d9/da/dc/d35/d4a/d50/fc2 0 2024-04-27T07:33:29.222 INFO:tasks.workunit.client.0.smithi082.stdout:1/680: link d4/d15/d49/d99/d9a/dc7/ce4 d4/d15/d49/dab/cec 0 2024-04-27T07:33:29.224 INFO:tasks.workunit.client.0.smithi082.stdout:8/698: rename d0/d83/d90 to d0/d2b/d9a/de5 0 2024-04-27T07:33:29.226 INFO:tasks.workunit.client.1.smithi100.stdout:7/204: dread d1/dd/d16/d1f/f25 [0,4194304] 0 2024-04-27T07:33:29.226 INFO:tasks.workunit.client.1.smithi100.stdout:7/205: dread - d1/dd/d16/f2d zero size 2024-04-27T07:33:29.227 INFO:tasks.workunit.client.0.smithi082.stdout:5/803: mkdir d8/d3c/d4a/d112 0 2024-04-27T07:33:29.227 INFO:tasks.workunit.client.0.smithi082.stdout:0/781: link da/d3c/d3f/d57/dcc/da8/c111 da/d1d/c11d 0 2024-04-27T07:33:29.227 INFO:tasks.workunit.client.1.smithi100.stdout:7/206: chown d1/dd/d16/d1f/l22 710306 1 2024-04-27T07:33:29.227 INFO:tasks.workunit.client.0.smithi082.stdout:0/782: stat da/d3c/d3f/d57/f7e 0 2024-04-27T07:33:29.228 INFO:tasks.workunit.client.0.smithi082.stdout:0/783: stat da/d3c/c69 0 2024-04-27T07:33:29.229 INFO:tasks.workunit.client.1.smithi100.stdout:7/207: mkdir d1/dd/d16/d1f/d3b 0 2024-04-27T07:33:29.231 INFO:tasks.workunit.client.1.smithi100.stdout:7/208: dread d1/f33 [0,4194304] 0 2024-04-27T07:33:29.232 INFO:tasks.workunit.client.1.smithi100.stdout:7/209: stat d1/dd/d16/d1f 0 2024-04-27T07:33:29.232 INFO:tasks.workunit.client.1.smithi100.stdout:7/210: chown d1/f32 214911 1 2024-04-27T07:33:29.232 INFO:tasks.workunit.client.0.smithi082.stdout:1/681: mknod d4/d15/d49/dab/dc3/d3e/ced 0 2024-04-27T07:33:29.236 INFO:tasks.workunit.client.0.smithi082.stdout:8/699: rename d0/d3 to d0/d2b/d80/dca/de6 0 2024-04-27T07:33:29.237 INFO:tasks.workunit.client.0.smithi082.stdout:8/700: chown d0/d2b/d80/dca/de6/d1b 202 1 2024-04-27T07:33:29.237 INFO:tasks.workunit.client.0.smithi082.stdout:5/804: fsync d8/d29/dea/d5f/df6/dfd/d102/d10e/d8b/fd7 0 2024-04-27T07:33:29.238 INFO:tasks.workunit.client.0.smithi082.stdout:5/805: stat d8/d77/f78 0 2024-04-27T07:33:29.239 INFO:tasks.workunit.client.0.smithi082.stdout:5/806: write d8/d15/d22/fe4 [175635,24607] 0 2024-04-27T07:33:29.242 INFO:tasks.workunit.client.0.smithi082.stdout:4/828: symlink d3/d6/d26/d5e/l119 0 2024-04-27T07:33:29.242 INFO:tasks.workunit.client.0.smithi082.stdout:9/641: creat d9/da/dc/d35/d38/dd8/fda x:0 0 0 2024-04-27T07:33:29.244 INFO:tasks.workunit.client.0.smithi082.stdout:1/682: rename d4/d15/d1c/l42 to d4/d15/d49/lee 0 2024-04-27T07:33:29.244 INFO:tasks.workunit.client.0.smithi082.stdout:9/642: chown d9/da/dc/d88 31 1 2024-04-27T07:33:29.245 INFO:tasks.workunit.client.0.smithi082.stdout:3/999: dread d8/d9/dd/f5a [0,4194304] 0 2024-04-27T07:33:29.245 INFO:tasks.workunit.client.0.smithi082.stdout:4/829: chown d3/d6/d26/d55/c7f 126 1 2024-04-27T07:33:29.246 INFO:tasks.workunit.client.0.smithi082.stdout:8/701: mkdir d0/d2b/d80/dca/de6/d1b/d29/d65/de7 0 2024-04-27T07:33:29.247 INFO:tasks.workunit.client.0.smithi082.stdout:7/702: link d3/d49/d97/l1c d3/d49/d97/d6c/lf2 0 2024-04-27T07:33:29.248 INFO:tasks.workunit.client.1.smithi100.stdout:6/240: rename de/d18 to de/d58 0 2024-04-27T07:33:29.248 INFO:tasks.workunit.client.0.smithi082.stdout:9/643: stat d9/d2d/d2b/d46/d76 0 2024-04-27T07:33:29.249 INFO:tasks.workunit.client.0.smithi082.stdout:4/830: mknod d3/dce/c11a 0 2024-04-27T07:33:29.249 INFO:tasks.workunit.client.0.smithi082.stdout:0/784: dwrite da/d38/d7f/d4a/fa4 [4194304,4194304] 0 2024-04-27T07:33:29.251 INFO:tasks.workunit.client.0.smithi082.stdout:1/683: symlink d4/d15/d3f/d97/lef 0 2024-04-27T07:33:29.252 INFO:tasks.workunit.client.1.smithi100.stdout:6/241: dread de/d2e/d3f/f43 [0,4194304] 0 2024-04-27T07:33:29.252 INFO:tasks.workunit.client.0.smithi082.stdout:7/703: creat d3/de9/ff3 x:0 0 0 2024-04-27T07:33:29.254 INFO:tasks.workunit.client.1.smithi100.stdout:3/227: write d7/d9/d26/d2a/f20 [1709072,51985] 0 2024-04-27T07:33:29.255 INFO:tasks.workunit.client.0.smithi082.stdout:7/704: dread - d3/d9/d4f/d9a/fbe zero size 2024-04-27T07:33:29.256 INFO:tasks.workunit.client.1.smithi100.stdout:6/242: getdents de/d2e/d3f 0 2024-04-27T07:33:29.257 INFO:tasks.workunit.client.0.smithi082.stdout:9/644: write d9/da/dc/d73/f95 [695168,78590] 0 2024-04-27T07:33:29.259 INFO:tasks.workunit.client.0.smithi082.stdout:1/684: read d4/d15/d3f/d98/fd8 [7321799,92516] 0 2024-04-27T07:33:29.259 INFO:tasks.workunit.client.1.smithi100.stdout:3/228: dread d7/d9/d10/d28/d2c/f34 [0,4194304] 0 2024-04-27T07:33:29.260 INFO:tasks.workunit.client.1.smithi100.stdout:7/211: rename d1/dd/d16/d1f to d1/dd/d16/d3c 0 2024-04-27T07:33:29.261 INFO:tasks.workunit.client.0.smithi082.stdout:4/831: mknod d3/d6/d26/d55/d67/d9d/d101/d69/d85/db8/d10b/c11b 0 2024-04-27T07:33:29.261 INFO:tasks.workunit.client.1.smithi100.stdout:6/243: creat de/d58/d28/f59 x:0 0 0 2024-04-27T07:33:29.262 INFO:tasks.workunit.client.0.smithi082.stdout:0/785: truncate da/d3c/d3f/d4c/d95/faf 852362 0 2024-04-27T07:33:29.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/702: dwrite d0/d2b/f68 [0,4194304] 0 2024-04-27T07:33:29.262 INFO:tasks.workunit.client.1.smithi100.stdout:7/212: write d1/dd/d16/f2d [315191,16097] 0 2024-04-27T07:33:29.262 INFO:tasks.workunit.client.1.smithi100.stdout:3/229: write d7/d9/d26/d45/f49 [250755,53369] 0 2024-04-27T07:33:29.262 INFO:tasks.workunit.client.0.smithi082.stdout:5/807: dwrite d8/d14/f49 [0,4194304] 0 2024-04-27T07:33:29.263 INFO:tasks.workunit.client.1.smithi100.stdout:7/213: dread - d1/dd/d16/f3a zero size 2024-04-27T07:33:29.264 INFO:tasks.workunit.client.1.smithi100.stdout:3/230: chown d7/d9/d10/d22/l40 5660 1 2024-04-27T07:33:29.265 INFO:tasks.workunit.client.1.smithi100.stdout:6/244: creat de/d58/d21/d23/f5a x:0 0 0 2024-04-27T07:33:29.266 INFO:tasks.workunit.client.0.smithi082.stdout:1/685: chown d4/d15/d3f/d6d/f85 28 1 2024-04-27T07:33:29.266 INFO:tasks.workunit.client.0.smithi082.stdout:9/645: creat d9/da/db0/fdb x:0 0 0 2024-04-27T07:33:29.266 INFO:tasks.workunit.client.0.smithi082.stdout:0/786: fdatasync da/d28/d36/feb 0 2024-04-27T07:33:29.266 INFO:tasks.workunit.client.1.smithi100.stdout:3/231: write d7/d9/d26/f38 [1315638,25380] 0 2024-04-27T07:33:29.269 INFO:tasks.workunit.client.0.smithi082.stdout:9/646: fdatasync d9/da/dc/d35/d38/da5/f8f 0 2024-04-27T07:33:29.269 INFO:tasks.workunit.client.0.smithi082.stdout:7/705: link d3/d9/d4f/d9a/fd7 d3/d49/d97/d7d/da1/ff4 0 2024-04-27T07:33:29.270 INFO:tasks.workunit.client.1.smithi100.stdout:3/232: symlink d7/d9/d10/d28/d2c/l4c 0 2024-04-27T07:33:29.270 INFO:tasks.workunit.client.0.smithi082.stdout:7/706: stat d3/d9/d4f/d9a/fd7 0 2024-04-27T07:33:29.271 INFO:tasks.workunit.client.0.smithi082.stdout:9/647: chown d9/d2d/d2b/d46/d5d/c7c 16285 1 2024-04-27T07:33:29.271 INFO:tasks.workunit.client.0.smithi082.stdout:4/832: creat d3/d6/d26/d55/d67/d9d/f11c x:0 0 0 2024-04-27T07:33:29.272 INFO:tasks.workunit.client.0.smithi082.stdout:1/686: write d4/d15/d29/f47 [6690243,95900] 0 2024-04-27T07:33:29.272 INFO:tasks.workunit.client.0.smithi082.stdout:8/703: symlink d0/d2b/d80/dca/de6/le8 0 2024-04-27T07:33:29.273 INFO:tasks.workunit.client.1.smithi100.stdout:3/233: symlink d7/d46/l4d 0 2024-04-27T07:33:29.273 INFO:tasks.workunit.client.0.smithi082.stdout:5/808: creat d8/d29/dea/d5f/d100/f113 x:0 0 0 2024-04-27T07:33:29.275 INFO:tasks.workunit.client.1.smithi100.stdout:3/234: fsync d7/f1c 0 2024-04-27T07:33:29.276 INFO:tasks.workunit.client.1.smithi100.stdout:6/245: rmdir de/d58/d21/d23 39 2024-04-27T07:33:29.276 INFO:tasks.workunit.client.0.smithi082.stdout:7/707: creat d3/d49/d97/d3a/d2a/dac/dae/dce/ff5 x:0 0 0 2024-04-27T07:33:29.277 INFO:tasks.workunit.client.1.smithi100.stdout:3/235: creat d7/d9/d10/d33/f4e x:0 0 0 2024-04-27T07:33:29.278 INFO:tasks.workunit.client.1.smithi100.stdout:6/246: mkdir de/d58/d21/d5b 0 2024-04-27T07:33:29.278 INFO:tasks.workunit.client.0.smithi082.stdout:8/704: rename d0/d2b/d80/dca/de6/d55/d6d to d0/d2b/d80/dca/de9 0 2024-04-27T07:33:29.279 INFO:tasks.workunit.client.0.smithi082.stdout:7/708: truncate d3/d49/d97/d7d/da1/fb0 404087 0 2024-04-27T07:33:29.279 INFO:tasks.workunit.client.0.smithi082.stdout:9/648: creat d9/d2d/d2b/d46/d76/dcb/fdc x:0 0 0 2024-04-27T07:33:29.280 INFO:tasks.workunit.client.1.smithi100.stdout:6/247: write de/d58/f22 [446300,12163] 0 2024-04-27T07:33:29.280 INFO:tasks.workunit.client.1.smithi100.stdout:3/236: creat d7/d9/d10/d33/d47/f4f x:0 0 0 2024-04-27T07:33:29.280 INFO:tasks.workunit.client.1.smithi100.stdout:6/248: stat de/d58/f37 0 2024-04-27T07:33:29.281 INFO:tasks.workunit.client.1.smithi100.stdout:3/237: chown d7/d9/d10/c37 8841 1 2024-04-27T07:33:29.283 INFO:tasks.workunit.client.1.smithi100.stdout:6/249: unlink de/d58/f20 0 2024-04-27T07:33:29.284 INFO:tasks.workunit.client.1.smithi100.stdout:6/250: fsync de/d58/f1b 0 2024-04-27T07:33:29.286 INFO:tasks.workunit.client.1.smithi100.stdout:3/238: dwrite d7/d9/d26/f32 [0,4194304] 0 2024-04-27T07:33:29.288 INFO:tasks.workunit.client.1.smithi100.stdout:6/251: dread de/f17 [0,4194304] 0 2024-04-27T07:33:29.290 INFO:tasks.workunit.client.1.smithi100.stdout:6/252: creat de/f5c x:0 0 0 2024-04-27T07:33:29.290 INFO:tasks.workunit.client.1.smithi100.stdout:6/253: write de/d58/f1a [1502317,48537] 0 2024-04-27T07:33:29.295 INFO:tasks.workunit.client.1.smithi100.stdout:6/254: dwrite de/d58/d21/d24/f46 [0,4194304] 0 2024-04-27T07:33:29.299 INFO:tasks.workunit.client.1.smithi100.stdout:2/239: sync 2024-04-27T07:33:29.300 INFO:tasks.workunit.client.1.smithi100.stdout:6/255: fdatasync de/d58/d28/f59 0 2024-04-27T07:33:29.302 INFO:tasks.workunit.client.1.smithi100.stdout:6/256: write de/d58/f37 [1259241,120553] 0 2024-04-27T07:33:29.303 INFO:tasks.workunit.client.1.smithi100.stdout:2/240: rmdir d0/da/d39 39 2024-04-27T07:33:29.304 INFO:tasks.workunit.client.1.smithi100.stdout:2/241: write d0/da/f28 [1276235,29574] 0 2024-04-27T07:33:29.308 INFO:tasks.workunit.client.1.smithi100.stdout:2/242: truncate d0/da/d29/d47/f4a 903700 0 2024-04-27T07:33:29.310 INFO:tasks.workunit.client.1.smithi100.stdout:2/243: write d0/f12 [5474739,36171] 0 2024-04-27T07:33:29.316 INFO:tasks.workunit.client.1.smithi100.stdout:2/244: rename d0/da/c41 to d0/da/d29/d26/c56 0 2024-04-27T07:33:29.317 INFO:tasks.workunit.client.1.smithi100.stdout:2/245: creat d0/d1e/f57 x:0 0 0 2024-04-27T07:33:29.319 INFO:tasks.workunit.client.1.smithi100.stdout:2/246: mknod d0/da/d29/d47/c58 0 2024-04-27T07:33:29.319 INFO:tasks.workunit.client.1.smithi100.stdout:2/247: write d0/da/d29/d26/f4b [3698001,25906] 0 2024-04-27T07:33:29.322 INFO:tasks.workunit.client.1.smithi100.stdout:2/248: creat d0/d1e/d51/f59 x:0 0 0 2024-04-27T07:33:29.323 INFO:tasks.workunit.client.1.smithi100.stdout:2/249: mkdir d0/da/d29/d47/d5a 0 2024-04-27T07:33:29.324 INFO:tasks.workunit.client.1.smithi100.stdout:2/250: write d0/da/d29/f3c [325158,40502] 0 2024-04-27T07:33:29.324 INFO:tasks.workunit.client.1.smithi100.stdout:2/251: fsync d0/d1e/f31 0 2024-04-27T07:33:29.325 INFO:tasks.workunit.client.1.smithi100.stdout:2/252: chown d0/da/l2e 2 1 2024-04-27T07:33:29.325 INFO:tasks.workunit.client.1.smithi100.stdout:2/253: dread - d0/d1e/f27 zero size 2024-04-27T07:33:29.329 INFO:tasks.workunit.client.1.smithi100.stdout:3/239: getdents d7/d9/d10/d33 0 2024-04-27T07:33:29.331 INFO:tasks.workunit.client.1.smithi100.stdout:3/240: dread d7/d9/d10/d28/d2c/f34 [0,4194304] 0 2024-04-27T07:33:29.332 INFO:tasks.workunit.client.1.smithi100.stdout:6/257: getdents de/d58 0 2024-04-27T07:33:29.334 INFO:tasks.workunit.client.0.smithi082.stdout:8/705: chown d0/d2b/d80/dca/de6/f1a 10 1 2024-04-27T07:33:29.335 INFO:tasks.workunit.client.0.smithi082.stdout:0/787: creat da/d38/f11e x:0 0 0 2024-04-27T07:33:29.336 INFO:tasks.workunit.client.0.smithi082.stdout:2/729: sync 2024-04-27T07:33:29.337 INFO:tasks.workunit.client.0.smithi082.stdout:4/833: dwrite d3/dab/ff0 [0,4194304] 0 2024-04-27T07:33:29.338 INFO:tasks.workunit.client.0.smithi082.stdout:1/687: symlink d4/d15/d49/dab/dc3/d4c/d7a/de7/lf0 0 2024-04-27T07:33:29.339 INFO:tasks.workunit.client.0.smithi082.stdout:4/834: chown d3/d6/d26/d55 355819526 1 2024-04-27T07:33:29.340 INFO:tasks.workunit.client.1.smithi100.stdout:3/241: dwrite d7/d9/d10/f15 [0,4194304] 0 2024-04-27T07:33:29.341 INFO:tasks.workunit.client.1.smithi100.stdout:6/258: dwrite de/d58/d21/f49 [0,4194304] 0 2024-04-27T07:33:29.341 INFO:tasks.workunit.client.0.smithi082.stdout:2/730: stat d7/d9/d4f/d66 0 2024-04-27T07:33:29.345 INFO:tasks.workunit.client.1.smithi100.stdout:3/242: symlink d7/d9/d10/d3e/l50 0 2024-04-27T07:33:29.345 INFO:tasks.workunit.client.1.smithi100.stdout:6/259: dread - de/d58/d21/d23/f39 zero size 2024-04-27T07:33:29.347 INFO:tasks.workunit.client.1.smithi100.stdout:6/260: write de/d58/d28/f47 [168614,41461] 0 2024-04-27T07:33:29.348 INFO:tasks.workunit.client.1.smithi100.stdout:6/261: chown de/d58/f1a 238531683 1 2024-04-27T07:33:29.349 INFO:tasks.workunit.client.0.smithi082.stdout:8/706: creat d0/d2b/d80/dca/de6/d1c/fea x:0 0 0 2024-04-27T07:33:29.349 INFO:tasks.workunit.client.1.smithi100.stdout:6/262: readlink de/d2e/l51 0 2024-04-27T07:33:29.349 INFO:tasks.workunit.client.1.smithi100.stdout:3/243: creat d7/d9/f51 x:0 0 0 2024-04-27T07:33:29.351 INFO:tasks.workunit.client.1.smithi100.stdout:6/263: mknod de/d58/d21/d23/c5d 0 2024-04-27T07:33:29.351 INFO:tasks.workunit.client.0.smithi082.stdout:8/707: write d0/d2b/d80/dca/de6/d1c/d76/da0/fb3 [363151,125856] 0 2024-04-27T07:33:29.352 INFO:tasks.workunit.client.0.smithi082.stdout:7/709: mknod d3/d49/d97/d6c/cf6 0 2024-04-27T07:33:29.354 INFO:tasks.workunit.client.1.smithi100.stdout:6/264: creat de/d58/d21/d23/f5e x:0 0 0 2024-04-27T07:33:29.357 INFO:tasks.workunit.client.1.smithi100.stdout:6/265: rename de/d2e/l51 to de/d58/d21/d5b/l5f 0 2024-04-27T07:33:29.358 INFO:tasks.workunit.client.0.smithi082.stdout:2/731: creat d7/d8/d99/ff0 x:0 0 0 2024-04-27T07:33:29.359 INFO:tasks.workunit.client.0.smithi082.stdout:9/649: mknod d9/da/dc/d35/d38/dd8/cdd 0 2024-04-27T07:33:29.362 INFO:tasks.workunit.client.1.smithi100.stdout:6/266: rename de/f56 to de/d2e/d3f/f60 0 2024-04-27T07:33:29.364 INFO:tasks.workunit.client.0.smithi082.stdout:8/708: creat d0/d2b/d9a/de5/feb x:0 0 0 2024-04-27T07:33:29.365 INFO:tasks.workunit.client.1.smithi100.stdout:3/244: truncate d7/d9/d26/f32 1874700 0 2024-04-27T07:33:29.366 INFO:tasks.workunit.client.0.smithi082.stdout:8/709: write d0/d2b/d80/dca/de6/d1c/f7d [200890,108380] 0 2024-04-27T07:33:29.367 INFO:tasks.workunit.client.0.smithi082.stdout:7/710: stat d3/d49/d97/d3a/d2a/f72 0 2024-04-27T07:33:29.368 INFO:tasks.workunit.client.0.smithi082.stdout:7/711: chown d3/d9/d4f/d61/dd0 5 1 2024-04-27T07:33:29.368 INFO:tasks.workunit.client.0.smithi082.stdout:4/835: symlink d3/d9/l11d 0 2024-04-27T07:33:29.369 INFO:tasks.workunit.client.1.smithi100.stdout:6/267: dwrite de/d58/d21/d24/f2b [0,4194304] 0 2024-04-27T07:33:29.369 INFO:tasks.workunit.client.1.smithi100.stdout:6/268: stat de/d58/c1c 0 2024-04-27T07:33:29.371 INFO:tasks.workunit.client.0.smithi082.stdout:2/732: unlink d7/d8/d13/f60 0 2024-04-27T07:33:29.373 INFO:tasks.workunit.client.0.smithi082.stdout:9/650: chown d9/da/dc/c29 104 1 2024-04-27T07:33:29.373 INFO:tasks.workunit.client.1.smithi100.stdout:3/245: getdents d7/d9 0 2024-04-27T07:33:29.376 INFO:tasks.workunit.client.0.smithi082.stdout:1/688: getdents d4/d15/d49/dab/dc3/d3e/d46/dcf 0 2024-04-27T07:33:29.376 INFO:tasks.workunit.client.0.smithi082.stdout:7/712: dwrite d3/d49/d97/d7d/f93 [0,4194304] 0 2024-04-27T07:33:29.378 INFO:tasks.workunit.client.1.smithi100.stdout:6/269: dread de/d58/d21/d24/f27 [0,4194304] 0 2024-04-27T07:33:29.379 INFO:tasks.workunit.client.0.smithi082.stdout:9/651: truncate d9/da/dc/d35/d38/d65/f82 780375 0 2024-04-27T07:33:29.379 INFO:tasks.workunit.client.1.smithi100.stdout:3/246: dread d7/d9/d10/f15 [0,4194304] 0 2024-04-27T07:33:29.381 INFO:tasks.workunit.client.1.smithi100.stdout:3/247: write d7/d9/d10/d28/d2c/f34 [215527,76891] 0 2024-04-27T07:33:29.382 INFO:tasks.workunit.client.1.smithi100.stdout:6/270: creat de/d58/d21/f61 x:0 0 0 2024-04-27T07:33:29.386 INFO:tasks.workunit.client.1.smithi100.stdout:6/271: creat de/d58/d21/d5b/f62 x:0 0 0 2024-04-27T07:33:29.387 INFO:tasks.workunit.client.0.smithi082.stdout:0/788: rename da/d28/d36/f4e to da/d38/d7f/d4a/d80/f11f 0 2024-04-27T07:33:29.389 INFO:tasks.workunit.client.1.smithi100.stdout:3/248: dwrite d7/d9/d10/d3e/f4a [0,4194304] 0 2024-04-27T07:33:29.391 INFO:tasks.workunit.client.1.smithi100.stdout:6/272: mknod de/d58/d21/c63 0 2024-04-27T07:33:29.393 INFO:tasks.workunit.client.0.smithi082.stdout:9/652: write d9/da/dc/d88/da8/fac [1183918,25235] 0 2024-04-27T07:33:29.393 INFO:tasks.workunit.client.1.smithi100.stdout:3/249: creat d7/d9/d10/d28/f52 x:0 0 0 2024-04-27T07:33:29.394 INFO:tasks.workunit.client.0.smithi082.stdout:2/733: mkdir d7/d8/d99/dc8/df1 0 2024-04-27T07:33:29.397 INFO:tasks.workunit.client.1.smithi100.stdout:3/250: unlink d7/d9/d10/d3e/f4a 0 2024-04-27T07:33:29.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/689: symlink d4/d15/d49/d99/de8/lf1 0 2024-04-27T07:33:29.402 INFO:tasks.workunit.client.0.smithi082.stdout:7/713: creat d3/d49/d97/d3a/d71/da0/ddf/ff7 x:0 0 0 2024-04-27T07:33:29.402 INFO:tasks.workunit.client.0.smithi082.stdout:1/690: truncate d4/d15/d49/dab/dc3/d3e/d57/da5/fbb 632388 0 2024-04-27T07:33:29.403 INFO:tasks.workunit.client.1.smithi100.stdout:3/251: truncate d7/d9/d26/f44 1829845 0 2024-04-27T07:33:29.404 INFO:tasks.workunit.client.1.smithi100.stdout:3/252: stat d7/d9/d10/d28/d2c/c3c 0 2024-04-27T07:33:29.404 INFO:tasks.workunit.client.0.smithi082.stdout:2/734: symlink d7/d9/d4f/d6e/d82/lf2 0 2024-04-27T07:33:29.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/735: stat d7/d14/f9a 0 2024-04-27T07:33:29.407 INFO:tasks.workunit.client.0.smithi082.stdout:0/789: mkdir da/d3c/d3f/d120 0 2024-04-27T07:33:29.408 INFO:tasks.workunit.client.0.smithi082.stdout:7/714: symlink d3/d49/d97/d3a/d2a/dac/dae/lf8 0 2024-04-27T07:33:29.409 INFO:tasks.workunit.client.1.smithi100.stdout:3/253: dread d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:29.409 INFO:tasks.workunit.client.0.smithi082.stdout:5/809: truncate d8/d3c/d47/f46 3675497 0 2024-04-27T07:33:29.410 INFO:tasks.workunit.client.0.smithi082.stdout:9/653: dwrite d9/da/dc/f20 [0,4194304] 0 2024-04-27T07:33:29.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/715: write d3/d49/d97/d3a/fad [597245,102240] 0 2024-04-27T07:33:29.411 INFO:tasks.workunit.client.1.smithi100.stdout:3/254: symlink d7/d9/d2f/l53 0 2024-04-27T07:33:29.412 INFO:tasks.workunit.client.0.smithi082.stdout:1/691: creat d4/d15/d49/d99/d9a/da9/ff2 x:0 0 0 2024-04-27T07:33:29.413 INFO:tasks.workunit.client.1.smithi100.stdout:3/255: symlink d7/d9/d10/d22/l54 0 2024-04-27T07:33:29.414 INFO:tasks.workunit.client.0.smithi082.stdout:1/692: write d4/d15/d49/d99/d9a/da9/ff2 [724110,28707] 0 2024-04-27T07:33:29.416 INFO:tasks.workunit.client.0.smithi082.stdout:4/836: rename d3/d6/d26/d55/d67/d9d to d3/d6/d26/d5e/d11e 0 2024-04-27T07:33:29.417 INFO:tasks.workunit.client.0.smithi082.stdout:2/736: mknod d7/d8/d99/cf3 0 2024-04-27T07:33:29.418 INFO:tasks.workunit.client.1.smithi100.stdout:3/256: getdents d7/d9/d10/d33/d47 0 2024-04-27T07:33:29.419 INFO:tasks.workunit.client.0.smithi082.stdout:0/790: mknod da/d3c/c121 0 2024-04-27T07:33:29.420 INFO:tasks.workunit.client.1.smithi100.stdout:3/257: mkdir d7/d9/d10/d3e/d55 0 2024-04-27T07:33:29.421 INFO:tasks.workunit.client.1.smithi100.stdout:3/258: chown d7/d9/d10/d22/l40 2 1 2024-04-27T07:33:29.421 INFO:tasks.workunit.client.1.smithi100.stdout:3/259: stat d7/d9/fc 0 2024-04-27T07:33:29.422 INFO:tasks.workunit.client.0.smithi082.stdout:9/654: mknod d9/d2d/d2b/d46/d5d/cde 0 2024-04-27T07:33:29.422 INFO:tasks.workunit.client.1.smithi100.stdout:3/260: readlink d7/d9/d10/d33/l36 0 2024-04-27T07:33:29.424 INFO:tasks.workunit.client.1.smithi100.stdout:3/261: symlink d7/d9/d10/d3e/d55/l56 0 2024-04-27T07:33:29.425 INFO:tasks.workunit.client.0.smithi082.stdout:2/737: mknod d7/d9/d4f/d66/dae/cf4 0 2024-04-27T07:33:29.425 INFO:tasks.workunit.client.1.smithi100.stdout:3/262: creat d7/d9/d10/d28/d2c/f57 x:0 0 0 2024-04-27T07:33:29.426 INFO:tasks.workunit.client.0.smithi082.stdout:0/791: fsync da/d3c/d3f/f5b 0 2024-04-27T07:33:29.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/655: unlink d9/da/dc/d35/d38/dd8/fda 0 2024-04-27T07:33:29.431 INFO:tasks.workunit.client.1.smithi100.stdout:3/263: dwrite d7/d9/d26/d2a/f20 [0,4194304] 0 2024-04-27T07:33:29.432 INFO:tasks.workunit.client.0.smithi082.stdout:4/837: truncate d3/fb2 4185403 0 2024-04-27T07:33:29.434 INFO:tasks.workunit.client.1.smithi100.stdout:3/264: write d7/d9/fc [315617,120862] 0 2024-04-27T07:33:29.438 INFO:tasks.workunit.client.0.smithi082.stdout:9/656: dwrite d9/da/dc/d73/f95 [4194304,4194304] 0 2024-04-27T07:33:29.438 INFO:tasks.workunit.client.1.smithi100.stdout:3/265: rename c1 to d7/d9/d26/c58 0 2024-04-27T07:33:29.441 INFO:tasks.workunit.client.0.smithi082.stdout:0/792: rename da/d38/d7f/d4a/f103 to da/d28/d109/f122 0 2024-04-27T07:33:29.441 INFO:tasks.workunit.client.1.smithi100.stdout:3/266: creat d7/d9/d26/f59 x:0 0 0 2024-04-27T07:33:29.442 INFO:tasks.workunit.client.0.smithi082.stdout:8/710: dwrite d0/d2b/d6f/f70 [0,4194304] 0 2024-04-27T07:33:29.443 INFO:tasks.workunit.client.0.smithi082.stdout:7/716: dread d3/d49/d97/d7d/da1/fbd [0,4194304] 0 2024-04-27T07:33:29.444 INFO:tasks.workunit.client.0.smithi082.stdout:8/711: dread - d0/d2b/d9a/da4/fe4 zero size 2024-04-27T07:33:29.444 INFO:tasks.workunit.client.0.smithi082.stdout:2/738: mknod d7/d30/d61/cf5 0 2024-04-27T07:33:29.449 INFO:tasks.workunit.client.0.smithi082.stdout:5/810: getdents d8/d14 0 2024-04-27T07:33:29.455 INFO:tasks.workunit.client.0.smithi082.stdout:7/717: creat d3/db1/ff9 x:0 0 0 2024-04-27T07:33:29.456 INFO:tasks.workunit.client.0.smithi082.stdout:8/712: mkdir d0/d2b/d80/dca/dec 0 2024-04-27T07:33:29.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/693: truncate d4/d15/d49/dab/dc3/d4c/d7a/fae 2253790 0 2024-04-27T07:33:29.471 INFO:tasks.workunit.client.0.smithi082.stdout:1/694: mknod d4/d15/d49/dab/dc3/d4c/d7a/de7/cf3 0 2024-04-27T07:33:29.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/718: link d3/d49/d97/d3a/d2a/f3f d3/d49/d97/d3a/d2a/dac/dae/dce/de4/ffa 0 2024-04-27T07:33:29.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/719: dread - d3/d9/d4f/d9a/fe7 zero size 2024-04-27T07:33:29.476 INFO:tasks.workunit.client.0.smithi082.stdout:1/695: mknod d4/d15/d49/dab/dc3/d3e/cf4 0 2024-04-27T07:33:29.478 INFO:tasks.workunit.client.0.smithi082.stdout:7/720: truncate d3/d49/d97/d3a/d71/f7a 2660374 0 2024-04-27T07:33:29.480 INFO:tasks.workunit.client.0.smithi082.stdout:7/721: write d3/d49/d97/d7d/f93 [2248605,42834] 0 2024-04-27T07:33:29.481 INFO:tasks.workunit.client.0.smithi082.stdout:9/657: dwrite d9/da/f67 [0,4194304] 0 2024-04-27T07:33:29.486 INFO:tasks.workunit.client.0.smithi082.stdout:1/696: rename d4/d15/d49/d99/d9a/dc7/ld2 to d4/d15/d49/dab/dc3/d3e/d57/lf5 0 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.1.smithi100.stdout:4/287: sync 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.1.smithi100.stdout:9/216: sync 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.1.smithi100.stdout:1/347: sync 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.1.smithi100.stdout:0/228: sync 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.1.smithi100.stdout:5/211: sync 2024-04-27T07:33:29.491 INFO:tasks.workunit.client.0.smithi082.stdout:7/722: rename d3/d49/d97/d7d to d3/dfb 0 2024-04-27T07:33:29.493 INFO:tasks.workunit.client.0.smithi082.stdout:1/697: link d4/d15/f18 d4/d15/d3f/d6d/db7/ff6 0 2024-04-27T07:33:29.494 INFO:tasks.workunit.client.1.smithi100.stdout:5/212: truncate d0/d4/f36 196209 0 2024-04-27T07:33:29.495 INFO:tasks.workunit.client.1.smithi100.stdout:9/217: mkdir d1/d9/db/d2b/d4f 0 2024-04-27T07:33:29.495 INFO:tasks.workunit.client.1.smithi100.stdout:5/213: readlink d0/d4/d21/l27 0 2024-04-27T07:33:29.496 INFO:tasks.workunit.client.1.smithi100.stdout:9/218: chown d1/f26 1847375 1 2024-04-27T07:33:29.496 INFO:tasks.workunit.client.1.smithi100.stdout:0/229: mknod d1/d38/d3a/c56 0 2024-04-27T07:33:29.496 INFO:tasks.workunit.client.0.smithi082.stdout:9/658: dread f4 [0,4194304] 0 2024-04-27T07:33:29.497 INFO:tasks.workunit.client.0.smithi082.stdout:7/723: rename d3/db/f18 to d3/d49/d97/d3a/d2a/dac/da9/ffc 0 2024-04-27T07:33:29.501 INFO:tasks.workunit.client.1.smithi100.stdout:9/219: creat d1/d9/db/d2b/d31/f50 x:0 0 0 2024-04-27T07:33:29.502 INFO:tasks.workunit.client.1.smithi100.stdout:9/220: write d1/f29 [626657,72897] 0 2024-04-27T07:33:29.503 INFO:tasks.workunit.client.1.smithi100.stdout:4/288: link d5/d16/d19/d21/f41 d5/d1b/f5f 0 2024-04-27T07:33:29.503 INFO:tasks.workunit.client.0.smithi082.stdout:5/811: truncate d8/d15/f24 1853597 0 2024-04-27T07:33:29.503 INFO:tasks.workunit.client.0.smithi082.stdout:4/838: dread d3/d6/d26/f35 [0,4194304] 0 2024-04-27T07:33:29.504 INFO:tasks.workunit.client.1.smithi100.stdout:5/214: dwrite d0/d4/d28/d37/f1c [0,4194304] 0 2024-04-27T07:33:29.504 INFO:tasks.workunit.client.1.smithi100.stdout:1/348: link d0/d1f/l42 d0/d1b/l6b 0 2024-04-27T07:33:29.505 INFO:tasks.workunit.client.1.smithi100.stdout:0/230: dread - d1/d8/d20/f4b zero size 2024-04-27T07:33:29.505 INFO:tasks.workunit.client.1.smithi100.stdout:5/215: chown d0/d4/d21/f2e 957153 1 2024-04-27T07:33:29.505 INFO:tasks.workunit.client.1.smithi100.stdout:9/221: chown d1/d9/l38 16449968 1 2024-04-27T07:33:29.507 INFO:tasks.workunit.client.1.smithi100.stdout:5/216: chown d0/f10 44869414 1 2024-04-27T07:33:29.508 INFO:tasks.workunit.client.1.smithi100.stdout:0/231: fdatasync d1/d8/d20/f3b 0 2024-04-27T07:33:29.509 INFO:tasks.workunit.client.1.smithi100.stdout:4/289: symlink d5/d16/d19/d46/d53/l60 0 2024-04-27T07:33:29.510 INFO:tasks.workunit.client.0.smithi082.stdout:7/724: rename d3/d49/d97/d3a/d2a/dac/dae/lf8 to d3/d49/d97/d6c/ddc/lfd 0 2024-04-27T07:33:29.510 INFO:tasks.workunit.client.1.smithi100.stdout:9/222: dread d1/d9/f42 [4194304,4194304] 0 2024-04-27T07:33:29.510 INFO:tasks.workunit.client.1.smithi100.stdout:4/290: chown d5/d23/f3c 1 1 2024-04-27T07:33:29.512 INFO:tasks.workunit.client.1.smithi100.stdout:0/232: dread - d1/f39 zero size 2024-04-27T07:33:29.514 INFO:tasks.workunit.client.0.smithi082.stdout:5/812: symlink d8/d29/d4e/l114 0 2024-04-27T07:33:29.515 INFO:tasks.workunit.client.1.smithi100.stdout:9/223: creat d1/d9/db/f51 x:0 0 0 2024-04-27T07:33:29.516 INFO:tasks.workunit.client.0.smithi082.stdout:0/793: dwrite da/d28/d36/f65 [0,4194304] 0 2024-04-27T07:33:29.517 INFO:tasks.workunit.client.0.smithi082.stdout:4/839: write d3/d6/d26/d5e/d11e/d101/d69/d85/ff6 [2337933,53887] 0 2024-04-27T07:33:29.518 INFO:tasks.workunit.client.1.smithi100.stdout:4/291: dwrite d5/f6 [0,4194304] 0 2024-04-27T07:33:29.518 INFO:tasks.workunit.client.1.smithi100.stdout:5/217: link d0/d4/d28/d37/d1a/d34/f38 d0/d4/d21/d24/f47 0 2024-04-27T07:33:29.521 INFO:tasks.workunit.client.0.smithi082.stdout:8/713: dwrite d0/f99 [0,4194304] 0 2024-04-27T07:33:29.522 INFO:tasks.workunit.client.1.smithi100.stdout:0/233: mknod d1/d8/d20/c57 0 2024-04-27T07:33:29.523 INFO:tasks.workunit.client.1.smithi100.stdout:1/349: dread d0/f19 [0,4194304] 0 2024-04-27T07:33:29.524 INFO:tasks.workunit.client.0.smithi082.stdout:2/739: dwrite d7/d30/d61/f71 [4194304,4194304] 0 2024-04-27T07:33:29.524 INFO:tasks.workunit.client.1.smithi100.stdout:9/224: unlink d1/f2c 0 2024-04-27T07:33:29.526 INFO:tasks.workunit.client.1.smithi100.stdout:0/234: truncate d1/d8/d20/f4b 132505 0 2024-04-27T07:33:29.526 INFO:tasks.workunit.client.1.smithi100.stdout:9/225: chown d1/d9/db/d2b/d31/f50 94530 1 2024-04-27T07:33:29.528 INFO:tasks.workunit.client.1.smithi100.stdout:0/235: chown d1/d30/f3d 0 1 2024-04-27T07:33:29.528 INFO:tasks.workunit.client.0.smithi082.stdout:0/794: creat da/d3c/d3f/dbb/f123 x:0 0 0 2024-04-27T07:33:29.528 INFO:tasks.workunit.client.1.smithi100.stdout:5/218: mkdir d0/d4/d28/d37/d48 0 2024-04-27T07:33:29.529 INFO:tasks.workunit.client.1.smithi100.stdout:0/236: write d1/d30/f3d [472747,94720] 0 2024-04-27T07:33:29.530 INFO:tasks.workunit.client.1.smithi100.stdout:1/350: mkdir d0/d1f/d27/d6c 0 2024-04-27T07:33:29.532 INFO:tasks.workunit.client.1.smithi100.stdout:9/226: mkdir d1/d9/d1f/d52 0 2024-04-27T07:33:29.533 INFO:tasks.workunit.client.1.smithi100.stdout:1/351: dread d0/d1f/d27/f28 [0,4194304] 0 2024-04-27T07:33:29.535 INFO:tasks.workunit.client.1.smithi100.stdout:1/352: fdatasync d0/d1b/d20/d2d/f2e 0 2024-04-27T07:33:29.537 INFO:tasks.workunit.client.1.smithi100.stdout:1/353: dread - d0/d1b/d20/d2d/d35/d4d/d60/f64 zero size 2024-04-27T07:33:29.538 INFO:tasks.workunit.client.1.smithi100.stdout:5/219: fsync d0/f9 0 2024-04-27T07:33:29.545 INFO:tasks.workunit.client.1.smithi100.stdout:5/220: rename d0/d4/d28/d37/d1a/d34/l45 to d0/d4/d21/d24/d2f/d39/l49 0 2024-04-27T07:33:29.546 INFO:tasks.workunit.client.1.smithi100.stdout:4/292: dread d5/d16/d19/f30 [0,4194304] 0 2024-04-27T07:33:29.546 INFO:tasks.workunit.client.1.smithi100.stdout:1/354: dwrite d0/d1f/d27/d40/d61/f66 [0,4194304] 0 2024-04-27T07:33:29.548 INFO:tasks.workunit.client.0.smithi082.stdout:9/659: dread d9/f51 [0,4194304] 0 2024-04-27T07:33:29.549 INFO:tasks.workunit.client.1.smithi100.stdout:1/355: mkdir d0/d1f/d6d 0 2024-04-27T07:33:29.551 INFO:tasks.workunit.client.0.smithi082.stdout:8/714: truncate d0/d2b/d80/dca/de6/d1b/fcd 222350 0 2024-04-27T07:33:29.552 INFO:tasks.workunit.client.1.smithi100.stdout:4/293: symlink d5/d1b/d2c/d3f/l61 0 2024-04-27T07:33:29.553 INFO:tasks.workunit.client.0.smithi082.stdout:5/813: dread d8/d2e/fb0 [0,4194304] 0 2024-04-27T07:33:29.554 INFO:tasks.workunit.client.1.smithi100.stdout:5/221: getdents d0/d4/d21/d24/d46 0 2024-04-27T07:33:29.554 INFO:tasks.workunit.client.0.smithi082.stdout:2/740: fsync d7/d30/d23/fcf 0 2024-04-27T07:33:29.554 INFO:tasks.workunit.client.1.smithi100.stdout:1/356: symlink d0/d1f/d27/d6c/l6e 0 2024-04-27T07:33:29.557 INFO:tasks.workunit.client.1.smithi100.stdout:5/222: symlink d0/d4/d21/d24/d2f/l4a 0 2024-04-27T07:33:29.559 INFO:tasks.workunit.client.1.smithi100.stdout:1/357: mknod d0/d1b/d20/d2d/d35/d4d/d60/c6f 0 2024-04-27T07:33:29.560 INFO:tasks.workunit.client.1.smithi100.stdout:5/223: creat d0/d4/d21/f4b x:0 0 0 2024-04-27T07:33:29.562 INFO:tasks.workunit.client.1.smithi100.stdout:1/358: creat d0/d1f/d27/d40/f70 x:0 0 0 2024-04-27T07:33:29.563 INFO:tasks.workunit.client.1.smithi100.stdout:5/224: symlink d0/d4/d28/d37/d1a/d34/l4c 0 2024-04-27T07:33:29.564 INFO:tasks.workunit.client.1.smithi100.stdout:1/359: rmdir d0/d1f/d27/d6c 39 2024-04-27T07:33:29.571 INFO:tasks.workunit.client.1.smithi100.stdout:1/360: dwrite d0/f18 [0,4194304] 0 2024-04-27T07:33:29.574 INFO:tasks.workunit.client.1.smithi100.stdout:0/237: dwrite d1/d30/f33 [0,4194304] 0 2024-04-27T07:33:29.575 INFO:tasks.workunit.client.1.smithi100.stdout:1/361: write d0/d23/f2c [5168816,21529] 0 2024-04-27T07:33:29.579 INFO:tasks.workunit.client.1.smithi100.stdout:0/238: symlink d1/d38/d3a/d54/l58 0 2024-04-27T07:33:29.579 INFO:tasks.workunit.client.1.smithi100.stdout:9/227: dwrite d1/d9/d1f/f3c [0,4194304] 0 2024-04-27T07:33:29.580 INFO:tasks.workunit.client.1.smithi100.stdout:1/362: mknod d0/d1f/d6d/c71 0 2024-04-27T07:33:29.588 INFO:tasks.workunit.client.1.smithi100.stdout:9/228: symlink d1/d9/d1f/d52/l53 0 2024-04-27T07:33:29.592 INFO:tasks.workunit.client.1.smithi100.stdout:4/294: dread d5/d16/d19/d21/d2b/f51 [0,4194304] 0 2024-04-27T07:33:29.593 INFO:tasks.workunit.client.1.smithi100.stdout:9/229: mkdir d1/d9/d1f/d52/d54 0 2024-04-27T07:33:29.593 INFO:tasks.workunit.client.1.smithi100.stdout:0/239: dwrite d1/f39 [0,4194304] 0 2024-04-27T07:33:29.596 INFO:tasks.workunit.client.1.smithi100.stdout:0/240: write d1/d38/f47 [5187399,68976] 0 2024-04-27T07:33:29.598 INFO:tasks.workunit.client.1.smithi100.stdout:9/230: write d1/d9/d1f/f3c [4172531,22835] 0 2024-04-27T07:33:29.602 INFO:tasks.workunit.client.0.smithi082.stdout:0/795: creat da/d1d/d6a/dd0/f124 x:0 0 0 2024-04-27T07:33:29.602 INFO:tasks.workunit.client.0.smithi082.stdout:9/660: truncate d9/d2d/d72/f9c 513592 0 2024-04-27T07:33:29.604 INFO:tasks.workunit.client.1.smithi100.stdout:9/231: creat d1/d9/d1f/d4a/f55 x:0 0 0 2024-04-27T07:33:29.604 INFO:tasks.workunit.client.0.smithi082.stdout:9/661: readlink d9/l1d 0 2024-04-27T07:33:29.605 INFO:tasks.workunit.client.0.smithi082.stdout:8/715: chown d0/d2b/d80/dca/de6/lbe 3 1 2024-04-27T07:33:29.605 INFO:tasks.workunit.client.0.smithi082.stdout:4/840: dwrite d3/d6/d26/d5e/d11e/d101/d69/d85/db8/fe1 [0,4194304] 0 2024-04-27T07:33:29.606 INFO:tasks.workunit.client.0.smithi082.stdout:2/741: dread - d7/d9/d4f/d6e/fca zero size 2024-04-27T07:33:29.608 INFO:tasks.workunit.client.1.smithi100.stdout:0/241: dwrite d1/d8/d20/d1e/f21 [0,4194304] 0 2024-04-27T07:33:29.609 INFO:tasks.workunit.client.0.smithi082.stdout:5/814: dread d8/d15/d65/f9b [0,4194304] 0 2024-04-27T07:33:29.609 INFO:tasks.workunit.client.0.smithi082.stdout:2/742: fdatasync d7/d30/d23/fe5 0 2024-04-27T07:33:29.609 INFO:tasks.workunit.client.0.smithi082.stdout:4/841: stat d3/d10/d9c/ca2 0 2024-04-27T07:33:29.610 INFO:tasks.workunit.client.1.smithi100.stdout:1/363: dread d0/f14 [0,4194304] 0 2024-04-27T07:33:29.611 INFO:tasks.workunit.client.0.smithi082.stdout:8/716: write d0/d2b/d6f/fd4 [4025120,26995] 0 2024-04-27T07:33:29.612 INFO:tasks.workunit.client.0.smithi082.stdout:7/725: dwrite d3/d49/d97/f1b [0,4194304] 0 2024-04-27T07:33:29.612 INFO:tasks.workunit.client.1.smithi100.stdout:1/364: fsync d0/f19 0 2024-04-27T07:33:29.614 INFO:tasks.workunit.client.1.smithi100.stdout:9/232: dwrite d1/d9/f21 [4194304,4194304] 0 2024-04-27T07:33:29.615 INFO:tasks.workunit.client.0.smithi082.stdout:2/743: chown d7/d8/d13/l8d 142445 1 2024-04-27T07:33:29.616 INFO:tasks.workunit.client.1.smithi100.stdout:0/242: unlink d1/f24 0 2024-04-27T07:33:29.617 INFO:tasks.workunit.client.0.smithi082.stdout:5/815: mkdir d8/d29/d4e/d115 0 2024-04-27T07:33:29.617 INFO:tasks.workunit.client.1.smithi100.stdout:1/365: dread - d0/d1b/d20/f51 zero size 2024-04-27T07:33:29.619 INFO:tasks.workunit.client.0.smithi082.stdout:0/796: dwrite da/d3c/d3f/f41 [0,4194304] 0 2024-04-27T07:33:29.619 INFO:tasks.workunit.client.0.smithi082.stdout:7/726: mknod d3/d9/d4f/d9a/cfe 0 2024-04-27T07:33:29.622 INFO:tasks.workunit.client.0.smithi082.stdout:2/744: mkdir d7/d9/df6 0 2024-04-27T07:33:29.623 INFO:tasks.workunit.client.0.smithi082.stdout:4/842: chown d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98/de4/ffa 29635378 1 2024-04-27T07:33:29.624 INFO:tasks.workunit.client.1.smithi100.stdout:0/243: mkdir d1/d8/d14/d59 0 2024-04-27T07:33:29.625 INFO:tasks.workunit.client.1.smithi100.stdout:1/366: creat d0/d1b/d20/d2d/d35/f72 x:0 0 0 2024-04-27T07:33:29.626 INFO:tasks.workunit.client.0.smithi082.stdout:0/797: symlink da/d38/da9/ddd/l125 0 2024-04-27T07:33:29.628 INFO:tasks.workunit.client.0.smithi082.stdout:7/727: dread - d3/d49/d97/d3a/d2a/f88 zero size 2024-04-27T07:33:29.629 INFO:tasks.workunit.client.1.smithi100.stdout:1/367: readlink d0/d1f/d27/d6c/l6e 0 2024-04-27T07:33:29.632 INFO:tasks.workunit.client.1.smithi100.stdout:1/368: mknod d0/d1f/d27/d6c/c73 0 2024-04-27T07:33:29.633 INFO:tasks.workunit.client.0.smithi082.stdout:8/717: dwrite d0/d2b/d9a/da4/d35/fbd [0,4194304] 0 2024-04-27T07:33:29.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/728: fsync d3/db/f46 0 2024-04-27T07:33:29.634 INFO:tasks.workunit.client.1.smithi100.stdout:0/244: dwrite d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:29.635 INFO:tasks.workunit.client.0.smithi082.stdout:0/798: unlink da/d38/da9/ddd/f118 0 2024-04-27T07:33:29.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/816: dwrite d8/d42/f106 [0,4194304] 0 2024-04-27T07:33:29.637 INFO:tasks.workunit.client.0.smithi082.stdout:2/745: read d7/f56 [2921657,97923] 0 2024-04-27T07:33:29.637 INFO:tasks.workunit.client.1.smithi100.stdout:1/369: unlink d0/d23/f2c 0 2024-04-27T07:33:29.638 INFO:tasks.workunit.client.1.smithi100.stdout:1/370: truncate d0/d1b/d20/f51 899238 0 2024-04-27T07:33:29.639 INFO:tasks.workunit.client.1.smithi100.stdout:1/371: chown d0/d1b/d20 2297 1 2024-04-27T07:33:29.642 INFO:tasks.workunit.client.1.smithi100.stdout:1/372: creat d0/d1f/d27/d40/d61/f74 x:0 0 0 2024-04-27T07:33:29.643 INFO:tasks.workunit.client.1.smithi100.stdout:4/295: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:29.648 INFO:tasks.workunit.client.1.smithi100.stdout:0/245: creat d1/d8/d20/f5a x:0 0 0 2024-04-27T07:33:29.648 INFO:tasks.workunit.client.1.smithi100.stdout:4/296: mknod d5/c62 0 2024-04-27T07:33:29.649 INFO:tasks.workunit.client.1.smithi100.stdout:0/246: chown d1/d30/f33 1 1 2024-04-27T07:33:29.650 INFO:tasks.workunit.client.0.smithi082.stdout:8/718: readlink d0/d2b/d80/dca/de6/d87/d46/l8e 0 2024-04-27T07:33:29.654 INFO:tasks.workunit.client.1.smithi100.stdout:1/373: dwrite d0/d1b/d20/f51 [0,4194304] 0 2024-04-27T07:33:29.655 INFO:tasks.workunit.client.1.smithi100.stdout:0/247: creat d1/d8/d14/d59/f5b x:0 0 0 2024-04-27T07:33:29.659 INFO:tasks.workunit.client.1.smithi100.stdout:1/374: unlink d0/d1b/f46 0 2024-04-27T07:33:29.660 INFO:tasks.workunit.client.1.smithi100.stdout:4/297: getdents d5/d16/d19/d46/d53 0 2024-04-27T07:33:29.660 INFO:tasks.workunit.client.0.smithi082.stdout:4/843: dwrite d3/d6/d26/d5e/d11e/d101/d69/fd0 [0,4194304] 0 2024-04-27T07:33:29.661 INFO:tasks.workunit.client.0.smithi082.stdout:9/662: dread d9/da/dc/d33/f37 [0,4194304] 0 2024-04-27T07:33:29.662 INFO:tasks.workunit.client.1.smithi100.stdout:4/298: write d5/d23/f25 [1558603,47161] 0 2024-04-27T07:33:29.663 INFO:tasks.workunit.client.0.smithi082.stdout:2/746: dwrite d7/d8/d13/fdb [0,4194304] 0 2024-04-27T07:33:29.664 INFO:tasks.workunit.client.1.smithi100.stdout:4/299: creat d5/d1b/d2c/d3f/f63 x:0 0 0 2024-04-27T07:33:29.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/844: write d3/d6/d26/d55/ffc [3875778,50611] 0 2024-04-27T07:33:29.666 INFO:tasks.workunit.client.0.smithi082.stdout:8/719: dread d0/d2b/d80/dca/de6/d87/f3e [4194304,4194304] 0 2024-04-27T07:33:29.667 INFO:tasks.workunit.client.1.smithi100.stdout:4/300: write d5/d23/f42 [639907,116022] 0 2024-04-27T07:33:29.667 INFO:tasks.workunit.client.1.smithi100.stdout:8/201: sync 2024-04-27T07:33:29.667 INFO:tasks.workunit.client.1.smithi100.stdout:0/248: dwrite d1/d38/f40 [0,4194304] 0 2024-04-27T07:33:29.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/845: write d3/d6/d26/d5e/fea [857996,36139] 0 2024-04-27T07:33:29.669 INFO:tasks.workunit.client.0.smithi082.stdout:7/729: dread d3/db/ff [0,4194304] 0 2024-04-27T07:33:29.674 INFO:tasks.workunit.client.0.smithi082.stdout:5/817: symlink d8/d29/dea/da3/l116 0 2024-04-27T07:33:29.675 INFO:tasks.workunit.client.0.smithi082.stdout:5/818: dread - d8/d2e/d85/fd6 zero size 2024-04-27T07:33:29.679 INFO:tasks.workunit.client.0.smithi082.stdout:2/747: dread - d7/d9/d4f/d66/f8e zero size 2024-04-27T07:33:29.680 INFO:tasks.workunit.client.1.smithi100.stdout:8/202: dwrite d6/fb [0,4194304] 0 2024-04-27T07:33:29.681 INFO:tasks.workunit.client.1.smithi100.stdout:0/249: dwrite d1/d8/d14/f41 [0,4194304] 0 2024-04-27T07:33:29.681 INFO:tasks.workunit.client.0.smithi082.stdout:4/846: rmdir d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98 39 2024-04-27T07:33:29.685 INFO:tasks.workunit.client.0.smithi082.stdout:0/799: symlink da/d3c/d3f/d57/dcc/l126 0 2024-04-27T07:33:29.689 INFO:tasks.workunit.client.0.smithi082.stdout:9/663: dwrite d9/da/dc/d35/d4b/f5f [0,4194304] 0 2024-04-27T07:33:29.692 INFO:tasks.workunit.client.0.smithi082.stdout:4/847: unlink d3/d6/d26/d5e/d11e/d101/d69/ca4 0 2024-04-27T07:33:29.692 INFO:tasks.workunit.client.1.smithi100.stdout:0/250: creat d1/d30/f5c x:0 0 0 2024-04-27T07:33:29.693 INFO:tasks.workunit.client.0.smithi082.stdout:0/800: write da/d3c/fd8 [734725,36856] 0 2024-04-27T07:33:29.694 INFO:tasks.workunit.client.1.smithi100.stdout:0/251: truncate d1/d30/f5c 470892 0 2024-04-27T07:33:29.694 INFO:tasks.workunit.client.0.smithi082.stdout:2/748: truncate d7/d9/d4f/d66/dae/f8c 1052733 0 2024-04-27T07:33:29.695 INFO:tasks.workunit.client.1.smithi100.stdout:8/203: rename d6/d20/f29 to d6/f41 0 2024-04-27T07:33:29.696 INFO:tasks.workunit.client.0.smithi082.stdout:7/730: dwrite d3/d9/d7c/f8f [0,4194304] 0 2024-04-27T07:33:29.697 INFO:tasks.workunit.client.1.smithi100.stdout:0/252: rmdir d1/d38/d3a/d54 39 2024-04-27T07:33:29.698 INFO:tasks.workunit.client.0.smithi082.stdout:4/848: dread - d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/fcb zero size 2024-04-27T07:33:29.699 INFO:tasks.workunit.client.1.smithi100.stdout:0/253: write d1/f10 [4175664,106162] 0 2024-04-27T07:33:29.701 INFO:tasks.workunit.client.1.smithi100.stdout:0/254: dread - d1/d8/d20/f2b zero size 2024-04-27T07:33:29.702 INFO:tasks.workunit.client.1.smithi100.stdout:0/255: chown d1/d38/l3e 5373 1 2024-04-27T07:33:29.702 INFO:tasks.workunit.client.1.smithi100.stdout:8/204: truncate d6/f10 2719132 0 2024-04-27T07:33:29.702 INFO:tasks.workunit.client.0.smithi082.stdout:0/801: unlink da/d3c/d3f/d4c/d95/de9/def/d81/cc6 0 2024-04-27T07:33:29.703 INFO:tasks.workunit.client.1.smithi100.stdout:0/256: fsync d1/d8/d20/f28 0 2024-04-27T07:33:29.703 INFO:tasks.workunit.client.0.smithi082.stdout:9/664: getdents d9/da/dc/d33 0 2024-04-27T07:33:29.705 INFO:tasks.workunit.client.0.smithi082.stdout:7/731: symlink d3/d49/d97/lff 0 2024-04-27T07:33:29.706 INFO:tasks.workunit.client.1.smithi100.stdout:0/257: readlink d1/d8/d20/d1e/l34 0 2024-04-27T07:33:29.706 INFO:tasks.workunit.client.0.smithi082.stdout:4/849: link d3/d6/d26/d5e/f97 d3/d6/d26/d5e/d11e/d101/d69/df5/f11f 0 2024-04-27T07:33:29.707 INFO:tasks.workunit.client.1.smithi100.stdout:0/258: chown d1/d38/f4a 0 1 2024-04-27T07:33:29.708 INFO:tasks.workunit.client.0.smithi082.stdout:9/665: creat d9/d48/fdf x:0 0 0 2024-04-27T07:33:29.708 INFO:tasks.workunit.client.1.smithi100.stdout:1/375: dread d0/d1b/f2f [0,4194304] 0 2024-04-27T07:33:29.709 INFO:tasks.workunit.client.0.smithi082.stdout:9/666: chown d9/da/d85/cd3 1857004 1 2024-04-27T07:33:29.709 INFO:tasks.workunit.client.0.smithi082.stdout:0/802: mknod da/d1d/d6a/c127 0 2024-04-27T07:33:29.709 INFO:tasks.workunit.client.1.smithi100.stdout:0/259: dread - d1/d8/d14/d59/f5b zero size 2024-04-27T07:33:29.710 INFO:tasks.workunit.client.0.smithi082.stdout:9/667: write d9/d2d/d2b/d46/d76/dcb/fdc [93697,85309] 0 2024-04-27T07:33:29.710 INFO:tasks.workunit.client.0.smithi082.stdout:7/732: creat d3/d49/d97/d3a/d2a/dac/f100 x:0 0 0 2024-04-27T07:33:29.711 INFO:tasks.workunit.client.0.smithi082.stdout:0/803: read - da/d3c/d3f/d4c/d95/de9/def/f115 zero size 2024-04-27T07:33:29.711 INFO:tasks.workunit.client.1.smithi100.stdout:1/376: unlink d0/d23/d3a/f56 0 2024-04-27T07:33:29.711 INFO:tasks.workunit.client.0.smithi082.stdout:4/850: dread - d3/d9/fb9 zero size 2024-04-27T07:33:29.713 INFO:tasks.workunit.client.0.smithi082.stdout:4/851: write d3/fba [986199,4350] 0 2024-04-27T07:33:29.714 INFO:tasks.workunit.client.0.smithi082.stdout:9/668: creat d9/da/dc/d35/d38/da5/fe0 x:0 0 0 2024-04-27T07:33:29.714 INFO:tasks.workunit.client.1.smithi100.stdout:1/377: truncate d0/d1b/d20/f57 1031639 0 2024-04-27T07:33:29.715 INFO:tasks.workunit.client.1.smithi100.stdout:0/260: symlink d1/d8/l5d 0 2024-04-27T07:33:29.716 INFO:tasks.workunit.client.0.smithi082.stdout:0/804: fsync da/d38/d7f/d4a/d80/dcb/fe1 0 2024-04-27T07:33:29.716 INFO:tasks.workunit.client.0.smithi082.stdout:4/852: read d3/d6/d26/d5e/d11e/d101/f59 [189948,94729] 0 2024-04-27T07:33:29.717 INFO:tasks.workunit.client.1.smithi100.stdout:4/301: write d5/d1b/f5f [188104,64173] 0 2024-04-27T07:33:29.718 INFO:tasks.workunit.client.1.smithi100.stdout:0/261: write d1/d30/f4e [1194965,121687] 0 2024-04-27T07:33:29.719 INFO:tasks.workunit.client.0.smithi082.stdout:4/853: write d3/d6/d26/d5e/d11e/d101/f9a [30148,113595] 0 2024-04-27T07:33:29.720 INFO:tasks.workunit.client.0.smithi082.stdout:4/854: chown d3/d6/d26/d5e/ld1 0 1 2024-04-27T07:33:29.720 INFO:tasks.workunit.client.1.smithi100.stdout:4/302: creat d5/d1b/d2c/f64 x:0 0 0 2024-04-27T07:33:29.721 INFO:tasks.workunit.client.0.smithi082.stdout:0/805: fsync f5 0 2024-04-27T07:33:29.721 INFO:tasks.workunit.client.1.smithi100.stdout:0/262: read d1/d8/d20/f29 [612723,9606] 0 2024-04-27T07:33:29.722 INFO:tasks.workunit.client.1.smithi100.stdout:1/378: dwrite d0/f3d [0,4194304] 0 2024-04-27T07:33:29.722 INFO:tasks.workunit.client.0.smithi082.stdout:0/806: dread - da/d3c/d3f/d4c/d119/f11a zero size 2024-04-27T07:33:29.724 INFO:tasks.workunit.client.1.smithi100.stdout:4/303: mkdir d5/d1b/d65 0 2024-04-27T07:33:29.725 INFO:tasks.workunit.client.0.smithi082.stdout:4/855: unlink d3/d6/d26/f90 0 2024-04-27T07:33:29.727 INFO:tasks.workunit.client.0.smithi082.stdout:9/669: getdents d9/da/dc/d35/d38 0 2024-04-27T07:33:29.728 INFO:tasks.workunit.client.0.smithi082.stdout:0/807: fdatasync f7 0 2024-04-27T07:33:29.728 INFO:tasks.workunit.client.0.smithi082.stdout:4/856: read d3/d9/f6a [7270965,34718] 0 2024-04-27T07:33:29.728 INFO:tasks.workunit.client.1.smithi100.stdout:4/304: readlink d5/d1b/d2c/d3f/l61 0 2024-04-27T07:33:29.728 INFO:tasks.workunit.client.0.smithi082.stdout:9/670: stat d9/da/c7d 0 2024-04-27T07:33:29.730 INFO:tasks.workunit.client.0.smithi082.stdout:9/671: chown d9/da/dc/d35/d38/da5/d66/f91 12442 1 2024-04-27T07:33:29.731 INFO:tasks.workunit.client.0.smithi082.stdout:4/857: rmdir d3/d9 39 2024-04-27T07:33:29.732 INFO:tasks.workunit.client.1.smithi100.stdout:4/305: chown d5/d1b/d2c/d50/f5c 1310 1 2024-04-27T07:33:29.732 INFO:tasks.workunit.client.1.smithi100.stdout:1/379: dwrite d0/d1b/f62 [0,4194304] 0 2024-04-27T07:33:29.733 INFO:tasks.workunit.client.0.smithi082.stdout:9/672: write f4 [1872935,124240] 0 2024-04-27T07:33:29.735 INFO:tasks.workunit.client.1.smithi100.stdout:0/263: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:29.735 INFO:tasks.workunit.client.1.smithi100.stdout:1/380: mkdir d0/d23/d3a/d75 0 2024-04-27T07:33:29.736 INFO:tasks.workunit.client.0.smithi082.stdout:9/673: read d9/da/dc/d35/d38/dc5/f39 [533792,36134] 0 2024-04-27T07:33:29.736 INFO:tasks.workunit.client.1.smithi100.stdout:4/306: mknod d5/d1b/d65/c66 0 2024-04-27T07:33:29.737 INFO:tasks.workunit.client.1.smithi100.stdout:0/264: chown d1/d30/l31 729 1 2024-04-27T07:33:29.737 INFO:tasks.workunit.client.0.smithi082.stdout:0/808: dwrite f9 [0,4194304] 0 2024-04-27T07:33:29.737 INFO:tasks.workunit.client.1.smithi100.stdout:4/307: readlink d5/d16/d19/l4f 0 2024-04-27T07:33:29.738 INFO:tasks.workunit.client.1.smithi100.stdout:0/265: readlink d1/d8/d20/l2d 0 2024-04-27T07:33:29.738 INFO:tasks.workunit.client.1.smithi100.stdout:1/381: dread d0/d1b/d20/f57 [0,4194304] 0 2024-04-27T07:33:29.739 INFO:tasks.workunit.client.1.smithi100.stdout:0/266: rmdir d1/d38/d3a 39 2024-04-27T07:33:29.740 INFO:tasks.workunit.client.1.smithi100.stdout:1/382: write d0/d1f/d27/d40/d61/f74 [75582,20227] 0 2024-04-27T07:33:29.742 INFO:tasks.workunit.client.0.smithi082.stdout:2/749: dread d7/d9/f1d [0,4194304] 0 2024-04-27T07:33:29.743 INFO:tasks.workunit.client.1.smithi100.stdout:0/267: mknod d1/d8/d14/d59/c5e 0 2024-04-27T07:33:29.745 INFO:tasks.workunit.client.0.smithi082.stdout:4/858: creat d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98/de4/f120 x:0 0 0 2024-04-27T07:33:29.746 INFO:tasks.workunit.client.1.smithi100.stdout:1/383: write d0/d1b/d20/d2d/d35/d4d/d60/f64 [321947,83179] 0 2024-04-27T07:33:29.748 INFO:tasks.workunit.client.1.smithi100.stdout:4/308: dwrite d5/d16/d19/d21/d2b/f58 [0,4194304] 0 2024-04-27T07:33:29.750 INFO:tasks.workunit.client.0.smithi082.stdout:9/674: creat d9/da/dc/d35/d38/fe1 x:0 0 0 2024-04-27T07:33:29.750 INFO:tasks.workunit.client.0.smithi082.stdout:0/809: dwrite da/d3c/d3f/d57/dcc/f102 [0,4194304] 0 2024-04-27T07:33:29.751 INFO:tasks.workunit.client.0.smithi082.stdout:7/733: dread d3/d49/d97/d3a/d2a/dac/dae/dce/de4/ffa [0,4194304] 0 2024-04-27T07:33:29.752 INFO:tasks.workunit.client.0.smithi082.stdout:9/675: stat d9/da/f31 0 2024-04-27T07:33:29.753 INFO:tasks.workunit.client.1.smithi100.stdout:1/384: creat d0/d1b/d20/d2d/d35/d65/f76 x:0 0 0 2024-04-27T07:33:29.755 INFO:tasks.workunit.client.0.smithi082.stdout:2/750: chown d7/l46 4 1 2024-04-27T07:33:29.756 INFO:tasks.workunit.client.1.smithi100.stdout:0/268: rename d1/d8/d14/c23 to d1/d8/c5f 0 2024-04-27T07:33:29.756 INFO:tasks.workunit.client.1.smithi100.stdout:8/205: dwrite f4 [0,4194304] 0 2024-04-27T07:33:29.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/859: rename d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/l7e to d3/dce/l121 0 2024-04-27T07:33:29.759 INFO:tasks.workunit.client.0.smithi082.stdout:7/734: dread d3/d49/d97/d3a/d2a/f3f [0,4194304] 0 2024-04-27T07:33:29.761 INFO:tasks.workunit.client.0.smithi082.stdout:2/751: creat d7/d9/d4f/d66/dae/ff7 x:0 0 0 2024-04-27T07:33:29.761 INFO:tasks.workunit.client.1.smithi100.stdout:8/206: write d6/f35 [81026,100123] 0 2024-04-27T07:33:29.764 INFO:tasks.workunit.client.0.smithi082.stdout:0/810: rename da/d28/d36/d40/c94 to da/d3c/dc7/c128 0 2024-04-27T07:33:29.765 INFO:tasks.workunit.client.1.smithi100.stdout:8/207: creat d6/d1b/f42 x:0 0 0 2024-04-27T07:33:29.766 INFO:tasks.workunit.client.0.smithi082.stdout:0/811: write da/fd3 [1091275,12206] 0 2024-04-27T07:33:29.767 INFO:tasks.workunit.client.1.smithi100.stdout:0/269: creat d1/d38/f60 x:0 0 0 2024-04-27T07:33:29.768 INFO:tasks.workunit.client.0.smithi082.stdout:0/812: write da/d1d/f2d [4355782,51548] 0 2024-04-27T07:33:29.768 INFO:tasks.workunit.client.0.smithi082.stdout:4/860: dread d3/d6/d26/f60 [0,4194304] 0 2024-04-27T07:33:29.769 INFO:tasks.workunit.client.1.smithi100.stdout:8/208: mknod d6/d1b/d1d/c43 0 2024-04-27T07:33:29.771 INFO:tasks.workunit.client.0.smithi082.stdout:2/752: rename d7/d31/d54/fbd to d7/d30/d23/ff8 0 2024-04-27T07:33:29.772 INFO:tasks.workunit.client.1.smithi100.stdout:0/270: mkdir d1/d8/d20/d61 0 2024-04-27T07:33:29.773 INFO:tasks.workunit.client.0.smithi082.stdout:2/753: dread - d7/d9/d4f/d6e/fca zero size 2024-04-27T07:33:29.773 INFO:tasks.workunit.client.0.smithi082.stdout:4/861: readlink d3/d6/d26/d5e/d11e/d101/d69/l10e 0 2024-04-27T07:33:29.774 INFO:tasks.workunit.client.1.smithi100.stdout:8/209: link d6/f17 d6/d20/d2a/f44 0 2024-04-27T07:33:29.776 INFO:tasks.workunit.client.0.smithi082.stdout:0/813: mkdir da/d38/d7f/d4a/d80/da0/d129 0 2024-04-27T07:33:29.777 INFO:tasks.workunit.client.0.smithi082.stdout:7/735: dwrite d3/d9/f74 [0,4194304] 0 2024-04-27T07:33:29.778 INFO:tasks.workunit.client.0.smithi082.stdout:4/862: chown d3/d6/dcf/d110/l117 2 1 2024-04-27T07:33:29.778 INFO:tasks.workunit.client.0.smithi082.stdout:0/814: readlink da/d3c/d3f/d57/dcc/lad 0 2024-04-27T07:33:29.783 INFO:tasks.workunit.client.0.smithi082.stdout:7/736: dread d3/d49/f51 [0,4194304] 0 2024-04-27T07:33:29.784 INFO:tasks.workunit.client.1.smithi100.stdout:1/385: dwrite d0/f26 [0,4194304] 0 2024-04-27T07:33:29.785 INFO:tasks.workunit.client.0.smithi082.stdout:0/815: symlink da/d3c/d3f/l12a 0 2024-04-27T07:33:29.790 INFO:tasks.workunit.client.0.smithi082.stdout:4/863: dwrite d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f7c [0,4194304] 0 2024-04-27T07:33:29.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/737: creat d3/d49/d97/d3a/d2a/dac/f101 x:0 0 0 2024-04-27T07:33:29.790 INFO:tasks.workunit.client.0.smithi082.stdout:0/816: creat da/d3c/d3f/dbb/f12b x:0 0 0 2024-04-27T07:33:29.791 INFO:tasks.workunit.client.1.smithi100.stdout:4/309: dread d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:29.791 INFO:tasks.workunit.client.0.smithi082.stdout:5/819: write d8/d29/dea/d5f/f84 [5033505,114047] 0 2024-04-27T07:33:29.793 INFO:tasks.workunit.client.0.smithi082.stdout:7/738: fdatasync d3/d9/dda/fdb 0 2024-04-27T07:33:29.796 INFO:tasks.workunit.client.1.smithi100.stdout:4/310: symlink d5/d16/d2e/d5a/l67 0 2024-04-27T07:33:29.799 INFO:tasks.workunit.client.0.smithi082.stdout:0/817: dread da/d3c/fd8 [0,4194304] 0 2024-04-27T07:33:29.800 INFO:tasks.workunit.client.0.smithi082.stdout:0/818: chown da/l18 4152 1 2024-04-27T07:33:29.801 INFO:tasks.workunit.client.1.smithi100.stdout:0/271: truncate d1/d30/f52 3924404 0 2024-04-27T07:33:29.802 INFO:tasks.workunit.client.0.smithi082.stdout:0/819: fdatasync da/d3c/d3f/d4c/d95/de9/def/f115 0 2024-04-27T07:33:29.802 INFO:tasks.workunit.client.1.smithi100.stdout:0/272: write d1/f39 [2963820,35137] 0 2024-04-27T07:33:29.803 INFO:tasks.workunit.client.1.smithi100.stdout:4/311: dread d5/d23/f42 [0,4194304] 0 2024-04-27T07:33:29.806 INFO:tasks.workunit.client.0.smithi082.stdout:2/754: dread d7/d8/d13/d94/fad [0,4194304] 0 2024-04-27T07:33:29.808 INFO:tasks.workunit.client.0.smithi082.stdout:5/820: dread f4 [0,4194304] 0 2024-04-27T07:33:29.809 INFO:tasks.workunit.client.0.smithi082.stdout:5/821: chown d8/d2e 293095173 1 2024-04-27T07:33:29.809 INFO:tasks.workunit.client.0.smithi082.stdout:2/755: creat d7/d8/d99/db4/ff9 x:0 0 0 2024-04-27T07:33:29.809 INFO:tasks.workunit.client.0.smithi082.stdout:5/822: stat d8/d3b 0 2024-04-27T07:33:29.810 INFO:tasks.workunit.client.0.smithi082.stdout:2/756: write d7/f87 [3824177,10157] 0 2024-04-27T07:33:29.811 INFO:tasks.workunit.client.1.smithi100.stdout:4/312: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:29.811 INFO:tasks.workunit.client.1.smithi100.stdout:1/386: dwrite d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:29.814 INFO:tasks.workunit.client.1.smithi100.stdout:4/313: write d5/d16/f26 [4414391,36122] 0 2024-04-27T07:33:29.815 INFO:tasks.workunit.client.1.smithi100.stdout:0/273: dwrite d1/d8/d20/f2b [0,4194304] 0 2024-04-27T07:33:29.816 INFO:tasks.workunit.client.0.smithi082.stdout:5/823: dwrite d8/d29/d4e/ff0 [0,4194304] 0 2024-04-27T07:33:29.817 INFO:tasks.workunit.client.1.smithi100.stdout:4/314: rename d5/d16/d19/d21/d2b to d5/d16/d19/d21/d2b/d68 22 2024-04-27T07:33:29.817 INFO:tasks.workunit.client.1.smithi100.stdout:1/387: mknod d0/d1b/d20/d2d/d35/d4d/d60/c77 0 2024-04-27T07:33:29.818 INFO:tasks.workunit.client.1.smithi100.stdout:0/274: write d1/d30/f36 [287649,12028] 0 2024-04-27T07:33:29.819 INFO:tasks.workunit.client.1.smithi100.stdout:0/275: readlink d1/d38/l3e 0 2024-04-27T07:33:29.819 INFO:tasks.workunit.client.1.smithi100.stdout:4/315: chown d5/d1b/d2c/d3f/f57 23 1 2024-04-27T07:33:29.819 INFO:tasks.workunit.client.1.smithi100.stdout:1/388: fsync d0/d1b/d20/d2d/d35/f4c 0 2024-04-27T07:33:29.820 INFO:tasks.workunit.client.1.smithi100.stdout:7/214: sync 2024-04-27T07:33:29.820 INFO:tasks.workunit.client.0.smithi082.stdout:2/757: creat d7/d8/dd9/ffa x:0 0 0 2024-04-27T07:33:29.820 INFO:tasks.workunit.client.1.smithi100.stdout:4/316: chown d5/d1b/d65/c66 759998533 1 2024-04-27T07:33:29.821 INFO:tasks.workunit.client.1.smithi100.stdout:1/389: read d0/d1b/f2f [452427,112238] 0 2024-04-27T07:33:29.825 INFO:tasks.workunit.client.1.smithi100.stdout:7/215: unlink d1/dd/d16/d3c/l22 0 2024-04-27T07:33:29.826 INFO:tasks.workunit.client.0.smithi082.stdout:9/676: rename d9/da/dc/d35/d38/da5/l5b to d9/da/dc/d35/d38/dc5/db8/le2 0 2024-04-27T07:33:29.826 INFO:tasks.workunit.client.1.smithi100.stdout:1/390: mknod d0/d1f/d27/d40/c78 0 2024-04-27T07:33:29.826 INFO:tasks.workunit.client.1.smithi100.stdout:7/216: chown d1/f32 42 1 2024-04-27T07:33:29.828 INFO:tasks.workunit.client.1.smithi100.stdout:0/276: dwrite d1/f5 [0,4194304] 0 2024-04-27T07:33:29.828 INFO:tasks.workunit.client.1.smithi100.stdout:1/391: chown d0/d1b/d20 9344422 1 2024-04-27T07:33:29.833 INFO:tasks.workunit.client.1.smithi100.stdout:8/210: write d6/f10 [1224727,50490] 0 2024-04-27T07:33:29.834 INFO:tasks.workunit.client.0.smithi082.stdout:2/758: write d7/d30/d23/f91 [4213419,46409] 0 2024-04-27T07:33:29.835 INFO:tasks.workunit.client.1.smithi100.stdout:8/211: read - d6/d1b/f42 zero size 2024-04-27T07:33:29.836 INFO:tasks.workunit.client.1.smithi100.stdout:7/217: creat d1/dd/d16/d3c/d3b/f3d x:0 0 0 2024-04-27T07:33:29.838 INFO:tasks.workunit.client.1.smithi100.stdout:8/212: fsync d6/d1b/d1d/f2c 0 2024-04-27T07:33:29.839 INFO:tasks.workunit.client.1.smithi100.stdout:0/277: dwrite d1/d8/d20/f4b [0,4194304] 0 2024-04-27T07:33:29.839 INFO:tasks.workunit.client.1.smithi100.stdout:8/213: chown d6/d20/l3e 381644 1 2024-04-27T07:33:29.841 INFO:tasks.workunit.client.1.smithi100.stdout:8/214: write d6/d1b/d1d/f39 [342986,45031] 0 2024-04-27T07:33:29.842 INFO:tasks.workunit.client.0.smithi082.stdout:4/864: dwrite d3/d6/f3e [0,4194304] 0 2024-04-27T07:33:29.842 INFO:tasks.workunit.client.0.smithi082.stdout:7/739: dwrite d3/d49/d97/d3a/d71/f7a [0,4194304] 0 2024-04-27T07:33:29.845 INFO:tasks.workunit.client.1.smithi100.stdout:8/215: chown d6/f35 294521 1 2024-04-27T07:33:29.845 INFO:tasks.workunit.client.1.smithi100.stdout:1/392: getdents d0 0 2024-04-27T07:33:29.846 INFO:tasks.workunit.client.0.smithi082.stdout:7/740: write d3/d9/f37 [2323757,129371] 0 2024-04-27T07:33:29.846 INFO:tasks.workunit.client.1.smithi100.stdout:7/218: dread d1/fc [0,4194304] 0 2024-04-27T07:33:29.847 INFO:tasks.workunit.client.1.smithi100.stdout:4/317: write d5/fe [877573,112854] 0 2024-04-27T07:33:29.849 INFO:tasks.workunit.client.0.smithi082.stdout:4/865: mkdir d3/d6/d26/d5e/d11e/d101/d122 0 2024-04-27T07:33:29.849 INFO:tasks.workunit.client.1.smithi100.stdout:7/219: truncate d1/d2f/f36 33968 0 2024-04-27T07:33:29.850 INFO:tasks.workunit.client.1.smithi100.stdout:8/216: write d6/d20/d2a/f3a [7482141,111703] 0 2024-04-27T07:33:29.851 INFO:tasks.workunit.client.0.smithi082.stdout:5/824: dread d8/f3e [0,4194304] 0 2024-04-27T07:33:29.852 INFO:tasks.workunit.client.0.smithi082.stdout:7/741: fdatasync d3/d49/d97/d3a/d2a/dac/dae/dce/de4/ffa 0 2024-04-27T07:33:29.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/759: link d7/d8/d13/d94/lc9 d7/d8/d13/d94/lfb 0 2024-04-27T07:33:29.853 INFO:tasks.workunit.client.1.smithi100.stdout:7/220: write d1/f1c [473223,76202] 0 2024-04-27T07:33:29.854 INFO:tasks.workunit.client.1.smithi100.stdout:4/318: mknod d5/d16/c69 0 2024-04-27T07:33:29.855 INFO:tasks.workunit.client.0.smithi082.stdout:7/742: readlink d3/d49/d97/d3a/d2a/dac/dae/dce/de4/lab 0 2024-04-27T07:33:29.857 INFO:tasks.workunit.client.0.smithi082.stdout:5/825: symlink d8/d15/de0/l117 0 2024-04-27T07:33:29.857 INFO:tasks.workunit.client.1.smithi100.stdout:4/319: creat d5/d1b/d2c/d50/f6a x:0 0 0 2024-04-27T07:33:29.858 INFO:tasks.workunit.client.1.smithi100.stdout:4/320: stat d5/c62 0 2024-04-27T07:33:29.858 INFO:tasks.workunit.client.0.smithi082.stdout:5/826: chown d8/d15/de0/cff 52 1 2024-04-27T07:33:29.858 INFO:tasks.workunit.client.0.smithi082.stdout:5/827: stat d8/d3b/f41 0 2024-04-27T07:33:29.859 INFO:tasks.workunit.client.1.smithi100.stdout:7/221: mkdir d1/dd/d16/d3e 0 2024-04-27T07:33:29.859 INFO:tasks.workunit.client.0.smithi082.stdout:4/866: mkdir d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d123 0 2024-04-27T07:33:29.859 INFO:tasks.workunit.client.0.smithi082.stdout:5/828: fsync d8/d3c/d47/fe2 0 2024-04-27T07:33:29.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/743: mkdir d3/d49/d97/d3a/d2a/dac/d91/d102 0 2024-04-27T07:33:29.861 INFO:tasks.workunit.client.0.smithi082.stdout:2/760: unlink d7/d9/cc7 0 2024-04-27T07:33:29.861 INFO:tasks.workunit.client.1.smithi100.stdout:4/321: symlink d5/d16/d17/l6b 0 2024-04-27T07:33:29.861 INFO:tasks.workunit.client.0.smithi082.stdout:2/761: readlink d7/d8/lc0 0 2024-04-27T07:33:29.862 INFO:tasks.workunit.client.1.smithi100.stdout:7/222: creat d1/dd/d16/d3c/d3b/f3f x:0 0 0 2024-04-27T07:33:29.862 INFO:tasks.workunit.client.1.smithi100.stdout:4/322: dread - d5/d16/d2e/f38 zero size 2024-04-27T07:33:29.862 INFO:tasks.workunit.client.0.smithi082.stdout:4/867: mknod d3/d6/d26/d5e/d21/c124 0 2024-04-27T07:33:29.863 INFO:tasks.workunit.client.1.smithi100.stdout:4/323: fdatasync d5/d1b/d2c/d3f/f57 0 2024-04-27T07:33:29.863 INFO:tasks.workunit.client.0.smithi082.stdout:7/744: unlink d3/d49/d97/c58 0 2024-04-27T07:33:29.865 INFO:tasks.workunit.client.1.smithi100.stdout:7/223: mkdir d1/dd/d16/d3c/d3b/d40 0 2024-04-27T07:33:29.865 INFO:tasks.workunit.client.0.smithi082.stdout:4/868: mknod d3/d6/d26/d55/c125 0 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:5/225: sync 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:6/273: sync 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:9/233: sync 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:2/254: sync 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:3/267: sync 2024-04-27T07:33:29.866 INFO:tasks.workunit.client.1.smithi100.stdout:4/324: creat d5/d1b/f6c x:0 0 0 2024-04-27T07:33:29.867 INFO:tasks.workunit.client.0.smithi082.stdout:5/829: creat d8/d15/d65/dc7/f118 x:0 0 0 2024-04-27T07:33:29.867 INFO:tasks.workunit.client.0.smithi082.stdout:7/745: symlink d3/db/dbb/l103 0 2024-04-27T07:33:29.867 INFO:tasks.workunit.client.1.smithi100.stdout:2/255: stat d0/d1e/d51 0 2024-04-27T07:33:29.867 INFO:tasks.workunit.client.1.smithi100.stdout:7/224: rmdir d1/dd/d2a/d2c 39 2024-04-27T07:33:29.868 INFO:tasks.workunit.client.1.smithi100.stdout:4/325: read - d5/d1b/f6c zero size 2024-04-27T07:33:29.869 INFO:tasks.workunit.client.1.smithi100.stdout:6/274: fdatasync de/d58/d21/d24/f2b 0 2024-04-27T07:33:29.870 INFO:tasks.workunit.client.1.smithi100.stdout:2/256: dread - d0/da/d29/f23 zero size 2024-04-27T07:33:29.872 INFO:tasks.workunit.client.1.smithi100.stdout:7/225: creat d1/dd/d16/d3e/f41 x:0 0 0 2024-04-27T07:33:29.873 INFO:tasks.workunit.client.0.smithi082.stdout:7/746: dwrite d3/d9/d4f/d9a/fbe [0,4194304] 0 2024-04-27T07:33:29.874 INFO:tasks.workunit.client.1.smithi100.stdout:9/234: unlink d1/d9/db/d2b/f40 0 2024-04-27T07:33:29.874 INFO:tasks.workunit.client.1.smithi100.stdout:8/217: dread d6/d20/d2a/f3c [0,4194304] 0 2024-04-27T07:33:29.876 INFO:tasks.workunit.client.1.smithi100.stdout:2/257: write d0/d1e/f3b [614699,33844] 0 2024-04-27T07:33:29.876 INFO:tasks.workunit.client.1.smithi100.stdout:4/326: mkdir d5/d16/d19/d21/d6d 0 2024-04-27T07:33:29.877 INFO:tasks.workunit.client.0.smithi082.stdout:7/747: creat d3/d9/f104 x:0 0 0 2024-04-27T07:33:29.879 INFO:tasks.workunit.client.1.smithi100.stdout:6/275: creat de/d58/d21/d24/f64 x:0 0 0 2024-04-27T07:33:29.880 INFO:tasks.workunit.client.0.smithi082.stdout:7/748: getdents d3/d49/d97/d3a/d2a/dac/d91/d102 0 2024-04-27T07:33:29.881 INFO:tasks.workunit.client.1.smithi100.stdout:5/226: dwrite d0/d4/fc [0,4194304] 0 2024-04-27T07:33:29.881 INFO:tasks.workunit.client.0.smithi082.stdout:7/749: symlink d3/d49/l105 0 2024-04-27T07:33:29.882 INFO:tasks.workunit.client.1.smithi100.stdout:6/276: chown de/d2e/d3f 5216 1 2024-04-27T07:33:29.884 INFO:tasks.workunit.client.1.smithi100.stdout:3/268: dread d7/f1f [0,4194304] 0 2024-04-27T07:33:29.886 INFO:tasks.workunit.client.1.smithi100.stdout:0/278: write d1/d8/d20/f4b [5101615,108489] 0 2024-04-27T07:33:29.886 INFO:tasks.workunit.client.1.smithi100.stdout:6/277: dread de/d58/d21/f26 [0,4194304] 0 2024-04-27T07:33:29.886 INFO:tasks.workunit.client.1.smithi100.stdout:4/327: symlink d5/d1b/d2c/l6e 0 2024-04-27T07:33:29.892 INFO:tasks.workunit.client.1.smithi100.stdout:3/269: mknod d7/d9/d10/d33/d47/c5a 0 2024-04-27T07:33:29.894 INFO:tasks.workunit.client.1.smithi100.stdout:3/270: chown d7/d9/d26/d45/f49 6824478 1 2024-04-27T07:33:29.894 INFO:tasks.workunit.client.1.smithi100.stdout:8/218: rmdir d6/d20/d2a/d3f 0 2024-04-27T07:33:29.895 INFO:tasks.workunit.client.1.smithi100.stdout:1/393: truncate d0/d23/f54 1390450 0 2024-04-27T07:33:29.895 INFO:tasks.workunit.client.1.smithi100.stdout:5/227: dwrite d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:29.896 INFO:tasks.workunit.client.1.smithi100.stdout:4/328: symlink d5/d1b/d65/l6f 0 2024-04-27T07:33:29.897 INFO:tasks.workunit.client.1.smithi100.stdout:3/271: fdatasync d7/d9/d26/f38 0 2024-04-27T07:33:29.898 INFO:tasks.workunit.client.1.smithi100.stdout:8/219: fsync d6/d1b/d1d/f2c 0 2024-04-27T07:33:29.898 INFO:tasks.workunit.client.0.smithi082.stdout:7/750: truncate d3/d49/d97/f79 3325514 0 2024-04-27T07:33:29.898 INFO:tasks.workunit.client.1.smithi100.stdout:1/394: write d0/d1f/f5e [836970,53006] 0 2024-04-27T07:33:29.899 INFO:tasks.workunit.client.1.smithi100.stdout:0/279: symlink d1/d8/d14/l62 0 2024-04-27T07:33:29.900 INFO:tasks.workunit.client.0.smithi082.stdout:7/751: rmdir d3/db/dbb 39 2024-04-27T07:33:29.902 INFO:tasks.workunit.client.0.smithi082.stdout:5/830: dwrite d8/d2e/d85/fcf [0,4194304] 0 2024-04-27T07:33:29.903 INFO:tasks.workunit.client.0.smithi082.stdout:4/869: dwrite d3/d6/d26/d5e/d11e/d101/d69/df5/f11f [0,4194304] 0 2024-04-27T07:33:29.905 INFO:tasks.workunit.client.1.smithi100.stdout:3/272: creat d7/d9/d10/d22/f5b x:0 0 0 2024-04-27T07:33:29.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/831: write d8/d29/dea/d5f/f84 [4216664,37877] 0 2024-04-27T07:33:29.908 INFO:tasks.workunit.client.1.smithi100.stdout:8/220: creat d6/f45 x:0 0 0 2024-04-27T07:33:29.909 INFO:tasks.workunit.client.1.smithi100.stdout:4/329: dwrite d5/d16/d19/d21/f41 [0,4194304] 0 2024-04-27T07:33:29.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/832: mkdir d8/d29/dea/d5f/d100/d119 0 2024-04-27T07:33:29.911 INFO:tasks.workunit.client.1.smithi100.stdout:8/221: read d6/f35 [92709,14767] 0 2024-04-27T07:33:29.914 INFO:tasks.workunit.client.1.smithi100.stdout:1/395: dwrite d0/d23/d3a/f59 [0,4194304] 0 2024-04-27T07:33:29.914 INFO:tasks.workunit.client.1.smithi100.stdout:0/280: write d1/d8/f2e [1873060,100278] 0 2024-04-27T07:33:29.915 INFO:tasks.workunit.client.0.smithi082.stdout:4/870: dwrite d3/d9/f65 [0,4194304] 0 2024-04-27T07:33:29.915 INFO:tasks.workunit.client.1.smithi100.stdout:3/273: write d7/d9/d10/d28/f52 [85726,101850] 0 2024-04-27T07:33:29.916 INFO:tasks.workunit.client.0.smithi082.stdout:4/871: dread - d3/d6/d26/d55/d67/fd4 zero size 2024-04-27T07:33:29.917 INFO:tasks.workunit.client.0.smithi082.stdout:5/833: read d8/d3c/d47/fe2 [845012,88098] 0 2024-04-27T07:33:29.918 INFO:tasks.workunit.client.0.smithi082.stdout:4/872: chown d3/d9/fed 22700879 1 2024-04-27T07:33:29.918 INFO:tasks.workunit.client.1.smithi100.stdout:8/222: truncate d6/d20/f40 709598 0 2024-04-27T07:33:29.919 INFO:tasks.workunit.client.1.smithi100.stdout:1/396: dread - d0/d1b/d20/d2d/d35/f4c zero size 2024-04-27T07:33:29.919 INFO:tasks.workunit.client.0.smithi082.stdout:5/834: rmdir d8/d2e/d85 39 2024-04-27T07:33:29.920 INFO:tasks.workunit.client.0.smithi082.stdout:5/835: readlink d8/d29/d4e/l114 0 2024-04-27T07:33:29.923 INFO:tasks.workunit.client.0.smithi082.stdout:5/836: creat d8/d29/d4e/d115/f11a x:0 0 0 2024-04-27T07:33:29.923 INFO:tasks.workunit.client.1.smithi100.stdout:9/235: truncate d1/d9/d1f/f3c 2437755 0 2024-04-27T07:33:29.924 INFO:tasks.workunit.client.0.smithi082.stdout:4/873: read d3/d9/f6a [6982045,15539] 0 2024-04-27T07:33:29.924 INFO:tasks.workunit.client.0.smithi082.stdout:5/837: chown d8/d14/f21 5 1 2024-04-27T07:33:29.925 INFO:tasks.workunit.client.1.smithi100.stdout:3/274: mknod d7/d9/d10/c5c 0 2024-04-27T07:33:29.928 INFO:tasks.workunit.client.1.smithi100.stdout:7/226: dwrite d1/f33 [0,4194304] 0 2024-04-27T07:33:29.928 INFO:tasks.workunit.client.0.smithi082.stdout:4/874: unlink d3/d6/d26/d5e/d11e/lcc 0 2024-04-27T07:33:29.928 INFO:tasks.workunit.client.0.smithi082.stdout:4/875: readlink d3/d6/d26/l2d 0 2024-04-27T07:33:29.929 INFO:tasks.workunit.client.0.smithi082.stdout:5/838: symlink d8/d2e/l11b 0 2024-04-27T07:33:29.929 INFO:tasks.workunit.client.1.smithi100.stdout:7/227: chown d1/dd/d16/d3e 26616164 1 2024-04-27T07:33:29.931 INFO:tasks.workunit.client.0.smithi082.stdout:5/839: chown d8/d29/dea/d5f/df6/dfd/d102/d10e/lf8 13357867 1 2024-04-27T07:33:29.933 INFO:tasks.workunit.client.0.smithi082.stdout:4/876: rmdir d3/d6/de9 0 2024-04-27T07:33:29.934 INFO:tasks.workunit.client.0.smithi082.stdout:5/840: mknod d8/d15/d65/dc7/c11c 0 2024-04-27T07:33:29.936 INFO:tasks.workunit.client.0.smithi082.stdout:5/841: chown d8/d2e/d85/daa/fe1 786069 1 2024-04-27T07:33:29.936 INFO:tasks.workunit.client.1.smithi100.stdout:6/278: link de/d58/d21/d5b/l5f de/d58/d28/l65 0 2024-04-27T07:33:29.936 INFO:tasks.workunit.client.1.smithi100.stdout:3/275: dread d7/f1c [0,4194304] 0 2024-04-27T07:33:29.936 INFO:tasks.workunit.client.1.smithi100.stdout:8/223: unlink d6/l19 0 2024-04-27T07:33:29.937 INFO:tasks.workunit.client.0.smithi082.stdout:4/877: rename d3/d81 to d3/d6/d26/d55/d67/d126 0 2024-04-27T07:33:29.938 INFO:tasks.workunit.client.1.smithi100.stdout:6/279: write de/d58/d28/f30 [3578334,68526] 0 2024-04-27T07:33:29.939 INFO:tasks.workunit.client.0.smithi082.stdout:4/878: read d3/d6/d26/d55/d67/f86 [500062,65739] 0 2024-04-27T07:33:29.940 INFO:tasks.workunit.client.1.smithi100.stdout:1/397: mkdir d0/d1b/d20/d2d/d35/d4d/d60/d79 0 2024-04-27T07:33:29.941 INFO:tasks.workunit.client.1.smithi100.stdout:3/276: truncate d7/d9/d10/f29 451884 0 2024-04-27T07:33:29.941 INFO:tasks.workunit.client.1.smithi100.stdout:9/236: mkdir d1/d9/db/d56 0 2024-04-27T07:33:29.942 INFO:tasks.workunit.client.0.smithi082.stdout:5/842: getdents d8/d29 0 2024-04-27T07:33:29.943 INFO:tasks.workunit.client.1.smithi100.stdout:6/280: write de/d58/f22 [559104,120295] 0 2024-04-27T07:33:29.943 INFO:tasks.workunit.client.1.smithi100.stdout:0/281: creat d1/d8/d20/d61/f63 x:0 0 0 2024-04-27T07:33:29.944 INFO:tasks.workunit.client.0.smithi082.stdout:7/752: dwrite d3/d49/d97/d3a/f65 [0,4194304] 0 2024-04-27T07:33:29.945 INFO:tasks.workunit.client.1.smithi100.stdout:1/398: readlink d0/d1f/d27/d4e/l6a 0 2024-04-27T07:33:29.945 INFO:tasks.workunit.client.1.smithi100.stdout:3/277: chown d7/d46/l4d 823 1 2024-04-27T07:33:29.946 INFO:tasks.workunit.client.1.smithi100.stdout:9/237: readlink d1/d9/db/l3d 0 2024-04-27T07:33:29.946 INFO:tasks.workunit.client.1.smithi100.stdout:8/224: mkdir d6/d20/d46 0 2024-04-27T07:33:29.946 INFO:tasks.workunit.client.1.smithi100.stdout:7/228: dwrite d1/f15 [0,4194304] 0 2024-04-27T07:33:29.946 INFO:tasks.workunit.client.1.smithi100.stdout:6/281: fdatasync de/d58/d28/f2f 0 2024-04-27T07:33:29.949 INFO:tasks.workunit.client.0.smithi082.stdout:4/879: dwrite d3/d6/d26/d5e/d11e/d101/d69/fe5 [0,4194304] 0 2024-04-27T07:33:29.955 INFO:tasks.workunit.client.1.smithi100.stdout:1/399: dread d0/f19 [0,4194304] 0 2024-04-27T07:33:29.955 INFO:tasks.workunit.client.0.smithi082.stdout:7/753: getdents d3/d49/d97/d3a/d71/da0 0 2024-04-27T07:33:29.956 INFO:tasks.workunit.client.1.smithi100.stdout:3/278: rename f4 to d7/d9/d2f/f5d 0 2024-04-27T07:33:29.956 INFO:tasks.workunit.client.1.smithi100.stdout:7/229: truncate d1/dd/d16/d3c/d3b/f3f 568820 0 2024-04-27T07:33:29.960 INFO:tasks.workunit.client.1.smithi100.stdout:2/258: truncate d0/da/d29/d26/f4b 608008 0 2024-04-27T07:33:29.964 INFO:tasks.workunit.client.1.smithi100.stdout:4/330: dread d5/d16/f26 [0,4194304] 0 2024-04-27T07:33:29.965 INFO:tasks.workunit.client.1.smithi100.stdout:6/282: creat de/d58/d21/d5b/f66 x:0 0 0 2024-04-27T07:33:29.967 INFO:tasks.workunit.client.1.smithi100.stdout:5/228: truncate d0/d4/d21/f2e 497314 0 2024-04-27T07:33:29.968 INFO:tasks.workunit.client.1.smithi100.stdout:0/282: dwrite d1/d8/d14/d59/f5b [0,4194304] 0 2024-04-27T07:33:29.971 INFO:tasks.workunit.client.1.smithi100.stdout:3/279: rename d7/d46 to d7/d9/d26/d2a/d5e 0 2024-04-27T07:33:29.972 INFO:tasks.workunit.client.1.smithi100.stdout:1/400: mknod d0/d1f/d27/d6c/c7a 0 2024-04-27T07:33:29.975 INFO:tasks.workunit.client.1.smithi100.stdout:8/225: getdents d6/d20/d46 0 2024-04-27T07:33:29.976 INFO:tasks.workunit.client.1.smithi100.stdout:4/331: symlink d5/d16/d19/d46/l70 0 2024-04-27T07:33:29.976 INFO:tasks.workunit.client.1.smithi100.stdout:9/238: dwrite d1/f30 [0,4194304] 0 2024-04-27T07:33:29.979 INFO:tasks.workunit.client.1.smithi100.stdout:2/259: mknod d0/da/d29/d47/d5a/c5b 0 2024-04-27T07:33:29.980 INFO:tasks.workunit.client.1.smithi100.stdout:3/280: write d7/d9/d10/d28/f52 [823759,103720] 0 2024-04-27T07:33:29.983 INFO:tasks.workunit.client.1.smithi100.stdout:2/260: dread - d0/d1e/f27 zero size 2024-04-27T07:33:29.984 INFO:tasks.workunit.client.1.smithi100.stdout:0/283: dwrite d1/d8/d20/f5a [0,4194304] 0 2024-04-27T07:33:29.984 INFO:tasks.workunit.client.1.smithi100.stdout:8/226: truncate d6/d20/d2a/f3c 2400629 0 2024-04-27T07:33:29.985 INFO:tasks.workunit.client.0.smithi082.stdout:1/698: sync 2024-04-27T07:33:29.985 INFO:tasks.workunit.client.0.smithi082.stdout:6/706: sync 2024-04-27T07:33:29.987 INFO:tasks.workunit.client.0.smithi082.stdout:4/880: dread d3/d9/f7d [4194304,4194304] 0 2024-04-27T07:33:29.989 INFO:tasks.workunit.client.1.smithi100.stdout:1/401: dread d0/f3d [0,4194304] 0 2024-04-27T07:33:29.993 INFO:tasks.workunit.client.1.smithi100.stdout:4/332: dwrite d5/d1b/f6c [0,4194304] 0 2024-04-27T07:33:30.000 INFO:tasks.workunit.client.1.smithi100.stdout:1/402: write d0/d1b/d20/d2d/d35/f4c [96995,2286] 0 2024-04-27T07:33:30.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/281: dwrite d7/d9/d26/d45/f49 [0,4194304] 0 2024-04-27T07:33:30.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/282: chown d7/d9/d10/d3e/d55 14129 1 2024-04-27T07:33:30.001 INFO:tasks.workunit.client.1.smithi100.stdout:1/403: truncate d0/d1b/f33 459282 0 2024-04-27T07:33:30.003 INFO:tasks.workunit.client.1.smithi100.stdout:3/283: read d7/d9/d10/d28/d2c/f34 [55815,89205] 0 2024-04-27T07:33:30.006 INFO:tasks.workunit.client.1.smithi100.stdout:3/284: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:30.007 INFO:tasks.workunit.client.0.smithi082.stdout:7/754: creat d3/d49/d97/d3a/d2a/dac/d91/f106 x:0 0 0 2024-04-27T07:33:30.008 INFO:tasks.workunit.client.1.smithi100.stdout:3/285: chown d7/d9/d10/d3e/d55/l56 1 1 2024-04-27T07:33:30.009 INFO:tasks.workunit.client.1.smithi100.stdout:1/404: dwrite d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:30.019 INFO:tasks.workunit.client.0.smithi082.stdout:4/881: creat d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98/f127 x:0 0 0 2024-04-27T07:33:30.021 INFO:tasks.workunit.client.0.smithi082.stdout:6/707: dwrite d2/d2d/d4a/de4/dcc/d77/dca/dd6/fde [0,4194304] 0 2024-04-27T07:33:30.024 INFO:tasks.workunit.client.1.smithi100.stdout:8/227: mkdir d6/d1b/d1d/d47 0 2024-04-27T07:33:30.029 INFO:tasks.workunit.client.0.smithi082.stdout:4/882: dwrite d3/d6/d26/d5e/d11e/d101/d69/fd0 [0,4194304] 0 2024-04-27T07:33:30.029 INFO:tasks.workunit.client.1.smithi100.stdout:2/261: mknod d0/da/d29/d47/d5a/c5c 0 2024-04-27T07:33:30.031 INFO:tasks.workunit.client.0.smithi082.stdout:6/708: creat d2/d3/da8/fe9 x:0 0 0 2024-04-27T07:33:30.032 INFO:tasks.workunit.client.0.smithi082.stdout:5/843: write d8/d77/f78 [3177088,2833] 0 2024-04-27T07:33:30.035 INFO:tasks.workunit.client.1.smithi100.stdout:4/333: mknod d5/d16/d19/d46/c71 0 2024-04-27T07:33:30.039 INFO:tasks.workunit.client.0.smithi082.stdout:4/883: dwrite d3/dab/ff0 [0,4194304] 0 2024-04-27T07:33:30.040 INFO:tasks.workunit.client.0.smithi082.stdout:1/699: dread d4/d15/d49/dab/dc3/d4c/f92 [0,4194304] 0 2024-04-27T07:33:30.041 INFO:tasks.workunit.client.1.smithi100.stdout:2/262: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-27T07:33:30.041 INFO:tasks.workunit.client.1.smithi100.stdout:2/263: chown d0/da/f28 1 1 2024-04-27T07:33:30.042 INFO:tasks.workunit.client.0.smithi082.stdout:6/709: symlink d2/d3/d1b/lea 0 2024-04-27T07:33:30.043 INFO:tasks.workunit.client.1.smithi100.stdout:3/286: mknod d7/d9/d10/d28/c5f 0 2024-04-27T07:33:30.044 INFO:tasks.workunit.client.0.smithi082.stdout:4/884: write d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f47 [7879636,26506] 0 2024-04-27T07:33:30.045 INFO:tasks.workunit.client.1.smithi100.stdout:3/287: chown d7/d9/d10/d28/d2c/c3c 6790 1 2024-04-27T07:33:30.046 INFO:tasks.workunit.client.1.smithi100.stdout:3/288: chown d7/d9/d10/d28/d2c/f34 521049079 1 2024-04-27T07:33:30.046 INFO:tasks.workunit.client.1.smithi100.stdout:6/283: truncate de/f10 3598283 0 2024-04-27T07:33:30.049 INFO:tasks.workunit.client.1.smithi100.stdout:7/230: rename d1/f27 to d1/dd/f42 0 2024-04-27T07:33:30.050 INFO:tasks.workunit.client.0.smithi082.stdout:1/700: getdents d4/d15/d49/dab/dc3/d3e/d53 0 2024-04-27T07:33:30.052 INFO:tasks.workunit.client.0.smithi082.stdout:1/701: write d4/d15/d49/dab/dc3/d4c/fe1 [94192,56787] 0 2024-04-27T07:33:30.052 INFO:tasks.workunit.client.0.smithi082.stdout:6/710: dread d2/d2d/f51 [0,4194304] 0 2024-04-27T07:33:30.057 INFO:tasks.workunit.client.0.smithi082.stdout:1/702: rmdir d4/d15/d3f/d6d 39 2024-04-27T07:33:30.057 INFO:tasks.workunit.client.1.smithi100.stdout:4/334: mknod d5/d16/d4c/c72 0 2024-04-27T07:33:30.058 INFO:tasks.workunit.client.0.smithi082.stdout:1/703: stat d4/d15/d49/dab/dc3/d3e/d46/c96 0 2024-04-27T07:33:30.060 INFO:tasks.workunit.client.1.smithi100.stdout:2/264: mkdir d0/da/d29/d26/d5d 0 2024-04-27T07:33:30.063 INFO:tasks.workunit.client.1.smithi100.stdout:3/289: creat d7/d9/d26/d2a/d5e/f60 x:0 0 0 2024-04-27T07:33:30.063 INFO:tasks.workunit.client.1.smithi100.stdout:2/265: write d0/d1e/d51/f59 [241996,116028] 0 2024-04-27T07:33:30.064 INFO:tasks.workunit.client.0.smithi082.stdout:1/704: unlink d4/d15/d49/da0/c62 0 2024-04-27T07:33:30.065 INFO:tasks.workunit.client.1.smithi100.stdout:3/290: chown d7/d9/d10/c37 536 1 2024-04-27T07:33:30.065 INFO:tasks.workunit.client.1.smithi100.stdout:1/405: dread d0/d1f/d27/f39 [0,4194304] 0 2024-04-27T07:33:30.068 INFO:tasks.workunit.client.1.smithi100.stdout:8/228: mknod d6/d20/c48 0 2024-04-27T07:33:30.071 INFO:tasks.workunit.client.0.smithi082.stdout:1/705: read d4/d15/d49/d99/d9a/da9/fb4 [3529596,103491] 0 2024-04-27T07:33:30.072 INFO:tasks.workunit.client.0.smithi082.stdout:1/706: fdatasync d4/d15/d3f/d97/dd1/fd5 0 2024-04-27T07:33:30.074 INFO:tasks.workunit.client.0.smithi082.stdout:4/885: dread d3/d6/d26/d5e/d11e/d101/d69/fd8 [0,4194304] 0 2024-04-27T07:33:30.074 INFO:tasks.workunit.client.1.smithi100.stdout:2/266: unlink d0/da/d29/l2d 0 2024-04-27T07:33:30.076 INFO:tasks.workunit.client.0.smithi082.stdout:1/707: symlink d4/d15/ddb/lf7 0 2024-04-27T07:33:30.077 INFO:tasks.workunit.client.0.smithi082.stdout:1/708: write d4/d15/d3f/f67 [1319689,33961] 0 2024-04-27T07:33:30.078 INFO:tasks.workunit.client.1.smithi100.stdout:6/284: link de/f17 de/d58/d28/f67 0 2024-04-27T07:33:30.078 INFO:tasks.workunit.client.0.smithi082.stdout:4/886: creat d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98/de4/f128 x:0 0 0 2024-04-27T07:33:30.079 INFO:tasks.workunit.client.1.smithi100.stdout:6/285: readlink de/d58/d28/l3a 0 2024-04-27T07:33:30.081 INFO:tasks.workunit.client.1.smithi100.stdout:3/291: mknod d7/d9/d10/d28/c61 0 2024-04-27T07:33:30.081 INFO:tasks.workunit.client.0.smithi082.stdout:4/887: chown d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/fc1 1161 1 2024-04-27T07:33:30.081 INFO:tasks.workunit.client.1.smithi100.stdout:3/292: chown d7/d9/d10/d33/d47 10271639 1 2024-04-27T07:33:30.082 INFO:tasks.workunit.client.1.smithi100.stdout:3/293: fsync d7/d9/f51 0 2024-04-27T07:33:30.082 INFO:tasks.workunit.client.1.smithi100.stdout:7/231: unlink d1/d2f/l30 0 2024-04-27T07:33:30.083 INFO:tasks.workunit.client.0.smithi082.stdout:4/888: rmdir d3/d6/dcf/d110 39 2024-04-27T07:33:30.083 INFO:tasks.workunit.client.1.smithi100.stdout:9/239: truncate d1/d9/d1f/f27 1232193 0 2024-04-27T07:33:30.084 INFO:tasks.workunit.client.1.smithi100.stdout:7/232: write d1/dd/d16/d3c/d3b/f3d [440331,53561] 0 2024-04-27T07:33:30.084 INFO:tasks.workunit.client.1.smithi100.stdout:1/406: mkdir d0/d1f/d27/d4e/d7b 0 2024-04-27T07:33:30.087 INFO:tasks.workunit.client.1.smithi100.stdout:0/284: getdents d1/d30 0 2024-04-27T07:33:30.087 INFO:tasks.workunit.client.1.smithi100.stdout:7/233: read d1/f15 [546884,102172] 0 2024-04-27T07:33:30.088 INFO:tasks.workunit.client.1.smithi100.stdout:8/229: creat d6/d20/d2a/f49 x:0 0 0 2024-04-27T07:33:30.089 INFO:tasks.workunit.client.1.smithi100.stdout:2/267: creat d0/da/d29/d47/f5e x:0 0 0 2024-04-27T07:33:30.090 INFO:tasks.workunit.client.1.smithi100.stdout:8/230: dread - d6/d1b/d1d/f32 zero size 2024-04-27T07:33:30.092 INFO:tasks.workunit.client.1.smithi100.stdout:6/286: rename de/d58/d28/c31 to de/d58/d28/c68 0 2024-04-27T07:33:30.093 INFO:tasks.workunit.client.1.smithi100.stdout:3/294: creat d7/d9/d2f/f62 x:0 0 0 2024-04-27T07:33:30.093 INFO:tasks.workunit.client.1.smithi100.stdout:8/231: write d6/d20/d2a/f3a [7003788,93874] 0 2024-04-27T07:33:30.095 INFO:tasks.workunit.client.1.smithi100.stdout:0/285: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:30.101 INFO:tasks.workunit.client.1.smithi100.stdout:6/287: creat de/f69 x:0 0 0 2024-04-27T07:33:30.102 INFO:tasks.workunit.client.1.smithi100.stdout:9/240: mkdir d1/d9/db/d2b/d4f/d57 0 2024-04-27T07:33:30.103 INFO:tasks.workunit.client.1.smithi100.stdout:9/241: dread - d1/d9/db/f51 zero size 2024-04-27T07:33:30.105 INFO:tasks.workunit.client.1.smithi100.stdout:9/242: write d1/d9/f21 [6324461,104552] 0 2024-04-27T07:33:30.107 INFO:tasks.workunit.client.1.smithi100.stdout:3/295: rmdir d7/d9/d26/d2a/d5e 39 2024-04-27T07:33:30.109 INFO:tasks.workunit.client.1.smithi100.stdout:0/286: mkdir d1/d8/d14/d59/d64 0 2024-04-27T07:33:30.110 INFO:tasks.workunit.client.1.smithi100.stdout:1/407: rename d0/d1b/d20/l2a to d0/d1f/d27/d4e/d7b/l7c 0 2024-04-27T07:33:30.111 INFO:tasks.workunit.client.0.smithi082.stdout:5/844: write d8/f2d [308746,23533] 0 2024-04-27T07:33:30.113 INFO:tasks.workunit.client.0.smithi082.stdout:5/845: truncate d8/d42/f10c 1035656 0 2024-04-27T07:33:30.113 INFO:tasks.workunit.client.0.smithi082.stdout:5/846: readlink d8/d29/d4e/l114 0 2024-04-27T07:33:30.114 INFO:tasks.workunit.client.1.smithi100.stdout:2/268: creat d0/da/d29/d26/d5d/f5f x:0 0 0 2024-04-27T07:33:30.115 INFO:tasks.workunit.client.1.smithi100.stdout:2/269: fdatasync d0/d1e/f31 0 2024-04-27T07:33:30.116 INFO:tasks.workunit.client.0.smithi082.stdout:5/847: rmdir d8/d29/d4e/d115 39 2024-04-27T07:33:30.117 INFO:tasks.workunit.client.1.smithi100.stdout:9/243: dwrite d1/d9/f49 [0,4194304] 0 2024-04-27T07:33:30.119 INFO:tasks.workunit.client.1.smithi100.stdout:0/287: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:30.119 INFO:tasks.workunit.client.1.smithi100.stdout:0/288: chown d1/d8 727914 1 2024-04-27T07:33:30.120 INFO:tasks.workunit.client.0.smithi082.stdout:6/711: creat d2/d3/feb x:0 0 0 2024-04-27T07:33:30.121 INFO:tasks.workunit.client.0.smithi082.stdout:6/712: read - d2/d3/d9c/fbf zero size 2024-04-27T07:33:30.121 INFO:tasks.workunit.client.0.smithi082.stdout:5/848: mknod d8/d98/d9c/c11d 0 2024-04-27T07:33:30.123 INFO:tasks.workunit.client.1.smithi100.stdout:9/244: truncate d1/d9/db/d2b/d31/f50 27467 0 2024-04-27T07:33:30.125 INFO:tasks.workunit.client.0.smithi082.stdout:6/713: mkdir d2/d2d/d4a/de4/dec 0 2024-04-27T07:33:30.129 INFO:tasks.workunit.client.1.smithi100.stdout:3/296: mknod d7/d9/d10/d3e/d55/c63 0 2024-04-27T07:33:30.130 INFO:tasks.workunit.client.0.smithi082.stdout:7/755: dread d3/d9/d7c/fb4 [0,4194304] 0 2024-04-27T07:33:30.131 INFO:tasks.workunit.client.0.smithi082.stdout:6/714: creat d2/d1e/d32/d85/fed x:0 0 0 2024-04-27T07:33:30.132 INFO:tasks.workunit.client.1.smithi100.stdout:2/270: dwrite d0/da/d29/d47/f5e [0,4194304] 0 2024-04-27T07:33:30.134 INFO:tasks.workunit.client.0.smithi082.stdout:5/849: link d8/d2e/d85/fd6 d8/d29/dea/d5f/df6/dfd/d102/d10e/d8b/f11e 0 2024-04-27T07:33:30.135 INFO:tasks.workunit.client.0.smithi082.stdout:7/756: mknod d3/d9/dda/c107 0 2024-04-27T07:33:30.139 INFO:tasks.workunit.client.1.smithi100.stdout:6/288: link de/d58/d21/d23/f3e de/d58/d28/f6a 0 2024-04-27T07:33:30.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/850: chown d8/d29/d4e/d90/c91 1392 1 2024-04-27T07:33:30.140 INFO:tasks.workunit.client.1.smithi100.stdout:9/245: dwrite d1/d9/db/f3f [0,4194304] 0 2024-04-27T07:33:30.140 INFO:tasks.workunit.client.0.smithi082.stdout:7/757: dread d3/d49/d97/d6c/f7f [0,4194304] 0 2024-04-27T07:33:30.143 INFO:tasks.workunit.client.0.smithi082.stdout:5/851: mknod d8/d29/dea/d5f/df6/dfd/d102/d10e/d110/c11f 0 2024-04-27T07:33:30.144 INFO:tasks.workunit.client.0.smithi082.stdout:5/852: chown d8/d15/dca 2900154 1 2024-04-27T07:33:30.144 INFO:tasks.workunit.client.0.smithi082.stdout:7/758: chown d3/d49/d97/d3a/d2a/dac/cd9 61238 1 2024-04-27T07:33:30.146 INFO:tasks.workunit.client.1.smithi100.stdout:2/271: dwrite d0/d1e/f57 [0,4194304] 0 2024-04-27T07:33:30.147 INFO:tasks.workunit.client.0.smithi082.stdout:1/709: mknod d4/d15/d49/d99/cf8 0 2024-04-27T07:33:30.148 INFO:tasks.workunit.client.1.smithi100.stdout:8/232: link d6/d20/d2a/c28 d6/d1b/d1d/c4a 0 2024-04-27T07:33:30.148 INFO:tasks.workunit.client.1.smithi100.stdout:1/408: dread d0/d1f/f2b [0,4194304] 0 2024-04-27T07:33:30.148 INFO:tasks.workunit.client.1.smithi100.stdout:8/233: fdatasync d6/d1b/f34 0 2024-04-27T07:33:30.149 INFO:tasks.workunit.client.0.smithi082.stdout:7/759: chown d3/d9/d4f/lc3 772517 1 2024-04-27T07:33:30.150 INFO:tasks.workunit.client.1.smithi100.stdout:3/297: stat d7/d9/d26/d2a/d5e 0 2024-04-27T07:33:30.154 INFO:tasks.workunit.client.0.smithi082.stdout:4/889: mknod d3/d6/d26/d55/c129 0 2024-04-27T07:33:30.157 INFO:tasks.workunit.client.1.smithi100.stdout:6/289: fdatasync de/d58/f1b 0 2024-04-27T07:33:30.157 INFO:tasks.workunit.client.1.smithi100.stdout:6/290: stat de/d58/f1b 0 2024-04-27T07:33:30.158 INFO:tasks.workunit.client.1.smithi100.stdout:6/291: stat f6 0 2024-04-27T07:33:30.158 INFO:tasks.workunit.client.0.smithi082.stdout:4/890: write d3/d6/d26/d5e/d11e/d101/d69/f70 [1639880,29465] 0 2024-04-27T07:33:30.158 INFO:tasks.workunit.client.0.smithi082.stdout:1/710: dwrite d4/d15/d49/dab/dc3/f9b [4194304,4194304] 0 2024-04-27T07:33:30.159 INFO:tasks.workunit.client.1.smithi100.stdout:9/246: symlink d1/d9/d1f/l58 0 2024-04-27T07:33:30.161 INFO:tasks.workunit.client.1.smithi100.stdout:9/247: write d1/d9/d1f/d4a/f4d [1036283,62394] 0 2024-04-27T07:33:30.162 INFO:tasks.workunit.client.1.smithi100.stdout:9/248: chown d1/d9/d1f/l44 169294179 1 2024-04-27T07:33:30.162 INFO:tasks.workunit.client.1.smithi100.stdout:9/249: fdatasync d1/d9/f25 0 2024-04-27T07:33:30.163 INFO:tasks.workunit.client.1.smithi100.stdout:0/289: truncate d1/d8/d20/f4b 297981 0 2024-04-27T07:33:30.164 INFO:tasks.workunit.client.0.smithi082.stdout:6/715: write d2/d2e/d55/fe8 [973729,101931] 0 2024-04-27T07:33:30.165 INFO:tasks.workunit.client.1.smithi100.stdout:8/234: symlink d6/l4b 0 2024-04-27T07:33:30.165 INFO:tasks.workunit.client.0.smithi082.stdout:4/891: write d3/d9/f7d [2459598,59562] 0 2024-04-27T07:33:30.168 INFO:tasks.workunit.client.1.smithi100.stdout:3/298: mkdir d7/d9/d10/d28/d2c/d64 0 2024-04-27T07:33:30.168 INFO:tasks.workunit.client.1.smithi100.stdout:1/409: dread d0/d1b/d20/f57 [0,4194304] 0 2024-04-27T07:33:30.169 INFO:tasks.workunit.client.0.smithi082.stdout:1/711: getdents d4/d15/d3f/d6d 0 2024-04-27T07:33:30.169 INFO:tasks.workunit.client.1.smithi100.stdout:6/292: rename de/d58/d21/c63 to de/d58/d21/d23/c6b 0 2024-04-27T07:33:30.170 INFO:tasks.workunit.client.0.smithi082.stdout:6/716: symlink d2/d1e/d32/d7d/d82/db4/lee 0 2024-04-27T07:33:30.171 INFO:tasks.workunit.client.1.smithi100.stdout:6/293: chown de/d58/d28/f30 307361457 1 2024-04-27T07:33:30.171 INFO:tasks.workunit.client.1.smithi100.stdout:2/272: unlink d0/c17 0 2024-04-27T07:33:30.172 INFO:tasks.workunit.client.1.smithi100.stdout:8/235: dwrite d6/f10 [0,4194304] 0 2024-04-27T07:33:30.172 INFO:tasks.workunit.client.1.smithi100.stdout:6/294: dread - de/d58/d28/f4f zero size 2024-04-27T07:33:30.174 INFO:tasks.workunit.client.0.smithi082.stdout:1/712: rename d4/d15/ddb to d4/d15/d49/d99/d9a/dc7/df9 0 2024-04-27T07:33:30.175 INFO:tasks.workunit.client.1.smithi100.stdout:8/236: dread d6/d1b/f34 [0,4194304] 0 2024-04-27T07:33:30.177 INFO:tasks.workunit.client.0.smithi082.stdout:6/717: chown d2/d2d/d4a/de4/dcc/f83 251118 1 2024-04-27T07:33:30.177 INFO:tasks.workunit.client.1.smithi100.stdout:1/410: symlink d0/d1f/d27/d40/l7d 0 2024-04-27T07:33:30.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/760: dread d3/db/f5d [0,4194304] 0 2024-04-27T07:33:30.178 INFO:tasks.workunit.client.0.smithi082.stdout:5/853: dwrite d8/d3c/d64/f7e [0,4194304] 0 2024-04-27T07:33:30.179 INFO:tasks.workunit.client.1.smithi100.stdout:6/295: symlink de/l6c 0 2024-04-27T07:33:30.180 INFO:tasks.workunit.client.1.smithi100.stdout:8/237: read d6/d1b/f22 [2151890,13627] 0 2024-04-27T07:33:30.181 INFO:tasks.workunit.client.1.smithi100.stdout:9/250: symlink d1/d9/db/d2b/d4f/d57/l59 0 2024-04-27T07:33:30.181 INFO:tasks.workunit.client.1.smithi100.stdout:3/299: creat d7/d9/d10/d28/d2c/d3a/f65 x:0 0 0 2024-04-27T07:33:30.182 INFO:tasks.workunit.client.0.smithi082.stdout:4/892: dwrite d3/d6/d26/d5e/d11e/d101/d69/fd8 [4194304,4194304] 0 2024-04-27T07:33:30.183 INFO:tasks.workunit.client.1.smithi100.stdout:2/273: dwrite d0/f24 [0,4194304] 0 2024-04-27T07:33:30.184 INFO:tasks.workunit.client.0.smithi082.stdout:5/854: creat d8/d14/f120 x:0 0 0 2024-04-27T07:33:30.184 INFO:tasks.workunit.client.0.smithi082.stdout:7/761: fdatasync d3/d49/d97/d3a/d71/da0/fa6 0 2024-04-27T07:33:30.192 INFO:tasks.workunit.client.0.smithi082.stdout:1/713: creat d4/d15/d49/dab/dc3/d3e/d57/da5/ffa x:0 0 0 2024-04-27T07:33:30.193 INFO:tasks.workunit.client.1.smithi100.stdout:0/290: dwrite d1/d38/d3a/f3c [0,4194304] 0 2024-04-27T07:33:30.194 INFO:tasks.workunit.client.0.smithi082.stdout:5/855: rename d8/f25 to d8/d42/f121 0 2024-04-27T07:33:30.194 INFO:tasks.workunit.client.0.smithi082.stdout:7/762: dwrite d3/d49/d97/d3a/d2a/dac/f100 [0,4194304] 0 2024-04-27T07:33:30.197 INFO:tasks.workunit.client.1.smithi100.stdout:6/296: write de/d2e/f55 [5784589,40137] 0 2024-04-27T07:33:30.197 INFO:tasks.workunit.client.1.smithi100.stdout:1/411: rename d0/c17 to d0/d1f/d27/d4e/c7e 0 2024-04-27T07:33:30.197 INFO:tasks.workunit.client.0.smithi082.stdout:7/763: fsync d3/d49/d97/d3a/d2a/dac/d91/f98 0 2024-04-27T07:33:30.198 INFO:tasks.workunit.client.0.smithi082.stdout:1/714: fdatasync d4/d15/d49/dab/dc3/d3e/d53/f54 0 2024-04-27T07:33:30.200 INFO:tasks.workunit.client.0.smithi082.stdout:7/764: truncate d3/db/ff 2353085 0 2024-04-27T07:33:30.202 INFO:tasks.workunit.client.0.smithi082.stdout:1/715: fsync d4/d15/d49/dab/dc3/d3e/d53/d72/fac 0 2024-04-27T07:33:30.204 INFO:tasks.workunit.client.0.smithi082.stdout:7/765: write d3/de9/ff3 [170378,28669] 0 2024-04-27T07:33:30.204 INFO:tasks.workunit.client.0.smithi082.stdout:4/893: dread d3/d6/d26/d55/f72 [0,4194304] 0 2024-04-27T07:33:30.206 INFO:tasks.workunit.client.1.smithi100.stdout:9/251: symlink d1/d9/db/d2b/d4f/d57/l5a 0 2024-04-27T07:33:30.206 INFO:tasks.workunit.client.0.smithi082.stdout:7/766: read d3/db/f5d [170566,98976] 0 2024-04-27T07:33:30.207 INFO:tasks.workunit.client.0.smithi082.stdout:1/716: creat d4/d15/d3f/d97/ffb x:0 0 0 2024-04-27T07:33:30.209 INFO:tasks.workunit.client.0.smithi082.stdout:4/894: unlink d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/fae 0 2024-04-27T07:33:30.211 INFO:tasks.workunit.client.0.smithi082.stdout:1/717: unlink d4/d15/fca 0 2024-04-27T07:33:30.213 INFO:tasks.workunit.client.0.smithi082.stdout:7/767: creat d3/d49/d97/d3a/d71/f108 x:0 0 0 2024-04-27T07:33:30.214 INFO:tasks.workunit.client.0.smithi082.stdout:4/895: rename d3/d6/d26/d55/f72 to d3/d6/d26/d55/d67/f12a 0 2024-04-27T07:33:30.215 INFO:tasks.workunit.client.1.smithi100.stdout:6/297: unlink de/d2e/d3f/c57 0 2024-04-27T07:33:30.216 INFO:tasks.workunit.client.0.smithi082.stdout:7/768: rmdir d3/d49/d97/d3a/d2a/dac/d91 39 2024-04-27T07:33:30.217 INFO:tasks.workunit.client.0.smithi082.stdout:4/896: truncate d3/d6/d26/d5e/d21/f100 693217 0 2024-04-27T07:33:30.217 INFO:tasks.workunit.client.0.smithi082.stdout:1/718: truncate d4/d15/d49/dab/dc3/d3e/f40 1773919 0 2024-04-27T07:33:30.218 INFO:tasks.workunit.client.1.smithi100.stdout:2/274: mknod d0/c60 0 2024-04-27T07:33:30.218 INFO:tasks.workunit.client.0.smithi082.stdout:1/719: readlink d4/d15/d49/d4e/l60 0 2024-04-27T07:33:30.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/769: mkdir d3/d49/d97/d3a/d71/d109 0 2024-04-27T07:33:30.220 INFO:tasks.workunit.client.0.smithi082.stdout:4/897: chown d3/c83 716 1 2024-04-27T07:33:30.220 INFO:tasks.workunit.client.1.smithi100.stdout:0/291: dwrite d1/d8/ff [0,4194304] 0 2024-04-27T07:33:30.223 INFO:tasks.workunit.client.1.smithi100.stdout:3/300: rename d7/d9/d10/c5c to d7/d9/d26/d2a/c66 0 2024-04-27T07:33:30.224 INFO:tasks.workunit.client.0.smithi082.stdout:7/770: rename d3/d49/d97/lbc to d3/d9/dda/l10a 0 2024-04-27T07:33:30.226 INFO:tasks.workunit.client.0.smithi082.stdout:7/771: fdatasync d3/d49/d97/d3a/d2a/f30 0 2024-04-27T07:33:30.227 INFO:tasks.workunit.client.1.smithi100.stdout:6/298: fdatasync de/f10 0 2024-04-27T07:33:30.227 INFO:tasks.workunit.client.1.smithi100.stdout:0/292: mkdir d1/d8/d14/d65 0 2024-04-27T07:33:30.227 INFO:tasks.workunit.client.1.smithi100.stdout:8/238: dread d6/d20/d2a/f37 [0,4194304] 0 2024-04-27T07:33:30.228 INFO:tasks.workunit.client.0.smithi082.stdout:4/898: creat d3/d6/d26/d5e/d11e/d101/f12b x:0 0 0 2024-04-27T07:33:30.228 INFO:tasks.workunit.client.0.smithi082.stdout:1/720: dread d4/d15/d3f/fc9 [0,4194304] 0 2024-04-27T07:33:30.228 INFO:tasks.workunit.client.0.smithi082.stdout:1/721: stat d4/d15/l20 0 2024-04-27T07:33:30.229 INFO:tasks.workunit.client.1.smithi100.stdout:6/299: stat de/d58/d21/f49 0 2024-04-27T07:33:30.230 INFO:tasks.workunit.client.0.smithi082.stdout:7/772: creat d3/f10b x:0 0 0 2024-04-27T07:33:30.231 INFO:tasks.workunit.client.0.smithi082.stdout:1/722: symlink d4/d15/d49/d99/lfc 0 2024-04-27T07:33:30.231 INFO:tasks.workunit.client.1.smithi100.stdout:3/301: creat d7/d9/d26/d45/f67 x:0 0 0 2024-04-27T07:33:30.232 INFO:tasks.workunit.client.0.smithi082.stdout:4/899: mkdir d3/d6/d26/d5e/d12c 0 2024-04-27T07:33:30.232 INFO:tasks.workunit.client.0.smithi082.stdout:6/718: truncate d2/f74 6553082 0 2024-04-27T07:33:30.233 INFO:tasks.workunit.client.1.smithi100.stdout:8/239: unlink f4 0 2024-04-27T07:33:30.233 INFO:tasks.workunit.client.1.smithi100.stdout:3/302: dread - d7/d9/d26/d2a/d5e/f60 zero size 2024-04-27T07:33:30.233 INFO:tasks.workunit.client.0.smithi082.stdout:4/900: truncate d3/d9/f45 4745747 0 2024-04-27T07:33:30.234 INFO:tasks.workunit.client.1.smithi100.stdout:8/240: chown l3 139 1 2024-04-27T07:33:30.234 INFO:tasks.workunit.client.0.smithi082.stdout:7/773: creat d3/d49/f10c x:0 0 0 2024-04-27T07:33:30.235 INFO:tasks.workunit.client.0.smithi082.stdout:4/901: symlink d3/dab/l12d 0 2024-04-27T07:33:30.235 INFO:tasks.workunit.client.1.smithi100.stdout:0/293: chown d1/d38/c46 0 1 2024-04-27T07:33:30.236 INFO:tasks.workunit.client.0.smithi082.stdout:6/719: truncate d2/d2d/d4a/de4/dcc/d13/f21 6715068 0 2024-04-27T07:33:30.239 INFO:tasks.workunit.client.0.smithi082.stdout:6/720: mknod d2/d81/cef 0 2024-04-27T07:33:30.240 INFO:tasks.workunit.client.1.smithi100.stdout:9/252: rename d1/f4 to d1/d9/db/d2b/d31/f5b 0 2024-04-27T07:33:30.245 INFO:tasks.workunit.client.0.smithi082.stdout:6/721: symlink d2/d2e/d55/dd0/lf0 0 2024-04-27T07:33:30.246 INFO:tasks.workunit.client.0.smithi082.stdout:5/856: dwrite d8/d77/fc9 [0,4194304] 0 2024-04-27T07:33:30.247 INFO:tasks.workunit.client.1.smithi100.stdout:1/412: chown d0/d1b/d20/d2d/d35/f72 121 1 2024-04-27T07:33:30.248 INFO:tasks.workunit.client.1.smithi100.stdout:3/303: symlink d7/d9/d10/d3e/l68 0 2024-04-27T07:33:30.249 INFO:tasks.workunit.client.0.smithi082.stdout:7/774: dwrite d3/d49/d97/d3a/f65 [4194304,4194304] 0 2024-04-27T07:33:30.250 INFO:tasks.workunit.client.1.smithi100.stdout:3/304: stat d7/d9/d26/d45 0 2024-04-27T07:33:30.251 INFO:tasks.workunit.client.1.smithi100.stdout:0/294: mkdir d1/d8/d20/d61/d66 0 2024-04-27T07:33:30.251 INFO:tasks.workunit.client.0.smithi082.stdout:1/723: dread d4/d15/d3f/d6d/d93/fe6 [0,4194304] 0 2024-04-27T07:33:30.252 INFO:tasks.workunit.client.0.smithi082.stdout:0/820: sync 2024-04-27T07:33:30.252 INFO:tasks.workunit.client.0.smithi082.stdout:8/720: sync 2024-04-27T07:33:30.253 INFO:tasks.workunit.client.1.smithi100.stdout:0/295: dread - d1/d8/d14/f50 zero size 2024-04-27T07:33:30.253 INFO:tasks.workunit.client.1.smithi100.stdout:5/229: sync 2024-04-27T07:33:30.253 INFO:tasks.workunit.client.1.smithi100.stdout:5/230: fsync d0/d4/f36 0 2024-04-27T07:33:30.256 INFO:tasks.workunit.client.1.smithi100.stdout:5/231: truncate d0/d4/d28/d37/f1b 857303 0 2024-04-27T07:33:30.257 INFO:tasks.workunit.client.1.smithi100.stdout:3/305: creat d7/d9/d2f/f69 x:0 0 0 2024-04-27T07:33:30.258 INFO:tasks.workunit.client.0.smithi082.stdout:7/775: creat d3/d49/d97/d3a/d71/da0/f10d x:0 0 0 2024-04-27T07:33:30.259 INFO:tasks.workunit.client.1.smithi100.stdout:9/253: mkdir d1/d9/db/d56/d5c 0 2024-04-27T07:33:30.261 INFO:tasks.workunit.client.1.smithi100.stdout:2/275: dread d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:30.261 INFO:tasks.workunit.client.0.smithi082.stdout:6/722: dwrite d2/d75/fbe [0,4194304] 0 2024-04-27T07:33:30.261 INFO:tasks.workunit.client.0.smithi082.stdout:4/902: dread d3/d6/d26/d5e/d11e/d101/fb0 [0,4194304] 0 2024-04-27T07:33:30.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/721: creat d0/d2b/d80/dca/de6/d87/d71/fed x:0 0 0 2024-04-27T07:33:30.263 INFO:tasks.workunit.client.1.smithi100.stdout:5/232: truncate d0/d4/f36 284003 0 2024-04-27T07:33:30.263 INFO:tasks.workunit.client.0.smithi082.stdout:0/821: mknod da/d38/d7f/d4a/d80/da0/c12c 0 2024-04-27T07:33:30.264 INFO:tasks.workunit.client.1.smithi100.stdout:2/276: write d0/d1e/f31 [2009131,129151] 0 2024-04-27T07:33:30.264 INFO:tasks.workunit.client.0.smithi082.stdout:1/724: creat d4/d15/d49/dab/dc3/d3e/d46/ffd x:0 0 0 2024-04-27T07:33:30.266 INFO:tasks.workunit.client.0.smithi082.stdout:0/822: stat da/d3c/d3f/c5a 0 2024-04-27T07:33:30.266 INFO:tasks.workunit.client.0.smithi082.stdout:5/857: dread d8/f45 [0,4194304] 0 2024-04-27T07:33:30.268 INFO:tasks.workunit.client.0.smithi082.stdout:5/858: chown d8/d2e/d85/daa/fe1 1803871 1 2024-04-27T07:33:30.270 INFO:tasks.workunit.client.0.smithi082.stdout:7/776: link d3/d49/d97/d3a/d71/da0/fa6 d3/dfb/da1/f10e 0 2024-04-27T07:33:30.275 INFO:tasks.workunit.client.0.smithi082.stdout:8/722: dwrite d0/d2b/d80/dca/de6/d87/d42/f5b [0,4194304] 0 2024-04-27T07:33:30.275 INFO:tasks.workunit.client.0.smithi082.stdout:0/823: symlink da/d38/d7f/d4a/d80/da0/d104/l12d 0 2024-04-27T07:33:30.276 INFO:tasks.workunit.client.0.smithi082.stdout:7/777: creat d3/d49/d97/d6c/f10f x:0 0 0 2024-04-27T07:33:30.277 INFO:tasks.workunit.client.0.smithi082.stdout:8/723: read - d0/d2b/d80/dca/de6/d1c/fb0 zero size 2024-04-27T07:33:30.279 INFO:tasks.workunit.client.0.smithi082.stdout:1/725: rename d4/d15/d3f/d97/dd1/fd5 to d4/d15/d3f/ffe 0 2024-04-27T07:33:30.281 INFO:tasks.workunit.client.0.smithi082.stdout:7/778: creat d3/d49/d97/d3a/d71/da0/ddf/f110 x:0 0 0 2024-04-27T07:33:30.283 INFO:tasks.workunit.client.0.smithi082.stdout:8/724: readlink d0/d2b/d80/dca/de6/d1b/d29/d6a/lb6 0 2024-04-27T07:33:30.285 INFO:tasks.workunit.client.0.smithi082.stdout:7/779: symlink d3/dfb/l111 0 2024-04-27T07:33:30.292 INFO:tasks.workunit.client.0.smithi082.stdout:8/725: dwrite d0/d2b/d80/dca/de6/d1b/d53/fd3 [0,4194304] 0 2024-04-27T07:33:30.292 INFO:tasks.workunit.client.0.smithi082.stdout:5/859: write d8/d29/dea/d5f/df6/dfd/d102/d10e/f96 [2329716,58767] 0 2024-04-27T07:33:30.299 INFO:tasks.workunit.client.0.smithi082.stdout:6/723: dread d2/d3/f6 [0,4194304] 0 2024-04-27T07:33:30.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/726: unlink d0/d2b/d80/dca/de6/d1b/f98 0 2024-04-27T07:33:30.299 INFO:tasks.workunit.client.0.smithi082.stdout:0/824: write da/d2a/fb0 [139809,97307] 0 2024-04-27T07:33:30.299 INFO:tasks.workunit.client.0.smithi082.stdout:6/724: rmdir d2/d1e/d80 39 2024-04-27T07:33:30.300 INFO:tasks.workunit.client.0.smithi082.stdout:4/903: dread d3/d6/d26/d5e/d11e/d101/d69/d85/ff6 [0,4194304] 0 2024-04-27T07:33:30.300 INFO:tasks.workunit.client.0.smithi082.stdout:5/860: mknod d8/d15/dca/dce/df3/c122 0 2024-04-27T07:33:30.303 INFO:tasks.workunit.client.0.smithi082.stdout:6/725: readlink d2/d2e/d55/l7b 0 2024-04-27T07:33:30.303 INFO:tasks.workunit.client.0.smithi082.stdout:1/726: write d4/d15/d49/dab/dc3/d3e/f61 [712334,29738] 0 2024-04-27T07:33:30.304 INFO:tasks.workunit.client.0.smithi082.stdout:5/861: fsync d8/d2e/d85/fcf 0 2024-04-27T07:33:30.304 INFO:tasks.workunit.client.0.smithi082.stdout:7/780: write d3/d49/d97/d3a/d2a/f88 [981782,51973] 0 2024-04-27T07:33:30.307 INFO:tasks.workunit.client.0.smithi082.stdout:0/825: mknod da/d38/d7f/d4a/d80/da0/c12e 0 2024-04-27T07:33:30.309 INFO:tasks.workunit.client.0.smithi082.stdout:7/781: chown d3/db/f5d 841 1 2024-04-27T07:33:30.311 INFO:tasks.workunit.client.0.smithi082.stdout:6/726: mkdir d2/d2e/d6c/df1 0 2024-04-27T07:33:30.314 INFO:tasks.workunit.client.0.smithi082.stdout:1/727: mkdir d4/d15/d49/dab/dc3/d4c/d7a/de7/dff 0 2024-04-27T07:33:30.314 INFO:tasks.workunit.client.0.smithi082.stdout:8/727: dwrite d0/d2b/d80/dca/de6/d87/d71/fed [0,4194304] 0 2024-04-27T07:33:30.314 INFO:tasks.workunit.client.0.smithi082.stdout:0/826: fsync da/d38/d7f/d4a/f6d 0 2024-04-27T07:33:30.316 INFO:tasks.workunit.client.0.smithi082.stdout:0/827: chown da/d1d/f2d 8 1 2024-04-27T07:33:30.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/728: write d4/d15/d29/f7d [4406540,75347] 0 2024-04-27T07:33:30.318 INFO:tasks.workunit.client.0.smithi082.stdout:1/729: chown d4/d15/fd9 2785806 1 2024-04-27T07:33:30.319 INFO:tasks.workunit.client.0.smithi082.stdout:6/727: unlink d2/d2d/f51 0 2024-04-27T07:33:30.321 INFO:tasks.workunit.client.0.smithi082.stdout:7/782: rename d3/d49/d97/d3a/d71/da0/ddf/f110 to d3/d9/d4f/d61/dd0/f112 0 2024-04-27T07:33:30.326 INFO:tasks.workunit.client.0.smithi082.stdout:4/904: dread d3/d10/f15 [0,4194304] 0 2024-04-27T07:33:30.326 INFO:tasks.workunit.client.0.smithi082.stdout:8/728: truncate d0/d2b/d80/dca/de6/d1c/d76/f94 546902 0 2024-04-27T07:33:30.327 INFO:tasks.workunit.client.0.smithi082.stdout:6/728: symlink d2/d2d/d4a/lf2 0 2024-04-27T07:33:30.327 INFO:tasks.workunit.client.0.smithi082.stdout:5/862: dwrite d8/fb5 [0,4194304] 0 2024-04-27T07:33:30.329 INFO:tasks.workunit.client.0.smithi082.stdout:7/783: symlink d3/d9/d7c/l113 0 2024-04-27T07:33:30.331 INFO:tasks.workunit.client.0.smithi082.stdout:7/784: readlink d3/d49/d97/d3a/d71/da0/lc4 0 2024-04-27T07:33:30.333 INFO:tasks.workunit.client.0.smithi082.stdout:4/905: creat d3/dce/f12e x:0 0 0 2024-04-27T07:33:30.336 INFO:tasks.workunit.client.0.smithi082.stdout:6/729: creat d2/d2d/d4a/ff3 x:0 0 0 2024-04-27T07:33:30.340 INFO:tasks.workunit.client.0.smithi082.stdout:7/785: creat d3/d49/d97/d3a/d71/da0/ddf/f114 x:0 0 0 2024-04-27T07:33:30.343 INFO:tasks.workunit.client.0.smithi082.stdout:2/762: sync 2024-04-27T07:33:30.343 INFO:tasks.workunit.client.0.smithi082.stdout:9/677: sync 2024-04-27T07:33:30.344 INFO:tasks.workunit.client.0.smithi082.stdout:6/730: dwrite d2/f8c [0,4194304] 0 2024-04-27T07:33:30.345 INFO:tasks.workunit.client.0.smithi082.stdout:0/828: write da/d38/f6e [3196060,18760] 0 2024-04-27T07:33:30.345 INFO:tasks.workunit.client.1.smithi100.stdout:3/306: symlink d7/d9/d26/d2a/d5e/l6a 0 2024-04-27T07:33:30.347 INFO:tasks.workunit.client.1.smithi100.stdout:8/241: getdents d6 0 2024-04-27T07:33:30.347 INFO:tasks.workunit.client.1.smithi100.stdout:2/277: stat d0/d1e/d51/f59 0 2024-04-27T07:33:30.348 INFO:tasks.workunit.client.1.smithi100.stdout:1/413: dread d0/d1f/d27/f28 [0,4194304] 0 2024-04-27T07:33:30.349 INFO:tasks.workunit.client.0.smithi082.stdout:6/731: write d2/d2e/d55/fe8 [1765436,72382] 0 2024-04-27T07:33:30.350 INFO:tasks.workunit.client.0.smithi082.stdout:1/730: dread d4/d15/d49/dab/dc3/d4c/d7a/fae [0,4194304] 0 2024-04-27T07:33:30.350 INFO:tasks.workunit.client.0.smithi082.stdout:8/729: rename d0/d2b/d80/dca/de6/d1b/fa6 to d0/d2b/d80/dca/de6/d87/fee 0 2024-04-27T07:33:30.350 INFO:tasks.workunit.client.1.smithi100.stdout:6/300: dread de/d58/d21/d24/f46 [0,4194304] 0 2024-04-27T07:33:30.351 INFO:tasks.workunit.client.1.smithi100.stdout:3/307: unlink d7/d9/d2f/f62 0 2024-04-27T07:33:30.352 INFO:tasks.workunit.client.0.smithi082.stdout:5/863: dread d8/d15/f58 [0,4194304] 0 2024-04-27T07:33:30.352 INFO:tasks.workunit.client.1.smithi100.stdout:8/242: mkdir d6/d4c 0 2024-04-27T07:33:30.353 INFO:tasks.workunit.client.0.smithi082.stdout:5/864: chown d8/d2e/d85/fcf 403186 1 2024-04-27T07:33:30.354 INFO:tasks.workunit.client.0.smithi082.stdout:0/829: write da/d28/d36/f65 [2886082,57927] 0 2024-04-27T07:33:30.354 INFO:tasks.workunit.client.1.smithi100.stdout:8/243: dread d6/d1b/f2d [0,4194304] 0 2024-04-27T07:33:30.354 INFO:tasks.workunit.client.1.smithi100.stdout:9/254: link d1/d9/f1b d1/d9/d1f/d52/f5d 0 2024-04-27T07:33:30.355 INFO:tasks.workunit.client.0.smithi082.stdout:9/678: write d9/d2d/d2b/d46/d76/dcb/fdc [1152870,4802] 0 2024-04-27T07:33:30.356 INFO:tasks.workunit.client.0.smithi082.stdout:5/865: stat d8/d15/de0/ff5 0 2024-04-27T07:33:30.357 INFO:tasks.workunit.client.1.smithi100.stdout:6/301: creat de/d2e/d3f/f6d x:0 0 0 2024-04-27T07:33:30.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/732: unlink d2/d1e/fe1 0 2024-04-27T07:33:30.359 INFO:tasks.workunit.client.1.smithi100.stdout:6/302: write de/d58/d28/f59 [1023096,86813] 0 2024-04-27T07:33:30.359 INFO:tasks.workunit.client.1.smithi100.stdout:3/308: creat d7/d9/d10/d3e/f6b x:0 0 0 2024-04-27T07:33:30.361 INFO:tasks.workunit.client.1.smithi100.stdout:3/309: truncate d7/d9/d10/d3e/f6b 57490 0 2024-04-27T07:33:30.363 INFO:tasks.workunit.client.0.smithi082.stdout:7/786: rename d3/d49/d97/d3a/d71/f7a to d3/db1/f115 0 2024-04-27T07:33:30.363 INFO:tasks.workunit.client.0.smithi082.stdout:9/679: fdatasync d9/d2d/d2b/d46/d76/dcb/fdc 0 2024-04-27T07:33:30.363 INFO:tasks.workunit.client.0.smithi082.stdout:6/733: chown d2/d3/fd 2182 1 2024-04-27T07:33:30.364 INFO:tasks.workunit.client.0.smithi082.stdout:8/730: creat d0/d2b/d80/dca/de6/d1b/d29/fef x:0 0 0 2024-04-27T07:33:30.365 INFO:tasks.workunit.client.1.smithi100.stdout:5/233: getdents d0/d4/d21 0 2024-04-27T07:33:30.365 INFO:tasks.workunit.client.1.smithi100.stdout:5/234: chown d0/d4 496933329 1 2024-04-27T07:33:30.369 INFO:tasks.workunit.client.0.smithi082.stdout:4/906: dwrite d3/d6/d26/d5e/d11e/d101/f59 [0,4194304] 0 2024-04-27T07:33:30.370 INFO:tasks.workunit.client.1.smithi100.stdout:2/278: rename d0/da/d29/l54 to d0/da/d29/d26/d3e/l61 0 2024-04-27T07:33:30.372 INFO:tasks.workunit.client.1.smithi100.stdout:2/279: write d0/d1e/f57 [4173337,1221] 0 2024-04-27T07:33:30.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/830: dwrite da/d3c/dc7/ffd [0,4194304] 0 2024-04-27T07:33:30.374 INFO:tasks.workunit.client.0.smithi082.stdout:6/734: symlink d2/d3/da8/lf4 0 2024-04-27T07:33:30.375 INFO:tasks.workunit.client.0.smithi082.stdout:9/680: unlink d9/d2d/d2b/d46/d5d/d6f/c45 0 2024-04-27T07:33:30.377 INFO:tasks.workunit.client.0.smithi082.stdout:5/866: dwrite d8/d15/d65/dc7/f118 [0,4194304] 0 2024-04-27T07:33:30.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/731: getdents d4/d15/d29 0 2024-04-27T07:33:30.379 INFO:tasks.workunit.client.1.smithi100.stdout:1/414: truncate d0/d1b/f33 373266 0 2024-04-27T07:33:30.381 INFO:tasks.workunit.client.1.smithi100.stdout:3/310: getdents d7/d9/d10/d28/d2c/d64 0 2024-04-27T07:33:30.381 INFO:tasks.workunit.client.1.smithi100.stdout:1/415: chown d0/d1f/d27/d6c 0 1 2024-04-27T07:33:30.381 INFO:tasks.workunit.client.0.smithi082.stdout:8/731: rmdir d0/d2b/d80/dca/de6/d1c 39 2024-04-27T07:33:30.383 INFO:tasks.workunit.client.1.smithi100.stdout:2/280: chown d0/da/d29/d26/c21 124991 1 2024-04-27T07:33:30.383 INFO:tasks.workunit.client.1.smithi100.stdout:8/244: dwrite d6/f31 [0,4194304] 0 2024-04-27T07:33:30.384 INFO:tasks.workunit.client.1.smithi100.stdout:9/255: getdents d1/d9/db/d2b 0 2024-04-27T07:33:30.385 INFO:tasks.workunit.client.0.smithi082.stdout:2/763: dwrite d7/d9/d4f/d66/f7c [0,4194304] 0 2024-04-27T07:33:30.386 INFO:tasks.workunit.client.1.smithi100.stdout:1/416: chown d0/d1b/d20/d2d/f2e 81 1 2024-04-27T07:33:30.387 INFO:tasks.workunit.client.0.smithi082.stdout:0/831: dread - da/d38/d7f/d4a/d80/da0/dd5/ddf/ff0 zero size 2024-04-27T07:33:30.388 INFO:tasks.workunit.client.0.smithi082.stdout:8/732: dread - d0/d83/fc4 zero size 2024-04-27T07:33:30.388 INFO:tasks.workunit.client.1.smithi100.stdout:9/256: readlink d1/d9/l48 0 2024-04-27T07:33:30.391 INFO:tasks.workunit.client.0.smithi082.stdout:7/787: dwrite d3/d49/d97/f1b [4194304,4194304] 0 2024-04-27T07:33:30.391 INFO:tasks.workunit.client.1.smithi100.stdout:1/417: chown d0/d1f/d27/d40/c78 1613942 1 2024-04-27T07:33:30.391 INFO:tasks.workunit.client.1.smithi100.stdout:9/257: stat d1/d9/l38 0 2024-04-27T07:33:30.391 INFO:tasks.workunit.client.1.smithi100.stdout:8/245: rmdir d6/d1b 39 2024-04-27T07:33:30.393 INFO:tasks.workunit.client.1.smithi100.stdout:6/303: dwrite de/d58/d21/f26 [0,4194304] 0 2024-04-27T07:33:30.395 INFO:tasks.workunit.client.1.smithi100.stdout:3/311: mkdir d7/d9/d26/d6c 0 2024-04-27T07:33:30.395 INFO:tasks.workunit.client.0.smithi082.stdout:5/867: rename d8/d98 to d8/d42/d123 0 2024-04-27T07:33:30.396 INFO:tasks.workunit.client.0.smithi082.stdout:1/732: creat d4/d15/d49/d99/d9a/dc7/df9/f100 x:0 0 0 2024-04-27T07:33:30.398 INFO:tasks.workunit.client.0.smithi082.stdout:9/681: write d9/da/dc/d35/d38/fab [248134,46464] 0 2024-04-27T07:33:30.398 INFO:tasks.workunit.client.0.smithi082.stdout:2/764: mkdir d7/d9/d4f/d6e/d82/dc6/dfc 0 2024-04-27T07:33:30.398 INFO:tasks.workunit.client.1.smithi100.stdout:3/312: truncate d7/d9/d2f/f5d 1414386 0 2024-04-27T07:33:30.401 INFO:tasks.workunit.client.0.smithi082.stdout:1/733: write d4/f12 [1007019,70171] 0 2024-04-27T07:33:30.401 INFO:tasks.workunit.client.0.smithi082.stdout:9/682: readlink d9/da/dc/d35/d4b/l8d 0 2024-04-27T07:33:30.402 INFO:tasks.workunit.client.0.smithi082.stdout:0/832: unlink da/d38/d7f/d4a/d80/da0/dd5/ce8 0 2024-04-27T07:33:30.402 INFO:tasks.workunit.client.1.smithi100.stdout:9/258: unlink d1/d9/db/ff 0 2024-04-27T07:33:30.402 INFO:tasks.workunit.client.1.smithi100.stdout:8/246: chown d6/d1b/l1f 11 1 2024-04-27T07:33:30.402 INFO:tasks.workunit.client.1.smithi100.stdout:5/235: dread d0/f10 [0,4194304] 0 2024-04-27T07:33:30.405 INFO:tasks.workunit.client.1.smithi100.stdout:8/247: mknod d6/d1b/d1d/c4d 0 2024-04-27T07:33:30.406 INFO:tasks.workunit.client.0.smithi082.stdout:2/765: creat d7/d8/d99/dc8/df1/ffd x:0 0 0 2024-04-27T07:33:30.407 INFO:tasks.workunit.client.1.smithi100.stdout:8/248: stat d6/f35 0 2024-04-27T07:33:30.407 INFO:tasks.workunit.client.0.smithi082.stdout:1/734: dread d4/d15/d49/dab/dc3/d3e/d57/da5/fbb [0,4194304] 0 2024-04-27T07:33:30.408 INFO:tasks.workunit.client.1.smithi100.stdout:8/249: dread - d6/f18 zero size 2024-04-27T07:33:30.409 INFO:tasks.workunit.client.1.smithi100.stdout:1/418: link d0/d23/d3a/f59 d0/d1b/d20/d2d/d35/f7f 0 2024-04-27T07:33:30.410 INFO:tasks.workunit.client.1.smithi100.stdout:3/313: symlink d7/d9/d26/d2a/l6d 0 2024-04-27T07:33:30.410 INFO:tasks.workunit.client.0.smithi082.stdout:7/788: dwrite d3/d9/d4f/d9a/fea [0,4194304] 0 2024-04-27T07:33:30.411 INFO:tasks.workunit.client.1.smithi100.stdout:5/236: write d0/d4/fc [3933927,11523] 0 2024-04-27T07:33:30.412 INFO:tasks.workunit.client.1.smithi100.stdout:9/259: mknod d1/d9/db/d2b/d4f/c5e 0 2024-04-27T07:33:30.414 INFO:tasks.workunit.client.0.smithi082.stdout:9/683: mknod d9/da/ce3 0 2024-04-27T07:33:30.415 INFO:tasks.workunit.client.1.smithi100.stdout:1/419: creat d0/d1b/d20/d2d/d35/f80 x:0 0 0 2024-04-27T07:33:30.415 INFO:tasks.workunit.client.1.smithi100.stdout:8/250: symlink d6/d1b/l4e 0 2024-04-27T07:33:30.415 INFO:tasks.workunit.client.0.smithi082.stdout:5/868: dwrite d8/d2e/d85/daa/f105 [0,4194304] 0 2024-04-27T07:33:30.418 INFO:tasks.workunit.client.0.smithi082.stdout:8/733: getdents d0/d2b/d80/dca/de6/d1b/d29/d65 0 2024-04-27T07:33:30.418 INFO:tasks.workunit.client.0.smithi082.stdout:1/735: truncate d4/d15/f37 3107904 0 2024-04-27T07:33:30.419 INFO:tasks.workunit.client.1.smithi100.stdout:6/304: link de/d58/d28/c68 de/d58/d21/d5b/c6e 0 2024-04-27T07:33:30.419 INFO:tasks.workunit.client.1.smithi100.stdout:8/251: chown d6/d1b/d1d/c3d 380946 1 2024-04-27T07:33:30.423 INFO:tasks.workunit.client.1.smithi100.stdout:5/237: rename d0/d4/d28/d37/f1c to d0/d4/d28/d37/d1a/f4d 0 2024-04-27T07:33:30.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/869: readlink d8/d14/l62 0 2024-04-27T07:33:30.425 INFO:tasks.workunit.client.0.smithi082.stdout:1/736: read d4/d15/d1c/fdf [1233668,76450] 0 2024-04-27T07:33:30.426 INFO:tasks.workunit.client.0.smithi082.stdout:2/766: dwrite d7/d9/d4f/d6e/fca [0,4194304] 0 2024-04-27T07:33:30.428 INFO:tasks.workunit.client.1.smithi100.stdout:3/314: rmdir d7/d9/d10/d28/d2c/d64 0 2024-04-27T07:33:30.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/684: getdents d9/da/db0 0 2024-04-27T07:33:30.430 INFO:tasks.workunit.client.1.smithi100.stdout:6/305: creat de/d58/d21/d5b/f6f x:0 0 0 2024-04-27T07:33:30.430 INFO:tasks.workunit.client.1.smithi100.stdout:8/252: mkdir d6/d1b/d1d/d47/d4f 0 2024-04-27T07:33:30.431 INFO:tasks.workunit.client.1.smithi100.stdout:1/420: dwrite d0/d1b/d20/d2d/f52 [0,4194304] 0 2024-04-27T07:33:30.435 INFO:tasks.workunit.client.0.smithi082.stdout:7/789: dwrite d3/d9/dda/fdb [0,4194304] 0 2024-04-27T07:33:30.435 INFO:tasks.workunit.client.1.smithi100.stdout:8/253: mkdir d6/d20/d50 0 2024-04-27T07:33:30.437 INFO:tasks.workunit.client.1.smithi100.stdout:1/421: symlink d0/d1f/d27/l81 0 2024-04-27T07:33:30.439 INFO:tasks.workunit.client.1.smithi100.stdout:6/306: mknod de/d58/d21/d5b/c70 0 2024-04-27T07:33:30.439 INFO:tasks.workunit.client.0.smithi082.stdout:2/767: getdents d7/d31 0 2024-04-27T07:33:30.439 INFO:tasks.workunit.client.0.smithi082.stdout:5/870: dwrite d8/d15/f13 [4194304,4194304] 0 2024-04-27T07:33:30.442 INFO:tasks.workunit.client.1.smithi100.stdout:8/254: rename d6/d1b/f38 to d6/d1b/d1d/d47/f51 0 2024-04-27T07:33:30.444 INFO:tasks.workunit.client.1.smithi100.stdout:6/307: creat de/d58/f71 x:0 0 0 2024-04-27T07:33:30.444 INFO:tasks.workunit.client.0.smithi082.stdout:2/768: mknod d7/d31/cfe 0 2024-04-27T07:33:30.445 INFO:tasks.workunit.client.1.smithi100.stdout:8/255: chown d6/d1b/f22 2 1 2024-04-27T07:33:30.445 INFO:tasks.workunit.client.0.smithi082.stdout:5/871: creat d8/d42/d123/f124 x:0 0 0 2024-04-27T07:33:30.447 INFO:tasks.workunit.client.1.smithi100.stdout:6/308: chown de/d58/d21/d23/f4b 1 1 2024-04-27T07:33:30.448 INFO:tasks.workunit.client.1.smithi100.stdout:1/422: dwrite d0/d1b/d20/d2d/d35/f72 [0,4194304] 0 2024-04-27T07:33:30.449 INFO:tasks.workunit.client.0.smithi082.stdout:7/790: link d3/d49/d97/l1c d3/d49/d97/d3a/d2a/dac/dae/dce/l116 0 2024-04-27T07:33:30.451 INFO:tasks.workunit.client.1.smithi100.stdout:1/423: stat d0/d1f/d27/d40/l7d 0 2024-04-27T07:33:30.452 INFO:tasks.workunit.client.1.smithi100.stdout:6/309: symlink de/d2e/d3f/l72 0 2024-04-27T07:33:30.452 INFO:tasks.workunit.client.1.smithi100.stdout:8/256: truncate d6/f17 3304715 0 2024-04-27T07:33:30.454 INFO:tasks.workunit.client.0.smithi082.stdout:5/872: rmdir d8/d3c/d4a/d112 0 2024-04-27T07:33:30.455 INFO:tasks.workunit.client.1.smithi100.stdout:3/315: dread d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:30.455 INFO:tasks.workunit.client.1.smithi100.stdout:1/424: mknod d0/d1f/d27/d40/d61/c82 0 2024-04-27T07:33:30.455 INFO:tasks.workunit.client.0.smithi082.stdout:7/791: truncate d3/dfb/da1/fbd 4188513 0 2024-04-27T07:33:30.457 INFO:tasks.workunit.client.0.smithi082.stdout:7/792: readlink d3/db/l16 0 2024-04-27T07:33:30.457 INFO:tasks.workunit.client.1.smithi100.stdout:9/260: dread d1/d9/db/d2b/d31/f5b [0,4194304] 0 2024-04-27T07:33:30.458 INFO:tasks.workunit.client.0.smithi082.stdout:4/907: dwrite d3/d9/f8b [0,4194304] 0 2024-04-27T07:33:30.459 INFO:tasks.workunit.client.0.smithi082.stdout:6/735: dread d2/d2d/d4a/de4/dcc/d13/f16 [0,4194304] 0 2024-04-27T07:33:30.460 INFO:tasks.workunit.client.1.smithi100.stdout:8/257: link d6/f45 d6/d20/d50/f52 0 2024-04-27T07:33:30.460 INFO:tasks.workunit.client.0.smithi082.stdout:5/873: symlink d8/d29/d4e/d90/l125 0 2024-04-27T07:33:30.461 INFO:tasks.workunit.client.1.smithi100.stdout:8/258: stat d6/d20/d50 0 2024-04-27T07:33:30.461 INFO:tasks.workunit.client.1.smithi100.stdout:3/316: write d7/f1f [49511,127986] 0 2024-04-27T07:33:30.462 INFO:tasks.workunit.client.1.smithi100.stdout:8/259: truncate d6/d20/f33 882457 0 2024-04-27T07:33:30.462 INFO:tasks.workunit.client.0.smithi082.stdout:5/874: write d8/fb5 [2151760,10841] 0 2024-04-27T07:33:30.463 INFO:tasks.workunit.client.1.smithi100.stdout:1/425: creat d0/d1b/d20/d2d/f83 x:0 0 0 2024-04-27T07:33:30.463 INFO:tasks.workunit.client.1.smithi100.stdout:8/260: read d6/d20/f33 [778969,85421] 0 2024-04-27T07:33:30.464 INFO:tasks.workunit.client.0.smithi082.stdout:7/793: write d3/d49/d97/d3a/d71/fcc [736101,83843] 0 2024-04-27T07:33:30.465 INFO:tasks.workunit.client.1.smithi100.stdout:8/261: chown d6/d1b/f42 597932 1 2024-04-27T07:33:30.465 INFO:tasks.workunit.client.1.smithi100.stdout:1/426: dread - d0/d1f/d27/d40/f70 zero size 2024-04-27T07:33:30.466 INFO:tasks.workunit.client.1.smithi100.stdout:9/261: creat d1/d9/d1f/d52/d54/f5f x:0 0 0 2024-04-27T07:33:30.468 INFO:tasks.workunit.client.1.smithi100.stdout:3/317: rename d7/d9/d26/d2a/f3f to d7/d9/d26/d2a/d5e/f6e 0 2024-04-27T07:33:30.469 INFO:tasks.workunit.client.0.smithi082.stdout:6/736: mkdir d2/d1e/d80/df5 0 2024-04-27T07:33:30.469 INFO:tasks.workunit.client.0.smithi082.stdout:5/875: read - d8/d29/dea/d5f/fa4 zero size 2024-04-27T07:33:30.470 INFO:tasks.workunit.client.1.smithi100.stdout:3/318: write d7/d9/d10/f3d [2239860,55074] 0 2024-04-27T07:33:30.470 INFO:tasks.workunit.client.1.smithi100.stdout:9/262: creat d1/d9/db/d2b/d4f/d57/f60 x:0 0 0 2024-04-27T07:33:30.471 INFO:tasks.workunit.client.0.smithi082.stdout:4/908: link d3/d10/f15 d3/dab/f12f 0 2024-04-27T07:33:30.472 INFO:tasks.workunit.client.1.smithi100.stdout:1/427: mknod d0/d1b/d20/c84 0 2024-04-27T07:33:30.473 INFO:tasks.workunit.client.1.smithi100.stdout:5/238: dread d0/d4/f11 [0,4194304] 0 2024-04-27T07:33:30.474 INFO:tasks.workunit.client.1.smithi100.stdout:2/281: write d0/f7 [1040549,54010] 0 2024-04-27T07:33:30.475 INFO:tasks.workunit.client.0.smithi082.stdout:4/909: write d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f7c [1008533,5179] 0 2024-04-27T07:33:30.476 INFO:tasks.workunit.client.1.smithi100.stdout:5/239: readlink d0/d4/d28/d37/l3c 0 2024-04-27T07:33:30.476 INFO:tasks.workunit.client.1.smithi100.stdout:1/428: readlink d0/d1b/d20/l32 0 2024-04-27T07:33:30.476 INFO:tasks.workunit.client.0.smithi082.stdout:7/794: getdents d3/d49/d97/d3a/d2a/dac/d91/d102 0 2024-04-27T07:33:30.477 INFO:tasks.workunit.client.1.smithi100.stdout:9/263: mkdir d1/d9/d1f/d52/d54/d61 0 2024-04-27T07:33:30.477 INFO:tasks.workunit.client.1.smithi100.stdout:3/319: chown d7/d9/d10/d33/f41 5 1 2024-04-27T07:33:30.479 INFO:tasks.workunit.client.1.smithi100.stdout:2/282: symlink d0/da/l62 0 2024-04-27T07:33:30.479 INFO:tasks.workunit.client.0.smithi082.stdout:4/910: dread d3/d6/d26/d5e/d11e/d101/fb0 [0,4194304] 0 2024-04-27T07:33:30.481 INFO:tasks.workunit.client.0.smithi082.stdout:7/795: creat d3/db1/f117 x:0 0 0 2024-04-27T07:33:30.483 INFO:tasks.workunit.client.1.smithi100.stdout:5/240: rename d0/f9 to d0/d4/d28/d37/d1a/f4e 0 2024-04-27T07:33:30.485 INFO:tasks.workunit.client.1.smithi100.stdout:1/429: creat d0/f85 x:0 0 0 2024-04-27T07:33:30.485 INFO:tasks.workunit.client.0.smithi082.stdout:4/911: mkdir d3/d6/dcf/d110/d130 0 2024-04-27T07:33:30.486 INFO:tasks.workunit.client.0.smithi082.stdout:8/734: dread d0/d2b/d80/dca/de6/d1b/d29/d65/f7c [0,4194304] 0 2024-04-27T07:33:30.487 INFO:tasks.workunit.client.1.smithi100.stdout:4/335: sync 2024-04-27T07:33:30.488 INFO:tasks.workunit.client.1.smithi100.stdout:3/320: dwrite d7/d9/d26/d2a/d5e/f6e [0,4194304] 0 2024-04-27T07:33:30.489 INFO:tasks.workunit.client.0.smithi082.stdout:7/796: dwrite d3/d9/f37 [4194304,4194304] 0 2024-04-27T07:33:30.491 INFO:tasks.workunit.client.1.smithi100.stdout:3/321: readlink d7/d9/d26/d2a/d5e/l4d 0 2024-04-27T07:33:30.493 INFO:tasks.workunit.client.0.smithi082.stdout:8/735: write d0/d2b/d80/dca/de6/d1c/fb0 [867098,105219] 0 2024-04-27T07:33:30.494 INFO:tasks.workunit.client.1.smithi100.stdout:2/283: dwrite d0/da/d29/d26/f2a [0,4194304] 0 2024-04-27T07:33:30.495 INFO:tasks.workunit.client.0.smithi082.stdout:7/797: write d3/d49/d97/f2f [2798326,115517] 0 2024-04-27T07:33:30.495 INFO:tasks.workunit.client.0.smithi082.stdout:0/833: dwrite da/d1d/f25 [0,4194304] 0 2024-04-27T07:33:30.496 INFO:tasks.workunit.client.1.smithi100.stdout:4/336: getdents d5/d16/d19/d21/d6d 0 2024-04-27T07:33:30.502 INFO:tasks.workunit.client.1.smithi100.stdout:4/337: write d5/d1b/d2c/f64 [860331,119533] 0 2024-04-27T07:33:30.502 INFO:tasks.workunit.client.1.smithi100.stdout:2/284: creat d0/d1e/d51/f63 x:0 0 0 2024-04-27T07:33:30.502 INFO:tasks.workunit.client.1.smithi100.stdout:4/338: chown d5/d16/d17/l6b 64562 1 2024-04-27T07:33:30.503 INFO:tasks.workunit.client.0.smithi082.stdout:0/834: chown da/d38/f11e 73390 1 2024-04-27T07:33:30.503 INFO:tasks.workunit.client.0.smithi082.stdout:4/912: dwrite d3/d6/d26/d55/d67/f115 [0,4194304] 0 2024-04-27T07:33:30.504 INFO:tasks.workunit.client.1.smithi100.stdout:4/339: chown d5/d1b/d2c/d50 2381096 1 2024-04-27T07:33:30.504 INFO:tasks.workunit.client.0.smithi082.stdout:7/798: write d3/d49/d97/d3a/f92 [272392,84393] 0 2024-04-27T07:33:30.507 INFO:tasks.workunit.client.1.smithi100.stdout:3/322: dwrite d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:30.507 INFO:tasks.workunit.client.1.smithi100.stdout:7/234: sync 2024-04-27T07:33:30.507 INFO:tasks.workunit.client.1.smithi100.stdout:0/296: sync 2024-04-27T07:33:30.508 INFO:tasks.workunit.client.0.smithi082.stdout:8/736: creat d0/d2b/d80/dca/de6/ff0 x:0 0 0 2024-04-27T07:33:30.508 INFO:tasks.workunit.client.1.smithi100.stdout:1/430: rmdir d0/d23 39 2024-04-27T07:33:30.509 INFO:tasks.workunit.client.0.smithi082.stdout:8/737: chown d0/d2b/d9a/da4/laf 109965497 1 2024-04-27T07:33:30.510 INFO:tasks.workunit.client.0.smithi082.stdout:7/799: dread d3/d49/d97/d3a/f38 [0,4194304] 0 2024-04-27T07:33:30.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/913: dwrite d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f7c [0,4194304] 0 2024-04-27T07:33:30.513 INFO:tasks.workunit.client.0.smithi082.stdout:7/800: truncate d3/d49/d97/d3a/d71/fe6 384611 0 2024-04-27T07:33:30.515 INFO:tasks.workunit.client.0.smithi082.stdout:4/914: write d3/d6/d26/d5e/d11e/d101/d69/d85/ff6 [956599,81462] 0 2024-04-27T07:33:30.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/915: chown d3/d9/f45 3348008 1 2024-04-27T07:33:30.517 INFO:tasks.workunit.client.0.smithi082.stdout:4/916: write d3/d6/d26/d55/d67/fd4 [956354,124254] 0 2024-04-27T07:33:30.519 INFO:tasks.workunit.client.0.smithi082.stdout:4/917: readlink d3/d6/d26/d5e/d11e/d101/d69/l99 0 2024-04-27T07:33:30.520 INFO:tasks.workunit.client.1.smithi100.stdout:0/297: chown d1/l35 988 1 2024-04-27T07:33:30.520 INFO:tasks.workunit.client.1.smithi100.stdout:3/323: mknod d7/d9/d10/d22/c6f 0 2024-04-27T07:33:30.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/737: dread d4/d15/d49/dab/dc3/d3e/d46/f50 [0,4194304] 0 2024-04-27T07:33:30.525 INFO:tasks.workunit.client.1.smithi100.stdout:7/235: unlink d1/dd/l19 0 2024-04-27T07:33:30.526 INFO:tasks.workunit.client.0.smithi082.stdout:1/738: unlink d4/d15/d3f/lb5 0 2024-04-27T07:33:30.527 INFO:tasks.workunit.client.1.smithi100.stdout:0/298: dwrite d1/f55 [0,4194304] 0 2024-04-27T07:33:30.530 INFO:tasks.workunit.client.1.smithi100.stdout:4/340: rename d5/d1b/d2c/d50/f6a to d5/d16/d19/f73 0 2024-04-27T07:33:30.532 INFO:tasks.workunit.client.1.smithi100.stdout:3/324: mknod d7/d9/d10/d3e/c70 0 2024-04-27T07:33:30.534 INFO:tasks.workunit.client.1.smithi100.stdout:1/431: write d0/d1b/f2f [2978830,106055] 0 2024-04-27T07:33:30.537 INFO:tasks.workunit.client.1.smithi100.stdout:3/325: write d7/d9/d10/f29 [1266505,89057] 0 2024-04-27T07:33:30.540 INFO:tasks.workunit.client.1.smithi100.stdout:0/299: dwrite d1/d8/d20/d61/f63 [0,4194304] 0 2024-04-27T07:33:30.540 INFO:tasks.workunit.client.1.smithi100.stdout:3/326: chown d7/d9/d2f/l53 623 1 2024-04-27T07:33:30.540 INFO:tasks.workunit.client.1.smithi100.stdout:7/236: write d1/dd/d2a/d2c/f2e [940648,103027] 0 2024-04-27T07:33:30.542 INFO:tasks.workunit.client.1.smithi100.stdout:4/341: symlink d5/d16/d2e/l74 0 2024-04-27T07:33:30.543 INFO:tasks.workunit.client.1.smithi100.stdout:4/342: stat d5/d16/d2e/l40 0 2024-04-27T07:33:30.544 INFO:tasks.workunit.client.1.smithi100.stdout:6/310: getdents de/d2e/d3f 0 2024-04-27T07:33:30.545 INFO:tasks.workunit.client.1.smithi100.stdout:6/311: write de/d2e/d3f/f43 [6694501,91734] 0 2024-04-27T07:33:30.547 INFO:tasks.workunit.client.1.smithi100.stdout:6/312: chown de/d58/d21/d5b/c70 8042865 1 2024-04-27T07:33:30.549 INFO:tasks.workunit.client.1.smithi100.stdout:2/285: link d0/da/d29/d47/d5a/c5c d0/da/d29/d26/d5d/c64 0 2024-04-27T07:33:30.550 INFO:tasks.workunit.client.1.smithi100.stdout:2/286: write d0/da/f28 [4479332,19910] 0 2024-04-27T07:33:30.550 INFO:tasks.workunit.client.1.smithi100.stdout:1/432: symlink d0/d1b/d20/d2d/d35/d65/l86 0 2024-04-27T07:33:30.552 INFO:tasks.workunit.client.1.smithi100.stdout:7/237: creat d1/dd/d2a/d2c/f43 x:0 0 0 2024-04-27T07:33:30.553 INFO:tasks.workunit.client.1.smithi100.stdout:7/238: stat d1/dd/d16/f26 0 2024-04-27T07:33:30.555 INFO:tasks.workunit.client.1.smithi100.stdout:3/327: symlink d7/d9/d10/d3e/l71 0 2024-04-27T07:33:30.556 INFO:tasks.workunit.client.0.smithi082.stdout:7/801: dread d3/d49/d97/d3a/d2a/f3f [0,4194304] 0 2024-04-27T07:33:30.556 INFO:tasks.workunit.client.1.smithi100.stdout:3/328: write d7/d9/d10/d33/f4e [625439,48470] 0 2024-04-27T07:33:30.557 INFO:tasks.workunit.client.1.smithi100.stdout:6/313: mkdir de/d58/d21/d23/d73 0 2024-04-27T07:33:30.557 INFO:tasks.workunit.client.1.smithi100.stdout:3/329: chown d7/d9/c1a 0 1 2024-04-27T07:33:30.558 INFO:tasks.workunit.client.0.smithi082.stdout:7/802: unlink d3/f8 0 2024-04-27T07:33:30.560 INFO:tasks.workunit.client.1.smithi100.stdout:2/287: creat d0/d1e/d51/f65 x:0 0 0 2024-04-27T07:33:30.563 INFO:tasks.workunit.client.1.smithi100.stdout:6/314: mknod de/c74 0 2024-04-27T07:33:30.565 INFO:tasks.workunit.client.1.smithi100.stdout:3/330: dwrite d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:30.569 INFO:tasks.workunit.client.1.smithi100.stdout:9/264: truncate d1/f29 52709 0 2024-04-27T07:33:30.569 INFO:tasks.workunit.client.1.smithi100.stdout:2/288: stat d0/da/l1f 0 2024-04-27T07:33:30.571 INFO:tasks.workunit.client.1.smithi100.stdout:7/239: mknod d1/dd/d16/c44 0 2024-04-27T07:33:30.573 INFO:tasks.workunit.client.1.smithi100.stdout:4/343: dread d5/f15 [0,4194304] 0 2024-04-27T07:33:30.574 INFO:tasks.workunit.client.1.smithi100.stdout:0/300: rename d1/d8/d14/c1d to d1/d8/d20/c67 0 2024-04-27T07:33:30.575 INFO:tasks.workunit.client.1.smithi100.stdout:0/301: truncate d1/f55 4793218 0 2024-04-27T07:33:30.576 INFO:tasks.workunit.client.1.smithi100.stdout:0/302: chown d1/d8/d20/d61/d66 15236 1 2024-04-27T07:33:30.576 INFO:tasks.workunit.client.1.smithi100.stdout:6/315: mkdir de/d58/d75 0 2024-04-27T07:33:30.577 INFO:tasks.workunit.client.1.smithi100.stdout:3/331: fsync d7/f1c 0 2024-04-27T07:33:30.578 INFO:tasks.workunit.client.1.smithi100.stdout:5/241: truncate d0/d4/f1e 3003469 0 2024-04-27T07:33:30.578 INFO:tasks.workunit.client.1.smithi100.stdout:3/332: stat d7/d9/d26/d6c 0 2024-04-27T07:33:30.580 INFO:tasks.workunit.client.1.smithi100.stdout:9/265: creat d1/d9/db/d2b/d4f/f62 x:0 0 0 2024-04-27T07:33:30.580 INFO:tasks.workunit.client.1.smithi100.stdout:0/303: truncate d1/d8/d14/f50 952951 0 2024-04-27T07:33:30.582 INFO:tasks.workunit.client.1.smithi100.stdout:0/304: readlink d1/d30/l31 0 2024-04-27T07:33:30.583 INFO:tasks.workunit.client.1.smithi100.stdout:5/242: write d0/d4/d28/d37/d1a/f20 [1760062,85155] 0 2024-04-27T07:33:30.584 INFO:tasks.workunit.client.1.smithi100.stdout:4/344: mknod d5/d16/d19/d21/c75 0 2024-04-27T07:33:30.589 INFO:tasks.workunit.client.1.smithi100.stdout:1/433: creat d0/d1f/d27/f87 x:0 0 0 2024-04-27T07:33:30.590 INFO:tasks.workunit.client.1.smithi100.stdout:6/316: dwrite de/d2e/d3f/f6d [0,4194304] 0 2024-04-27T07:33:30.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:30 smithi082 ceph-mon[26613]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 196 MiB/s wr, 393 op/s 2024-04-27T07:33:30.593 INFO:tasks.workunit.client.1.smithi100.stdout:7/240: getdents d1/dd/d16/d31 0 2024-04-27T07:33:30.593 INFO:tasks.workunit.client.1.smithi100.stdout:1/434: fdatasync d0/d1b/f62 0 2024-04-27T07:33:30.595 INFO:tasks.workunit.client.1.smithi100.stdout:0/305: mknod d1/d30/c68 0 2024-04-27T07:33:30.596 INFO:tasks.workunit.client.0.smithi082.stdout:9/685: write d9/f94 [1321813,128376] 0 2024-04-27T07:33:30.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/686: chown d9/d2d/d72/cba 3627027 1 2024-04-27T07:33:30.599 INFO:tasks.workunit.client.1.smithi100.stdout:7/241: read d1/f21 [2943618,24765] 0 2024-04-27T07:33:30.599 INFO:tasks.workunit.client.1.smithi100.stdout:5/243: dread d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:30.602 INFO:tasks.workunit.client.0.smithi082.stdout:9/687: creat d9/da/dc/d35/d38/dc5/fe4 x:0 0 0 2024-04-27T07:33:30.603 INFO:tasks.workunit.client.1.smithi100.stdout:4/345: fdatasync d5/fc 0 2024-04-27T07:33:30.603 INFO:tasks.workunit.client.1.smithi100.stdout:3/333: dwrite d7/d9/d26/f59 [0,4194304] 0 2024-04-27T07:33:30.604 INFO:tasks.workunit.client.1.smithi100.stdout:1/435: symlink d0/d1f/d27/d4e/l88 0 2024-04-27T07:33:30.605 INFO:tasks.workunit.client.0.smithi082.stdout:2/769: creat d7/d31/dde/fff x:0 0 0 2024-04-27T07:33:30.606 INFO:tasks.workunit.client.0.smithi082.stdout:9/688: mknod d9/da/dc/d35/d4a/d7e/ce5 0 2024-04-27T07:33:30.609 INFO:tasks.workunit.client.0.smithi082.stdout:2/770: symlink d7/d30/d23/l100 0 2024-04-27T07:33:30.610 INFO:tasks.workunit.client.1.smithi100.stdout:7/242: fdatasync d1/fc 0 2024-04-27T07:33:30.611 INFO:tasks.workunit.client.0.smithi082.stdout:9/689: chown d9/d2d/d2b/d46/d76/c7b 51372865 1 2024-04-27T07:33:30.613 INFO:tasks.workunit.client.0.smithi082.stdout:9/690: chown d9/da/dc/d35/d38/da5/la1 1880250 1 2024-04-27T07:33:30.614 INFO:tasks.workunit.client.1.smithi100.stdout:5/244: dwrite d0/d4/d28/d37/f1b [0,4194304] 0 2024-04-27T07:33:30.616 INFO:tasks.workunit.client.1.smithi100.stdout:5/245: chown d0/d4/d28/d37/d1a 3 1 2024-04-27T07:33:30.617 INFO:tasks.workunit.client.0.smithi082.stdout:9/691: symlink d9/da/dc/d33/d5e/le6 0 2024-04-27T07:33:30.618 INFO:tasks.workunit.client.0.smithi082.stdout:2/771: getdents d7/d8/d99/db4 0 2024-04-27T07:33:30.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/334: write d7/d9/d10/f15 [4555321,90802] 0 2024-04-27T07:33:30.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/692: symlink d9/d2d/d2b/d46/le7 0 2024-04-27T07:33:30.621 INFO:tasks.workunit.client.0.smithi082.stdout:6/737: write d2/d2d/d4a/de4/dcc/f72 [2461345,61114] 0 2024-04-27T07:33:30.621 INFO:tasks.workunit.client.0.smithi082.stdout:9/693: chown d9/da/d85/cd3 3550084 1 2024-04-27T07:33:30.622 INFO:tasks.workunit.client.1.smithi100.stdout:4/346: write d5/d16/d19/f73 [515448,1560] 0 2024-04-27T07:33:30.625 INFO:tasks.workunit.client.0.smithi082.stdout:5/876: dwrite d8/d3c/d4a/f6a [0,4194304] 0 2024-04-27T07:33:30.626 INFO:tasks.workunit.client.0.smithi082.stdout:9/694: creat d9/d2d/d72/fe8 x:0 0 0 2024-04-27T07:33:30.627 INFO:tasks.workunit.client.0.smithi082.stdout:6/738: symlink d2/d2d/lf6 0 2024-04-27T07:33:30.630 INFO:tasks.workunit.client.1.smithi100.stdout:3/335: creat d7/d9/d26/d2a/d5e/f72 x:0 0 0 2024-04-27T07:33:30.630 INFO:tasks.workunit.client.1.smithi100.stdout:0/306: dread d1/d8/d14/f17 [0,4194304] 0 2024-04-27T07:33:30.631 INFO:tasks.workunit.client.0.smithi082.stdout:9/695: fsync d9/d2d/d2b/f34 0 2024-04-27T07:33:30.633 INFO:tasks.workunit.client.1.smithi100.stdout:2/289: dwrite d0/da/d29/f23 [0,4194304] 0 2024-04-27T07:33:30.635 INFO:tasks.workunit.client.0.smithi082.stdout:1/739: rename d4/d15/d3f to d4/d15/d49/dab/dc3/d3e/d57/d101 0 2024-04-27T07:33:30.636 INFO:tasks.workunit.client.1.smithi100.stdout:1/436: link d0/d1f/d27/f28 d0/d1b/d20/d2d/d35/f89 0 2024-04-27T07:33:30.637 INFO:tasks.workunit.client.0.smithi082.stdout:0/835: dwrite da/f1c [4194304,4194304] 0 2024-04-27T07:33:30.637 INFO:tasks.workunit.client.1.smithi100.stdout:3/336: symlink d7/d9/d10/d28/d2c/l73 0 2024-04-27T07:33:30.638 INFO:tasks.workunit.client.0.smithi082.stdout:6/739: creat d2/d1e/d32/d7d/ff7 x:0 0 0 2024-04-27T07:33:30.638 INFO:tasks.workunit.client.1.smithi100.stdout:1/437: chown d0/d1f/f2b 70898 1 2024-04-27T07:33:30.640 INFO:tasks.workunit.client.0.smithi082.stdout:5/877: dwrite d8/d29/dea/ffe [0,4194304] 0 2024-04-27T07:33:30.641 INFO:tasks.workunit.client.1.smithi100.stdout:7/243: rename d1/dd/d16/d3c/d3b/f3d to d1/dd/d16/d3c/d3b/f45 0 2024-04-27T07:33:30.643 INFO:tasks.workunit.client.1.smithi100.stdout:0/307: unlink d1/l1f 0 2024-04-27T07:33:30.645 INFO:tasks.workunit.client.0.smithi082.stdout:9/696: mknod d9/da/dc/d35/d4b/ce9 0 2024-04-27T07:33:30.645 INFO:tasks.workunit.client.0.smithi082.stdout:0/836: truncate da/d28/d109/f122 210125 0 2024-04-27T07:33:30.645 INFO:tasks.workunit.client.0.smithi082.stdout:5/878: chown d8/d42/d123/f124 1 1 2024-04-27T07:33:30.646 INFO:tasks.workunit.client.1.smithi100.stdout:2/290: dwrite d0/d1e/d51/f52 [0,4194304] 0 2024-04-27T07:33:30.646 INFO:tasks.workunit.client.0.smithi082.stdout:5/879: chown d8/d3c/fa0 648566 1 2024-04-27T07:33:30.647 INFO:tasks.workunit.client.1.smithi100.stdout:7/244: dread d1/fc [0,4194304] 0 2024-04-27T07:33:30.647 INFO:tasks.workunit.client.1.smithi100.stdout:2/291: stat d0/da/d29/d47 0 2024-04-27T07:33:30.648 INFO:tasks.workunit.client.0.smithi082.stdout:1/740: mkdir d4/d15/d49/d99/de8/d102 0 2024-04-27T07:33:30.649 INFO:tasks.workunit.client.1.smithi100.stdout:3/337: mkdir d7/d9/d10/d3e/d74 0 2024-04-27T07:33:30.652 INFO:tasks.workunit.client.1.smithi100.stdout:4/347: link d5/d16/d19/d46/c5e d5/d16/d19/d21/d6d/c76 0 2024-04-27T07:33:30.654 INFO:tasks.workunit.client.1.smithi100.stdout:0/308: mknod d1/d8/d14/d59/c69 0 2024-04-27T07:33:30.657 INFO:tasks.workunit.client.0.smithi082.stdout:6/740: symlink d2/d2e/d6c/lf8 0 2024-04-27T07:33:30.659 INFO:tasks.workunit.client.0.smithi082.stdout:6/741: chown d2/d2d/d4a/de4/dcc/d77/dca/dd6 496763581 1 2024-04-27T07:33:30.659 INFO:tasks.workunit.client.1.smithi100.stdout:7/245: chown d1/dd/d16/d2b 105587 1 2024-04-27T07:33:30.660 INFO:tasks.workunit.client.0.smithi082.stdout:6/742: readlink d2/d1e/d32/d7d/d82/db4/lee 0 2024-04-27T07:33:30.660 INFO:tasks.workunit.client.1.smithi100.stdout:7/246: write d1/f32 [861013,121968] 0 2024-04-27T07:33:30.661 INFO:tasks.workunit.client.1.smithi100.stdout:2/292: dread d0/d1e/d51/f59 [0,4194304] 0 2024-04-27T07:33:30.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/741: creat d4/d15/d49/f103 x:0 0 0 2024-04-27T07:33:30.665 INFO:tasks.workunit.client.1.smithi100.stdout:3/338: unlink d7/d9/d26/d2a/l6d 0 2024-04-27T07:33:30.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:30 smithi100 ceph-mon[34183]: pgmap v21: 65 pgs: 65 active+clean; 1.8 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 63 MiB/s rd, 196 MiB/s wr, 393 op/s 2024-04-27T07:33:30.667 INFO:tasks.workunit.client.1.smithi100.stdout:4/348: mkdir d5/d16/d19/d21/d77 0 2024-04-27T07:33:30.667 INFO:tasks.workunit.client.1.smithi100.stdout:0/309: mkdir d1/d8/d20/d61/d6a 0 2024-04-27T07:33:30.668 INFO:tasks.workunit.client.1.smithi100.stdout:0/310: write d1/f55 [274872,100115] 0 2024-04-27T07:33:30.671 INFO:tasks.workunit.client.1.smithi100.stdout:7/247: creat d1/dd/d16/d3c/d3b/f46 x:0 0 0 2024-04-27T07:33:30.672 INFO:tasks.workunit.client.0.smithi082.stdout:5/880: write d8/d42/f54 [11667,79353] 0 2024-04-27T07:33:30.673 INFO:tasks.workunit.client.1.smithi100.stdout:3/339: creat d7/d9/d10/d28/f75 x:0 0 0 2024-04-27T07:33:30.674 INFO:tasks.workunit.client.0.smithi082.stdout:5/881: chown d8/d3c/d4a/f88 418 1 2024-04-27T07:33:30.674 INFO:tasks.workunit.client.1.smithi100.stdout:4/349: rename d5/d16/d2e/l40 to d5/d16/d4c/l78 0 2024-04-27T07:33:30.676 INFO:tasks.workunit.client.1.smithi100.stdout:4/350: fsync d5/d1b/f6c 0 2024-04-27T07:33:30.677 INFO:tasks.workunit.client.1.smithi100.stdout:0/311: mknod d1/d30/c6b 0 2024-04-27T07:33:30.680 INFO:tasks.workunit.client.1.smithi100.stdout:3/340: creat d7/d9/d10/d3e/d55/f76 x:0 0 0 2024-04-27T07:33:30.680 INFO:tasks.workunit.client.1.smithi100.stdout:1/438: dwrite d0/d1b/d20/d2d/d35/f89 [0,4194304] 0 2024-04-27T07:33:30.681 INFO:tasks.workunit.client.1.smithi100.stdout:7/248: dread d1/dd/d16/d3c/d3b/f45 [0,4194304] 0 2024-04-27T07:33:30.682 INFO:tasks.workunit.client.1.smithi100.stdout:1/439: chown d0/d1f/d27/d6c/c7a 1556075 1 2024-04-27T07:33:30.682 INFO:tasks.workunit.client.1.smithi100.stdout:2/293: rename d0/l14 to d0/da/d39/l66 0 2024-04-27T07:33:30.683 INFO:tasks.workunit.client.1.smithi100.stdout:4/351: mknod d5/d23/c79 0 2024-04-27T07:33:30.688 INFO:tasks.workunit.client.1.smithi100.stdout:1/440: fsync d0/f18 0 2024-04-27T07:33:30.690 INFO:tasks.workunit.client.0.smithi082.stdout:7/803: rename d3/c1a to d3/d49/d97/d3a/c118 0 2024-04-27T07:33:30.691 INFO:tasks.workunit.client.0.smithi082.stdout:6/743: mknod d2/d3/d1b/cf9 0 2024-04-27T07:33:30.692 INFO:tasks.workunit.client.1.smithi100.stdout:0/312: rename d1/d8/d20/c57 to d1/d38/d3a/d54/c6c 0 2024-04-27T07:33:30.692 INFO:tasks.workunit.client.0.smithi082.stdout:1/742: creat d4/d15/d49/dab/dc3/d3e/d57/d101/d97/f104 x:0 0 0 2024-04-27T07:33:30.693 INFO:tasks.workunit.client.1.smithi100.stdout:4/352: rmdir d5/d16/d2e 39 2024-04-27T07:33:30.694 INFO:tasks.workunit.client.0.smithi082.stdout:9/697: rename d9/d2d/c3a to d9/d48/cea 0 2024-04-27T07:33:30.696 INFO:tasks.workunit.client.0.smithi082.stdout:7/804: chown d3/d49/f51 803258 1 2024-04-27T07:33:30.699 INFO:tasks.workunit.client.0.smithi082.stdout:9/698: symlink d9/da/dc/d35/d38/da5/leb 0 2024-04-27T07:33:30.700 INFO:tasks.workunit.client.0.smithi082.stdout:9/699: write d9/f94 [2206261,88322] 0 2024-04-27T07:33:30.700 INFO:tasks.workunit.client.0.smithi082.stdout:7/805: read d3/d49/d97/f6a [1409329,53919] 0 2024-04-27T07:33:30.701 INFO:tasks.workunit.client.1.smithi100.stdout:7/249: creat d1/dd/f47 x:0 0 0 2024-04-27T07:33:30.706 INFO:tasks.workunit.client.0.smithi082.stdout:9/700: write d9/da/dc/d88/d93/fc1 [419177,97753] 0 2024-04-27T07:33:30.707 INFO:tasks.workunit.client.0.smithi082.stdout:0/837: rename da/d3c/d3f/d4c/d95/de9/def/d81/de3/d101 to da/d38/d7f/d4a/d80/da0/d12f 0 2024-04-27T07:33:30.707 INFO:tasks.workunit.client.0.smithi082.stdout:7/806: creat d3/d49/d97/d3a/d2a/dac/d91/f119 x:0 0 0 2024-04-27T07:33:30.707 INFO:tasks.workunit.client.1.smithi100.stdout:4/353: symlink d5/d16/d2e/d5a/l7a 0 2024-04-27T07:33:30.707 INFO:tasks.workunit.client.1.smithi100.stdout:3/341: write d7/f1c [5391474,70457] 0 2024-04-27T07:33:30.707 INFO:tasks.workunit.client.1.smithi100.stdout:3/342: chown d7/d9/d10/d28/d2c/c3c 12 1 2024-04-27T07:33:30.708 INFO:tasks.workunit.client.0.smithi082.stdout:9/701: chown d9/da/dc/d35/d38/d65 1927 1 2024-04-27T07:33:30.708 INFO:tasks.workunit.client.1.smithi100.stdout:4/354: write d5/f15 [980613,115669] 0 2024-04-27T07:33:30.709 INFO:tasks.workunit.client.1.smithi100.stdout:7/250: symlink d1/dd/l48 0 2024-04-27T07:33:30.710 INFO:tasks.workunit.client.0.smithi082.stdout:6/744: rename d2/d75/ld1 to d2/d3/da8/lfa 0 2024-04-27T07:33:30.710 INFO:tasks.workunit.client.1.smithi100.stdout:2/294: truncate d0/f12 720324 0 2024-04-27T07:33:30.711 INFO:tasks.workunit.client.1.smithi100.stdout:2/295: stat d0/da/l1f 0 2024-04-27T07:33:30.712 INFO:tasks.workunit.client.1.smithi100.stdout:1/441: link d0/f3d d0/d23/f8a 0 2024-04-27T07:33:30.713 INFO:tasks.workunit.client.0.smithi082.stdout:7/807: unlink d3/db/c55 0 2024-04-27T07:33:30.713 INFO:tasks.workunit.client.1.smithi100.stdout:7/251: truncate d1/f15 4045550 0 2024-04-27T07:33:30.715 INFO:tasks.workunit.client.0.smithi082.stdout:6/745: mknod d2/d3/da8/cfb 0 2024-04-27T07:33:30.716 INFO:tasks.workunit.client.1.smithi100.stdout:3/343: dwrite d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:30.719 INFO:tasks.workunit.client.1.smithi100.stdout:4/355: creat d5/d16/f7b x:0 0 0 2024-04-27T07:33:30.719 INFO:tasks.workunit.client.0.smithi082.stdout:9/702: link d9/d2d/d2b/d46/f58 d9/d2d/fec 0 2024-04-27T07:33:30.721 INFO:tasks.workunit.client.1.smithi100.stdout:2/296: creat d0/da/d29/d26/d5d/f67 x:0 0 0 2024-04-27T07:33:30.724 INFO:tasks.workunit.client.0.smithi082.stdout:6/746: dread d2/d1e/d32/d7d/d82/da0/fcd [0,4194304] 0 2024-04-27T07:33:30.725 INFO:tasks.workunit.client.1.smithi100.stdout:3/344: unlink d7/d9/d10/d3e/f6b 0 2024-04-27T07:33:30.726 INFO:tasks.workunit.client.1.smithi100.stdout:2/297: unlink d0/da/l2e 0 2024-04-27T07:33:30.727 INFO:tasks.workunit.client.0.smithi082.stdout:0/838: dread da/fe [0,4194304] 0 2024-04-27T07:33:30.728 INFO:tasks.workunit.client.1.smithi100.stdout:3/345: write d7/d9/d26/d45/f67 [509749,100177] 0 2024-04-27T07:33:30.728 INFO:tasks.workunit.client.1.smithi100.stdout:3/346: chown d7/d9/d2f 6694398 1 2024-04-27T07:33:30.729 INFO:tasks.workunit.client.1.smithi100.stdout:4/356: dread d5/d16/d19/f30 [0,4194304] 0 2024-04-27T07:33:30.730 INFO:tasks.workunit.client.0.smithi082.stdout:6/747: unlink d2/d1e/d32/c3f 0 2024-04-27T07:33:30.730 INFO:tasks.workunit.client.1.smithi100.stdout:3/347: chown d7 15298 1 2024-04-27T07:33:30.730 INFO:tasks.workunit.client.0.smithi082.stdout:0/839: rmdir da/d38/d7f/d4a/d80/dcb 39 2024-04-27T07:33:30.731 INFO:tasks.workunit.client.1.smithi100.stdout:2/298: symlink d0/da/d29/l68 0 2024-04-27T07:33:30.736 INFO:tasks.workunit.client.1.smithi100.stdout:4/357: dread d5/d23/f25 [0,4194304] 0 2024-04-27T07:33:30.737 INFO:tasks.workunit.client.0.smithi082.stdout:6/748: dwrite d2/d3/d9c/fbf [0,4194304] 0 2024-04-27T07:33:30.740 INFO:tasks.workunit.client.1.smithi100.stdout:4/358: creat d5/d16/d4c/f7c x:0 0 0 2024-04-27T07:33:30.741 INFO:tasks.workunit.client.0.smithi082.stdout:5/882: dwrite d8/d15/d22/fb4 [0,4194304] 0 2024-04-27T07:33:30.742 INFO:tasks.workunit.client.1.smithi100.stdout:4/359: chown d5/d1b/d2c/d3f/f57 520097 1 2024-04-27T07:33:30.743 INFO:tasks.workunit.client.0.smithi082.stdout:6/749: truncate d2/d1e/d32/d7d/d82/da0/fcd 2617990 0 2024-04-27T07:33:30.744 INFO:tasks.workunit.client.1.smithi100.stdout:7/252: write d1/dd/f1e [3640213,26558] 0 2024-04-27T07:33:30.744 INFO:tasks.workunit.client.1.smithi100.stdout:1/442: write d0/f3d [3669973,107762] 0 2024-04-27T07:33:30.748 INFO:tasks.workunit.client.1.smithi100.stdout:4/360: rename d5/d16/d17 to d5/d1b/d2c/d7d 0 2024-04-27T07:33:30.749 INFO:tasks.workunit.client.1.smithi100.stdout:4/361: fdatasync d5/f8 0 2024-04-27T07:33:30.751 INFO:tasks.workunit.client.1.smithi100.stdout:7/253: unlink d1/dd/c14 0 2024-04-27T07:33:30.756 INFO:tasks.workunit.client.1.smithi100.stdout:7/254: mknod d1/dd/d16/d3c/d3b/c49 0 2024-04-27T07:33:30.756 INFO:tasks.workunit.client.1.smithi100.stdout:3/348: write d7/d9/d26/f32 [1437249,22121] 0 2024-04-27T07:33:30.757 INFO:tasks.workunit.client.1.smithi100.stdout:3/349: fdatasync d7/d9/d26/d2a/f20 0 2024-04-27T07:33:30.759 INFO:tasks.workunit.client.1.smithi100.stdout:3/350: write d7/d9/d10/d28/d2c/f2e [932566,65949] 0 2024-04-27T07:33:30.764 INFO:tasks.workunit.client.1.smithi100.stdout:7/255: read d1/dd/d16/f26 [512596,115194] 0 2024-04-27T07:33:30.765 INFO:tasks.workunit.client.1.smithi100.stdout:2/299: dwrite d0/f12 [0,4194304] 0 2024-04-27T07:33:30.771 INFO:tasks.workunit.client.0.smithi082.stdout:5/883: creat d8/d42/d123/d9c/f126 x:0 0 0 2024-04-27T07:33:30.771 INFO:tasks.workunit.client.0.smithi082.stdout:7/808: write d3/dfb/f64 [101677,36885] 0 2024-04-27T07:33:30.771 INFO:tasks.workunit.client.1.smithi100.stdout:7/256: mkdir d1/dd/d16/d4a 0 2024-04-27T07:33:30.772 INFO:tasks.workunit.client.0.smithi082.stdout:9/703: write d9/da/dc/d35/d38/da5/d66/f91 [801047,58527] 0 2024-04-27T07:33:30.773 INFO:tasks.workunit.client.0.smithi082.stdout:5/884: dread d8/f45 [0,4194304] 0 2024-04-27T07:33:30.774 INFO:tasks.workunit.client.1.smithi100.stdout:1/443: truncate d0/d1f/d27/f39 2364857 0 2024-04-27T07:33:30.774 INFO:tasks.workunit.client.1.smithi100.stdout:4/362: truncate d5/d23/f25 1596291 0 2024-04-27T07:33:30.774 INFO:tasks.workunit.client.0.smithi082.stdout:0/840: write da/f19 [325460,100131] 0 2024-04-27T07:33:30.774 INFO:tasks.workunit.client.1.smithi100.stdout:4/363: chown d5/d16/d19/d21/d6d 22684976 1 2024-04-27T07:33:30.775 INFO:tasks.workunit.client.0.smithi082.stdout:9/704: fsync d9/d2d/d2b/d46/d5d/d6f/f86 0 2024-04-27T07:33:30.776 INFO:tasks.workunit.client.1.smithi100.stdout:7/257: write d1/f21 [3749507,96606] 0 2024-04-27T07:33:30.777 INFO:tasks.workunit.client.0.smithi082.stdout:0/841: truncate da/d1d/df8/f10e 405978 0 2024-04-27T07:33:30.777 INFO:tasks.workunit.client.1.smithi100.stdout:1/444: creat d0/d1b/d20/d2d/d35/f8b x:0 0 0 2024-04-27T07:33:30.778 INFO:tasks.workunit.client.1.smithi100.stdout:1/445: stat d0/d23/l37 0 2024-04-27T07:33:30.782 INFO:tasks.workunit.client.1.smithi100.stdout:7/258: creat d1/dd/f4b x:0 0 0 2024-04-27T07:33:30.783 INFO:tasks.workunit.client.1.smithi100.stdout:8/262: sync 2024-04-27T07:33:30.784 INFO:tasks.workunit.client.1.smithi100.stdout:4/364: dwrite d5/d16/d19/f73 [0,4194304] 0 2024-04-27T07:33:30.786 INFO:tasks.workunit.client.1.smithi100.stdout:7/259: mkdir d1/dd/d16/d31/d4c 0 2024-04-27T07:33:30.787 INFO:tasks.workunit.client.1.smithi100.stdout:4/365: chown d5/d16/f7b 220995136 1 2024-04-27T07:33:30.788 INFO:tasks.workunit.client.1.smithi100.stdout:3/351: dread d7/d9/d26/d2a/f20 [0,4194304] 0 2024-04-27T07:33:30.790 INFO:tasks.workunit.client.1.smithi100.stdout:1/446: dwrite d0/f85 [0,4194304] 0 2024-04-27T07:33:30.795 INFO:tasks.workunit.client.1.smithi100.stdout:4/366: mkdir d5/d16/d19/d46/d53/d7e 0 2024-04-27T07:33:30.797 INFO:tasks.workunit.client.1.smithi100.stdout:8/263: dwrite d6/f41 [0,4194304] 0 2024-04-27T07:33:30.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/260: rename d1/dd/d16/d3c to d1/dd/d16/d31/d4c/d4d 0 2024-04-27T07:33:30.804 INFO:tasks.workunit.client.1.smithi100.stdout:1/447: dwrite d0/d1f/f5e [0,4194304] 0 2024-04-27T07:33:30.804 INFO:tasks.workunit.client.1.smithi100.stdout:7/261: dread - d1/dd/f47 zero size 2024-04-27T07:33:30.805 INFO:tasks.workunit.client.1.smithi100.stdout:8/264: mknod d6/d20/d2a/c53 0 2024-04-27T07:33:30.806 INFO:tasks.workunit.client.1.smithi100.stdout:8/265: write d6/f7 [2497846,72488] 0 2024-04-27T07:33:30.809 INFO:tasks.workunit.client.1.smithi100.stdout:1/448: creat d0/d1f/d27/d40/d61/f8c x:0 0 0 2024-04-27T07:33:30.810 INFO:tasks.workunit.client.1.smithi100.stdout:1/449: readlink d0/d1b/d20/d2d/d35/d4d/l50 0 2024-04-27T07:33:30.811 INFO:tasks.workunit.client.1.smithi100.stdout:8/266: truncate d6/d1b/f22 4891842 0 2024-04-27T07:33:30.812 INFO:tasks.workunit.client.1.smithi100.stdout:7/262: creat d1/dd/d16/d31/d4c/d4d/d3b/d40/f4e x:0 0 0 2024-04-27T07:33:30.815 INFO:tasks.workunit.client.1.smithi100.stdout:8/267: dread d6/d20/d2a/f37 [0,4194304] 0 2024-04-27T07:33:30.815 INFO:tasks.workunit.client.1.smithi100.stdout:1/450: rename d0/d1b/d20/d2d/d35/d4d/l50 to d0/d1b/d20/d2d/d35/d4d/d60/d79/l8d 0 2024-04-27T07:33:30.816 INFO:tasks.workunit.client.1.smithi100.stdout:1/451: chown d0/d1b/d20/d2d/f52 3758818 1 2024-04-27T07:33:30.818 INFO:tasks.workunit.client.1.smithi100.stdout:8/268: mkdir d6/d20/d54 0 2024-04-27T07:33:30.819 INFO:tasks.workunit.client.1.smithi100.stdout:7/263: link d1/dd/d16/c44 d1/dd/d16/d31/c4f 0 2024-04-27T07:33:30.819 INFO:tasks.workunit.client.1.smithi100.stdout:8/269: truncate d6/f3b 276585 0 2024-04-27T07:33:30.819 INFO:tasks.workunit.client.1.smithi100.stdout:8/270: read d6/f41 [1630491,50436] 0 2024-04-27T07:33:30.820 INFO:tasks.workunit.client.1.smithi100.stdout:7/264: symlink d1/dd/d16/d31/l50 0 2024-04-27T07:33:30.821 INFO:tasks.workunit.client.1.smithi100.stdout:8/271: write d6/f3b [808494,68490] 0 2024-04-27T07:33:30.829 INFO:tasks.workunit.client.1.smithi100.stdout:8/272: dwrite d6/d1b/f42 [0,4194304] 0 2024-04-27T07:33:30.830 INFO:tasks.workunit.client.1.smithi100.stdout:7/265: dwrite d1/dd/fe [0,4194304] 0 2024-04-27T07:33:30.831 INFO:tasks.workunit.client.1.smithi100.stdout:7/266: write d1/dd/d16/f3a [795800,2957] 0 2024-04-27T07:33:30.831 INFO:tasks.workunit.client.0.smithi082.stdout:7/809: link d3/db/f2e d3/d49/d97/d3a/d2a/dac/d91/d102/f11a 0 2024-04-27T07:33:30.832 INFO:tasks.workunit.client.1.smithi100.stdout:8/273: rmdir d6/d1b/d1d/d47 39 2024-04-27T07:33:30.832 INFO:tasks.workunit.client.0.smithi082.stdout:6/750: truncate d2/d75/fbe 704330 0 2024-04-27T07:33:30.832 INFO:tasks.workunit.client.0.smithi082.stdout:7/810: fsync d3/d49/d97/d3a/d71/fcc 0 2024-04-27T07:33:30.833 INFO:tasks.workunit.client.1.smithi100.stdout:7/267: mkdir d1/d2f/d51 0 2024-04-27T07:33:30.833 INFO:tasks.workunit.client.1.smithi100.stdout:7/268: readlink d1/dd/l38 0 2024-04-27T07:33:30.834 INFO:tasks.workunit.client.1.smithi100.stdout:8/274: creat d6/d20/d2a/f55 x:0 0 0 2024-04-27T07:33:30.834 INFO:tasks.workunit.client.0.smithi082.stdout:7/811: fdatasync d3/d49/d97/d3a/d71/da0/ddf/ff7 0 2024-04-27T07:33:30.836 INFO:tasks.workunit.client.1.smithi100.stdout:1/452: dread d0/d1b/f62 [0,4194304] 0 2024-04-27T07:33:30.836 INFO:tasks.workunit.client.0.smithi082.stdout:9/705: mknod d9/da/dc/d35/d38/dd8/ced 0 2024-04-27T07:33:30.838 INFO:tasks.workunit.client.1.smithi100.stdout:1/453: rmdir d0/d23 39 2024-04-27T07:33:30.839 INFO:tasks.workunit.client.0.smithi082.stdout:7/812: rename d3/d49/d97/d3a/l3c to d3/d49/d97/l11b 0 2024-04-27T07:33:30.840 INFO:tasks.workunit.client.0.smithi082.stdout:9/706: rmdir d9/da/dc/d33/d5e 39 2024-04-27T07:33:30.841 INFO:tasks.workunit.client.1.smithi100.stdout:7/269: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f3f [0,4194304] 0 2024-04-27T07:33:30.841 INFO:tasks.workunit.client.1.smithi100.stdout:1/454: symlink d0/d1b/d20/d2d/d35/l8e 0 2024-04-27T07:33:30.843 INFO:tasks.workunit.client.0.smithi082.stdout:7/813: creat d3/f11c x:0 0 0 2024-04-27T07:33:30.844 INFO:tasks.workunit.client.1.smithi100.stdout:1/455: creat d0/d1f/f8f x:0 0 0 2024-04-27T07:33:30.844 INFO:tasks.workunit.client.1.smithi100.stdout:7/270: fsync d1/dd/d16/d31/d4c/d4d/d3b/f45 0 2024-04-27T07:33:30.844 INFO:tasks.workunit.client.0.smithi082.stdout:9/707: mkdir d9/da/dc/d35/d38/dee 0 2024-04-27T07:33:30.846 INFO:tasks.workunit.client.0.smithi082.stdout:9/708: read d9/da/dc/d33/f37 [609258,17476] 0 2024-04-27T07:33:30.847 INFO:tasks.workunit.client.0.smithi082.stdout:7/814: symlink d3/d49/d97/d3a/d2a/dac/l11d 0 2024-04-27T07:33:30.847 INFO:tasks.workunit.client.0.smithi082.stdout:0/842: dread da/f26 [0,4194304] 0 2024-04-27T07:33:30.850 INFO:tasks.workunit.client.1.smithi100.stdout:7/271: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f45 [0,4194304] 0 2024-04-27T07:33:30.851 INFO:tasks.workunit.client.0.smithi082.stdout:0/843: getdents da/d28/d109 0 2024-04-27T07:33:30.852 INFO:tasks.workunit.client.0.smithi082.stdout:7/815: getdents d3/d49/d97/d3a/d71 0 2024-04-27T07:33:30.852 INFO:tasks.workunit.client.1.smithi100.stdout:7/272: mknod d1/dd/d16/d4a/c52 0 2024-04-27T07:33:30.855 INFO:tasks.workunit.client.1.smithi100.stdout:7/273: unlink d1/f21 0 2024-04-27T07:33:30.856 INFO:tasks.workunit.client.0.smithi082.stdout:7/816: mkdir d3/d9/dda/d11e 0 2024-04-27T07:33:30.857 INFO:tasks.workunit.client.1.smithi100.stdout:7/274: symlink d1/dd/d16/d31/l53 0 2024-04-27T07:33:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:7/817: write d3/dfb/da1/fb0 [1025730,13958] 0 2024-04-27T07:33:30.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/818: write d3/d49/d97/d6c/f7f [2643824,57631] 0 2024-04-27T07:33:30.861 INFO:tasks.workunit.client.0.smithi082.stdout:7/819: fdatasync d3/d49/d97/d6c/f7f 0 2024-04-27T07:33:30.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/820: truncate d3/d9/f37 8764347 0 2024-04-27T07:33:30.863 INFO:tasks.workunit.client.0.smithi082.stdout:7/821: chown d3/d9/d4f/d9a/cf1 254 1 2024-04-27T07:33:30.868 INFO:tasks.workunit.client.0.smithi082.stdout:7/822: dwrite d3/d49/f10c [0,4194304] 0 2024-04-27T07:33:30.872 INFO:tasks.workunit.client.0.smithi082.stdout:7/823: rename d3/d9/d7c/cde to d3/db1/c11f 0 2024-04-27T07:33:30.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/824: dread d3/d49/f51 [0,4194304] 0 2024-04-27T07:33:30.885 INFO:tasks.workunit.client.0.smithi082.stdout:7/825: readlink d3/d49/d97/d3a/d2a/dac/l11d 0 2024-04-27T07:33:30.888 INFO:tasks.workunit.client.0.smithi082.stdout:7/826: truncate d3/d49/d97/d3a/f38 848978 0 2024-04-27T07:33:30.893 INFO:tasks.workunit.client.0.smithi082.stdout:7/827: symlink d3/d49/d97/d3a/d71/da0/ddf/l120 0 2024-04-27T07:33:30.893 INFO:tasks.workunit.client.0.smithi082.stdout:7/828: read - d3/de9/feb zero size 2024-04-27T07:33:30.894 INFO:tasks.workunit.client.0.smithi082.stdout:6/751: write d2/d1e/f98 [2839892,121567] 0 2024-04-27T07:33:30.897 INFO:tasks.workunit.client.0.smithi082.stdout:7/829: fdatasync d3/d9/d4f/d9a/fc2 0 2024-04-27T07:33:30.903 INFO:tasks.workunit.client.0.smithi082.stdout:6/752: rename d2/d1e/fc3 to d2/d1e/ffc 0 2024-04-27T07:33:30.906 INFO:tasks.workunit.client.0.smithi082.stdout:7/830: creat d3/db/f121 x:0 0 0 2024-04-27T07:33:30.910 INFO:tasks.workunit.client.0.smithi082.stdout:9/709: dwrite d9/d2d/f68 [0,4194304] 0 2024-04-27T07:33:30.913 INFO:tasks.workunit.client.0.smithi082.stdout:9/710: fsync d9/da/dc/d35/d38/dc5/f39 0 2024-04-27T07:33:30.914 INFO:tasks.workunit.client.0.smithi082.stdout:7/831: dwrite d3/f45 [0,4194304] 0 2024-04-27T07:33:30.916 INFO:tasks.workunit.client.0.smithi082.stdout:7/832: fsync d3/d9/d7c/f8f 0 2024-04-27T07:33:30.918 INFO:tasks.workunit.client.0.smithi082.stdout:0/844: write da/d1d/d6a/fbf [687895,46900] 0 2024-04-27T07:33:30.922 INFO:tasks.workunit.client.0.smithi082.stdout:0/845: mknod da/d1d/c130 0 2024-04-27T07:33:30.923 INFO:tasks.workunit.client.0.smithi082.stdout:7/833: creat d3/d49/d97/d3a/d2a/dac/d91/d102/f122 x:0 0 0 2024-04-27T07:33:30.925 INFO:tasks.workunit.client.0.smithi082.stdout:9/711: link d9/da/dc/d35/d38/da5/d66/f91 d9/da/dc/d35/d38/fef 0 2024-04-27T07:33:30.927 INFO:tasks.workunit.client.0.smithi082.stdout:7/834: mknod d3/d49/d97/d6c/c123 0 2024-04-27T07:33:30.929 INFO:tasks.workunit.client.0.smithi082.stdout:9/712: rename d9/d2d/d2b/d46/d5d/ld9 to d9/d2d/d72/lf0 0 2024-04-27T07:33:30.931 INFO:tasks.workunit.client.0.smithi082.stdout:9/713: readlink d9/da/dc/d35/d38/da5/d66/d97/lb3 0 2024-04-27T07:33:30.933 INFO:tasks.workunit.client.0.smithi082.stdout:7/835: rename d3/d49/d97/d3a/d2a/dac/cd9 to d3/d9/d7c/c124 0 2024-04-27T07:33:30.934 INFO:tasks.workunit.client.0.smithi082.stdout:0/846: getdents da/d2a/dc4 0 2024-04-27T07:33:30.936 INFO:tasks.workunit.client.0.smithi082.stdout:9/714: rename d9/d2d/d2b/d46/d76/f9f to d9/d2d/d2b/d46/d5d/da7/ff1 0 2024-04-27T07:33:30.937 INFO:tasks.workunit.client.0.smithi082.stdout:7/836: mkdir d3/de9/d125 0 2024-04-27T07:33:30.941 INFO:tasks.workunit.client.0.smithi082.stdout:0/847: rename da/d3c/d3f/d57/dcc/da8/fb2 to da/d3c/d3f/d4c/d95/de9/df6/f131 0 2024-04-27T07:33:30.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/848: dread - da/d3c/d3f/d4c/d95/de9/def/fcd zero size 2024-04-27T07:33:30.943 INFO:tasks.workunit.client.0.smithi082.stdout:7/837: creat d3/dfb/da1/db6/f126 x:0 0 0 2024-04-27T07:33:30.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/753: dread d2/d2d/d4a/de4/dcc/f24 [0,4194304] 0 2024-04-27T07:33:30.945 INFO:tasks.workunit.client.0.smithi082.stdout:0/849: fsync da/d3c/d3f/d57/dcc/f8e 0 2024-04-27T07:33:30.948 INFO:tasks.workunit.client.0.smithi082.stdout:7/838: creat d3/d49/d97/d3a/f127 x:0 0 0 2024-04-27T07:33:30.949 INFO:tasks.workunit.client.0.smithi082.stdout:6/754: creat d2/d2d/d4a/de4/ffd x:0 0 0 2024-04-27T07:33:30.950 INFO:tasks.workunit.client.0.smithi082.stdout:0/850: mknod da/d38/d7f/d4a/d80/da0/d12f/c132 0 2024-04-27T07:33:30.954 INFO:tasks.workunit.client.0.smithi082.stdout:0/851: creat da/d38/d7f/d4a/d80/da0/d12f/f133 x:0 0 0 2024-04-27T07:33:30.956 INFO:tasks.workunit.client.0.smithi082.stdout:6/755: dwrite d2/d45/dc2/fcb [0,4194304] 0 2024-04-27T07:33:30.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/852: symlink da/l134 0 2024-04-27T07:33:30.961 INFO:tasks.workunit.client.0.smithi082.stdout:0/853: fdatasync da/d38/f6e 0 2024-04-27T07:33:30.965 INFO:tasks.workunit.client.0.smithi082.stdout:0/854: dread - da/d38/d7f/d4a/d80/da0/fe0 zero size 2024-04-27T07:33:30.973 INFO:tasks.workunit.client.0.smithi082.stdout:0/855: dwrite da/d28/f43 [0,4194304] 0 2024-04-27T07:33:30.979 INFO:tasks.workunit.client.0.smithi082.stdout:0/856: getdents da/d3c/d3f/d4c/d95/de9 0 2024-04-27T07:33:30.981 INFO:tasks.workunit.client.0.smithi082.stdout:0/857: creat da/d3c/d3f/d4c/d95/f135 x:0 0 0 2024-04-27T07:33:30.983 INFO:tasks.workunit.client.0.smithi082.stdout:6/756: dread d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:30.983 INFO:tasks.workunit.client.0.smithi082.stdout:0/858: rmdir da/d28/d36 39 2024-04-27T07:33:30.987 INFO:tasks.workunit.client.0.smithi082.stdout:6/757: write d2/d2d/d4a/de4/dcc/d13/f1c [2648256,101282] 0 2024-04-27T07:33:30.990 INFO:tasks.workunit.client.0.smithi082.stdout:6/758: write d2/d2d/d4a/de4/dcc/f17 [7049541,46217] 0 2024-04-27T07:33:30.992 INFO:tasks.workunit.client.0.smithi082.stdout:6/759: chown d2/d3/d9c/ldf 75902 1 2024-04-27T07:33:30.992 INFO:tasks.workunit.client.0.smithi082.stdout:0/859: dwrite da/d3c/fa7 [0,4194304] 0 2024-04-27T07:33:30.996 INFO:tasks.workunit.client.0.smithi082.stdout:0/860: read da/f42 [1486912,39876] 0 2024-04-27T07:33:30.997 INFO:tasks.workunit.client.0.smithi082.stdout:0/861: truncate da/d28/fde 3257919 0 2024-04-27T07:33:31.000 INFO:tasks.workunit.client.0.smithi082.stdout:6/760: dwrite d2/d2d/d4a/de4/dcc/d77/dca/dd6/fde [4194304,4194304] 0 2024-04-27T07:33:31.006 INFO:tasks.workunit.client.0.smithi082.stdout:6/761: creat d2/d2d/d4a/de4/dcc/d77/dd3/ffe x:0 0 0 2024-04-27T07:33:31.007 INFO:tasks.workunit.client.0.smithi082.stdout:0/862: dwrite da/d38/d7f/d4a/d80/da0/dd5/ddf/f110 [0,4194304] 0 2024-04-27T07:33:31.011 INFO:tasks.workunit.client.0.smithi082.stdout:6/762: creat d2/d2e/fff x:0 0 0 2024-04-27T07:33:31.012 INFO:tasks.workunit.client.0.smithi082.stdout:6/763: stat d2/d1e/d32/d7d/dbc/fd2 0 2024-04-27T07:33:31.015 INFO:tasks.workunit.client.0.smithi082.stdout:0/863: link da/d38/d7f/d4a/d80/da0/dd5/cea da/d3c/d3f/d4c/d95/de9/def/c136 0 2024-04-27T07:33:31.017 INFO:tasks.workunit.client.0.smithi082.stdout:6/764: link d2/d1e/d32/l68 d2/d75/l100 0 2024-04-27T07:33:31.019 INFO:tasks.workunit.client.0.smithi082.stdout:6/765: creat d2/d2d/d4a/de4/f101 x:0 0 0 2024-04-27T07:33:31.020 INFO:tasks.workunit.client.0.smithi082.stdout:6/766: fdatasync d2/d3/da8/fe9 0 2024-04-27T07:33:31.022 INFO:tasks.workunit.client.0.smithi082.stdout:0/864: rename da/d3c/d3f/dbb to da/d28/d36/d137 0 2024-04-27T07:33:31.025 INFO:tasks.workunit.client.0.smithi082.stdout:6/767: rename d2/d1e/f88 to d2/d2e/d6c/f102 0 2024-04-27T07:33:31.028 INFO:tasks.workunit.client.0.smithi082.stdout:6/768: creat d2/d2d/d4a/de4/dcc/d77/dca/dd6/f103 x:0 0 0 2024-04-27T07:33:31.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/865: creat da/d3c/d3f/d4c/d95/de9/def/f138 x:0 0 0 2024-04-27T07:33:31.030 INFO:tasks.workunit.client.0.smithi082.stdout:6/769: creat d2/d2e/d55/f104 x:0 0 0 2024-04-27T07:33:31.031 INFO:tasks.workunit.client.0.smithi082.stdout:0/866: chown da/d3c/dc7/c128 15 1 2024-04-27T07:33:31.031 INFO:tasks.workunit.client.0.smithi082.stdout:6/770: write d2/d45/dc2/fcb [4406497,67621] 0 2024-04-27T07:33:31.036 INFO:tasks.workunit.client.0.smithi082.stdout:6/771: creat d2/d2d/d4a/de4/dcc/d77/f105 x:0 0 0 2024-04-27T07:33:31.036 INFO:tasks.workunit.client.0.smithi082.stdout:6/772: chown d2/d1e/f34 14761024 1 2024-04-27T07:33:31.039 INFO:tasks.workunit.client.0.smithi082.stdout:6/773: mkdir d2/d2e/d106 0 2024-04-27T07:33:31.039 INFO:tasks.workunit.client.0.smithi082.stdout:0/867: write da/d38/d7f/d4a/d80/da0/fa3 [428447,64312] 0 2024-04-27T07:33:31.044 INFO:tasks.workunit.client.0.smithi082.stdout:6/774: rename d2/d1e/d32/d7d/d82/da0 to d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107 0 2024-04-27T07:33:31.045 INFO:tasks.workunit.client.0.smithi082.stdout:6/775: write d2/d45/fc6 [635910,67356] 0 2024-04-27T07:33:31.046 INFO:tasks.workunit.client.0.smithi082.stdout:0/868: link da/d1d/df8/f10e da/f139 0 2024-04-27T07:33:31.049 INFO:tasks.workunit.client.0.smithi082.stdout:6/776: unlink d2/d1e/d32/d7d/dbc/fd2 0 2024-04-27T07:33:31.050 INFO:tasks.workunit.client.0.smithi082.stdout:6/777: fdatasync d2/d3/da8/fda 0 2024-04-27T07:33:31.054 INFO:tasks.workunit.client.0.smithi082.stdout:6/778: creat d2/d2d/d4a/de4/dcc/d77/dd3/f108 x:0 0 0 2024-04-27T07:33:31.059 INFO:tasks.workunit.client.0.smithi082.stdout:0/869: write da/f62 [1235073,123917] 0 2024-04-27T07:33:31.061 INFO:tasks.workunit.client.0.smithi082.stdout:6/779: dwrite d2/d1e/d32/d7d/d82/f91 [4194304,4194304] 0 2024-04-27T07:33:31.062 INFO:tasks.workunit.client.0.smithi082.stdout:6/780: read - d2/d3/feb zero size 2024-04-27T07:33:31.063 INFO:tasks.workunit.client.0.smithi082.stdout:6/781: chown d2/d1e/f98 325408014 1 2024-04-27T07:33:31.066 INFO:tasks.workunit.client.0.smithi082.stdout:0/870: rename da/d28/d36/d137/f12b to da/d38/d7f/d4a/d10c/f13a 0 2024-04-27T07:33:31.071 INFO:tasks.workunit.client.0.smithi082.stdout:0/871: creat da/d3c/d3f/d4c/d95/de9/def/d81/de3/f13b x:0 0 0 2024-04-27T07:33:31.078 INFO:tasks.workunit.client.0.smithi082.stdout:0/872: rename da/d3c/d3f/f5b to da/d38/d7f/d4a/d80/dcb/f13c 0 2024-04-27T07:33:31.079 INFO:tasks.workunit.client.0.smithi082.stdout:0/873: write da/d38/d7f/d4a/fa4 [1997767,35882] 0 2024-04-27T07:33:31.082 INFO:tasks.workunit.client.0.smithi082.stdout:6/782: dread d2/d1e/f34 [0,4194304] 0 2024-04-27T07:33:31.083 INFO:tasks.workunit.client.0.smithi082.stdout:0/874: link f7 da/d3c/d3f/d4c/d95/de9/f13d 0 2024-04-27T07:33:31.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/783: write d2/d2d/d4a/de4/dcc/d77/dd3/f108 [161650,62940] 0 2024-04-27T07:33:31.087 INFO:tasks.workunit.client.0.smithi082.stdout:0/875: rename da/d38/d7f/d4a/d80/da0/d104 to da/d38/d7f/d4a/d80/da0/dd5/d13e 0 2024-04-27T07:33:31.088 INFO:tasks.workunit.client.0.smithi082.stdout:6/784: mknod d2/d2e/d6a/c109 0 2024-04-27T07:33:31.090 INFO:tasks.workunit.client.0.smithi082.stdout:0/876: truncate da/d3c/d3f/d4c/d95/de9/def/d81/de3/f13b 573769 0 2024-04-27T07:33:31.091 INFO:tasks.workunit.client.0.smithi082.stdout:0/877: dread - da/d3c/d3f/d4c/d95/fc9 zero size 2024-04-27T07:33:31.098 INFO:tasks.workunit.client.0.smithi082.stdout:0/878: dread da/d28/f66 [0,4194304] 0 2024-04-27T07:33:31.100 INFO:tasks.workunit.client.0.smithi082.stdout:0/879: symlink da/d28/d36/l13f 0 2024-04-27T07:33:31.103 INFO:tasks.workunit.client.0.smithi082.stdout:6/785: dread d2/d2e/f3b [0,4194304] 0 2024-04-27T07:33:31.103 INFO:tasks.workunit.client.0.smithi082.stdout:0/880: creat da/d38/d7f/d4a/d80/da0/dd5/d116/f140 x:0 0 0 2024-04-27T07:33:31.107 INFO:tasks.workunit.client.0.smithi082.stdout:0/881: creat da/d3c/d3f/d4c/d95/de9/def/d81/f141 x:0 0 0 2024-04-27T07:33:31.109 INFO:tasks.workunit.client.0.smithi082.stdout:0/882: readlink da/d3c/d3f/d4c/d95/de9/def/l117 0 2024-04-27T07:33:31.110 INFO:tasks.workunit.client.0.smithi082.stdout:6/786: dwrite d2/d2d/d4a/de4/dcc/d77/dca/dd6/f103 [0,4194304] 0 2024-04-27T07:33:31.114 INFO:tasks.workunit.client.0.smithi082.stdout:0/883: mknod da/d28/c142 0 2024-04-27T07:33:31.117 INFO:tasks.workunit.client.0.smithi082.stdout:0/884: rename da/d38/f47 to da/d3c/d3f/d4c/f143 0 2024-04-27T07:33:31.120 INFO:tasks.workunit.client.0.smithi082.stdout:0/885: creat da/d38/d7f/d4a/d80/da0/d129/f144 x:0 0 0 2024-04-27T07:33:31.120 INFO:tasks.workunit.client.0.smithi082.stdout:0/886: stat da/c5f 0 2024-04-27T07:33:31.123 INFO:tasks.workunit.client.0.smithi082.stdout:0/887: getdents da/d3c/d3f/d57/dcc/da8 0 2024-04-27T07:33:31.123 INFO:tasks.workunit.client.0.smithi082.stdout:0/888: chown da/d2a/fb0 12 1 2024-04-27T07:33:31.125 INFO:tasks.workunit.client.0.smithi082.stdout:0/889: rmdir da/d3c/d3f/d4c/d95/de9/df6 39 2024-04-27T07:33:31.127 INFO:tasks.workunit.client.0.smithi082.stdout:0/890: symlink da/d3c/d3f/d4c/d95/de9/def/d81/de3/l145 0 2024-04-27T07:33:31.128 INFO:tasks.workunit.client.0.smithi082.stdout:0/891: creat da/d38/d7f/d4a/d80/da0/dd5/ddf/f146 x:0 0 0 2024-04-27T07:33:31.130 INFO:tasks.workunit.client.0.smithi082.stdout:0/892: creat da/d3c/d3f/d4c/d95/de9/def/d81/f147 x:0 0 0 2024-04-27T07:33:31.131 INFO:tasks.workunit.client.0.smithi082.stdout:0/893: rmdir da/d2a/dc4 39 2024-04-27T07:33:31.133 INFO:tasks.workunit.client.0.smithi082.stdout:0/894: creat da/d3c/d3f/d4c/d95/de9/def/f148 x:0 0 0 2024-04-27T07:33:31.140 INFO:tasks.workunit.client.0.smithi082.stdout:0/895: truncate da/f6c 2631219 0 2024-04-27T07:33:31.141 INFO:tasks.workunit.client.0.smithi082.stdout:0/896: chown da/f6c 198175630 1 2024-04-27T07:33:31.142 INFO:tasks.workunit.client.0.smithi082.stdout:0/897: creat da/d3c/dc7/f149 x:0 0 0 2024-04-27T07:33:31.144 INFO:tasks.workunit.client.0.smithi082.stdout:0/898: symlink da/d3c/d3f/d4c/l14a 0 2024-04-27T07:33:31.144 INFO:tasks.workunit.client.0.smithi082.stdout:0/899: write da/fe [5563663,41375] 0 2024-04-27T07:33:31.145 INFO:tasks.workunit.client.1.smithi100.stdout:9/266: sync 2024-04-27T07:33:31.145 INFO:tasks.workunit.client.1.smithi100.stdout:9/267: chown d1/d9/db/f4e 3735 1 2024-04-27T07:33:31.149 INFO:tasks.workunit.client.1.smithi100.stdout:9/268: rename d1/d9/db/f3f to d1/d9/db/d2b/d31/f63 0 2024-04-27T07:33:31.150 INFO:tasks.workunit.client.0.smithi082.stdout:0/900: write da/d2a/dc4/fcf [32530,67239] 0 2024-04-27T07:33:31.151 INFO:tasks.workunit.client.1.smithi100.stdout:9/269: getdents d1/d9/d1f/d52/d54/d61 0 2024-04-27T07:33:31.153 INFO:tasks.workunit.client.1.smithi100.stdout:9/270: symlink d1/d9/db/l64 0 2024-04-27T07:33:31.156 INFO:tasks.workunit.client.1.smithi100.stdout:9/271: rename d1/d9/l48 to d1/d9/db/d2b/d4f/l65 0 2024-04-27T07:33:31.162 INFO:tasks.workunit.client.1.smithi100.stdout:9/272: link d1/d9/db/d2b/d4f/l65 d1/d9/d1f/d52/d54/d61/l66 0 2024-04-27T07:33:31.163 INFO:tasks.workunit.client.1.smithi100.stdout:9/273: chown d1/f22 14 1 2024-04-27T07:33:31.163 INFO:tasks.workunit.client.1.smithi100.stdout:9/274: chown d1/d9/d1f/f3a 29980 1 2024-04-27T07:33:31.165 INFO:tasks.workunit.client.1.smithi100.stdout:9/275: mkdir d1/d9/d1f/d4a/d67 0 2024-04-27T07:33:31.169 INFO:tasks.workunit.client.1.smithi100.stdout:9/276: getdents d1/d9/d1f/d4a 0 2024-04-27T07:33:31.170 INFO:tasks.workunit.client.1.smithi100.stdout:9/277: creat d1/d9/d1f/f68 x:0 0 0 2024-04-27T07:33:31.172 INFO:tasks.workunit.client.1.smithi100.stdout:9/278: chown d1/d9/db/d2b/d4f/l65 52868 1 2024-04-27T07:33:31.172 INFO:tasks.workunit.client.1.smithi100.stdout:9/279: dread - d1/d9/d1f/f68 zero size 2024-04-27T07:33:31.184 INFO:tasks.workunit.client.1.smithi100.stdout:9/280: dread d1/d9/db/d2b/d31/f35 [0,4194304] 0 2024-04-27T07:33:31.186 INFO:tasks.workunit.client.1.smithi100.stdout:9/281: symlink d1/d9/db/d2b/d4f/d57/l69 0 2024-04-27T07:33:31.188 INFO:tasks.workunit.client.0.smithi082.stdout:0/901: dread da/d3c/d3f/d57/dcc/fc0 [0,4194304] 0 2024-04-27T07:33:31.188 INFO:tasks.workunit.client.0.smithi082.stdout:8/738: sync 2024-04-27T07:33:31.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/739: write d0/d2b/d80/dca/de6/d87/d71/f5d [3357488,115521] 0 2024-04-27T07:33:31.190 INFO:tasks.workunit.client.0.smithi082.stdout:0/902: creat da/d3c/d3f/d57/f14b x:0 0 0 2024-04-27T07:33:31.192 INFO:tasks.workunit.client.0.smithi082.stdout:8/740: chown d0/d2b/d80/dca/de6/d87/d42/d7f/c86 2230458 1 2024-04-27T07:33:31.193 INFO:tasks.workunit.client.0.smithi082.stdout:0/903: creat da/d38/d7f/d4a/d80/da0/dd5/f14c x:0 0 0 2024-04-27T07:33:31.195 INFO:tasks.workunit.client.0.smithi082.stdout:0/904: rmdir da/d3c/d3f/d4c/d95/de9/def/d81/de3 39 2024-04-27T07:33:31.197 INFO:tasks.workunit.client.0.smithi082.stdout:0/905: mkdir da/d3c/d3f/d57/d14d 0 2024-04-27T07:33:31.197 INFO:tasks.workunit.client.0.smithi082.stdout:0/906: fdatasync da/d1d/f2d 0 2024-04-27T07:33:31.199 INFO:tasks.workunit.client.0.smithi082.stdout:0/907: mkdir da/d3c/d3f/d57/d14e 0 2024-04-27T07:33:31.200 INFO:tasks.workunit.client.0.smithi082.stdout:0/908: creat da/d3c/d3f/d4c/f14f x:0 0 0 2024-04-27T07:33:31.201 INFO:tasks.workunit.client.1.smithi100.stdout:9/282: dread d1/d9/d1f/d52/f5d [0,4194304] 0 2024-04-27T07:33:31.202 INFO:tasks.workunit.client.0.smithi082.stdout:0/909: read da/d3c/d3f/d4c/f143 [723162,67308] 0 2024-04-27T07:33:31.203 INFO:tasks.workunit.client.1.smithi100.stdout:9/283: mknod d1/d9/db/d56/c6a 0 2024-04-27T07:33:31.204 INFO:tasks.workunit.client.1.smithi100.stdout:9/284: dread - d1/d9/f41 zero size 2024-04-27T07:33:31.204 INFO:tasks.workunit.client.0.smithi082.stdout:0/910: symlink da/d2a/dc4/l150 0 2024-04-27T07:33:31.204 INFO:tasks.workunit.client.1.smithi100.stdout:9/285: chown d1/d9/d1f 12958566 1 2024-04-27T07:33:31.205 INFO:tasks.workunit.client.0.smithi082.stdout:0/911: chown da/d38/d7f/d4a/d80/da0/dd5/d116/f140 5977 1 2024-04-27T07:33:31.206 INFO:tasks.workunit.client.0.smithi082.stdout:0/912: mknod da/d38/d7f/d4a/d80/c151 0 2024-04-27T07:33:31.207 INFO:tasks.workunit.client.1.smithi100.stdout:9/286: rename d1/d9/f41 to d1/d9/db/d2b/f6b 0 2024-04-27T07:33:31.207 INFO:tasks.workunit.client.0.smithi082.stdout:0/913: truncate da/d3c/f10a 1694186 0 2024-04-27T07:33:31.208 INFO:tasks.workunit.client.0.smithi082.stdout:0/914: chown da/d28/fde 84476816 1 2024-04-27T07:33:31.209 INFO:tasks.workunit.client.1.smithi100.stdout:9/287: creat d1/d9/db/f6c x:0 0 0 2024-04-27T07:33:31.210 INFO:tasks.workunit.client.0.smithi082.stdout:0/915: mknod da/d3c/d3f/d4c/d95/de9/def/c152 0 2024-04-27T07:33:31.212 INFO:tasks.workunit.client.0.smithi082.stdout:0/916: dread da/f1f [0,4194304] 0 2024-04-27T07:33:31.213 INFO:tasks.workunit.client.0.smithi082.stdout:0/917: write da/d38/d7f/d4a/d80/fee [239917,74611] 0 2024-04-27T07:33:31.214 INFO:tasks.workunit.client.0.smithi082.stdout:0/918: write da/d38/d7f/d4a/d80/da0/dd5/f14c [551476,16292] 0 2024-04-27T07:33:31.215 INFO:tasks.workunit.client.0.smithi082.stdout:0/919: write da/d3c/dc7/ffd [684615,88114] 0 2024-04-27T07:33:31.217 INFO:tasks.workunit.client.0.smithi082.stdout:0/920: symlink da/d3c/d3f/d57/l153 0 2024-04-27T07:33:31.220 INFO:tasks.workunit.client.1.smithi100.stdout:9/288: dwrite d1/f29 [0,4194304] 0 2024-04-27T07:33:31.221 INFO:tasks.workunit.client.0.smithi082.stdout:0/921: creat da/d3c/d3f/d57/dcc/f154 x:0 0 0 2024-04-27T07:33:31.222 INFO:tasks.workunit.client.1.smithi100.stdout:9/289: dread - d1/d9/d1f/d52/d54/f5f zero size 2024-04-27T07:33:31.223 INFO:tasks.workunit.client.0.smithi082.stdout:0/922: read da/d3c/d3f/d4c/d95/de9/f10d [1967052,34933] 0 2024-04-27T07:33:31.224 INFO:tasks.workunit.client.1.smithi100.stdout:9/290: mknod d1/d9/d1f/d52/c6d 0 2024-04-27T07:33:31.224 INFO:tasks.workunit.client.0.smithi082.stdout:0/923: write da/d3c/d3f/d57/dcc/f154 [966370,8427] 0 2024-04-27T07:33:31.227 INFO:tasks.workunit.client.1.smithi100.stdout:9/291: truncate d1/d9/f23 1827127 0 2024-04-27T07:33:31.227 INFO:tasks.workunit.client.0.smithi082.stdout:0/924: symlink da/d3c/d3f/d4c/d95/de9/def/l155 0 2024-04-27T07:33:31.228 INFO:tasks.workunit.client.1.smithi100.stdout:6/317: sync 2024-04-27T07:33:31.229 INFO:tasks.workunit.client.1.smithi100.stdout:5/246: sync 2024-04-27T07:33:31.232 INFO:tasks.workunit.client.1.smithi100.stdout:6/318: creat de/d58/d75/f76 x:0 0 0 2024-04-27T07:33:31.233 INFO:tasks.workunit.client.1.smithi100.stdout:9/292: dwrite d1/f46 [0,4194304] 0 2024-04-27T07:33:31.234 INFO:tasks.workunit.client.0.smithi082.stdout:0/925: dwrite da/d3c/d3f/d4c/d95/f135 [0,4194304] 0 2024-04-27T07:33:31.236 INFO:tasks.workunit.client.0.smithi082.stdout:0/926: write da/d28/d36/feb [771713,122] 0 2024-04-27T07:33:31.242 INFO:tasks.workunit.client.1.smithi100.stdout:9/293: unlink d1/d9/f23 0 2024-04-27T07:33:31.242 INFO:tasks.workunit.client.0.smithi082.stdout:0/927: rename da/d28/d36/l13f to da/d38/da9/ddd/l156 0 2024-04-27T07:33:31.244 INFO:tasks.workunit.client.1.smithi100.stdout:5/247: truncate d0/f1d 3062635 0 2024-04-27T07:33:31.245 INFO:tasks.workunit.client.1.smithi100.stdout:5/248: readlink d0/d4/d28/d3e/l40 0 2024-04-27T07:33:31.245 INFO:tasks.workunit.client.0.smithi082.stdout:0/928: creat da/d3c/d3f/d57/dcc/f157 x:0 0 0 2024-04-27T07:33:31.246 INFO:tasks.workunit.client.1.smithi100.stdout:5/249: chown d0/d42 6 1 2024-04-27T07:33:31.247 INFO:tasks.workunit.client.0.smithi082.stdout:0/929: symlink da/d3c/dc7/l158 0 2024-04-27T07:33:31.250 INFO:tasks.workunit.client.0.smithi082.stdout:0/930: creat da/d3c/d3f/d57/d14d/f159 x:0 0 0 2024-04-27T07:33:31.251 INFO:tasks.workunit.client.0.smithi082.stdout:0/931: chown da/d38/da9/ddd/l125 794125 1 2024-04-27T07:33:31.253 INFO:tasks.workunit.client.1.smithi100.stdout:6/319: dread de/d58/d21/f49 [0,4194304] 0 2024-04-27T07:33:31.254 INFO:tasks.workunit.client.1.smithi100.stdout:6/320: readlink de/d2e/d3f/l41 0 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:6/321: chown de/d58/d21/d24/l33 183181 1 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:7/275: sync 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:2/300: sync 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:3/352: sync 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:4/367: sync 2024-04-27T07:33:31.256 INFO:tasks.workunit.client.1.smithi100.stdout:0/313: sync 2024-04-27T07:33:31.257 INFO:tasks.workunit.client.1.smithi100.stdout:1/456: sync 2024-04-27T07:33:31.257 INFO:tasks.workunit.client.1.smithi100.stdout:8/275: sync 2024-04-27T07:33:31.258 INFO:tasks.workunit.client.1.smithi100.stdout:2/301: fdatasync d0/da/f1c 0 2024-04-27T07:33:31.261 INFO:tasks.workunit.client.1.smithi100.stdout:6/322: write de/d58/f71 [347734,100952] 0 2024-04-27T07:33:31.261 INFO:tasks.workunit.client.1.smithi100.stdout:3/353: write d7/d9/d26/f38 [2564551,74887] 0 2024-04-27T07:33:31.261 INFO:tasks.workunit.client.1.smithi100.stdout:4/368: creat d5/d16/d4c/f7f x:0 0 0 2024-04-27T07:33:31.261 INFO:tasks.workunit.client.1.smithi100.stdout:0/314: symlink d1/d30/l6d 0 2024-04-27T07:33:31.264 INFO:tasks.workunit.client.1.smithi100.stdout:8/276: creat d6/d1b/d1d/d47/f56 x:0 0 0 2024-04-27T07:33:31.265 INFO:tasks.workunit.client.0.smithi082.stdout:0/932: truncate da/d28/d36/f65 1056290 0 2024-04-27T07:33:31.269 INFO:tasks.workunit.client.1.smithi100.stdout:5/250: dread d0/d4/fc [0,4194304] 0 2024-04-27T07:33:31.270 INFO:tasks.workunit.client.1.smithi100.stdout:9/294: write d1/d9/f42 [1686432,53990] 0 2024-04-27T07:33:31.272 INFO:tasks.workunit.client.1.smithi100.stdout:4/369: creat d5/d1b/f80 x:0 0 0 2024-04-27T07:33:31.273 INFO:tasks.workunit.client.1.smithi100.stdout:1/457: symlink d0/d1b/d20/d2d/d35/l90 0 2024-04-27T07:33:31.275 INFO:tasks.workunit.client.1.smithi100.stdout:4/370: write d5/d16/d4c/f7f [488651,68619] 0 2024-04-27T07:33:31.277 INFO:tasks.workunit.client.1.smithi100.stdout:3/354: creat d7/d9/d10/d28/f77 x:0 0 0 2024-04-27T07:33:31.278 INFO:tasks.workunit.client.1.smithi100.stdout:6/323: rename de/d2e/d3f/f48 to de/d2e/f77 0 2024-04-27T07:33:31.278 INFO:tasks.workunit.client.1.smithi100.stdout:3/355: dread - d7/d9/d10/d3e/d55/f76 zero size 2024-04-27T07:33:31.279 INFO:tasks.workunit.client.1.smithi100.stdout:6/324: stat de/f5c 0 2024-04-27T07:33:31.281 INFO:tasks.workunit.client.1.smithi100.stdout:6/325: write de/d58/d21/d5b/f62 [758198,124922] 0 2024-04-27T07:33:31.291 INFO:tasks.workunit.client.1.smithi100.stdout:1/458: creat d0/d1f/d27/d40/d61/f91 x:0 0 0 2024-04-27T07:33:31.293 INFO:tasks.workunit.client.1.smithi100.stdout:5/251: dwrite d0/d4/d28/d37/d1a/f4d [0,4194304] 0 2024-04-27T07:33:31.294 INFO:tasks.workunit.client.0.smithi082.stdout:0/933: dread da/d28/f61 [4194304,4194304] 0 2024-04-27T07:33:31.294 INFO:tasks.workunit.client.1.smithi100.stdout:2/302: write d0/da/d29/d26/f4b [222574,42153] 0 2024-04-27T07:33:31.295 INFO:tasks.workunit.client.1.smithi100.stdout:1/459: chown d0/d1f/d27/d40/d61/c82 633928158 1 2024-04-27T07:33:31.298 INFO:tasks.workunit.client.1.smithi100.stdout:4/371: rename d5/d16/d19/d21/f3e to d5/d16/d19/d46/f81 0 2024-04-27T07:33:31.298 INFO:tasks.workunit.client.1.smithi100.stdout:2/303: rename d0 to d0/d1e/d69 22 2024-04-27T07:33:31.299 INFO:tasks.workunit.client.0.smithi082.stdout:0/934: unlink da/d38/d7f/d4a/d80/da0/dd5/d13e/c10b 0 2024-04-27T07:33:31.300 INFO:tasks.workunit.client.1.smithi100.stdout:2/304: chown d0/da/l62 4327 1 2024-04-27T07:33:31.301 INFO:tasks.workunit.client.0.smithi082.stdout:0/935: symlink da/d28/d36/d137/l15a 0 2024-04-27T07:33:31.302 INFO:tasks.workunit.client.1.smithi100.stdout:8/277: link d6/f7 d6/d20/d46/f57 0 2024-04-27T07:33:31.304 INFO:tasks.workunit.client.1.smithi100.stdout:9/295: write d1/d9/db/f1e [423774,52535] 0 2024-04-27T07:33:31.304 INFO:tasks.workunit.client.1.smithi100.stdout:3/356: dread d7/d9/d26/d45/f49 [0,4194304] 0 2024-04-27T07:33:31.304 INFO:tasks.workunit.client.1.smithi100.stdout:0/315: write d1/d8/d20/f4b [375443,42487] 0 2024-04-27T07:33:31.306 INFO:tasks.workunit.client.0.smithi082.stdout:0/936: creat da/d38/d7f/d4a/d80/f15b x:0 0 0 2024-04-27T07:33:31.306 INFO:tasks.workunit.client.1.smithi100.stdout:8/278: chown d6/d20/d50 15 1 2024-04-27T07:33:31.307 INFO:tasks.workunit.client.1.smithi100.stdout:0/316: readlink d1/d8/l5d 0 2024-04-27T07:33:31.309 INFO:tasks.workunit.client.1.smithi100.stdout:9/296: read d1/d9/db/f2e [3843270,58776] 0 2024-04-27T07:33:31.310 INFO:tasks.workunit.client.1.smithi100.stdout:1/460: mknod d0/d1f/d27/d40/c92 0 2024-04-27T07:33:31.310 INFO:tasks.workunit.client.1.smithi100.stdout:6/326: dread fc [0,4194304] 0 2024-04-27T07:33:31.312 INFO:tasks.workunit.client.0.smithi082.stdout:0/937: dwrite da/d38/f11e [0,4194304] 0 2024-04-27T07:33:31.312 INFO:tasks.workunit.client.1.smithi100.stdout:4/372: dwrite d5/d16/d4c/f7c [0,4194304] 0 2024-04-27T07:33:31.314 INFO:tasks.workunit.client.1.smithi100.stdout:8/279: rmdir d6/d20 39 2024-04-27T07:33:31.319 INFO:tasks.workunit.client.0.smithi082.stdout:0/938: getdents da/d28/d36/d40 0 2024-04-27T07:33:31.319 INFO:tasks.workunit.client.0.smithi082.stdout:0/939: write da/fe [383113,60534] 0 2024-04-27T07:33:31.319 INFO:tasks.workunit.client.1.smithi100.stdout:4/373: stat d5/d1b/d2c 0 2024-04-27T07:33:31.320 INFO:tasks.workunit.client.0.smithi082.stdout:0/940: rmdir da/d38/d7f/d4a/d80/da0/dd5/ddf 39 2024-04-27T07:33:31.320 INFO:tasks.workunit.client.1.smithi100.stdout:5/252: unlink d0/d4/f1e 0 2024-04-27T07:33:31.320 INFO:tasks.workunit.client.1.smithi100.stdout:6/327: truncate de/d58/d28/f2f 951843 0 2024-04-27T07:33:31.322 INFO:tasks.workunit.client.1.smithi100.stdout:9/297: dwrite d1/f22 [0,4194304] 0 2024-04-27T07:33:31.323 INFO:tasks.workunit.client.1.smithi100.stdout:6/328: fsync de/d58/d21/d23/f5a 0 2024-04-27T07:33:31.324 INFO:tasks.workunit.client.1.smithi100.stdout:0/317: rename d1/d8/d20/d1e/f21 to d1/d8/d20/d1e/f6e 0 2024-04-27T07:33:31.327 INFO:tasks.workunit.client.1.smithi100.stdout:8/280: chown d6/la 255120450 1 2024-04-27T07:33:31.329 INFO:tasks.workunit.client.1.smithi100.stdout:2/305: rename d0/da/d29/d26/d3e/l61 to d0/d1e/l6a 0 2024-04-27T07:33:31.331 INFO:tasks.workunit.client.1.smithi100.stdout:4/374: creat d5/f82 x:0 0 0 2024-04-27T07:33:31.332 INFO:tasks.workunit.client.1.smithi100.stdout:2/306: truncate d0/da/d3a/f48 745056 0 2024-04-27T07:33:31.333 INFO:tasks.workunit.client.1.smithi100.stdout:6/329: dwrite de/d58/d21/d5b/f6f [0,4194304] 0 2024-04-27T07:33:31.334 INFO:tasks.workunit.client.1.smithi100.stdout:4/375: read - d5/d1b/d2c/d3f/f63 zero size 2024-04-27T07:33:31.335 INFO:tasks.workunit.client.1.smithi100.stdout:8/281: unlink l3 0 2024-04-27T07:33:31.335 INFO:tasks.workunit.client.1.smithi100.stdout:4/376: chown d5/d16/d2e/d5a/l67 201374869 1 2024-04-27T07:33:31.337 INFO:tasks.workunit.client.1.smithi100.stdout:5/253: symlink d0/d4/d28/d37/d48/l4f 0 2024-04-27T07:33:31.339 INFO:tasks.workunit.client.1.smithi100.stdout:6/330: creat de/d2e/f78 x:0 0 0 2024-04-27T07:33:31.340 INFO:tasks.workunit.client.1.smithi100.stdout:6/331: write de/d58/d21/f32 [2373055,34519] 0 2024-04-27T07:33:31.342 INFO:tasks.workunit.client.1.smithi100.stdout:1/461: link d0/d1f/d27/d4e/c53 d0/d1f/d6d/c93 0 2024-04-27T07:33:31.344 INFO:tasks.workunit.client.1.smithi100.stdout:1/462: write d0/d1f/f8f [97985,20866] 0 2024-04-27T07:33:31.345 INFO:tasks.workunit.client.1.smithi100.stdout:2/307: creat d0/da/f6b x:0 0 0 2024-04-27T07:33:31.348 INFO:tasks.workunit.client.1.smithi100.stdout:6/332: rename de/d58/d21/d23/f5a to de/d58/d28/f79 0 2024-04-27T07:33:31.349 INFO:tasks.workunit.client.1.smithi100.stdout:4/377: dwrite d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:31.351 INFO:tasks.workunit.client.1.smithi100.stdout:4/378: truncate d5/d1b/f5f 4731157 0 2024-04-27T07:33:31.352 INFO:tasks.workunit.client.1.smithi100.stdout:2/308: rmdir d0/d1e/d51 39 2024-04-27T07:33:31.353 INFO:tasks.workunit.client.1.smithi100.stdout:3/357: truncate d7/d9/d26/f38 2808996 0 2024-04-27T07:33:31.355 INFO:tasks.workunit.client.1.smithi100.stdout:2/309: write d0/da/f6b [649607,67117] 0 2024-04-27T07:33:31.356 INFO:tasks.workunit.client.1.smithi100.stdout:6/333: mknod de/d58/d21/d23/c7a 0 2024-04-27T07:33:31.359 INFO:tasks.workunit.client.1.smithi100.stdout:2/310: write d0/da/f1c [2257253,12471] 0 2024-04-27T07:33:31.361 INFO:tasks.workunit.client.1.smithi100.stdout:3/358: symlink d7/d9/d10/d3e/l78 0 2024-04-27T07:33:31.361 INFO:tasks.workunit.client.1.smithi100.stdout:0/318: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:31.362 INFO:tasks.workunit.client.1.smithi100.stdout:8/282: dread d6/ff [0,4194304] 0 2024-04-27T07:33:31.363 INFO:tasks.workunit.client.1.smithi100.stdout:6/334: truncate de/d58/d28/f79 360974 0 2024-04-27T07:33:31.363 INFO:tasks.workunit.client.1.smithi100.stdout:1/463: rename d0/d1f/d27/d40/f70 to d0/d1b/d20/f94 0 2024-04-27T07:33:31.365 INFO:tasks.workunit.client.1.smithi100.stdout:4/379: dwrite d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:31.367 INFO:tasks.workunit.client.1.smithi100.stdout:2/311: write d0/da/d29/d26/f45 [1211393,3092] 0 2024-04-27T07:33:31.373 INFO:tasks.workunit.client.1.smithi100.stdout:6/335: rename de/d58/d21/d24/l33 to de/d58/d21/d24/l7b 0 2024-04-27T07:33:31.376 INFO:tasks.workunit.client.1.smithi100.stdout:8/283: getdents d6/d1b 0 2024-04-27T07:33:31.377 INFO:tasks.workunit.client.1.smithi100.stdout:4/380: dread d5/f15 [0,4194304] 0 2024-04-27T07:33:31.377 INFO:tasks.workunit.client.1.smithi100.stdout:2/312: mknod d0/c6c 0 2024-04-27T07:33:31.377 INFO:tasks.workunit.client.1.smithi100.stdout:3/359: dwrite d7/d9/d26/d45/f67 [0,4194304] 0 2024-04-27T07:33:31.378 INFO:tasks.workunit.client.1.smithi100.stdout:4/381: stat d5/fe 0 2024-04-27T07:33:31.379 INFO:tasks.workunit.client.1.smithi100.stdout:1/464: dwrite d0/d23/d3a/f41 [0,4194304] 0 2024-04-27T07:33:31.380 INFO:tasks.workunit.client.1.smithi100.stdout:6/336: truncate f6 1460849 0 2024-04-27T07:33:31.380 INFO:tasks.workunit.client.1.smithi100.stdout:2/313: chown d0/da/d39/c4e 117 1 2024-04-27T07:33:31.381 INFO:tasks.workunit.client.1.smithi100.stdout:3/360: chown d7/d9/d10/d28/d2c/f2e 2 1 2024-04-27T07:33:31.382 INFO:tasks.workunit.client.1.smithi100.stdout:0/319: link d1/d38/d3a/c56 d1/d38/c6f 0 2024-04-27T07:33:31.385 INFO:tasks.workunit.client.0.smithi082.stdout:4/918: sync 2024-04-27T07:33:31.387 INFO:tasks.workunit.client.1.smithi100.stdout:3/361: rmdir d7/d9/d10/d3e/d55 39 2024-04-27T07:33:31.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/941: fdatasync da/d38/d7f/d4a/d80/da0/dd5/ddf/f110 0 2024-04-27T07:33:31.391 INFO:tasks.workunit.client.1.smithi100.stdout:2/314: dread d0/da/d29/d26/f45 [0,4194304] 0 2024-04-27T07:33:31.391 INFO:tasks.workunit.client.1.smithi100.stdout:2/315: stat d0/c38 0 2024-04-27T07:33:31.395 INFO:tasks.workunit.client.1.smithi100.stdout:4/382: dread d5/d1b/d2c/f64 [0,4194304] 0 2024-04-27T07:33:31.396 INFO:tasks.workunit.client.0.smithi082.stdout:0/942: read da/d3c/f82 [14664,124537] 0 2024-04-27T07:33:31.397 INFO:tasks.workunit.client.1.smithi100.stdout:2/316: dread d0/d1e/f33 [0,4194304] 0 2024-04-27T07:33:31.399 INFO:tasks.workunit.client.1.smithi100.stdout:0/320: creat d1/d8/d20/d61/d6a/f70 x:0 0 0 2024-04-27T07:33:31.401 INFO:tasks.workunit.client.1.smithi100.stdout:4/383: rmdir d5/d1b/d65 39 2024-04-27T07:33:31.403 INFO:tasks.workunit.client.0.smithi082.stdout:0/943: dwrite da/d3c/d3f/d4c/d95/de9/def/d81/f147 [0,4194304] 0 2024-04-27T07:33:31.404 INFO:tasks.workunit.client.0.smithi082.stdout:0/944: dread - da/d1d/d6a/dd0/f124 zero size 2024-04-27T07:33:31.405 INFO:tasks.workunit.client.1.smithi100.stdout:3/362: dwrite d7/d9/d26/d45/f49 [4194304,4194304] 0 2024-04-27T07:33:31.406 INFO:tasks.workunit.client.1.smithi100.stdout:3/363: write d7/d9/d10/f29 [1722617,95990] 0 2024-04-27T07:33:31.410 INFO:tasks.workunit.client.1.smithi100.stdout:0/321: mknod d1/d8/d20/d61/d6a/c71 0 2024-04-27T07:33:31.413 INFO:tasks.workunit.client.1.smithi100.stdout:8/284: write d6/f17 [3487891,62542] 0 2024-04-27T07:33:31.417 INFO:tasks.workunit.client.1.smithi100.stdout:3/364: dwrite d7/d9/d10/d33/f41 [0,4194304] 0 2024-04-27T07:33:31.418 INFO:tasks.workunit.client.1.smithi100.stdout:1/465: write d0/d1f/d27/f39 [3212055,92562] 0 2024-04-27T07:33:31.422 INFO:tasks.workunit.client.1.smithi100.stdout:2/317: creat d0/da/f6d x:0 0 0 2024-04-27T07:33:31.424 INFO:tasks.workunit.client.1.smithi100.stdout:8/285: read f1 [2600761,26662] 0 2024-04-27T07:33:31.425 INFO:tasks.workunit.client.1.smithi100.stdout:6/337: dread de/f17 [0,4194304] 0 2024-04-27T07:33:31.426 INFO:tasks.workunit.client.1.smithi100.stdout:6/338: stat de/d58/d28 0 2024-04-27T07:33:31.426 INFO:tasks.workunit.client.1.smithi100.stdout:3/365: creat d7/d9/d10/d33/f79 x:0 0 0 2024-04-27T07:33:31.428 INFO:tasks.workunit.client.1.smithi100.stdout:6/339: chown de/d58/d28/f4f 13562 1 2024-04-27T07:33:31.429 INFO:tasks.workunit.client.1.smithi100.stdout:1/466: rmdir d0/d1f/d27/d4e 39 2024-04-27T07:33:31.429 INFO:tasks.workunit.client.1.smithi100.stdout:0/322: mkdir d1/d8/d20/d72 0 2024-04-27T07:33:31.432 INFO:tasks.workunit.client.1.smithi100.stdout:4/384: dwrite d5/fc [0,4194304] 0 2024-04-27T07:33:31.432 INFO:tasks.workunit.client.1.smithi100.stdout:3/366: mknod d7/d9/d10/c7a 0 2024-04-27T07:33:31.433 INFO:tasks.workunit.client.1.smithi100.stdout:2/318: read - d0/d1e/d51/f63 zero size 2024-04-27T07:33:31.434 INFO:tasks.workunit.client.1.smithi100.stdout:8/286: dread d6/fb [0,4194304] 0 2024-04-27T07:33:31.435 INFO:tasks.workunit.client.1.smithi100.stdout:1/467: unlink d0/c3c 0 2024-04-27T07:33:31.435 INFO:tasks.workunit.client.1.smithi100.stdout:3/367: fdatasync d7/d9/d26/d45/f67 0 2024-04-27T07:33:31.439 INFO:tasks.workunit.client.1.smithi100.stdout:3/368: write d7/d9/d26/d2a/d5e/f72 [530000,18064] 0 2024-04-27T07:33:31.440 INFO:tasks.workunit.client.1.smithi100.stdout:2/319: rename d0/da/d29/d26 to d0/da/d29/d6e 0 2024-04-27T07:33:31.441 INFO:tasks.workunit.client.1.smithi100.stdout:6/340: dread de/d58/f71 [0,4194304] 0 2024-04-27T07:33:31.442 INFO:tasks.workunit.client.1.smithi100.stdout:0/323: dwrite d1/d8/d20/f2b [0,4194304] 0 2024-04-27T07:33:31.443 INFO:tasks.workunit.client.1.smithi100.stdout:6/341: chown de/d58/d21/d24/f46 125675 1 2024-04-27T07:33:31.443 INFO:tasks.workunit.client.1.smithi100.stdout:0/324: readlink d1/d30/l31 0 2024-04-27T07:33:31.444 INFO:tasks.workunit.client.1.smithi100.stdout:4/385: rename d5/d16/d2e/l47 to d5/d23/l83 0 2024-04-27T07:33:31.446 INFO:tasks.workunit.client.1.smithi100.stdout:6/342: fsync de/f3c 0 2024-04-27T07:33:31.446 INFO:tasks.workunit.client.1.smithi100.stdout:8/287: creat d6/d1b/d1d/d47/f58 x:0 0 0 2024-04-27T07:33:31.447 INFO:tasks.workunit.client.1.smithi100.stdout:1/468: mknod d0/d1f/d27/d40/c95 0 2024-04-27T07:33:31.449 INFO:tasks.workunit.client.1.smithi100.stdout:6/343: write de/d58/f37 [4352692,116721] 0 2024-04-27T07:33:31.450 INFO:tasks.workunit.client.1.smithi100.stdout:3/369: dwrite f6 [0,4194304] 0 2024-04-27T07:33:31.450 INFO:tasks.workunit.client.1.smithi100.stdout:0/325: truncate d1/d8/d20/f3b 1014223 0 2024-04-27T07:33:31.452 INFO:tasks.workunit.client.1.smithi100.stdout:3/370: chown d7/d9/d10/d33/f41 34336876 1 2024-04-27T07:33:31.454 INFO:tasks.workunit.client.1.smithi100.stdout:4/386: mkdir d5/d1b/d2c/d7d/d84 0 2024-04-27T07:33:31.456 INFO:tasks.workunit.client.1.smithi100.stdout:4/387: write d5/d16/d4c/f7f [166041,63555] 0 2024-04-27T07:33:31.457 INFO:tasks.workunit.client.1.smithi100.stdout:4/388: stat d5/c14 0 2024-04-27T07:33:31.458 INFO:tasks.workunit.client.1.smithi100.stdout:6/344: dread de/d58/d28/f47 [0,4194304] 0 2024-04-27T07:33:31.462 INFO:tasks.workunit.client.1.smithi100.stdout:0/326: dread d1/d8/d20/f4b [0,4194304] 0 2024-04-27T07:33:31.464 INFO:tasks.workunit.client.1.smithi100.stdout:8/288: fdatasync d6/d20/d50/f52 0 2024-04-27T07:33:31.464 INFO:tasks.workunit.client.1.smithi100.stdout:0/327: readlink d1/d8/d20/l2d 0 2024-04-27T07:33:31.467 INFO:tasks.workunit.client.1.smithi100.stdout:6/345: dwrite de/d58/d21/d24/f2b [4194304,4194304] 0 2024-04-27T07:33:31.470 INFO:tasks.workunit.client.1.smithi100.stdout:3/371: link d7/d9/d10/d33/d47/f4f d7/d9/d10/f7b 0 2024-04-27T07:33:31.471 INFO:tasks.workunit.client.1.smithi100.stdout:3/372: chown d7/d9/d10/f3d 37 1 2024-04-27T07:33:31.471 INFO:tasks.workunit.client.1.smithi100.stdout:2/320: getdents d0/da/d3a 0 2024-04-27T07:33:31.472 INFO:tasks.workunit.client.1.smithi100.stdout:3/373: fdatasync d7/d9/d26/f32 0 2024-04-27T07:33:31.474 INFO:tasks.workunit.client.1.smithi100.stdout:3/374: write d7/d9/d10/d33/f79 [640915,12082] 0 2024-04-27T07:33:31.475 INFO:tasks.workunit.client.1.smithi100.stdout:0/328: creat d1/d30/f73 x:0 0 0 2024-04-27T07:33:31.476 INFO:tasks.workunit.client.1.smithi100.stdout:0/329: fsync d1/f5 0 2024-04-27T07:33:31.477 INFO:tasks.workunit.client.1.smithi100.stdout:3/375: stat d7/d9/d10/d28/d2c/f34 0 2024-04-27T07:33:31.477 INFO:tasks.workunit.client.1.smithi100.stdout:0/330: readlink d1/l35 0 2024-04-27T07:33:31.477 INFO:tasks.workunit.client.1.smithi100.stdout:8/289: unlink d6/d1b/d1d/c3d 0 2024-04-27T07:33:31.480 INFO:tasks.workunit.client.1.smithi100.stdout:6/346: creat de/d58/f7c x:0 0 0 2024-04-27T07:33:31.483 INFO:tasks.workunit.client.1.smithi100.stdout:1/469: getdents d0/d1f/d27 0 2024-04-27T07:33:31.483 INFO:tasks.workunit.client.1.smithi100.stdout:2/321: dread d0/d1e/f33 [0,4194304] 0 2024-04-27T07:33:31.483 INFO:tasks.workunit.client.1.smithi100.stdout:1/470: stat d0/d1b/d20/f51 0 2024-04-27T07:33:31.486 INFO:tasks.workunit.client.1.smithi100.stdout:4/389: link d5/d16/d19/d46/l70 d5/d1b/d2c/l85 0 2024-04-27T07:33:31.486 INFO:tasks.workunit.client.1.smithi100.stdout:4/390: chown d5/d16/d2e/f38 2126269071 1 2024-04-27T07:33:31.487 INFO:tasks.workunit.client.1.smithi100.stdout:6/347: mkdir de/d58/d7d 0 2024-04-27T07:33:31.488 INFO:tasks.workunit.client.1.smithi100.stdout:1/471: creat d0/d1b/f96 x:0 0 0 2024-04-27T07:33:31.491 INFO:tasks.workunit.client.1.smithi100.stdout:0/331: creat d1/d8/d20/f74 x:0 0 0 2024-04-27T07:33:31.493 INFO:tasks.workunit.client.1.smithi100.stdout:8/290: rename d6/d1b/d1d/d47 to d6/d1b/d1d/d59 0 2024-04-27T07:33:31.494 INFO:tasks.workunit.client.1.smithi100.stdout:8/291: write d6/d1b/f34 [1552825,806] 0 2024-04-27T07:33:31.494 INFO:tasks.workunit.client.1.smithi100.stdout:1/472: mkdir d0/d1f/d97 0 2024-04-27T07:33:31.504 INFO:tasks.workunit.client.1.smithi100.stdout:7/276: sync 2024-04-27T07:33:31.534 INFO:tasks.workunit.client.1.smithi100.stdout:1/473: chown d0/d1b/d20/d2d/f2e 475560712 1 2024-04-27T07:33:31.535 INFO:tasks.workunit.client.1.smithi100.stdout:3/376: rename d7/d9/d10/d3e/d55/f76 to d7/d9/d10/d3e/f7c 0 2024-04-27T07:33:31.536 INFO:tasks.workunit.client.1.smithi100.stdout:2/322: getdents d0 0 2024-04-27T07:33:31.538 INFO:tasks.workunit.client.1.smithi100.stdout:7/277: mkdir d1/d54 0 2024-04-27T07:33:31.538 INFO:tasks.workunit.client.1.smithi100.stdout:8/292: truncate d6/f45 528882 0 2024-04-27T07:33:31.569 INFO:tasks.workunit.client.0.smithi082.stdout:2/772: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:5/885: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:4/919: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:8/741: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:1/743: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:9/715: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:6/787: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:0/945: sync 2024-04-27T07:33:31.570 INFO:tasks.workunit.client.0.smithi082.stdout:7/839: sync 2024-04-27T07:33:31.573 INFO:tasks.workunit.client.0.smithi082.stdout:8/742: readlink d0/d2b/d80/dca/de6/d87/l48 0 2024-04-27T07:33:31.575 INFO:tasks.workunit.client.0.smithi082.stdout:9/716: creat d9/da/d85/ff2 x:0 0 0 2024-04-27T07:33:31.575 INFO:tasks.workunit.client.0.smithi082.stdout:6/788: mknod d2/d1e/d32/d85/c10a 0 2024-04-27T07:33:31.577 INFO:tasks.workunit.client.0.smithi082.stdout:1/744: write d4/f22 [589805,35086] 0 2024-04-27T07:33:31.581 INFO:tasks.workunit.client.0.smithi082.stdout:7/840: truncate d3/d49/d97/d3a/d2a/f81 670079 0 2024-04-27T07:33:31.582 INFO:tasks.workunit.client.0.smithi082.stdout:9/717: mknod d9/d2d/d2b/d46/db6/cf3 0 2024-04-27T07:33:31.588 INFO:tasks.workunit.client.1.smithi100.stdout:6/348: dread de/d58/d21/f32 [0,4194304] 0 2024-04-27T07:33:31.588 INFO:tasks.workunit.client.0.smithi082.stdout:4/920: rename d3/d6/d26/d5e/d11e/d101/d69/l10e to d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d123/l131 0 2024-04-27T07:33:31.589 INFO:tasks.workunit.client.0.smithi082.stdout:5/886: dwrite d8/d29/dea/d5f/d100/f113 [0,4194304] 0 2024-04-27T07:33:31.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/946: dwrite da/d3c/d3f/d57/dcc/f157 [0,4194304] 0 2024-04-27T07:33:31.590 INFO:tasks.workunit.client.1.smithi100.stdout:1/474: getdents d0/d1b 0 2024-04-27T07:33:31.592 INFO:tasks.workunit.client.1.smithi100.stdout:7/278: dread - d1/dd/d16/d31/d4c/d4d/d3b/d40/f4e zero size 2024-04-27T07:33:31.592 INFO:tasks.workunit.client.1.smithi100.stdout:0/332: dread d1/d30/f4e [0,4194304] 0 2024-04-27T07:33:31.593 INFO:tasks.workunit.client.0.smithi082.stdout:1/745: unlink d4/d15/d49/dab/dc3/d3e/d57/c65 0 2024-04-27T07:33:31.594 INFO:tasks.workunit.client.1.smithi100.stdout:6/349: chown de/d58/d28/f4f 926318 1 2024-04-27T07:33:31.595 INFO:tasks.workunit.client.1.smithi100.stdout:3/377: dwrite d7/d9/d10/f29 [0,4194304] 0 2024-04-27T07:33:31.597 INFO:tasks.workunit.client.1.smithi100.stdout:0/333: dread - d1/d8/d20/f74 zero size 2024-04-27T07:33:31.598 INFO:tasks.workunit.client.1.smithi100.stdout:2/323: dwrite d0/da/d29/d6e/d5d/f67 [0,4194304] 0 2024-04-27T07:33:31.599 INFO:tasks.workunit.client.0.smithi082.stdout:2/773: dread f3 [0,4194304] 0 2024-04-27T07:33:31.601 INFO:tasks.workunit.client.0.smithi082.stdout:8/743: rename d0/d2b/d80/dca/de6/d1b/d29/c9f to d0/d2b/d80/dca/de6/d1b/d29/d65/de7/cf1 0 2024-04-27T07:33:31.601 INFO:tasks.workunit.client.0.smithi082.stdout:6/789: dwrite d2/d2d/d4a/ff3 [0,4194304] 0 2024-04-27T07:33:31.602 INFO:tasks.workunit.client.1.smithi100.stdout:3/378: write d7/d9/d10/f15 [4692501,125539] 0 2024-04-27T07:33:31.602 INFO:tasks.workunit.client.0.smithi082.stdout:9/718: truncate d9/da/dc/d88/da8/fb2 14619 0 2024-04-27T07:33:31.602 INFO:tasks.workunit.client.1.smithi100.stdout:7/279: symlink d1/dd/d16/l55 0 2024-04-27T07:33:31.603 INFO:tasks.workunit.client.1.smithi100.stdout:2/324: read d0/d1e/d51/f59 [185443,12025] 0 2024-04-27T07:33:31.603 INFO:tasks.workunit.client.1.smithi100.stdout:0/334: mknod d1/d30/c75 0 2024-04-27T07:33:31.603 INFO:tasks.workunit.client.0.smithi082.stdout:0/947: fsync da/d3c/d3f/d4c/f143 0 2024-04-27T07:33:31.606 INFO:tasks.workunit.client.1.smithi100.stdout:3/379: chown d7/d9/d26/d2a/d5e/f72 506311 1 2024-04-27T07:33:31.606 INFO:tasks.workunit.client.1.smithi100.stdout:2/325: chown d0/da/d29/d47/f5e 104078 1 2024-04-27T07:33:31.606 INFO:tasks.workunit.client.1.smithi100.stdout:7/280: truncate d1/f6 2626438 0 2024-04-27T07:33:31.606 INFO:tasks.workunit.client.1.smithi100.stdout:6/350: dread de/f17 [0,4194304] 0 2024-04-27T07:33:31.608 INFO:tasks.workunit.client.1.smithi100.stdout:0/335: getdents d1/d8/d20/d1e 0 2024-04-27T07:33:31.610 INFO:tasks.workunit.client.1.smithi100.stdout:3/380: rmdir d7/d9/d10/d3e 39 2024-04-27T07:33:31.611 INFO:tasks.workunit.client.0.smithi082.stdout:6/790: readlink d2/d2e/d55/dd0/lf0 0 2024-04-27T07:33:31.612 INFO:tasks.workunit.client.1.smithi100.stdout:3/381: readlink d7/d9/d10/d33/l36 0 2024-04-27T07:33:31.614 INFO:tasks.workunit.client.0.smithi082.stdout:9/719: dread - d9/da/dc/fd7 zero size 2024-04-27T07:33:31.614 INFO:tasks.workunit.client.0.smithi082.stdout:1/746: read d4/d15/d29/f7d [2240696,99315] 0 2024-04-27T07:33:31.614 INFO:tasks.workunit.client.0.smithi082.stdout:6/791: chown d2/d3/d1b/fc0 3876 1 2024-04-27T07:33:31.615 INFO:tasks.workunit.client.0.smithi082.stdout:7/841: rename d3/d49/d97/d3a/d71/l89 to d3/d49/d97/d3a/d2a/dac/dae/dce/l128 0 2024-04-27T07:33:31.616 INFO:tasks.workunit.client.1.smithi100.stdout:6/351: rmdir de/d58/d75 39 2024-04-27T07:33:31.618 INFO:tasks.workunit.client.1.smithi100.stdout:7/281: dread d1/dd/d16/f2d [0,4194304] 0 2024-04-27T07:33:31.618 INFO:tasks.workunit.client.1.smithi100.stdout:2/326: dwrite d0/da/f6d [0,4194304] 0 2024-04-27T07:33:31.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/382: creat d7/d9/d10/d28/f7d x:0 0 0 2024-04-27T07:33:31.619 INFO:tasks.workunit.client.0.smithi082.stdout:2/774: dwrite d7/d9/fce [0,4194304] 0 2024-04-27T07:33:31.621 INFO:tasks.workunit.client.0.smithi082.stdout:4/921: dread d3/d6/d26/d55/d67/f86 [0,4194304] 0 2024-04-27T07:33:31.623 INFO:tasks.workunit.client.1.smithi100.stdout:2/327: chown d0/d1e/d51/f63 59 1 2024-04-27T07:33:31.623 INFO:tasks.workunit.client.1.smithi100.stdout:8/293: dread d6/d1b/d1d/f32 [0,4194304] 0 2024-04-27T07:33:31.624 INFO:tasks.workunit.client.0.smithi082.stdout:8/744: rename d0/d2b/fdd to d0/d2b/d80/dca/de6/d1b/d29/d6a/ff2 0 2024-04-27T07:33:31.625 INFO:tasks.workunit.client.1.smithi100.stdout:0/336: dwrite d1/d8/d20/d61/f63 [0,4194304] 0 2024-04-27T07:33:31.626 INFO:tasks.workunit.client.0.smithi082.stdout:5/887: getdents d8/d29/dea/da3 0 2024-04-27T07:33:31.626 INFO:tasks.workunit.client.1.smithi100.stdout:0/337: chown d1/d8/d20 7828 1 2024-04-27T07:33:31.627 INFO:tasks.workunit.client.1.smithi100.stdout:7/282: mkdir d1/dd/d16/d4a/d56 0 2024-04-27T07:33:31.628 INFO:tasks.workunit.client.1.smithi100.stdout:1/475: truncate d0/f16 2432409 0 2024-04-27T07:33:31.630 INFO:tasks.workunit.client.1.smithi100.stdout:8/294: unlink c5 0 2024-04-27T07:33:31.631 INFO:tasks.workunit.client.1.smithi100.stdout:8/295: fdatasync d6/f8 0 2024-04-27T07:33:31.632 INFO:tasks.workunit.client.1.smithi100.stdout:2/328: creat d0/da/d3a/f6f x:0 0 0 2024-04-27T07:33:31.633 INFO:tasks.workunit.client.1.smithi100.stdout:8/296: chown d6/fb 137862 1 2024-04-27T07:33:31.633 INFO:tasks.workunit.client.0.smithi082.stdout:2/775: mknod d7/d8/dd9/c101 0 2024-04-27T07:33:31.634 INFO:tasks.workunit.client.1.smithi100.stdout:8/297: readlink d6/d1b/d1d/l36 0 2024-04-27T07:33:31.635 INFO:tasks.workunit.client.1.smithi100.stdout:8/298: fdatasync d6/d1b/d1d/f2c 0 2024-04-27T07:33:31.636 INFO:tasks.workunit.client.0.smithi082.stdout:2/776: write d7/d30/d23/fe5 [191351,21656] 0 2024-04-27T07:33:31.636 INFO:tasks.workunit.client.1.smithi100.stdout:6/352: truncate de/d58/f29 3469114 0 2024-04-27T07:33:31.636 INFO:tasks.workunit.client.1.smithi100.stdout:2/329: dread d0/da/d29/d6e/f45 [0,4194304] 0 2024-04-27T07:33:31.637 INFO:tasks.workunit.client.1.smithi100.stdout:2/330: stat d0/d1e/f57 0 2024-04-27T07:33:31.638 INFO:tasks.workunit.client.1.smithi100.stdout:1/476: chown d0/d1b/d20/d2d/d35/c3b 5012071 1 2024-04-27T07:33:31.640 INFO:tasks.workunit.client.1.smithi100.stdout:0/338: symlink d1/l76 0 2024-04-27T07:33:31.641 INFO:tasks.workunit.client.0.smithi082.stdout:0/948: rename da/d28/l78 to da/d3c/d3f/d4c/d105/l15c 0 2024-04-27T07:33:31.642 INFO:tasks.workunit.client.1.smithi100.stdout:0/339: readlink d1/d8/d14/l32 0 2024-04-27T07:33:31.642 INFO:tasks.workunit.client.1.smithi100.stdout:8/299: mknod d6/d20/d2a/c5a 0 2024-04-27T07:33:31.642 INFO:tasks.workunit.client.0.smithi082.stdout:8/745: symlink d0/d2b/d80/dca/de6/d87/d46/d4e/lf3 0 2024-04-27T07:33:31.643 INFO:tasks.workunit.client.1.smithi100.stdout:2/331: dread d0/da/f6b [0,4194304] 0 2024-04-27T07:33:31.643 INFO:tasks.workunit.client.0.smithi082.stdout:9/720: dwrite d9/da/dc/d35/d38/d65/fc7 [0,4194304] 0 2024-04-27T07:33:31.644 INFO:tasks.workunit.client.1.smithi100.stdout:3/383: getdents d7/d9/d26/d45 0 2024-04-27T07:33:31.644 INFO:tasks.workunit.client.1.smithi100.stdout:0/340: fsync d1/d8/d20/f2b 0 2024-04-27T07:33:31.644 INFO:tasks.workunit.client.0.smithi082.stdout:7/842: symlink d3/d49/d97/d3a/l129 0 2024-04-27T07:33:31.647 INFO:tasks.workunit.client.1.smithi100.stdout:6/353: dwrite de/d58/d28/f2f [0,4194304] 0 2024-04-27T07:33:31.648 INFO:tasks.workunit.client.0.smithi082.stdout:6/792: rename d2/d3/d1b/lb5 to d2/d2d/d4a/l10b 0 2024-04-27T07:33:31.649 INFO:tasks.workunit.client.0.smithi082.stdout:5/888: mkdir d8/d29/dea/d5f/d100/df7/d127 0 2024-04-27T07:33:31.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/721: creat d9/d2d/d2b/d46/d76/dcb/ff4 x:0 0 0 2024-04-27T07:33:31.653 INFO:tasks.workunit.client.1.smithi100.stdout:3/384: mkdir d7/d9/d10/d22/d7e 0 2024-04-27T07:33:31.653 INFO:tasks.workunit.client.1.smithi100.stdout:9/298: sync 2024-04-27T07:33:31.655 INFO:tasks.workunit.client.0.smithi082.stdout:8/746: symlink d0/d2b/d80/dca/de6/d87/d42/d7f/d82/lf4 0 2024-04-27T07:33:31.656 INFO:tasks.workunit.client.1.smithi100.stdout:7/283: dwrite d1/dd/d16/d31/d4c/d4d/f25 [0,4194304] 0 2024-04-27T07:33:31.659 INFO:tasks.workunit.client.0.smithi082.stdout:6/793: mkdir d2/d1e/d32/d85/d10c 0 2024-04-27T07:33:31.659 INFO:tasks.workunit.client.1.smithi100.stdout:2/332: chown d0/da/d29/d6e/d5d/c64 3670 1 2024-04-27T07:33:31.661 INFO:tasks.workunit.client.1.smithi100.stdout:8/300: link d6/d1b/d1d/f32 d6/d20/d54/f5b 0 2024-04-27T07:33:31.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/747: getdents d4/d15/d49/dab/dc3/d3e/d57/d101/d98 0 2024-04-27T07:33:31.664 INFO:tasks.workunit.client.1.smithi100.stdout:9/299: symlink d1/d9/db/d2b/l6e 0 2024-04-27T07:33:31.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/922: dread d3/d6/d26/d55/ffc [0,4194304] 0 2024-04-27T07:33:31.666 INFO:tasks.workunit.client.1.smithi100.stdout:0/341: dwrite d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:31.669 INFO:tasks.workunit.client.0.smithi082.stdout:4/923: write d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d98/fa0 [4501577,95014] 0 2024-04-27T07:33:31.671 INFO:tasks.workunit.client.0.smithi082.stdout:7/843: truncate d3/dfb/da1/ff4 205528 0 2024-04-27T07:33:31.672 INFO:tasks.workunit.client.1.smithi100.stdout:6/354: dread f7 [0,4194304] 0 2024-04-27T07:33:31.675 INFO:tasks.workunit.client.1.smithi100.stdout:0/342: fsync d1/d38/f4a 0 2024-04-27T07:33:31.675 INFO:tasks.workunit.client.1.smithi100.stdout:6/355: write de/d58/f7c [250956,16826] 0 2024-04-27T07:33:31.677 INFO:tasks.workunit.client.1.smithi100.stdout:2/333: dwrite d0/da/f1c [0,4194304] 0 2024-04-27T07:33:31.679 INFO:tasks.workunit.client.1.smithi100.stdout:8/301: creat d6/d20/d46/f5c x:0 0 0 2024-04-27T07:33:31.681 INFO:tasks.workunit.client.1.smithi100.stdout:3/385: dwrite d7/d9/d10/f15 [0,4194304] 0 2024-04-27T07:33:31.681 INFO:tasks.workunit.client.1.smithi100.stdout:9/300: chown d1/d9/db/d2b/d4f/d57/f60 16 1 2024-04-27T07:33:31.682 INFO:tasks.workunit.client.1.smithi100.stdout:7/284: rename d1/f1c to d1/dd/d16/d31/d4c/d4d/f57 0 2024-04-27T07:33:31.684 INFO:tasks.workunit.client.1.smithi100.stdout:2/334: rmdir d0/da/d29/d6e 39 2024-04-27T07:33:31.685 INFO:tasks.workunit.client.1.smithi100.stdout:1/477: dwrite d0/d1b/d20/d2d/d35/f7f [0,4194304] 0 2024-04-27T07:33:31.688 INFO:tasks.workunit.client.1.smithi100.stdout:8/302: fsync d6/d1b/f22 0 2024-04-27T07:33:31.688 INFO:tasks.workunit.client.1.smithi100.stdout:7/285: write d1/dd/d16/d3e/f41 [418655,128529] 0 2024-04-27T07:33:31.689 INFO:tasks.workunit.client.0.smithi082.stdout:5/889: dwrite d8/d29/d4e/fbc [0,4194304] 0 2024-04-27T07:33:31.693 INFO:tasks.workunit.client.1.smithi100.stdout:5/254: sync 2024-04-27T07:33:31.693 INFO:tasks.workunit.client.1.smithi100.stdout:4/391: sync 2024-04-27T07:33:31.694 INFO:tasks.workunit.client.1.smithi100.stdout:2/335: mkdir d0/da/d29/d47/d70 0 2024-04-27T07:33:31.698 INFO:tasks.workunit.client.0.smithi082.stdout:0/949: dread da/d3c/d3f/f41 [0,4194304] 0 2024-04-27T07:33:31.699 INFO:tasks.workunit.client.1.smithi100.stdout:2/336: chown d0/l20 1 1 2024-04-27T07:33:31.701 INFO:tasks.workunit.client.0.smithi082.stdout:5/890: dwrite d8/d3c/d64/f36 [4194304,4194304] 0 2024-04-27T07:33:31.701 INFO:tasks.workunit.client.1.smithi100.stdout:3/386: dwrite d7/f1c [0,4194304] 0 2024-04-27T07:33:31.702 INFO:tasks.workunit.client.1.smithi100.stdout:6/356: link de/d58/d21/f32 de/d58/d21/d24/f7e 0 2024-04-27T07:33:31.703 INFO:tasks.workunit.client.0.smithi082.stdout:6/794: dread d2/d1e/f98 [0,4194304] 0 2024-04-27T07:33:31.706 INFO:tasks.workunit.client.1.smithi100.stdout:3/387: readlink d7/d9/d10/d28/d2c/l31 0 2024-04-27T07:33:31.706 INFO:tasks.workunit.client.1.smithi100.stdout:0/343: creat d1/d8/d20/f77 x:0 0 0 2024-04-27T07:33:31.708 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:31 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:31.708 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:31 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:31.708 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:31 smithi082 ceph-mon[26613]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-04-27T07:33:31.708 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:31 smithi082 ceph-mon[26613]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-04-27T07:33:31.709 INFO:tasks.workunit.client.1.smithi100.stdout:8/303: dread d6/d1b/f34 [0,4194304] 0 2024-04-27T07:33:31.709 INFO:tasks.workunit.client.1.smithi100.stdout:7/286: symlink d1/dd/d16/d3e/l58 0 2024-04-27T07:33:31.711 INFO:tasks.workunit.client.1.smithi100.stdout:1/478: rename d0/d1b/d20/d2d/d35/d4d/d60/f64 to d0/d23/d3a/f98 0 2024-04-27T07:33:31.714 INFO:tasks.workunit.client.0.smithi082.stdout:6/795: dwrite d2/f8c [0,4194304] 0 2024-04-27T07:33:31.715 INFO:tasks.workunit.client.0.smithi082.stdout:4/924: dread d3/d6/d26/f33 [4194304,4194304] 0 2024-04-27T07:33:31.717 INFO:tasks.workunit.client.1.smithi100.stdout:0/344: dread d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:31.718 INFO:tasks.workunit.client.1.smithi100.stdout:4/392: mkdir d5/d1b/d2c/d7d/d84/d86 0 2024-04-27T07:33:31.718 INFO:tasks.workunit.client.1.smithi100.stdout:5/255: dread d0/d4/d21/d24/f47 [0,4194304] 0 2024-04-27T07:33:31.719 INFO:tasks.workunit.client.1.smithi100.stdout:0/345: fdatasync d1/d30/f3d 0 2024-04-27T07:33:31.721 INFO:tasks.workunit.client.1.smithi100.stdout:7/287: creat d1/d2f/f59 x:0 0 0 2024-04-27T07:33:31.722 INFO:tasks.workunit.client.1.smithi100.stdout:2/337: rename d0/da/c37 to d0/da/d3a/c71 0 2024-04-27T07:33:31.723 INFO:tasks.workunit.client.0.smithi082.stdout:8/747: mkdir d0/d2b/d80/da9/df5 0 2024-04-27T07:33:31.724 INFO:tasks.workunit.client.0.smithi082.stdout:2/777: link d7/d9/c12 d7/d8/d13/c102 0 2024-04-27T07:33:31.725 INFO:tasks.workunit.client.1.smithi100.stdout:8/304: mknod d6/c5d 0 2024-04-27T07:33:31.725 INFO:tasks.workunit.client.0.smithi082.stdout:2/778: stat d7/d9/f1d 0 2024-04-27T07:33:31.730 INFO:tasks.workunit.client.0.smithi082.stdout:7/844: mkdir d3/d9/d4f/d61/d12a 0 2024-04-27T07:33:31.730 INFO:tasks.workunit.client.0.smithi082.stdout:0/950: symlink da/l15d 0 2024-04-27T07:33:31.730 INFO:tasks.workunit.client.0.smithi082.stdout:5/891: rmdir d8 39 2024-04-27T07:33:31.730 INFO:tasks.workunit.client.0.smithi082.stdout:7/845: dread d3/de9/ff3 [0,4194304] 0 2024-04-27T07:33:31.731 INFO:tasks.workunit.client.1.smithi100.stdout:6/357: rename de/d58/d21/d24/f64 to de/d58/d21/d5b/f7f 0 2024-04-27T07:33:31.731 INFO:tasks.workunit.client.0.smithi082.stdout:7/846: readlink d3/dfb/da1/da3/la4 0 2024-04-27T07:33:31.732 INFO:tasks.workunit.client.0.smithi082.stdout:4/925: creat d3/d6/d26/d5e/d11e/d101/d69/df5/f132 x:0 0 0 2024-04-27T07:33:31.733 INFO:tasks.workunit.client.0.smithi082.stdout:4/926: chown d3/d6/d26/d5e/d21 54 1 2024-04-27T07:33:31.733 INFO:tasks.workunit.client.1.smithi100.stdout:7/288: read d1/f1a [1908634,57720] 0 2024-04-27T07:33:31.734 INFO:tasks.workunit.client.0.smithi082.stdout:8/748: truncate d0/d2b/d80/dca/de6/f18 4329834 0 2024-04-27T07:33:31.734 INFO:tasks.workunit.client.0.smithi082.stdout:2/779: readlink d7/d31/l3e 0 2024-04-27T07:33:31.735 INFO:tasks.workunit.client.1.smithi100.stdout:0/346: creat d1/d8/f78 x:0 0 0 2024-04-27T07:33:31.735 INFO:tasks.workunit.client.1.smithi100.stdout:8/305: dwrite d6/d20/d2a/f49 [0,4194304] 0 2024-04-27T07:33:31.735 INFO:tasks.workunit.client.1.smithi100.stdout:2/338: symlink d0/da/d29/l72 0 2024-04-27T07:33:31.737 INFO:tasks.workunit.client.1.smithi100.stdout:5/256: getdents d0/d4/d28/d37/d48 0 2024-04-27T07:33:31.737 INFO:tasks.workunit.client.1.smithi100.stdout:2/339: chown d0/c38 495 1 2024-04-27T07:33:31.738 INFO:tasks.workunit.client.0.smithi082.stdout:0/951: creat da/d2a/dc4/f15e x:0 0 0 2024-04-27T07:33:31.739 INFO:tasks.workunit.client.1.smithi100.stdout:8/306: stat d6/d1b/d1d/l25 0 2024-04-27T07:33:31.740 INFO:tasks.workunit.client.0.smithi082.stdout:6/796: unlink d2/d2d/c4d 0 2024-04-27T07:33:31.741 INFO:tasks.workunit.client.1.smithi100.stdout:7/289: symlink d1/dd/d16/d4a/d56/l5a 0 2024-04-27T07:33:31.742 INFO:tasks.workunit.client.0.smithi082.stdout:9/722: getdents d9/d2d 0 2024-04-27T07:33:31.742 INFO:tasks.workunit.client.0.smithi082.stdout:7/847: write d3/d9/f37 [7501805,29710] 0 2024-04-27T07:33:31.742 INFO:tasks.workunit.client.0.smithi082.stdout:8/749: dwrite d0/d2b/d80/dca/de6/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:31.744 INFO:tasks.workunit.client.0.smithi082.stdout:2/780: mknod d7/d9/d4f/d66/dd6/c103 0 2024-04-27T07:33:31.744 INFO:tasks.workunit.client.0.smithi082.stdout:4/927: write d3/d9/f6a [5602094,93141] 0 2024-04-27T07:33:31.744 INFO:tasks.workunit.client.1.smithi100.stdout:5/257: fdatasync d0/d4/d28/d37/d1a/d34/f38 0 2024-04-27T07:33:31.746 INFO:tasks.workunit.client.1.smithi100.stdout:3/388: dread d7/d9/d26/f32 [0,4194304] 0 2024-04-27T07:33:31.748 INFO:tasks.workunit.client.0.smithi082.stdout:0/952: creat da/d28/d109/f15f x:0 0 0 2024-04-27T07:33:31.749 INFO:tasks.workunit.client.1.smithi100.stdout:4/393: dread d5/d16/d19/d21/d2b/f51 [4194304,4194304] 0 2024-04-27T07:33:31.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/848: creat d3/dfb/f12b x:0 0 0 2024-04-27T07:33:31.750 INFO:tasks.workunit.client.0.smithi082.stdout:8/750: rmdir d0/d2b/d80/da9/dc6 39 2024-04-27T07:33:31.750 INFO:tasks.workunit.client.1.smithi100.stdout:0/347: dwrite d1/d8/d20/f3b [0,4194304] 0 2024-04-27T07:33:31.750 INFO:tasks.workunit.client.1.smithi100.stdout:8/307: symlink d6/d1b/d1d/d59/d4f/l5e 0 2024-04-27T07:33:31.751 INFO:tasks.workunit.client.0.smithi082.stdout:2/781: creat d7/d8/dd9/f104 x:0 0 0 2024-04-27T07:33:31.752 INFO:tasks.workunit.client.0.smithi082.stdout:5/892: fdatasync d8/d14/f21 0 2024-04-27T07:33:31.753 INFO:tasks.workunit.client.0.smithi082.stdout:6/797: dread d2/d45/f42 [0,4194304] 0 2024-04-27T07:33:31.753 INFO:tasks.workunit.client.0.smithi082.stdout:5/893: chown d8/d42/d123/f124 1010626 1 2024-04-27T07:33:31.754 INFO:tasks.workunit.client.1.smithi100.stdout:3/389: write d7/d9/d10/d28/d2c/f57 [885286,18180] 0 2024-04-27T07:33:31.757 INFO:tasks.workunit.client.1.smithi100.stdout:4/394: read - d5/d16/d4c/f5d zero size 2024-04-27T07:33:31.757 INFO:tasks.workunit.client.1.smithi100.stdout:3/390: chown d7/d9/d26/f44 346 1 2024-04-27T07:33:31.762 INFO:tasks.workunit.client.1.smithi100.stdout:7/290: dwrite d1/dd/d16/f26 [0,4194304] 0 2024-04-27T07:33:31.764 INFO:tasks.workunit.client.1.smithi100.stdout:5/258: write d0/d4/d28/d37/d1a/d34/f38 [1021532,53973] 0 2024-04-27T07:33:31.765 INFO:tasks.workunit.client.1.smithi100.stdout:6/358: dread f8 [0,4194304] 0 2024-04-27T07:33:31.767 INFO:tasks.workunit.client.1.smithi100.stdout:8/308: symlink d6/d1b/d1d/d59/l5f 0 2024-04-27T07:33:31.770 INFO:tasks.workunit.client.1.smithi100.stdout:7/291: read d1/d2f/f36 [17065,126736] 0 2024-04-27T07:33:31.770 INFO:tasks.workunit.client.1.smithi100.stdout:0/348: dread d1/d8/d20/f1c [0,4194304] 0 2024-04-27T07:33:31.771 INFO:tasks.workunit.client.1.smithi100.stdout:2/340: dread d0/da/d29/d6e/f4b [0,4194304] 0 2024-04-27T07:33:31.772 INFO:tasks.workunit.client.1.smithi100.stdout:9/301: truncate d1/d9/d1f/f27 584596 0 2024-04-27T07:33:31.776 INFO:tasks.workunit.client.1.smithi100.stdout:4/395: dwrite d5/d16/d19/d21/f41 [0,4194304] 0 2024-04-27T07:33:31.782 INFO:tasks.workunit.client.1.smithi100.stdout:9/302: chown d1/d9/d1f/d4a/f55 130329 1 2024-04-27T07:33:31.787 INFO:tasks.workunit.client.1.smithi100.stdout:2/341: rename d0/da/c40 to d0/da/d29/d6e/d5d/c73 0 2024-04-27T07:33:31.788 INFO:tasks.workunit.client.1.smithi100.stdout:2/342: write d0/da/d29/d6e/d5d/f67 [4482273,12866] 0 2024-04-27T07:33:31.789 INFO:tasks.workunit.client.1.smithi100.stdout:2/343: readlink d0/l20 0 2024-04-27T07:33:31.790 INFO:tasks.workunit.client.0.smithi082.stdout:5/894: chown d8/d29/dea/ldc 15558 1 2024-04-27T07:33:31.792 INFO:tasks.workunit.client.0.smithi082.stdout:5/895: chown d8/d15/d22/f72 115 1 2024-04-27T07:33:31.792 INFO:tasks.workunit.client.1.smithi100.stdout:6/359: rmdir de/d58/d7d 0 2024-04-27T07:33:31.793 INFO:tasks.workunit.client.1.smithi100.stdout:9/303: creat d1/d9/f6f x:0 0 0 2024-04-27T07:33:31.794 INFO:tasks.workunit.client.0.smithi082.stdout:8/751: dread - d0/d2b/d9a/da4/fc5 zero size 2024-04-27T07:33:31.795 INFO:tasks.workunit.client.1.smithi100.stdout:8/309: truncate d6/d1b/d1d/f32 888409 0 2024-04-27T07:33:31.796 INFO:tasks.workunit.client.0.smithi082.stdout:6/798: dread d2/f74 [0,4194304] 0 2024-04-27T07:33:31.797 INFO:tasks.workunit.client.0.smithi082.stdout:1/748: dread d4/d15/d29/f33 [0,4194304] 0 2024-04-27T07:33:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:8/752: stat d0/d2b/d80/dca/de6/l23 0 2024-04-27T07:33:31.798 INFO:tasks.workunit.client.1.smithi100.stdout:7/292: read d1/fc [244715,95973] 0 2024-04-27T07:33:31.799 INFO:tasks.workunit.client.0.smithi082.stdout:1/749: dread - d4/d15/d49/f103 zero size 2024-04-27T07:33:31.799 INFO:tasks.workunit.client.1.smithi100.stdout:2/344: mkdir d0/da/d29/d6e/d3e/d74 0 2024-04-27T07:33:31.800 INFO:tasks.workunit.client.1.smithi100.stdout:2/345: write d0/da/f1c [670945,90719] 0 2024-04-27T07:33:31.802 INFO:tasks.workunit.client.0.smithi082.stdout:9/723: creat d9/da/dc/d35/d4a/ff5 x:0 0 0 2024-04-27T07:33:31.802 INFO:tasks.workunit.client.1.smithi100.stdout:6/360: fsync de/d58/d21/d23/f4b 0 2024-04-27T07:33:31.803 INFO:tasks.workunit.client.1.smithi100.stdout:8/310: mknod d6/d20/d2a/c60 0 2024-04-27T07:33:31.805 INFO:tasks.workunit.client.0.smithi082.stdout:5/896: rename d8/d15/d65 to d8/d77/de8/d128 0 2024-04-27T07:33:31.805 INFO:tasks.workunit.client.1.smithi100.stdout:6/361: dread - de/d58/d28/f6a zero size 2024-04-27T07:33:31.808 INFO:tasks.workunit.client.0.smithi082.stdout:2/782: truncate f3 1904551 0 2024-04-27T07:33:31.809 INFO:tasks.workunit.client.1.smithi100.stdout:0/349: dread d1/d8/d20/f5a [0,4194304] 0 2024-04-27T07:33:31.809 INFO:tasks.workunit.client.1.smithi100.stdout:7/293: unlink d1/dd/d16/d31/c4f 0 2024-04-27T07:33:31.809 INFO:tasks.workunit.client.0.smithi082.stdout:2/783: chown d7/d8/d13/f7b 27012077 1 2024-04-27T07:33:31.810 INFO:tasks.workunit.client.0.smithi082.stdout:8/753: mkdir d0/d2b/d80/dca/de6/d87/d42/d7f/dac/df6 0 2024-04-27T07:33:31.811 INFO:tasks.workunit.client.1.smithi100.stdout:0/350: stat d1/d8/d20/f29 0 2024-04-27T07:33:31.812 INFO:tasks.workunit.client.1.smithi100.stdout:9/304: dwrite d1/d9/d1f/f68 [0,4194304] 0 2024-04-27T07:33:31.812 INFO:tasks.workunit.client.1.smithi100.stdout:0/351: fsync d1/d8/d14/d59/f5b 0 2024-04-27T07:33:31.812 INFO:tasks.workunit.client.1.smithi100.stdout:5/259: dread d0/d4/d21/d24/f47 [0,4194304] 0 2024-04-27T07:33:31.812 INFO:tasks.workunit.client.0.smithi082.stdout:1/750: symlink d4/d15/da7/l105 0 2024-04-27T07:33:31.814 INFO:tasks.workunit.client.0.smithi082.stdout:9/724: chown d9/da/dc/d35/d38/dc5/db8/le2 4825935 1 2024-04-27T07:33:31.815 INFO:tasks.workunit.client.1.smithi100.stdout:2/346: mkdir d0/da/d75 0 2024-04-27T07:33:31.816 INFO:tasks.workunit.client.0.smithi082.stdout:0/953: getdents da/d38 0 2024-04-27T07:33:31.817 INFO:tasks.workunit.client.1.smithi100.stdout:6/362: mkdir de/d2e/d3f/d80 0 2024-04-27T07:33:31.821 INFO:tasks.workunit.client.0.smithi082.stdout:8/754: dwrite d0/d2b/d80/dca/de6/d1b/d29/fef [0,4194304] 0 2024-04-27T07:33:31.823 INFO:tasks.workunit.client.1.smithi100.stdout:9/305: dread d1/d9/db/f1e [0,4194304] 0 2024-04-27T07:33:31.823 INFO:tasks.workunit.client.0.smithi082.stdout:5/897: creat d8/d3c/d64/db8/f129 x:0 0 0 2024-04-27T07:33:31.827 INFO:tasks.workunit.client.0.smithi082.stdout:0/954: symlink da/d3c/d3f/d57/d14d/l160 0 2024-04-27T07:33:31.828 INFO:tasks.workunit.client.0.smithi082.stdout:7/849: dread d3/d9/d4f/d9a/fea [0,4194304] 0 2024-04-27T07:33:31.829 INFO:tasks.workunit.client.1.smithi100.stdout:4/396: dwrite d5/d1b/f5f [4194304,4194304] 0 2024-04-27T07:33:31.831 INFO:tasks.workunit.client.0.smithi082.stdout:8/755: creat d0/d2b/d80/dca/de6/d87/d42/d7f/ff7 x:0 0 0 2024-04-27T07:33:31.833 INFO:tasks.workunit.client.0.smithi082.stdout:9/725: mknod d9/d2d/d72/dae/cf6 0 2024-04-27T07:33:31.833 INFO:tasks.workunit.client.1.smithi100.stdout:8/311: creat d6/d20/d50/f61 x:0 0 0 2024-04-27T07:33:31.833 INFO:tasks.workunit.client.1.smithi100.stdout:2/347: dwrite d0/d1e/f57 [4194304,4194304] 0 2024-04-27T07:33:31.834 INFO:tasks.workunit.client.0.smithi082.stdout:5/898: unlink d8/d29/dea/d5f/df6/dfd/d102/d10e/lf8 0 2024-04-27T07:33:31.835 INFO:tasks.workunit.client.1.smithi100.stdout:6/363: rename de/d58/c34 to de/d58/d21/d23/d73/c81 0 2024-04-27T07:33:31.837 INFO:tasks.workunit.client.1.smithi100.stdout:6/364: readlink de/d58/d21/l2a 0 2024-04-27T07:33:31.837 INFO:tasks.workunit.client.1.smithi100.stdout:3/391: truncate d7/d9/d26/d2a/d5e/f6e 3818433 0 2024-04-27T07:33:31.838 INFO:tasks.workunit.client.1.smithi100.stdout:8/312: fsync d6/d1b/f2d 0 2024-04-27T07:33:31.838 INFO:tasks.workunit.client.0.smithi082.stdout:7/850: creat d3/d49/d97/d3a/d2a/dac/da9/f12c x:0 0 0 2024-04-27T07:33:31.838 INFO:tasks.workunit.client.0.smithi082.stdout:9/726: read d9/da/dc/d35/d38/da5/d66/f6c [1949699,58047] 0 2024-04-27T07:33:31.840 INFO:tasks.workunit.client.0.smithi082.stdout:8/756: symlink d0/d2b/d80/dca/de6/d1c/d76/da0/lf8 0 2024-04-27T07:33:31.841 INFO:tasks.workunit.client.1.smithi100.stdout:6/365: write de/d58/d21/d24/f27 [1308073,101558] 0 2024-04-27T07:33:31.843 INFO:tasks.workunit.client.1.smithi100.stdout:9/306: dwrite d1/d9/db/d2b/d31/f50 [0,4194304] 0 2024-04-27T07:33:31.844 INFO:tasks.workunit.client.0.smithi082.stdout:6/799: dread d2/d3/d1b/f28 [0,4194304] 0 2024-04-27T07:33:31.844 INFO:tasks.workunit.client.1.smithi100.stdout:6/366: write de/d58/d21/f26 [910025,86518] 0 2024-04-27T07:33:31.848 INFO:tasks.workunit.client.0.smithi082.stdout:6/800: truncate d2/d2d/d4a/de4/f101 313876 0 2024-04-27T07:33:31.849 INFO:tasks.workunit.client.1.smithi100.stdout:5/260: link d0/d4/d21/d24/f47 d0/d4/d21/f50 0 2024-04-27T07:33:31.853 INFO:tasks.workunit.client.0.smithi082.stdout:9/727: dread d9/da/dc/f17 [0,4194304] 0 2024-04-27T07:33:31.854 INFO:tasks.workunit.client.0.smithi082.stdout:6/801: truncate d2/d45/f6f 2379261 0 2024-04-27T07:33:31.855 INFO:tasks.workunit.client.0.smithi082.stdout:6/802: dread - d2/d2d/d4a/de4/dcc/d77/dd3/ffe zero size 2024-04-27T07:33:31.855 INFO:tasks.workunit.client.0.smithi082.stdout:6/803: stat d2/d3 0 2024-04-27T07:33:31.856 INFO:tasks.workunit.client.0.smithi082.stdout:9/728: mkdir d9/da/dc/d88/df7 0 2024-04-27T07:33:31.857 INFO:tasks.workunit.client.0.smithi082.stdout:6/804: fsync d2/d2d/d4a/de4/dcc/d77/dd3/ffe 0 2024-04-27T07:33:31.859 INFO:tasks.workunit.client.1.smithi100.stdout:6/367: creat de/d58/d21/d23/f82 x:0 0 0 2024-04-27T07:33:31.859 INFO:tasks.workunit.client.0.smithi082.stdout:9/729: symlink d9/da/dc/d35/d4a/lf8 0 2024-04-27T07:33:31.860 INFO:tasks.workunit.client.1.smithi100.stdout:6/368: readlink de/l6c 0 2024-04-27T07:33:31.860 INFO:tasks.workunit.client.1.smithi100.stdout:7/294: rmdir d1/dd 39 2024-04-27T07:33:31.860 INFO:tasks.workunit.client.1.smithi100.stdout:3/392: dwrite d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:31.863 INFO:tasks.workunit.client.0.smithi082.stdout:9/730: creat d9/d48/dd6/ff9 x:0 0 0 2024-04-27T07:33:31.863 INFO:tasks.workunit.client.0.smithi082.stdout:6/805: getdents d2/d2e/d6a 0 2024-04-27T07:33:31.864 INFO:tasks.workunit.client.0.smithi082.stdout:6/806: chown d2/c87 1791 1 2024-04-27T07:33:31.865 INFO:tasks.workunit.client.0.smithi082.stdout:9/731: write d9/d2d/d2b/d46/d5d/d6f/f86 [899593,97382] 0 2024-04-27T07:33:31.867 INFO:tasks.workunit.client.1.smithi100.stdout:5/261: unlink d0/c2 0 2024-04-27T07:33:31.868 INFO:tasks.workunit.client.0.smithi082.stdout:9/732: creat d9/da/dc/d35/d38/dc5/ffa x:0 0 0 2024-04-27T07:33:31.869 INFO:tasks.workunit.client.1.smithi100.stdout:7/295: write d1/dd/f1e [1774362,19282] 0 2024-04-27T07:33:31.873 INFO:tasks.workunit.client.0.smithi082.stdout:9/733: dwrite d9/da/f67 [0,4194304] 0 2024-04-27T07:33:31.877 INFO:tasks.workunit.client.0.smithi082.stdout:9/734: creat d9/d48/ffb x:0 0 0 2024-04-27T07:33:31.877 INFO:tasks.workunit.client.1.smithi100.stdout:7/296: dwrite d1/dd/d16/d31/d4c/d4d/d3b/d40/f4e [0,4194304] 0 2024-04-27T07:33:31.880 INFO:tasks.workunit.client.0.smithi082.stdout:9/735: truncate d9/da/f26 3405771 0 2024-04-27T07:33:31.883 INFO:tasks.workunit.client.1.smithi100.stdout:9/307: getdents d1/d9/db/d2b/d4f/d57 0 2024-04-27T07:33:31.885 INFO:tasks.workunit.client.0.smithi082.stdout:9/736: mknod d9/d2d/d2b/d46/d76/cfc 0 2024-04-27T07:33:31.885 INFO:tasks.workunit.client.1.smithi100.stdout:5/262: chown d0/c1 56530 1 2024-04-27T07:33:31.888 INFO:tasks.workunit.client.0.smithi082.stdout:0/955: write da/d1d/f24 [1488995,59700] 0 2024-04-27T07:33:31.889 INFO:tasks.workunit.client.1.smithi100.stdout:6/369: creat de/d58/d21/f83 x:0 0 0 2024-04-27T07:33:31.890 INFO:tasks.workunit.client.0.smithi082.stdout:2/784: dwrite d7/d8/d13/f2b [0,4194304] 0 2024-04-27T07:33:31.891 INFO:tasks.workunit.client.0.smithi082.stdout:9/737: getdents d9/da/db0 0 2024-04-27T07:33:31.892 INFO:tasks.workunit.client.0.smithi082.stdout:0/956: stat da/d3c/d3f/d4c/d95/de9 0 2024-04-27T07:33:31.894 INFO:tasks.workunit.client.0.smithi082.stdout:8/757: write d0/d2b/d9a/da4/d35/f45 [9133023,95949] 0 2024-04-27T07:33:31.896 INFO:tasks.workunit.client.0.smithi082.stdout:2/785: symlink d7/d9/d4f/l105 0 2024-04-27T07:33:31.897 INFO:tasks.workunit.client.0.smithi082.stdout:1/751: dwrite d4/f86 [0,4194304] 0 2024-04-27T07:33:31.899 INFO:tasks.workunit.client.0.smithi082.stdout:9/738: symlink d9/d2d/d2b/d46/lfd 0 2024-04-27T07:33:31.900 INFO:tasks.workunit.client.1.smithi100.stdout:2/348: truncate d0/f12 1821785 0 2024-04-27T07:33:31.901 INFO:tasks.workunit.client.1.smithi100.stdout:6/370: creat de/d58/d21/d23/f84 x:0 0 0 2024-04-27T07:33:31.902 INFO:tasks.workunit.client.1.smithi100.stdout:6/371: chown de/d58 36 1 2024-04-27T07:33:31.903 INFO:tasks.workunit.client.1.smithi100.stdout:2/349: stat d0/d1e/c3f 0 2024-04-27T07:33:31.903 INFO:tasks.workunit.client.0.smithi082.stdout:5/899: dwrite d8/d15/de0/ff4 [0,4194304] 0 2024-04-27T07:33:31.904 INFO:tasks.workunit.client.1.smithi100.stdout:6/372: readlink de/d2e/d3f/l72 0 2024-04-27T07:33:31.905 INFO:tasks.workunit.client.1.smithi100.stdout:8/313: dwrite d6/d1b/d1d/f32 [0,4194304] 0 2024-04-27T07:33:31.905 INFO:tasks.workunit.client.0.smithi082.stdout:7/851: dwrite d3/d9/d4f/fb9 [0,4194304] 0 2024-04-27T07:33:31.905 INFO:tasks.workunit.client.1.smithi100.stdout:7/297: creat d1/dd/d16/f5b x:0 0 0 2024-04-27T07:33:31.907 INFO:tasks.workunit.client.0.smithi082.stdout:0/957: mkdir da/d3c/d3f/d4c/d95/de9/d161 0 2024-04-27T07:33:31.908 INFO:tasks.workunit.client.1.smithi100.stdout:8/314: fdatasync d6/d1b/f42 0 2024-04-27T07:33:31.909 INFO:tasks.workunit.client.0.smithi082.stdout:8/758: truncate d0/d2b/d80/da9/dc6/fd6 815277 0 2024-04-27T07:33:31.913 INFO:tasks.workunit.client.0.smithi082.stdout:6/807: dwrite d2/d2e/d6c/f102 [0,4194304] 0 2024-04-27T07:33:31.914 INFO:tasks.workunit.client.1.smithi100.stdout:9/308: mknod d1/d9/d1f/d52/d54/d61/c70 0 2024-04-27T07:33:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:31 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:31 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:31 smithi100 ceph-mon[34183]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-04-27T07:33:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:31 smithi100 ceph-mon[34183]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-04-27T07:33:31.917 INFO:tasks.workunit.client.1.smithi100.stdout:9/309: write d1/d9/f6f [854802,117128] 0 2024-04-27T07:33:31.917 INFO:tasks.workunit.client.1.smithi100.stdout:3/393: dwrite d7/d9/d26/d2a/d5e/f6e [0,4194304] 0 2024-04-27T07:33:31.918 INFO:tasks.workunit.client.0.smithi082.stdout:1/752: link d4/f34 d4/d15/d49/dab/dc3/d3e/d57/d101/f106 0 2024-04-27T07:33:31.918 INFO:tasks.workunit.client.0.smithi082.stdout:6/808: readlink d2/d1e/d32/d85/d93/ldb 0 2024-04-27T07:33:31.918 INFO:tasks.workunit.client.0.smithi082.stdout:9/739: dwrite d9/d2d/d2b/d46/d76/dcb/fdc [0,4194304] 0 2024-04-27T07:33:31.920 INFO:tasks.workunit.client.1.smithi100.stdout:2/350: rename d0/da/d29/d47/d5a/c5b to d0/da/d29/d47/c76 0 2024-04-27T07:33:31.920 INFO:tasks.workunit.client.0.smithi082.stdout:7/852: rename d3/d49/d97/d3a/d2a/dac/fed to d3/d49/d97/d3a/d2a/dac/d91/f12d 0 2024-04-27T07:33:31.922 INFO:tasks.workunit.client.1.smithi100.stdout:7/298: mknod d1/d2f/c5c 0 2024-04-27T07:33:31.927 INFO:tasks.workunit.client.1.smithi100.stdout:9/310: rmdir d1/d9/db/d2b/d4f/d57 39 2024-04-27T07:33:31.927 INFO:tasks.workunit.client.1.smithi100.stdout:3/394: mknod d7/d9/d10/d33/c7f 0 2024-04-27T07:33:31.929 INFO:tasks.workunit.client.1.smithi100.stdout:2/351: fsync d0/d1e/f33 0 2024-04-27T07:33:31.935 INFO:tasks.workunit.client.0.smithi082.stdout:1/753: rename d4/d15/d49/dab/dc3/d4c/f6a to d4/d15/d49/d99/f107 0 2024-04-27T07:33:31.935 INFO:tasks.workunit.client.0.smithi082.stdout:9/740: truncate d9/da/dc/d35/d38/da5/d66/f6c 1503796 0 2024-04-27T07:33:31.935 INFO:tasks.workunit.client.1.smithi100.stdout:8/315: mknod d6/d1b/d1d/c62 0 2024-04-27T07:33:31.935 INFO:tasks.workunit.client.1.smithi100.stdout:3/395: write d7/d9/d10/d28/f7d [355319,70820] 0 2024-04-27T07:33:31.936 INFO:tasks.workunit.client.1.smithi100.stdout:9/311: rmdir d1/d9/db/d2b 39 2024-04-27T07:33:31.937 INFO:tasks.workunit.client.0.smithi082.stdout:9/741: read - d9/da/dc/d73/dbb/fcf zero size 2024-04-27T07:33:31.938 INFO:tasks.workunit.client.1.smithi100.stdout:3/396: stat d7/d9/d10/d33/c7f 0 2024-04-27T07:33:31.938 INFO:tasks.workunit.client.1.smithi100.stdout:6/373: creat de/d58/d21/f85 x:0 0 0 2024-04-27T07:33:31.939 INFO:tasks.workunit.client.0.smithi082.stdout:8/759: getdents d0/d2b/d6f 0 2024-04-27T07:33:31.940 INFO:tasks.workunit.client.0.smithi082.stdout:8/760: write d0/d2b/d6f/fd4 [3497376,122701] 0 2024-04-27T07:33:31.941 INFO:tasks.workunit.client.0.smithi082.stdout:1/754: rename d4/f34 to d4/d15/d49/dab/dc3/d4c/d7a/d8c/f108 0 2024-04-27T07:33:31.942 INFO:tasks.workunit.client.1.smithi100.stdout:8/316: chown d6/c13 47343943 1 2024-04-27T07:33:31.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/958: dread da/d3c/f10a [0,4194304] 0 2024-04-27T07:33:31.944 INFO:tasks.workunit.client.0.smithi082.stdout:8/761: fsync d0/d2b/d80/dca/de6/d1b/d29/d6a/f6b 0 2024-04-27T07:33:31.944 INFO:tasks.workunit.client.1.smithi100.stdout:6/374: mkdir de/d2e/d86 0 2024-04-27T07:33:31.946 INFO:tasks.workunit.client.1.smithi100.stdout:5/263: dwrite d0/d4/d21/f2e [0,4194304] 0 2024-04-27T07:33:31.946 INFO:tasks.workunit.client.1.smithi100.stdout:2/352: rename d0/da/d29/d6e/d3e/f43 to d0/da/d29/d6e/d5d/f77 0 2024-04-27T07:33:31.947 INFO:tasks.workunit.client.0.smithi082.stdout:0/959: dread - da/d38/d7f/d4a/d10c/f13a zero size 2024-04-27T07:33:31.947 INFO:tasks.workunit.client.1.smithi100.stdout:8/317: write d6/d20/d2a/f49 [2921022,8785] 0 2024-04-27T07:33:31.947 INFO:tasks.workunit.client.0.smithi082.stdout:5/900: write d8/d42/fb3 [1154721,41339] 0 2024-04-27T07:33:31.949 INFO:tasks.workunit.client.1.smithi100.stdout:9/312: mkdir d1/d9/d1f/d71 0 2024-04-27T07:33:31.949 INFO:tasks.workunit.client.1.smithi100.stdout:3/397: dread f6 [0,4194304] 0 2024-04-27T07:33:31.951 INFO:tasks.workunit.client.0.smithi082.stdout:1/755: dwrite d4/d15/d49/dab/dc3/d4c/d7a/f80 [4194304,4194304] 0 2024-04-27T07:33:31.952 INFO:tasks.workunit.client.1.smithi100.stdout:8/318: write d6/d1b/d1d/d59/f56 [94446,21480] 0 2024-04-27T07:33:31.953 INFO:tasks.workunit.client.1.smithi100.stdout:3/398: write d7/d9/d10/d33/f79 [162291,96329] 0 2024-04-27T07:33:31.953 INFO:tasks.workunit.client.1.smithi100.stdout:8/319: chown d6/c5d 2623671 1 2024-04-27T07:33:31.954 INFO:tasks.workunit.client.0.smithi082.stdout:5/901: mknod d8/d3c/d64/c12a 0 2024-04-27T07:33:31.954 INFO:tasks.workunit.client.1.smithi100.stdout:8/320: readlink d6/d20/l3e 0 2024-04-27T07:33:31.955 INFO:tasks.workunit.client.1.smithi100.stdout:7/299: rmdir d1 39 2024-04-27T07:33:31.956 INFO:tasks.workunit.client.0.smithi082.stdout:8/762: rename d0/d2b/d80/da9 to d0/d2b/d80/dca/de6/d1c/d76/da0/df9 0 2024-04-27T07:33:31.957 INFO:tasks.workunit.client.0.smithi082.stdout:6/809: write d2/d2d/d4a/f52 [699928,2171] 0 2024-04-27T07:33:31.957 INFO:tasks.workunit.client.0.smithi082.stdout:2/786: dwrite d7/d9/d4f/f80 [0,4194304] 0 2024-04-27T07:33:31.957 INFO:tasks.workunit.client.1.smithi100.stdout:8/321: truncate d6/d1b/f2d 1375228 0 2024-04-27T07:33:31.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/960: fdatasync da/d3c/d3f/d57/dcc/f8e 0 2024-04-27T07:33:31.959 INFO:tasks.workunit.client.0.smithi082.stdout:1/756: symlink d4/d15/d49/da0/l109 0 2024-04-27T07:33:31.963 INFO:tasks.workunit.client.1.smithi100.stdout:2/353: rename d0/f7 to d0/da/d75/f78 0 2024-04-27T07:33:31.965 INFO:tasks.workunit.client.1.smithi100.stdout:9/313: truncate d1/d9/d1f/f3c 1723057 0 2024-04-27T07:33:31.969 INFO:tasks.workunit.client.1.smithi100.stdout:9/314: read d1/d9/d1f/d4a/f4d [794970,18687] 0 2024-04-27T07:33:31.973 INFO:tasks.workunit.client.1.smithi100.stdout:3/399: creat d7/d9/d26/d6c/f80 x:0 0 0 2024-04-27T07:33:31.973 INFO:tasks.workunit.client.1.smithi100.stdout:8/322: mknod d6/d20/d54/c63 0 2024-04-27T07:33:31.973 INFO:tasks.workunit.client.1.smithi100.stdout:7/300: dwrite d1/f32 [0,4194304] 0 2024-04-27T07:33:31.982 INFO:tasks.workunit.client.1.smithi100.stdout:9/315: dread - d1/d9/db/d2b/d4f/d57/f60 zero size 2024-04-27T07:33:31.983 INFO:tasks.workunit.client.1.smithi100.stdout:7/301: creat d1/dd/f5d x:0 0 0 2024-04-27T07:33:31.984 INFO:tasks.workunit.client.1.smithi100.stdout:7/302: readlink d1/dd/l38 0 2024-04-27T07:33:31.987 INFO:tasks.workunit.client.1.smithi100.stdout:3/400: link d7/d9/d10/d3e/f7c d7/d9/d10/d28/d2c/f81 0 2024-04-27T07:33:31.987 INFO:tasks.workunit.client.1.smithi100.stdout:3/401: chown d7/d9/d10/d28/f7d 1 1 2024-04-27T07:33:31.988 INFO:tasks.workunit.client.1.smithi100.stdout:7/303: creat d1/dd/d16/d4a/d56/f5e x:0 0 0 2024-04-27T07:33:31.989 INFO:tasks.workunit.client.1.smithi100.stdout:8/323: dread d6/f10 [0,4194304] 0 2024-04-27T07:33:31.990 INFO:tasks.workunit.client.1.smithi100.stdout:9/316: creat d1/d9/db/d2b/d4f/f72 x:0 0 0 2024-04-27T07:33:31.993 INFO:tasks.workunit.client.1.smithi100.stdout:1/479: sync 2024-04-27T07:33:31.994 INFO:tasks.workunit.client.1.smithi100.stdout:1/480: chown d0/d1b/f62 395707 1 2024-04-27T07:33:31.997 INFO:tasks.workunit.client.1.smithi100.stdout:3/402: creat d7/d9/d26/d2a/f82 x:0 0 0 2024-04-27T07:33:31.998 INFO:tasks.workunit.client.1.smithi100.stdout:9/317: dread d1/d9/d1f/f27 [0,4194304] 0 2024-04-27T07:33:32.001 INFO:tasks.workunit.client.1.smithi100.stdout:8/324: dwrite d6/d1b/f42 [4194304,4194304] 0 2024-04-27T07:33:32.005 INFO:tasks.workunit.client.1.smithi100.stdout:1/481: creat d0/d1b/d20/f99 x:0 0 0 2024-04-27T07:33:32.005 INFO:tasks.workunit.client.1.smithi100.stdout:6/375: dread de/f16 [0,4194304] 0 2024-04-27T07:33:32.010 INFO:tasks.workunit.client.1.smithi100.stdout:3/403: dwrite d7/d9/d10/d33/f4e [0,4194304] 0 2024-04-27T07:33:32.011 INFO:tasks.workunit.client.0.smithi082.stdout:6/810: dread d2/d2d/d4a/fb9 [0,4194304] 0 2024-04-27T07:33:32.012 INFO:tasks.workunit.client.1.smithi100.stdout:9/318: rename d1/d9/db/l64 to d1/d9/db/d2b/l73 0 2024-04-27T07:33:32.012 INFO:tasks.workunit.client.1.smithi100.stdout:8/325: dwrite d6/f17 [0,4194304] 0 2024-04-27T07:33:32.016 INFO:tasks.workunit.client.1.smithi100.stdout:8/326: write d6/f3b [762971,25656] 0 2024-04-27T07:33:32.017 INFO:tasks.workunit.client.1.smithi100.stdout:8/327: chown d6/d1b/d1d/d59/d4f 0 1 2024-04-27T07:33:32.018 INFO:tasks.workunit.client.1.smithi100.stdout:8/328: chown d6/d1b/d1d/f32 4 1 2024-04-27T07:33:32.018 INFO:tasks.workunit.client.1.smithi100.stdout:3/404: unlink d7/d9/d10/d33/f79 0 2024-04-27T07:33:32.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/853: write d3/d49/fb7 [436686,104956] 0 2024-04-27T07:33:32.026 INFO:tasks.workunit.client.1.smithi100.stdout:9/319: rename d1/d9/d1f/d52/l53 to d1/d9/d1f/d52/l74 0 2024-04-27T07:33:32.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/961: fsync da/d28/d36/f7b 0 2024-04-27T07:33:32.029 INFO:tasks.workunit.client.1.smithi100.stdout:7/304: truncate d1/dd/fe 1552446 0 2024-04-27T07:33:32.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/962: chown da/d38/d7f/lc5 122 1 2024-04-27T07:33:32.031 INFO:tasks.workunit.client.1.smithi100.stdout:7/305: chown d1/dd/d16/d31/d4c 8 1 2024-04-27T07:33:32.033 INFO:tasks.workunit.client.0.smithi082.stdout:2/787: rename d7/d9/c11 to d7/d9/d4f/d6e/d82/da4/c106 0 2024-04-27T07:33:32.033 INFO:tasks.workunit.client.1.smithi100.stdout:8/329: rename d6/d1b/c30 to d6/d20/d46/c64 0 2024-04-27T07:33:32.034 INFO:tasks.workunit.client.1.smithi100.stdout:6/376: dread de/d58/d28/f30 [0,4194304] 0 2024-04-27T07:33:32.036 INFO:tasks.workunit.client.1.smithi100.stdout:2/354: dread d0/da/d29/d6e/f2a [0,4194304] 0 2024-04-27T07:33:32.036 INFO:tasks.workunit.client.0.smithi082.stdout:6/811: symlink d2/d1e/d32/d7d/dbc/l10d 0 2024-04-27T07:33:32.037 INFO:tasks.workunit.client.1.smithi100.stdout:8/330: truncate d6/d20/f40 1138897 0 2024-04-27T07:33:32.037 INFO:tasks.workunit.client.0.smithi082.stdout:7/854: readlink d3/db/dbb/l103 0 2024-04-27T07:33:32.038 INFO:tasks.workunit.client.0.smithi082.stdout:5/902: link d8/d29/d4e/l114 d8/d29/dea/l12b 0 2024-04-27T07:33:32.039 INFO:tasks.workunit.client.0.smithi082.stdout:5/903: fdatasync d8/d29/dea/ffe 0 2024-04-27T07:33:32.040 INFO:tasks.workunit.client.0.smithi082.stdout:0/963: creat da/d3c/d3f/d4c/d105/f162 x:0 0 0 2024-04-27T07:33:32.041 INFO:tasks.workunit.client.1.smithi100.stdout:2/355: dread d0/da/d29/d6e/f2a [0,4194304] 0 2024-04-27T07:33:32.045 INFO:tasks.workunit.client.0.smithi082.stdout:2/788: dread d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:32.046 INFO:tasks.workunit.client.0.smithi082.stdout:2/789: dread d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:32.047 INFO:tasks.workunit.client.0.smithi082.stdout:5/904: creat d8/d29/dea/da3/f12c x:0 0 0 2024-04-27T07:33:32.047 INFO:tasks.workunit.client.1.smithi100.stdout:7/306: creat d1/d54/f5f x:0 0 0 2024-04-27T07:33:32.048 INFO:tasks.workunit.client.0.smithi082.stdout:0/964: mknod da/d38/d7f/d4a/d10c/c163 0 2024-04-27T07:33:32.048 INFO:tasks.workunit.client.0.smithi082.stdout:8/763: write d0/d2b/d6f/f78 [3080143,2918] 0 2024-04-27T07:33:32.050 INFO:tasks.workunit.client.0.smithi082.stdout:6/812: mkdir d2/d1e/d32/d7d/d82/d10e 0 2024-04-27T07:33:32.051 INFO:tasks.workunit.client.0.smithi082.stdout:8/764: write d0/d2b/d80/dca/de6/ff0 [957811,44329] 0 2024-04-27T07:33:32.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/482: truncate d0/fd 3023011 0 2024-04-27T07:33:32.053 INFO:tasks.workunit.client.1.smithi100.stdout:8/331: link d6/f31 d6/d20/d2a/f65 0 2024-04-27T07:33:32.054 INFO:tasks.workunit.client.0.smithi082.stdout:7/855: unlink d3/d49/d97/d3a/d2a/l9e 0 2024-04-27T07:33:32.057 INFO:tasks.workunit.client.0.smithi082.stdout:2/790: dread d7/d9/d4f/d66/fb3 [0,4194304] 0 2024-04-27T07:33:32.058 INFO:tasks.workunit.client.1.smithi100.stdout:7/307: dread d1/d2f/f36 [0,4194304] 0 2024-04-27T07:33:32.058 INFO:tasks.workunit.client.1.smithi100.stdout:9/320: getdents d1 0 2024-04-27T07:33:32.058 INFO:tasks.workunit.client.0.smithi082.stdout:6/813: dwrite d2/d45/fc6 [0,4194304] 0 2024-04-27T07:33:32.059 INFO:tasks.workunit.client.0.smithi082.stdout:2/791: chown d7/d30/d61/fa5 3 1 2024-04-27T07:33:32.059 INFO:tasks.workunit.client.1.smithi100.stdout:1/483: stat d0/d1f/d27/d40/l4a 0 2024-04-27T07:33:32.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/405: dwrite d7/d9/d26/f38 [0,4194304] 0 2024-04-27T07:33:32.061 INFO:tasks.workunit.client.1.smithi100.stdout:8/332: symlink d6/d20/d46/l66 0 2024-04-27T07:33:32.062 INFO:tasks.workunit.client.1.smithi100.stdout:1/484: dread - d0/d1b/f96 zero size 2024-04-27T07:33:32.063 INFO:tasks.workunit.client.0.smithi082.stdout:8/765: mknod d0/d2b/d80/dca/de6/d87/d71/cfa 0 2024-04-27T07:33:32.064 INFO:tasks.workunit.client.0.smithi082.stdout:6/814: truncate d2/d2d/d4a/de4/dcc/d77/dd3/ffe 669025 0 2024-04-27T07:33:32.065 INFO:tasks.workunit.client.1.smithi100.stdout:3/406: chown d7/d9/d26/f59 5753309 1 2024-04-27T07:33:32.067 INFO:tasks.workunit.client.0.smithi082.stdout:8/766: write d0/d2b/d80/dca/de6/d1b/fcd [1241591,90307] 0 2024-04-27T07:33:32.068 INFO:tasks.workunit.client.0.smithi082.stdout:0/965: symlink da/d3c/d3f/d57/d14e/l164 0 2024-04-27T07:33:32.068 INFO:tasks.workunit.client.0.smithi082.stdout:1/757: dwrite d4/d15/d49/dab/dc3/d3e/f87 [0,4194304] 0 2024-04-27T07:33:32.070 INFO:tasks.workunit.client.1.smithi100.stdout:5/264: dread d0/d4/f22 [0,4194304] 0 2024-04-27T07:33:32.071 INFO:tasks.workunit.client.1.smithi100.stdout:7/308: dwrite d1/dd/f5d [0,4194304] 0 2024-04-27T07:33:32.071 INFO:tasks.workunit.client.1.smithi100.stdout:9/321: creat d1/d9/f75 x:0 0 0 2024-04-27T07:33:32.072 INFO:tasks.workunit.client.0.smithi082.stdout:2/792: write d7/d9/d4f/d66/fb3 [935677,83937] 0 2024-04-27T07:33:32.073 INFO:tasks.workunit.client.1.smithi100.stdout:6/377: truncate de/d58/d21/d24/f46 4074819 0 2024-04-27T07:33:32.073 INFO:tasks.workunit.client.1.smithi100.stdout:9/322: write d1/fd [3695605,34231] 0 2024-04-27T07:33:32.074 INFO:tasks.workunit.client.0.smithi082.stdout:7/856: mkdir d3/db/d12e 0 2024-04-27T07:33:32.075 INFO:tasks.workunit.client.1.smithi100.stdout:7/309: write d1/dd/d16/d3e/f41 [1145567,55969] 0 2024-04-27T07:33:32.076 INFO:tasks.workunit.client.1.smithi100.stdout:2/356: getdents d0/da/d29/d47 0 2024-04-27T07:33:32.077 INFO:tasks.workunit.client.0.smithi082.stdout:8/767: mknod d0/d2b/d80/dca/de6/d87/d42/cfb 0 2024-04-27T07:33:32.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/905: dwrite d8/d42/d123/d9c/fd9 [0,4194304] 0 2024-04-27T07:33:32.078 INFO:tasks.workunit.client.0.smithi082.stdout:0/966: symlink da/d3c/d3f/d57/d14d/l165 0 2024-04-27T07:33:32.082 INFO:tasks.workunit.client.1.smithi100.stdout:5/265: unlink d0/f8 0 2024-04-27T07:33:32.083 INFO:tasks.workunit.client.0.smithi082.stdout:8/768: mknod d0/d2b/cfc 0 2024-04-27T07:33:32.084 INFO:tasks.workunit.client.1.smithi100.stdout:9/323: mkdir d1/d76 0 2024-04-27T07:33:32.084 INFO:tasks.workunit.client.0.smithi082.stdout:0/967: symlink da/d3c/d3f/d57/d14e/l166 0 2024-04-27T07:33:32.085 INFO:tasks.workunit.client.1.smithi100.stdout:6/378: creat de/d2e/d3f/f87 x:0 0 0 2024-04-27T07:33:32.086 INFO:tasks.workunit.client.1.smithi100.stdout:1/485: dwrite d0/d1b/d20/f94 [0,4194304] 0 2024-04-27T07:33:32.087 INFO:tasks.workunit.client.0.smithi082.stdout:6/815: creat d2/d1e/d32/d7d/d82/f10f x:0 0 0 2024-04-27T07:33:32.087 INFO:tasks.workunit.client.0.smithi082.stdout:2/793: truncate d7/d9/d4f/d66/dae/f8c 375014 0 2024-04-27T07:33:32.088 INFO:tasks.workunit.client.0.smithi082.stdout:7/857: dwrite d3/d49/d97/d3a/d2a/f88 [0,4194304] 0 2024-04-27T07:33:32.089 INFO:tasks.workunit.client.1.smithi100.stdout:2/357: unlink d0/da/d29/d47/c58 0 2024-04-27T07:33:32.090 INFO:tasks.workunit.client.0.smithi082.stdout:2/794: chown d7/d14/f5c 795647 1 2024-04-27T07:33:32.091 INFO:tasks.workunit.client.1.smithi100.stdout:7/310: creat d1/dd/d16/d31/f60 x:0 0 0 2024-04-27T07:33:32.093 INFO:tasks.workunit.client.0.smithi082.stdout:7/858: symlink d3/db/l12f 0 2024-04-27T07:33:32.094 INFO:tasks.workunit.client.0.smithi082.stdout:7/859: write d3/d9/f37 [692550,16910] 0 2024-04-27T07:33:32.095 INFO:tasks.workunit.client.0.smithi082.stdout:2/795: unlink d7/d9/d4f/d66/c9b 0 2024-04-27T07:33:32.096 INFO:tasks.workunit.client.1.smithi100.stdout:1/486: creat d0/d1f/d97/f9a x:0 0 0 2024-04-27T07:33:32.098 INFO:tasks.workunit.client.1.smithi100.stdout:5/266: write d0/f14 [2314258,32505] 0 2024-04-27T07:33:32.098 INFO:tasks.workunit.client.1.smithi100.stdout:2/358: fsync d0/da/d29/d6e/f2a 0 2024-04-27T07:33:32.099 INFO:tasks.workunit.client.0.smithi082.stdout:2/796: chown d7/d30/f36 31579 1 2024-04-27T07:33:32.099 INFO:tasks.workunit.client.1.smithi100.stdout:2/359: stat d0/da/d29/l68 0 2024-04-27T07:33:32.100 INFO:tasks.workunit.client.1.smithi100.stdout:2/360: readlink d0/da/d29/l68 0 2024-04-27T07:33:32.101 INFO:tasks.workunit.client.1.smithi100.stdout:1/487: dread - d0/d1b/d20/d2d/d35/d65/f76 zero size 2024-04-27T07:33:32.101 INFO:tasks.workunit.client.0.smithi082.stdout:2/797: mknod d7/d8/d13/c107 0 2024-04-27T07:33:32.102 INFO:tasks.workunit.client.1.smithi100.stdout:2/361: dread - d0/da/d29/d6e/d5d/f5f zero size 2024-04-27T07:33:32.104 INFO:tasks.workunit.client.1.smithi100.stdout:1/488: write d0/d1b/d20/d2d/d35/f8b [782560,49926] 0 2024-04-27T07:33:32.105 INFO:tasks.workunit.client.1.smithi100.stdout:7/311: unlink d1/dd/d16/f5b 0 2024-04-27T07:33:32.107 INFO:tasks.workunit.client.0.smithi082.stdout:2/798: dwrite d7/f87 [0,4194304] 0 2024-04-27T07:33:32.108 INFO:tasks.workunit.client.1.smithi100.stdout:2/362: mkdir d0/d79 0 2024-04-27T07:33:32.108 INFO:tasks.workunit.client.1.smithi100.stdout:1/489: chown d0/d1b/d20/d2d/d35/d4d/d60/d79/l8d 5549022 1 2024-04-27T07:33:32.110 INFO:tasks.workunit.client.1.smithi100.stdout:7/312: write d1/dd/d16/f2d [380307,11093] 0 2024-04-27T07:33:32.111 INFO:tasks.workunit.client.0.smithi082.stdout:2/799: symlink d7/d9/d4f/d6e/d82/da4/de0/l108 0 2024-04-27T07:33:32.112 INFO:tasks.workunit.client.0.smithi082.stdout:2/800: readlink d7/d9/d4f/d6e/ldd 0 2024-04-27T07:33:32.113 INFO:tasks.workunit.client.1.smithi100.stdout:2/363: mknod d0/c7a 0 2024-04-27T07:33:32.113 INFO:tasks.workunit.client.0.smithi082.stdout:1/758: write f2 [3439826,130197] 0 2024-04-27T07:33:32.114 INFO:tasks.workunit.client.0.smithi082.stdout:2/801: fdatasync d7/d9/f1d 0 2024-04-27T07:33:32.115 INFO:tasks.workunit.client.1.smithi100.stdout:7/313: link d1/dd/f4b d1/d54/f61 0 2024-04-27T07:33:32.117 INFO:tasks.workunit.client.0.smithi082.stdout:1/759: fdatasync d4/d15/d49/dab/dc3/d3e/d57/f77 0 2024-04-27T07:33:32.118 INFO:tasks.workunit.client.1.smithi100.stdout:1/490: dwrite d0/d1f/d27/d40/d61/f91 [0,4194304] 0 2024-04-27T07:33:32.118 INFO:tasks.workunit.client.0.smithi082.stdout:2/802: symlink d7/d31/dde/def/l109 0 2024-04-27T07:33:32.120 INFO:tasks.workunit.client.0.smithi082.stdout:2/803: read d7/d8/d99/fd4 [138725,70075] 0 2024-04-27T07:33:32.120 INFO:tasks.workunit.client.0.smithi082.stdout:1/760: mknod d4/d15/d49/dab/dc3/d4c/d7a/d8c/c10a 0 2024-04-27T07:33:32.121 INFO:tasks.workunit.client.1.smithi100.stdout:7/314: unlink d1/dd/d16/f3a 0 2024-04-27T07:33:32.121 INFO:tasks.workunit.client.1.smithi100.stdout:7/315: fsync d1/fc 0 2024-04-27T07:33:32.124 INFO:tasks.workunit.client.1.smithi100.stdout:3/407: write d7/d9/d10/f7b [35729,14141] 0 2024-04-27T07:33:32.126 INFO:tasks.workunit.client.1.smithi100.stdout:7/316: chown d1/dd/d16/d2b/c37 3 1 2024-04-27T07:33:32.126 INFO:tasks.workunit.client.1.smithi100.stdout:1/491: write d0/d1f/d27/f39 [3174649,86194] 0 2024-04-27T07:33:32.130 INFO:tasks.workunit.client.1.smithi100.stdout:3/408: write d7/d9/d26/d2a/d5e/f6e [4542274,121289] 0 2024-04-27T07:33:32.131 INFO:tasks.workunit.client.1.smithi100.stdout:2/364: dwrite d0/da/d29/d6e/d5d/f67 [0,4194304] 0 2024-04-27T07:33:32.132 INFO:tasks.workunit.client.0.smithi082.stdout:6/816: truncate d2/d2e/d55/fe8 2496091 0 2024-04-27T07:33:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:7/860: write d3/db/f2e [3971812,48854] 0 2024-04-27T07:33:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:5/906: dread d8/d29/fa7 [0,4194304] 0 2024-04-27T07:33:32.138 INFO:tasks.workunit.client.1.smithi100.stdout:5/267: write d0/d4/d21/d24/f47 [44258,106736] 0 2024-04-27T07:33:32.139 INFO:tasks.workunit.client.1.smithi100.stdout:5/268: fdatasync d0/d4/d28/d37/d1a/f20 0 2024-04-27T07:33:32.139 INFO:tasks.workunit.client.1.smithi100.stdout:1/492: rename d0/d1f/f5e to d0/d1b/d20/d2d/d35/f9b 0 2024-04-27T07:33:32.140 INFO:tasks.workunit.client.0.smithi082.stdout:1/761: write d4/d15/d49/d4e/f5a [514005,101242] 0 2024-04-27T07:33:32.140 INFO:tasks.workunit.client.0.smithi082.stdout:5/907: chown d8/d29/dea/da3/ld3 2656 1 2024-04-27T07:33:32.141 INFO:tasks.workunit.client.0.smithi082.stdout:4/928: sync 2024-04-27T07:33:32.141 INFO:tasks.workunit.client.0.smithi082.stdout:7/861: dread - d3/d49/d97/d3a/d2a/f95 zero size 2024-04-27T07:33:32.142 INFO:tasks.workunit.client.0.smithi082.stdout:8/769: dwrite d0/d2b/d80/dca/de6/d1b/d53/f73 [0,4194304] 0 2024-04-27T07:33:32.142 INFO:tasks.workunit.client.1.smithi100.stdout:1/493: stat d0/d1b/d20/d2d/d35/f9b 0 2024-04-27T07:33:32.142 INFO:tasks.workunit.client.0.smithi082.stdout:0/968: dwrite da/d38/d7f/d4a/d80/dcb/fe1 [0,4194304] 0 2024-04-27T07:33:32.143 INFO:tasks.workunit.client.1.smithi100.stdout:3/409: dwrite d7/d9/f51 [0,4194304] 0 2024-04-27T07:33:32.143 INFO:tasks.workunit.client.0.smithi082.stdout:6/817: creat d2/d2d/d3d/de7/f110 x:0 0 0 2024-04-27T07:33:32.146 INFO:tasks.workunit.client.0.smithi082.stdout:1/762: chown d4/f86 1677 1 2024-04-27T07:33:32.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/908: write d8/d3c/d47/f27 [412756,40727] 0 2024-04-27T07:33:32.147 INFO:tasks.workunit.client.1.smithi100.stdout:1/494: write d0/d1f/d27/d40/d61/f8c [29203,124065] 0 2024-04-27T07:33:32.149 INFO:tasks.workunit.client.0.smithi082.stdout:6/818: readlink d2/d2d/d4a/de4/dcc/d13/l4f 0 2024-04-27T07:33:32.149 INFO:tasks.workunit.client.0.smithi082.stdout:5/909: chown d8/d29/dea 82064 1 2024-04-27T07:33:32.150 INFO:tasks.workunit.client.1.smithi100.stdout:2/365: mkdir d0/da/d29/d47/d7b 0 2024-04-27T07:33:32.150 INFO:tasks.workunit.client.0.smithi082.stdout:0/969: dread - da/d3c/dc7/f149 zero size 2024-04-27T07:33:32.151 INFO:tasks.workunit.client.1.smithi100.stdout:1/495: chown d0/d1b/d20/d2d/d35/c3b 182 1 2024-04-27T07:33:32.155 INFO:tasks.workunit.client.1.smithi100.stdout:9/324: truncate d1/d9/d1f/f3a 1761354 0 2024-04-27T07:33:32.156 INFO:tasks.workunit.client.0.smithi082.stdout:6/819: truncate d2/d2e/d55/f104 344357 0 2024-04-27T07:33:32.158 INFO:tasks.workunit.client.1.smithi100.stdout:1/496: symlink d0/d1f/d27/d6c/l9c 0 2024-04-27T07:33:32.158 INFO:tasks.workunit.client.0.smithi082.stdout:8/770: rename d0/f7 to d0/d2b/d80/dca/de6/d87/d71/ffd 0 2024-04-27T07:33:32.160 INFO:tasks.workunit.client.0.smithi082.stdout:0/970: dread - da/db3/fe2 zero size 2024-04-27T07:33:32.160 INFO:tasks.workunit.client.0.smithi082.stdout:7/862: dwrite d3/db1/fee [0,4194304] 0 2024-04-27T07:33:32.160 INFO:tasks.workunit.client.0.smithi082.stdout:4/929: dwrite d3/dab/ff0 [0,4194304] 0 2024-04-27T07:33:32.161 INFO:tasks.workunit.client.1.smithi100.stdout:2/366: unlink d0/da/d29/d6e/c25 0 2024-04-27T07:33:32.162 INFO:tasks.workunit.client.1.smithi100.stdout:1/497: symlink d0/d1b/l9d 0 2024-04-27T07:33:32.164 INFO:tasks.workunit.client.0.smithi082.stdout:6/820: dread d2/d2d/d4a/de4/dcc/d77/dd3/ffe [0,4194304] 0 2024-04-27T07:33:32.165 INFO:tasks.workunit.client.1.smithi100.stdout:9/325: link d1/d9/db/c19 d1/d9/d1f/c77 0 2024-04-27T07:33:32.167 INFO:tasks.workunit.client.1.smithi100.stdout:3/410: dread d7/d9/d10/d28/d2c/f34 [0,4194304] 0 2024-04-27T07:33:32.167 INFO:tasks.workunit.client.1.smithi100.stdout:2/367: write d0/da/d29/d47/f4f [450805,72696] 0 2024-04-27T07:33:32.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/804: dread d7/d14/fc2 [0,4194304] 0 2024-04-27T07:33:32.168 INFO:tasks.workunit.client.1.smithi100.stdout:1/498: symlink d0/d1b/d20/d2d/l9e 0 2024-04-27T07:33:32.170 INFO:tasks.workunit.client.1.smithi100.stdout:1/499: readlink d0/d1f/d27/d4e/l6a 0 2024-04-27T07:33:32.170 INFO:tasks.workunit.client.0.smithi082.stdout:0/971: fdatasync da/d3c/d3f/d4c/d119/f11a 0 2024-04-27T07:33:32.172 INFO:tasks.workunit.client.0.smithi082.stdout:2/805: dread d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:32.172 INFO:tasks.workunit.client.1.smithi100.stdout:9/326: readlink d1/d9/d1f/l2d 0 2024-04-27T07:33:32.175 INFO:tasks.workunit.client.1.smithi100.stdout:3/411: unlink d7/d9/d26/d45/f67 0 2024-04-27T07:33:32.176 INFO:tasks.workunit.client.0.smithi082.stdout:7/863: truncate d3/db/f46 2824042 0 2024-04-27T07:33:32.180 INFO:tasks.workunit.client.1.smithi100.stdout:1/500: dwrite d0/d1b/d20/d2d/d35/f72 [4194304,4194304] 0 2024-04-27T07:33:32.181 INFO:tasks.workunit.client.0.smithi082.stdout:0/972: dwrite da/d3c/d3f/d4c/d95/de9/def/fcd [0,4194304] 0 2024-04-27T07:33:32.181 INFO:tasks.workunit.client.0.smithi082.stdout:2/806: getdents d7/d14 0 2024-04-27T07:33:32.181 INFO:tasks.workunit.client.1.smithi100.stdout:3/412: write d7/f1f [1775010,45584] 0 2024-04-27T07:33:32.183 INFO:tasks.workunit.client.1.smithi100.stdout:3/413: write d7/d9/d10/f15 [5762838,49734] 0 2024-04-27T07:33:32.183 INFO:tasks.workunit.client.1.smithi100.stdout:9/327: creat d1/d9/db/d2b/d4f/f78 x:0 0 0 2024-04-27T07:33:32.184 INFO:tasks.workunit.client.1.smithi100.stdout:1/501: mknod d0/d1f/c9f 0 2024-04-27T07:33:32.186 INFO:tasks.workunit.client.0.smithi082.stdout:2/807: readlink d7/d9/d4f/d66/dae/l72 0 2024-04-27T07:33:32.186 INFO:tasks.workunit.client.1.smithi100.stdout:1/502: fdatasync d0/d1b/d20/d2d/d35/f7f 0 2024-04-27T07:33:32.187 INFO:tasks.workunit.client.1.smithi100.stdout:9/328: write d1/d9/db/d2b/f34 [498339,120979] 0 2024-04-27T07:33:32.188 INFO:tasks.workunit.client.1.smithi100.stdout:1/503: chown d0/f3d 6747156 1 2024-04-27T07:33:32.189 INFO:tasks.workunit.client.0.smithi082.stdout:5/910: dread d8/d15/d22/fb4 [0,4194304] 0 2024-04-27T07:33:32.189 INFO:tasks.workunit.client.1.smithi100.stdout:3/414: truncate d7/d9/d10/d28/d2c/d3a/f65 316874 0 2024-04-27T07:33:32.189 INFO:tasks.workunit.client.1.smithi100.stdout:1/504: chown d0/d1f/f2b 42578168 1 2024-04-27T07:33:32.192 INFO:tasks.workunit.client.1.smithi100.stdout:5/269: dread d0/d4/f19 [4194304,4194304] 0 2024-04-27T07:33:32.197 INFO:tasks.workunit.client.1.smithi100.stdout:3/415: getdents d7/d9/d10/d33 0 2024-04-27T07:33:32.199 INFO:tasks.workunit.client.1.smithi100.stdout:9/329: link d1/d9/db/f4e d1/d9/db/d2b/f79 0 2024-04-27T07:33:32.200 INFO:tasks.workunit.client.1.smithi100.stdout:3/416: symlink d7/d9/d10/d33/l83 0 2024-04-27T07:33:32.202 INFO:tasks.workunit.client.1.smithi100.stdout:5/270: getdents d0/d4/d28/d3e 0 2024-04-27T07:33:32.203 INFO:tasks.workunit.client.0.smithi082.stdout:6/821: write d2/d75/fbe [137057,105722] 0 2024-04-27T07:33:32.204 INFO:tasks.workunit.client.1.smithi100.stdout:3/417: symlink d7/d9/l84 0 2024-04-27T07:33:32.206 INFO:tasks.workunit.client.0.smithi082.stdout:0/973: write da/d2a/fae [693022,71231] 0 2024-04-27T07:33:32.206 INFO:tasks.workunit.client.1.smithi100.stdout:5/271: mkdir d0/d4/d21/d51 0 2024-04-27T07:33:32.208 INFO:tasks.workunit.client.0.smithi082.stdout:5/911: truncate d8/d3c/fa0 1927906 0 2024-04-27T07:33:32.209 INFO:tasks.workunit.client.0.smithi082.stdout:0/974: dread - da/db3/fe2 zero size 2024-04-27T07:33:32.210 INFO:tasks.workunit.client.0.smithi082.stdout:4/930: dwrite d3/d10/d9c/fb3 [0,4194304] 0 2024-04-27T07:33:32.211 INFO:tasks.workunit.client.1.smithi100.stdout:9/330: creat d1/d9/d1f/f7a x:0 0 0 2024-04-27T07:33:32.211 INFO:tasks.workunit.client.0.smithi082.stdout:0/975: fsync da/d3c/fa7 0 2024-04-27T07:33:32.212 INFO:tasks.workunit.client.1.smithi100.stdout:9/331: dread - d1/d9/db/f4e zero size 2024-04-27T07:33:32.212 INFO:tasks.workunit.client.1.smithi100.stdout:5/272: readlink d0/l12 0 2024-04-27T07:33:32.212 INFO:tasks.workunit.client.0.smithi082.stdout:6/822: rename d2/d3/da8/fe9 to d2/d2d/d4a/de4/dcc/d77/dd3/f111 0 2024-04-27T07:33:32.214 INFO:tasks.workunit.client.0.smithi082.stdout:5/912: symlink d8/d29/l12d 0 2024-04-27T07:33:32.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/505: rmdir d0/d1b/d20/d2d 39 2024-04-27T07:33:32.219 INFO:tasks.workunit.client.1.smithi100.stdout:2/368: write d0/f12 [755091,59916] 0 2024-04-27T07:33:32.219 INFO:tasks.workunit.client.0.smithi082.stdout:2/808: dwrite f3 [0,4194304] 0 2024-04-27T07:33:32.219 INFO:tasks.workunit.client.0.smithi082.stdout:4/931: fdatasync d3/d6/d26/f36 0 2024-04-27T07:33:32.220 INFO:tasks.workunit.client.0.smithi082.stdout:1/763: dread d4/d15/d49/dab/dc3/d3e/d57/d101/f67 [4194304,4194304] 0 2024-04-27T07:33:32.220 INFO:tasks.workunit.client.1.smithi100.stdout:5/273: rename d0/d4/f36 to d0/d42/f52 0 2024-04-27T07:33:32.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/976: write da/d28/d36/d40/f44 [5192309,105183] 0 2024-04-27T07:33:32.223 INFO:tasks.workunit.client.0.smithi082.stdout:5/913: fsync d8/d42/d123/d9c/f126 0 2024-04-27T07:33:32.224 INFO:tasks.workunit.client.1.smithi100.stdout:2/369: chown d0/d1e/f3b 4103710 1 2024-04-27T07:33:32.225 INFO:tasks.workunit.client.1.smithi100.stdout:9/332: creat d1/d9/d1f/f7b x:0 0 0 2024-04-27T07:33:32.225 INFO:tasks.workunit.client.0.smithi082.stdout:8/771: dwrite d0/d2b/d80/dca/de6/d87/d71/ffd [0,4194304] 0 2024-04-27T07:33:32.225 INFO:tasks.workunit.client.0.smithi082.stdout:6/823: mkdir d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/d112 0 2024-04-27T07:33:32.226 INFO:tasks.workunit.client.1.smithi100.stdout:9/333: readlink d1/d9/db/d2b/d4f/d57/l69 0 2024-04-27T07:33:32.227 INFO:tasks.workunit.client.0.smithi082.stdout:0/977: stat da/d2a/l51 0 2024-04-27T07:33:32.228 INFO:tasks.workunit.client.1.smithi100.stdout:5/274: creat d0/d4/d28/f53 x:0 0 0 2024-04-27T07:33:32.229 INFO:tasks.workunit.client.0.smithi082.stdout:5/914: chown d8/d29/d4e/dad 13 1 2024-04-27T07:33:32.230 INFO:tasks.workunit.client.1.smithi100.stdout:2/370: chown d0/da/d29/d6e/c56 2918532 1 2024-04-27T07:33:32.230 INFO:tasks.workunit.client.0.smithi082.stdout:2/809: creat d7/f10a x:0 0 0 2024-04-27T07:33:32.231 INFO:tasks.workunit.client.0.smithi082.stdout:6/824: truncate d2/d45/dc2/fc4 811603 0 2024-04-27T07:33:32.232 INFO:tasks.workunit.client.1.smithi100.stdout:2/371: truncate d0/da/d29/d6e/d5d/f5f 777706 0 2024-04-27T07:33:32.233 INFO:tasks.workunit.client.1.smithi100.stdout:1/506: rename d0/d1f/d27/d40/d61 to d0/da0 0 2024-04-27T07:33:32.234 INFO:tasks.workunit.client.1.smithi100.stdout:0/352: sync 2024-04-27T07:33:32.234 INFO:tasks.workunit.client.0.smithi082.stdout:0/978: mkdir da/d38/d7f/d4a/d80/da0/d129/d167 0 2024-04-27T07:33:32.235 INFO:tasks.workunit.client.1.smithi100.stdout:0/353: truncate d1/d30/f73 634232 0 2024-04-27T07:33:32.237 INFO:tasks.workunit.client.0.smithi082.stdout:4/932: write d3/dab/f12f [3420676,44695] 0 2024-04-27T07:33:32.237 INFO:tasks.workunit.client.0.smithi082.stdout:1/764: dwrite d4/f22 [0,4194304] 0 2024-04-27T07:33:32.237 INFO:tasks.workunit.client.1.smithi100.stdout:0/354: write d1/d8/d14/f41 [1215597,18154] 0 2024-04-27T07:33:32.238 INFO:tasks.workunit.client.1.smithi100.stdout:1/507: mkdir d0/d1b/da1 0 2024-04-27T07:33:32.238 INFO:tasks.workunit.client.1.smithi100.stdout:2/372: truncate d0/da/d29/d47/f5e 4592812 0 2024-04-27T07:33:32.238 INFO:tasks.workunit.client.0.smithi082.stdout:6/825: truncate d2/d2d/d4a/de4/ffd 668291 0 2024-04-27T07:33:32.240 INFO:tasks.workunit.client.1.smithi100.stdout:1/508: chown d0/d1b/d20/l32 181287709 1 2024-04-27T07:33:32.240 INFO:tasks.workunit.client.1.smithi100.stdout:2/373: write d0/f12 [1906238,89107] 0 2024-04-27T07:33:32.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/772: rename d0/d2b/d9a/da4/d35/l96 to d0/d2b/d80/dca/de6/d1c/d76/da0/df9/lfe 0 2024-04-27T07:33:32.247 INFO:tasks.workunit.client.0.smithi082.stdout:4/933: read d3/d9/f65 [3689813,101878] 0 2024-04-27T07:33:32.247 INFO:tasks.workunit.client.0.smithi082.stdout:1/765: truncate d4/d15/d1c/f2c 5595614 0 2024-04-27T07:33:32.248 INFO:tasks.workunit.client.0.smithi082.stdout:2/810: dwrite d7/d30/d23/fe5 [0,4194304] 0 2024-04-27T07:33:32.251 INFO:tasks.workunit.client.0.smithi082.stdout:4/934: dread - d3/d9/fed zero size 2024-04-27T07:33:32.256 INFO:tasks.workunit.client.0.smithi082.stdout:6/826: write d2/d3/da8/fba [985720,87474] 0 2024-04-27T07:33:32.257 INFO:tasks.workunit.client.0.smithi082.stdout:5/915: dwrite f5 [4194304,4194304] 0 2024-04-27T07:33:32.257 INFO:tasks.workunit.client.0.smithi082.stdout:0/979: write da/d3c/d3f/d4c/d95/fc9 [1725,115908] 0 2024-04-27T07:33:32.257 INFO:tasks.workunit.client.0.smithi082.stdout:2/811: unlink d7/d8/d99/db4/fbe 0 2024-04-27T07:33:32.260 INFO:tasks.workunit.client.0.smithi082.stdout:8/773: getdents d0/d2b/d80/dca/de6/d87/d46/d4e 0 2024-04-27T07:33:32.261 INFO:tasks.workunit.client.0.smithi082.stdout:4/935: readlink d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/d123/l131 0 2024-04-27T07:33:32.266 INFO:tasks.workunit.client.0.smithi082.stdout:1/766: creat d4/d15/d49/dab/dc3/d3e/f10b x:0 0 0 2024-04-27T07:33:32.267 INFO:tasks.workunit.client.0.smithi082.stdout:4/936: dread d3/d6/d26/d5e/d11e/d101/fb5 [0,4194304] 0 2024-04-27T07:33:32.268 INFO:tasks.workunit.client.0.smithi082.stdout:1/767: readlink d4/d15/d49/l88 0 2024-04-27T07:33:32.268 INFO:tasks.workunit.client.0.smithi082.stdout:8/774: rmdir d0/d2b/d80/dca/de6/d1c 39 2024-04-27T07:33:32.269 INFO:tasks.workunit.client.1.smithi100.stdout:5/275: dread d0/d4/f11 [0,4194304] 0 2024-04-27T07:33:32.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/827: dread d2/d3/da8/fba [0,4194304] 0 2024-04-27T07:33:32.270 INFO:tasks.workunit.client.0.smithi082.stdout:2/812: unlink d7/d31/l53 0 2024-04-27T07:33:32.271 INFO:tasks.workunit.client.0.smithi082.stdout:0/980: getdents da/d3c/d3f/d4c/d95/de9/d161 0 2024-04-27T07:33:32.273 INFO:tasks.workunit.client.0.smithi082.stdout:8/775: fsync d0/d2b/d9a/da4/f34 0 2024-04-27T07:33:32.277 INFO:tasks.workunit.client.0.smithi082.stdout:0/981: creat da/d38/d7f/d4a/d80/dcb/f168 x:0 0 0 2024-04-27T07:33:32.279 INFO:tasks.workunit.client.0.smithi082.stdout:5/916: truncate d8/d42/f106 544410 0 2024-04-27T07:33:32.279 INFO:tasks.workunit.client.0.smithi082.stdout:8/776: creat d0/d2b/d80/fff x:0 0 0 2024-04-27T07:33:32.280 INFO:tasks.workunit.client.0.smithi082.stdout:1/768: write d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/d93/fe6 [4736941,96695] 0 2024-04-27T07:33:32.281 INFO:tasks.workunit.client.0.smithi082.stdout:2/813: symlink d7/l10b 0 2024-04-27T07:33:32.282 INFO:tasks.workunit.client.0.smithi082.stdout:6/828: mkdir d2/d1e/d32/d85/d10c/d113 0 2024-04-27T07:33:32.283 INFO:tasks.workunit.client.0.smithi082.stdout:2/814: write d7/d8/d13/fb8 [975145,38708] 0 2024-04-27T07:33:32.283 INFO:tasks.workunit.client.0.smithi082.stdout:2/815: stat d7/d30 0 2024-04-27T07:33:32.283 INFO:tasks.workunit.client.0.smithi082.stdout:6/829: stat d2/d3/d1b/fc0 0 2024-04-27T07:33:32.284 INFO:tasks.workunit.client.0.smithi082.stdout:0/982: creat da/d28/d36/d137/f169 x:0 0 0 2024-04-27T07:33:32.285 INFO:tasks.workunit.client.0.smithi082.stdout:5/917: symlink d8/d2e/d85/d103/l12e 0 2024-04-27T07:33:32.286 INFO:tasks.workunit.client.0.smithi082.stdout:8/777: dread - d0/d2b/d80/fbb zero size 2024-04-27T07:33:32.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/830: creat d2/d2e/d6c/f114 x:0 0 0 2024-04-27T07:33:32.289 INFO:tasks.workunit.client.0.smithi082.stdout:0/983: mkdir da/d38/d7f/d4a/d80/da0/dd5/d116/d16a 0 2024-04-27T07:33:32.290 INFO:tasks.workunit.client.0.smithi082.stdout:0/984: write da/d3c/d3f/d4c/ffc [310856,15487] 0 2024-04-27T07:33:32.293 INFO:tasks.workunit.client.0.smithi082.stdout:0/985: write da/d38/d7f/d4a/d80/da0/dd5/ddf/ff0 [699666,23032] 0 2024-04-27T07:33:32.294 INFO:tasks.workunit.client.0.smithi082.stdout:5/918: creat d8/d77/de8/d128/dc7/f12f x:0 0 0 2024-04-27T07:33:32.295 INFO:tasks.workunit.client.0.smithi082.stdout:8/778: write d0/d2b/d80/dca/de6/d87/d42/fab [802165,82167] 0 2024-04-27T07:33:32.296 INFO:tasks.workunit.client.0.smithi082.stdout:2/816: symlink d7/d8/l10c 0 2024-04-27T07:33:32.297 INFO:tasks.workunit.client.0.smithi082.stdout:8/779: readlink d0/d2b/d80/dca/de6/d87/l48 0 2024-04-27T07:33:32.298 INFO:tasks.workunit.client.0.smithi082.stdout:4/937: link d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/c3b d3/d6/d26/c133 0 2024-04-27T07:33:32.299 INFO:tasks.workunit.client.0.smithi082.stdout:1/769: write d4/fa1 [975599,57640] 0 2024-04-27T07:33:32.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/780: fdatasync d0/d2b/d80/dca/de6/d1b/d29/f57 0 2024-04-27T07:33:32.300 INFO:tasks.workunit.client.0.smithi082.stdout:0/986: symlink da/d3c/d3f/d57/d14d/l16b 0 2024-04-27T07:33:32.301 INFO:tasks.workunit.client.0.smithi082.stdout:6/831: getdents d2/d2e/d6c/df1 0 2024-04-27T07:33:32.302 INFO:tasks.workunit.client.0.smithi082.stdout:2/817: creat d7/d9/d4f/d6e/d82/da4/f10d x:0 0 0 2024-04-27T07:33:32.303 INFO:tasks.workunit.client.0.smithi082.stdout:2/818: chown d7/d9/d4f/d66/dae/fa9 886217 1 2024-04-27T07:33:32.306 INFO:tasks.workunit.client.0.smithi082.stdout:4/938: rmdir d3/d6/d26 39 2024-04-27T07:33:32.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/987: mkdir da/d3c/d3f/d57/d14d/d16c 0 2024-04-27T07:33:32.310 INFO:tasks.workunit.client.0.smithi082.stdout:8/781: creat d0/d2b/d80/dca/de6/d87/d42/d7f/dac/f100 x:0 0 0 2024-04-27T07:33:32.310 INFO:tasks.workunit.client.1.smithi100.stdout:9/334: rename d1/d9/d1f/d4a/f55 to d1/d9/d1f/d52/f7c 0 2024-04-27T07:33:32.312 INFO:tasks.workunit.client.0.smithi082.stdout:2/819: mknod d7/d9/d4f/d6e/d82/dc6/c10e 0 2024-04-27T07:33:32.312 INFO:tasks.workunit.client.0.smithi082.stdout:2/820: stat d7 0 2024-04-27T07:33:32.312 INFO:tasks.workunit.client.0.smithi082.stdout:2/821: fdatasync d7/d8/d13/fb8 0 2024-04-27T07:33:32.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/919: rename d8/f3e to d8/d2e/f130 0 2024-04-27T07:33:32.315 INFO:tasks.workunit.client.1.smithi100.stdout:0/355: mknod d1/d8/d20/d1e/c79 0 2024-04-27T07:33:32.317 INFO:tasks.workunit.client.0.smithi082.stdout:6/832: write d2/d75/f7e [3198735,58404] 0 2024-04-27T07:33:32.318 INFO:tasks.workunit.client.0.smithi082.stdout:2/822: truncate d7/d14/fb6 637321 0 2024-04-27T07:33:32.319 INFO:tasks.workunit.client.1.smithi100.stdout:5/276: mknod d0/d4/d21/c54 0 2024-04-27T07:33:32.320 INFO:tasks.workunit.client.0.smithi082.stdout:1/770: rename d4/d15/d49/d99/db8 to d4/d15/d49/da0/d10c 0 2024-04-27T07:33:32.321 INFO:tasks.workunit.client.0.smithi082.stdout:1/771: write d4/f12 [17004,130705] 0 2024-04-27T07:33:32.321 INFO:tasks.workunit.client.0.smithi082.stdout:5/920: mkdir d8/d2e/d85/d103/d131 0 2024-04-27T07:33:32.322 INFO:tasks.workunit.client.1.smithi100.stdout:3/418: unlink d7/d9/d26/d2a/c1e 0 2024-04-27T07:33:32.324 INFO:tasks.workunit.client.0.smithi082.stdout:8/782: write d0/d2b/d6f/fc2 [410337,14449] 0 2024-04-27T07:33:32.324 INFO:tasks.workunit.client.0.smithi082.stdout:6/833: fdatasync d2/d3/f6 0 2024-04-27T07:33:32.326 INFO:tasks.workunit.client.0.smithi082.stdout:6/834: dread - d2/d3/d9c/fa6 zero size 2024-04-27T07:33:32.326 INFO:tasks.workunit.client.1.smithi100.stdout:5/277: creat d0/d4/d28/f55 x:0 0 0 2024-04-27T07:33:32.328 INFO:tasks.workunit.client.1.smithi100.stdout:2/374: creat d0/d1e/f7c x:0 0 0 2024-04-27T07:33:32.329 INFO:tasks.workunit.client.0.smithi082.stdout:1/772: unlink d4/d15/d49/dab/dc3/d3e/f61 0 2024-04-27T07:33:32.330 INFO:tasks.workunit.client.0.smithi082.stdout:0/988: link da/d3c/d3f/d57/fc3 da/d38/da9/f16d 0 2024-04-27T07:33:32.331 INFO:tasks.workunit.client.0.smithi082.stdout:8/783: fdatasync d0/d2b/d80/dca/de6/d1b/d29/d65/fa2 0 2024-04-27T07:33:32.332 INFO:tasks.workunit.client.1.smithi100.stdout:2/375: truncate d0/d1e/d51/f63 661519 0 2024-04-27T07:33:32.332 INFO:tasks.workunit.client.1.smithi100.stdout:0/356: link d1/d38/d3a/d54/l58 d1/d8/d20/d72/l7a 0 2024-04-27T07:33:32.333 INFO:tasks.workunit.client.0.smithi082.stdout:4/939: truncate d3/d6/d26/d55/d67/f115 3328742 0 2024-04-27T07:33:32.334 INFO:tasks.workunit.client.0.smithi082.stdout:6/835: creat d2/d2d/d3d/f115 x:0 0 0 2024-04-27T07:33:32.336 INFO:tasks.workunit.client.0.smithi082.stdout:1/773: dwrite d4/d15/d49/d99/d9a/da9/ff2 [0,4194304] 0 2024-04-27T07:33:32.336 INFO:tasks.workunit.client.1.smithi100.stdout:9/335: getdents d1/d9/db/d2b/d31 0 2024-04-27T07:33:32.336 INFO:tasks.workunit.client.1.smithi100.stdout:5/278: dwrite d0/d4/d28/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:32.336 INFO:tasks.workunit.client.1.smithi100.stdout:3/419: getdents d7/d9/d10/d3e/d74 0 2024-04-27T07:33:32.337 INFO:tasks.workunit.client.1.smithi100.stdout:2/376: chown d0/d1e/d51/f63 69 1 2024-04-27T07:33:32.338 INFO:tasks.workunit.client.0.smithi082.stdout:0/989: creat da/d1d/d6a/f16e x:0 0 0 2024-04-27T07:33:32.343 INFO:tasks.workunit.client.1.smithi100.stdout:1/509: getdents d0/d1b/d20/d2d/d35/d4d/d60/d79 0 2024-04-27T07:33:32.343 INFO:tasks.workunit.client.0.smithi082.stdout:9/742: sync 2024-04-27T07:33:32.343 INFO:tasks.workunit.client.0.smithi082.stdout:9/743: write d9/da/d85/ff2 [167246,41178] 0 2024-04-27T07:33:32.343 INFO:tasks.workunit.client.0.smithi082.stdout:5/921: creat d8/d14/f132 x:0 0 0 2024-04-27T07:33:32.344 INFO:tasks.workunit.client.1.smithi100.stdout:3/420: dread d7/d9/d10/d28/d2c/d3a/f65 [0,4194304] 0 2024-04-27T07:33:32.345 INFO:tasks.workunit.client.1.smithi100.stdout:0/357: dwrite d1/d8/d20/f42 [0,4194304] 0 2024-04-27T07:33:32.345 INFO:tasks.workunit.client.0.smithi082.stdout:6/836: fdatasync d2/d2d/d4a/de4/dcc/f24 0 2024-04-27T07:33:32.347 INFO:tasks.workunit.client.1.smithi100.stdout:3/421: write d7/d9/d26/f32 [1978052,55956] 0 2024-04-27T07:33:32.348 INFO:tasks.workunit.client.0.smithi082.stdout:1/774: mknod d4/d15/d49/da0/c10d 0 2024-04-27T07:33:32.348 INFO:tasks.workunit.client.1.smithi100.stdout:5/279: mkdir d0/d4/d21/d24/d2f/d39/d56 0 2024-04-27T07:33:32.349 INFO:tasks.workunit.client.1.smithi100.stdout:2/377: chown d0/da/d29/d47/f4a 2 1 2024-04-27T07:33:32.349 INFO:tasks.workunit.client.0.smithi082.stdout:0/990: mknod da/d3c/d3f/d57/d14e/c16f 0 2024-04-27T07:33:32.351 INFO:tasks.workunit.client.0.smithi082.stdout:1/775: dread - d4/d15/d49/dab/feb zero size 2024-04-27T07:33:32.352 INFO:tasks.workunit.client.0.smithi082.stdout:0/991: dread - da/db3/fe2 zero size 2024-04-27T07:33:32.354 INFO:tasks.workunit.client.1.smithi100.stdout:2/378: write d0/d1e/f7c [142731,28112] 0 2024-04-27T07:33:32.354 INFO:tasks.workunit.client.0.smithi082.stdout:8/784: getdents d0/d2b/d80/dca/de9/dbf/dd2 0 2024-04-27T07:33:32.355 INFO:tasks.workunit.client.1.smithi100.stdout:9/336: rename d1/d9/db/d2b/d4f/d57/f60 to d1/d9/db/d2b/f7d 0 2024-04-27T07:33:32.356 INFO:tasks.workunit.client.0.smithi082.stdout:1/776: stat d4/d15/d29/f7d 0 2024-04-27T07:33:32.356 INFO:tasks.workunit.client.0.smithi082.stdout:9/744: creat d9/da/dc/d33/ffe x:0 0 0 2024-04-27T07:33:32.357 INFO:tasks.workunit.client.1.smithi100.stdout:3/422: dwrite d7/d9/d26/d6c/f80 [0,4194304] 0 2024-04-27T07:33:32.357 INFO:tasks.workunit.client.0.smithi082.stdout:2/823: dwrite d7/d14/fb6 [0,4194304] 0 2024-04-27T07:33:32.359 INFO:tasks.workunit.client.1.smithi100.stdout:1/510: rmdir d0/d1b/d20/d2d/d35 39 2024-04-27T07:33:32.362 INFO:tasks.workunit.client.0.smithi082.stdout:6/837: dwrite d2/d2d/d4a/ff3 [0,4194304] 0 2024-04-27T07:33:32.365 INFO:tasks.workunit.client.0.smithi082.stdout:2/824: symlink d7/d9/l10f 0 2024-04-27T07:33:32.365 INFO:tasks.workunit.client.1.smithi100.stdout:9/337: creat d1/d9/d1f/d52/f7e x:0 0 0 2024-04-27T07:33:32.365 INFO:tasks.workunit.client.1.smithi100.stdout:2/379: dread d0/da/f1c [0,4194304] 0 2024-04-27T07:33:32.368 INFO:tasks.workunit.client.1.smithi100.stdout:3/423: dwrite d7/d9/d10/d33/f41 [0,4194304] 0 2024-04-27T07:33:32.368 INFO:tasks.workunit.client.0.smithi082.stdout:8/785: chown d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/ld1 0 1 2024-04-27T07:33:32.369 INFO:tasks.workunit.client.1.smithi100.stdout:5/280: rename d0/d4/d28 to d0/d4/d21/d24/d2f/d57 0 2024-04-27T07:33:32.370 INFO:tasks.workunit.client.0.smithi082.stdout:2/825: chown d7/d9/c12 2200 1 2024-04-27T07:33:32.370 INFO:tasks.workunit.client.1.smithi100.stdout:5/281: write d0/f14 [4378660,37828] 0 2024-04-27T07:33:32.371 INFO:tasks.workunit.client.0.smithi082.stdout:9/745: symlink d9/da/dc/d35/d38/lff 0 2024-04-27T07:33:32.375 INFO:tasks.workunit.client.1.smithi100.stdout:3/424: mknod d7/d9/d26/d6c/c85 0 2024-04-27T07:33:32.375 INFO:tasks.workunit.client.0.smithi082.stdout:6/838: creat d2/d2d/d4a/de4/dcc/d77/dd3/f116 x:0 0 0 2024-04-27T07:33:32.377 INFO:tasks.workunit.client.0.smithi082.stdout:0/992: getdents da/d3c/d3f/d4c/d95/de9/df6 0 2024-04-27T07:33:32.379 INFO:tasks.workunit.client.1.smithi100.stdout:2/380: dwrite d0/f24 [0,4194304] 0 2024-04-27T07:33:32.379 INFO:tasks.workunit.client.0.smithi082.stdout:9/746: mkdir d9/da/dc/d88/da8/d100 0 2024-04-27T07:33:32.379 INFO:tasks.workunit.client.1.smithi100.stdout:3/425: dread f6 [0,4194304] 0 2024-04-27T07:33:32.380 INFO:tasks.workunit.client.0.smithi082.stdout:6/839: fdatasync d2/d2d/d3d/de7/f110 0 2024-04-27T07:33:32.381 INFO:tasks.workunit.client.0.smithi082.stdout:8/786: symlink d0/d2b/d9a/l101 0 2024-04-27T07:33:32.383 INFO:tasks.workunit.client.0.smithi082.stdout:5/922: truncate d8/d15/f58 238763 0 2024-04-27T07:33:32.386 INFO:tasks.workunit.client.0.smithi082.stdout:4/940: dwrite d3/d6/d26/d5e/d21/f80 [0,4194304] 0 2024-04-27T07:33:32.386 INFO:tasks.workunit.client.0.smithi082.stdout:1/777: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/f67 [4194304,4194304] 0 2024-04-27T07:33:32.389 INFO:tasks.workunit.client.0.smithi082.stdout:7/864: sync 2024-04-27T07:33:32.389 INFO:tasks.workunit.client.0.smithi082.stdout:4/941: stat d3/d6/d26/d5e/d11e/d101/fb0 0 2024-04-27T07:33:32.389 INFO:tasks.workunit.client.0.smithi082.stdout:9/747: write d9/da/dc/d35/d38/da5/d66/d97/fd5 [666692,19028] 0 2024-04-27T07:33:32.412 INFO:tasks.workunit.client.1.smithi100.stdout:5/282: dread d0/d4/fc [0,4194304] 0 2024-04-27T07:33:32.413 INFO:tasks.workunit.client.1.smithi100.stdout:4/397: sync 2024-04-27T07:33:32.417 INFO:tasks.workunit.client.1.smithi100.stdout:5/283: dread d0/d4/d21/f50 [0,4194304] 0 2024-04-27T07:33:32.417 INFO:tasks.workunit.client.1.smithi100.stdout:1/511: fdatasync d0/d1b/d20/d2d/d35/f9b 0 2024-04-27T07:33:32.420 INFO:tasks.workunit.client.1.smithi100.stdout:0/358: creat d1/d8/d20/f7b x:0 0 0 2024-04-27T07:33:32.424 INFO:tasks.workunit.client.1.smithi100.stdout:2/381: mknod d0/da/d3a/c7d 0 2024-04-27T07:33:32.426 INFO:tasks.workunit.client.1.smithi100.stdout:3/426: stat d7/d9/d2f/f5d 0 2024-04-27T07:33:32.426 INFO:tasks.workunit.client.1.smithi100.stdout:5/284: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:32.475 INFO:tasks.workunit.client.1.smithi100.stdout:5/285: mkdir d0/d58 0 2024-04-27T07:33:32.476 INFO:tasks.workunit.client.0.smithi082.stdout:8/787: mknod d0/d2b/d80/dca/de6/d1b/d29/c102 0 2024-04-27T07:33:32.477 INFO:tasks.workunit.client.0.smithi082.stdout:4/942: symlink d3/d6/d26/d5e/d21/l134 0 2024-04-27T07:33:32.477 INFO:tasks.workunit.client.0.smithi082.stdout:8/788: stat d0/d2b/dd5 0 2024-04-27T07:33:32.477 INFO:tasks.workunit.client.0.smithi082.stdout:1/778: chown d4/d15/d49/dab/dc3/d3e/cb9 387630799 1 2024-04-27T07:33:32.477 INFO:tasks.workunit.client.1.smithi100.stdout:0/359: creat d1/d38/f7c x:0 0 0 2024-04-27T07:33:32.479 INFO:tasks.workunit.client.0.smithi082.stdout:2/826: truncate d7/d8/d13/f2b 3450205 0 2024-04-27T07:33:32.479 INFO:tasks.workunit.client.1.smithi100.stdout:2/382: link d0/d1e/f27 d0/da/d29/d47/f7e 0 2024-04-27T07:33:32.480 INFO:tasks.workunit.client.1.smithi100.stdout:5/286: creat d0/d4/d21/d3d/f59 x:0 0 0 2024-04-27T07:33:32.480 INFO:tasks.workunit.client.0.smithi082.stdout:7/865: creat d3/d49/d97/d3a/d2a/dac/d91/f130 x:0 0 0 2024-04-27T07:33:32.481 INFO:tasks.workunit.client.0.smithi082.stdout:9/748: truncate d9/d2d/d2b/f34 1273020 0 2024-04-27T07:33:32.482 INFO:tasks.workunit.client.1.smithi100.stdout:0/360: write d1/d30/f33 [729041,101738] 0 2024-04-27T07:33:32.483 INFO:tasks.workunit.client.0.smithi082.stdout:7/866: dread - d3/d49/fe2 zero size 2024-04-27T07:33:32.486 INFO:tasks.workunit.client.0.smithi082.stdout:1/779: unlink d4/d15/d49/dab/dc3/d3e/d57/d101/fea 0 2024-04-27T07:33:32.486 INFO:tasks.workunit.client.1.smithi100.stdout:5/287: unlink d0/d4/d21/d24/l29 0 2024-04-27T07:33:32.487 INFO:tasks.workunit.client.1.smithi100.stdout:2/383: dwrite d0/da/f6d [0,4194304] 0 2024-04-27T07:33:32.487 INFO:tasks.workunit.client.0.smithi082.stdout:7/867: write d3/db/f2e [8739654,85734] 0 2024-04-27T07:33:32.489 INFO:tasks.workunit.client.1.smithi100.stdout:4/398: mkdir d5/d16/d19/d21/d87 0 2024-04-27T07:33:32.489 INFO:tasks.workunit.client.0.smithi082.stdout:9/749: symlink d9/da/dc/d35/d4b/l101 0 2024-04-27T07:33:32.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/840: dwrite d2/d2d/d4a/de4/dcc/f83 [0,4194304] 0 2024-04-27T07:33:32.491 INFO:tasks.workunit.client.0.smithi082.stdout:4/943: dwrite d3/dab/ff0 [0,4194304] 0 2024-04-27T07:33:32.491 INFO:tasks.workunit.client.0.smithi082.stdout:0/993: dread da/d28/f43 [0,4194304] 0 2024-04-27T07:33:32.492 INFO:tasks.workunit.client.1.smithi100.stdout:5/288: write d0/d4/f19 [4233051,107138] 0 2024-04-27T07:33:32.492 INFO:tasks.workunit.client.0.smithi082.stdout:8/789: getdents d0/d2b/d80/dca/de6/d1b/d29 0 2024-04-27T07:33:32.493 INFO:tasks.workunit.client.1.smithi100.stdout:0/361: dwrite d1/d8/d14/f17 [0,4194304] 0 2024-04-27T07:33:32.493 INFO:tasks.workunit.client.0.smithi082.stdout:7/868: fsync d3/db1/fee 0 2024-04-27T07:33:32.494 INFO:tasks.workunit.client.0.smithi082.stdout:1/780: creat d4/d15/d1c/f10e x:0 0 0 2024-04-27T07:33:32.495 INFO:tasks.workunit.client.1.smithi100.stdout:2/384: mknod d0/da/d3a/c7f 0 2024-04-27T07:33:32.498 INFO:tasks.workunit.client.1.smithi100.stdout:4/399: readlink d5/d1b/d65/l6f 0 2024-04-27T07:33:32.500 INFO:tasks.workunit.client.1.smithi100.stdout:4/400: chown d5/d23/f3c 648264 1 2024-04-27T07:33:32.504 INFO:tasks.workunit.client.0.smithi082.stdout:2/827: link d7/d30/d61/f71 d7/d8/f110 0 2024-04-27T07:33:32.505 INFO:tasks.workunit.client.1.smithi100.stdout:2/385: dwrite d0/da/d29/d6e/f2a [4194304,4194304] 0 2024-04-27T07:33:32.505 INFO:tasks.workunit.client.1.smithi100.stdout:5/289: creat d0/d4/d21/d24/f5a x:0 0 0 2024-04-27T07:33:32.507 INFO:tasks.workunit.client.0.smithi082.stdout:7/869: creat d3/db/dc1/f131 x:0 0 0 2024-04-27T07:33:32.510 INFO:tasks.workunit.client.0.smithi082.stdout:2/828: read d7/d14/fb6 [3282821,56979] 0 2024-04-27T07:33:32.510 INFO:tasks.workunit.client.0.smithi082.stdout:1/781: mknod d4/d15/d49/c10f 0 2024-04-27T07:33:32.511 INFO:tasks.workunit.client.0.smithi082.stdout:8/790: creat d0/d2b/d80/dca/de6/d1b/d29/d65/f103 x:0 0 0 2024-04-27T07:33:32.514 INFO:tasks.workunit.client.1.smithi100.stdout:5/290: stat d0/f1d 0 2024-04-27T07:33:32.518 INFO:tasks.workunit.client.1.smithi100.stdout:0/362: link d1/f10 d1/d8/d20/d61/f7d 0 2024-04-27T07:33:32.520 INFO:tasks.workunit.client.1.smithi100.stdout:5/291: write d0/f10 [5035447,96388] 0 2024-04-27T07:33:32.521 INFO:tasks.workunit.client.0.smithi082.stdout:9/750: dwrite d9/da/dc/d35/d38/fc9 [0,4194304] 0 2024-04-27T07:33:32.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/841: dwrite d2/d3/d9c/fa6 [0,4194304] 0 2024-04-27T07:33:32.521 INFO:tasks.workunit.client.0.smithi082.stdout:0/994: dwrite da/d1d/d6a/f107 [0,4194304] 0 2024-04-27T07:33:32.521 INFO:tasks.workunit.client.0.smithi082.stdout:4/944: truncate d3/d6/d26/d55/d67/fb1 271872 0 2024-04-27T07:33:32.522 INFO:tasks.workunit.client.0.smithi082.stdout:9/751: fdatasync d9/d2d/f68 0 2024-04-27T07:33:32.524 INFO:tasks.workunit.client.1.smithi100.stdout:5/292: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/f20 5099159 0 2024-04-27T07:33:32.528 INFO:tasks.workunit.client.1.smithi100.stdout:2/386: rmdir d0/da/d29/d47/d7b 0 2024-04-27T07:33:32.530 INFO:tasks.workunit.client.0.smithi082.stdout:4/945: chown d3/d9/fb 1277148756 1 2024-04-27T07:33:32.531 INFO:tasks.workunit.client.0.smithi082.stdout:8/791: creat d0/d2b/d80/dca/de6/d87/d42/d7f/d82/f104 x:0 0 0 2024-04-27T07:33:32.532 INFO:tasks.workunit.client.0.smithi082.stdout:2/829: dread d7/d14/fb6 [0,4194304] 0 2024-04-27T07:33:32.533 INFO:tasks.workunit.client.0.smithi082.stdout:2/830: write d7/d8/d99/fda [820461,37598] 0 2024-04-27T07:33:32.533 INFO:tasks.workunit.client.1.smithi100.stdout:5/293: dwrite d0/d4/d21/d24/d2f/d57/d37/f1b [0,4194304] 0 2024-04-27T07:33:32.534 INFO:tasks.workunit.client.0.smithi082.stdout:7/870: rename d3/d49/d97/d3a/d2a/dac/caf to d3/d49/d97/d3a/d71/d109/c132 0 2024-04-27T07:33:32.535 INFO:tasks.workunit.client.0.smithi082.stdout:2/831: write d7/f5b [411793,106598] 0 2024-04-27T07:33:32.536 INFO:tasks.workunit.client.0.smithi082.stdout:9/752: creat d9/da/dc/d35/d4a/d50/f102 x:0 0 0 2024-04-27T07:33:32.536 INFO:tasks.workunit.client.0.smithi082.stdout:1/782: dread d4/d15/d49/dab/dc3/f82 [0,4194304] 0 2024-04-27T07:33:32.539 INFO:tasks.workunit.client.0.smithi082.stdout:7/871: rmdir d3/d9 39 2024-04-27T07:33:32.540 INFO:tasks.workunit.client.1.smithi100.stdout:5/294: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d31/c5b 0 2024-04-27T07:33:32.541 INFO:tasks.workunit.client.0.smithi082.stdout:0/995: rename da/d38/d7f/d4a/f58 to da/d38/d7f/d4a/d80/da0/d129/d167/f170 0 2024-04-27T07:33:32.547 INFO:tasks.workunit.client.1.smithi100.stdout:1/512: rename d0/d1b/f62 to d0/d1b/da1/fa2 0 2024-04-27T07:33:32.548 INFO:tasks.workunit.client.0.smithi082.stdout:2/832: rmdir d7/d14 39 2024-04-27T07:33:32.548 INFO:tasks.workunit.client.0.smithi082.stdout:2/833: fsync d7/d9/d4f/d66/dae/ff7 0 2024-04-27T07:33:32.548 INFO:tasks.workunit.client.0.smithi082.stdout:4/946: creat d3/d6/d26/d5e/d12c/f135 x:0 0 0 2024-04-27T07:33:32.548 INFO:tasks.workunit.client.0.smithi082.stdout:1/783: creat d4/d15/d49/d99/f110 x:0 0 0 2024-04-27T07:33:32.550 INFO:tasks.workunit.client.1.smithi100.stdout:5/295: dwrite d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:32.550 INFO:tasks.workunit.client.1.smithi100.stdout:3/427: rename d7/d9/d26/f32 to d7/d9/d10/f86 0 2024-04-27T07:33:32.554 INFO:tasks.workunit.client.0.smithi082.stdout:2/834: creat d7/d8/d99/f111 x:0 0 0 2024-04-27T07:33:32.555 INFO:tasks.workunit.client.0.smithi082.stdout:1/784: dwrite d4/d15/d29/fe3 [0,4194304] 0 2024-04-27T07:33:32.556 INFO:tasks.workunit.client.0.smithi082.stdout:4/947: rename d3/d6/d26/d5e/fea to d3/d6/dcf/d110/f136 0 2024-04-27T07:33:32.556 INFO:tasks.workunit.client.1.smithi100.stdout:3/428: creat d7/d9/d26/d2a/f87 x:0 0 0 2024-04-27T07:33:32.559 INFO:tasks.workunit.client.0.smithi082.stdout:7/872: symlink d3/d9/dda/l133 0 2024-04-27T07:33:32.563 INFO:tasks.workunit.client.0.smithi082.stdout:1/785: fdatasync d4/d15/d49/dab/dc3/f82 0 2024-04-27T07:33:32.564 INFO:tasks.workunit.client.1.smithi100.stdout:2/387: link d0/d1e/f31 d0/da/d29/f80 0 2024-04-27T07:33:32.564 INFO:tasks.workunit.client.1.smithi100.stdout:3/429: dread d7/d9/d10/d28/f7d [0,4194304] 0 2024-04-27T07:33:32.565 INFO:tasks.workunit.client.1.smithi100.stdout:2/388: write d0/da/d3a/f48 [21664,32806] 0 2024-04-27T07:33:32.567 INFO:tasks.workunit.client.0.smithi082.stdout:1/786: mkdir d4/d15/d49/dab/d111 0 2024-04-27T07:33:32.570 INFO:tasks.workunit.client.0.smithi082.stdout:7/873: mkdir d3/d9/d4f/d134 0 2024-04-27T07:33:32.571 INFO:tasks.workunit.client.0.smithi082.stdout:7/874: chown d3/dfb/c5c 862865473 1 2024-04-27T07:33:32.572 INFO:tasks.workunit.client.0.smithi082.stdout:2/835: creat d7/d8/f112 x:0 0 0 2024-04-27T07:33:32.572 INFO:tasks.workunit.client.1.smithi100.stdout:4/401: rmdir d5/d16/d19/d21 39 2024-04-27T07:33:32.573 INFO:tasks.workunit.client.0.smithi082.stdout:6/842: truncate d2/d2d/d4a/fb9 130036 0 2024-04-27T07:33:32.575 INFO:tasks.workunit.client.1.smithi100.stdout:4/402: creat d5/f88 x:0 0 0 2024-04-27T07:33:32.575 INFO:tasks.workunit.client.0.smithi082.stdout:1/787: dwrite d4/d15/d49/dab/dc3/d3e/d46/ffd [0,4194304] 0 2024-04-27T07:33:32.575 INFO:tasks.workunit.client.1.smithi100.stdout:1/513: dread d0/d1f/f2b [0,4194304] 0 2024-04-27T07:33:32.576 INFO:tasks.workunit.client.0.smithi082.stdout:7/875: chown d3/db/dc1/ld8 2280 1 2024-04-27T07:33:32.578 INFO:tasks.workunit.client.1.smithi100.stdout:0/363: unlink d1/d8/f78 0 2024-04-27T07:33:32.578 INFO:tasks.workunit.client.1.smithi100.stdout:1/514: fsync d0/d1b/d20/d2d/d35/f7f 0 2024-04-27T07:33:32.579 INFO:tasks.workunit.client.0.smithi082.stdout:7/876: readlink d3/d9/dda/l10a 0 2024-04-27T07:33:32.581 INFO:tasks.workunit.client.0.smithi082.stdout:1/788: mkdir d4/d15/d49/dab/dc3/d4c/d7a/d8c/d112 0 2024-04-27T07:33:32.583 INFO:tasks.workunit.client.0.smithi082.stdout:2/836: creat d7/d8/d13/f113 x:0 0 0 2024-04-27T07:33:32.583 INFO:tasks.workunit.client.1.smithi100.stdout:4/403: dwrite d5/fc [4194304,4194304] 0 2024-04-27T07:33:32.584 INFO:tasks.workunit.client.0.smithi082.stdout:1/789: dread - d4/d15/d49/dab/fe2 zero size 2024-04-27T07:33:32.584 INFO:tasks.workunit.client.0.smithi082.stdout:9/753: dwrite d9/da/dc/d35/d38/d65/f7f [0,4194304] 0 2024-04-27T07:33:32.585 INFO:tasks.workunit.client.1.smithi100.stdout:0/364: mknod d1/d38/c7e 0 2024-04-27T07:33:32.586 INFO:tasks.workunit.client.0.smithi082.stdout:7/877: mknod d3/db/dc1/c135 0 2024-04-27T07:33:32.586 INFO:tasks.workunit.client.1.smithi100.stdout:4/404: dread - d5/d1b/d2c/d50/f5c zero size 2024-04-27T07:33:32.586 INFO:tasks.workunit.client.0.smithi082.stdout:1/790: chown d4/d15/d49/dab/dc3/d3e/f87 105 1 2024-04-27T07:33:32.593 INFO:tasks.workunit.client.1.smithi100.stdout:5/296: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/f4d 434267 0 2024-04-27T07:33:32.595 INFO:tasks.workunit.client.1.smithi100.stdout:0/365: dwrite d1/d38/f7c [0,4194304] 0 2024-04-27T07:33:32.597 INFO:tasks.workunit.client.1.smithi100.stdout:2/389: dread d0/da/f28 [0,4194304] 0 2024-04-27T07:33:32.600 INFO:tasks.workunit.client.1.smithi100.stdout:3/430: truncate d7/d9/d10/d28/f7d 21274 0 2024-04-27T07:33:32.600 INFO:tasks.workunit.client.1.smithi100.stdout:1/515: getdents d0/d23 0 2024-04-27T07:33:32.602 INFO:tasks.workunit.client.1.smithi100.stdout:3/431: stat d7/d9/d26/f59 0 2024-04-27T07:33:32.603 INFO:tasks.workunit.client.1.smithi100.stdout:5/297: rmdir d0/d4/d21/d3d 39 2024-04-27T07:33:32.604 INFO:tasks.workunit.client.1.smithi100.stdout:3/432: write d7/d9/d26/f44 [3494242,40371] 0 2024-04-27T07:33:32.604 INFO:tasks.workunit.client.1.smithi100.stdout:2/390: rename d0/da to d0/da/d29/d6e/d81 22 2024-04-27T07:33:32.605 INFO:tasks.workunit.client.1.smithi100.stdout:1/516: truncate d0/d23/d3a/f98 687612 0 2024-04-27T07:33:32.607 INFO:tasks.workunit.client.1.smithi100.stdout:3/433: stat d7/d9/c16 0 2024-04-27T07:33:32.607 INFO:tasks.workunit.client.1.smithi100.stdout:0/366: dread d1/d8/d20/f1c [0,4194304] 0 2024-04-27T07:33:32.609 INFO:tasks.workunit.client.1.smithi100.stdout:0/367: fdatasync d1/d38/f47 0 2024-04-27T07:33:32.609 INFO:tasks.workunit.client.1.smithi100.stdout:3/434: fsync d7/d9/f51 0 2024-04-27T07:33:32.611 INFO:tasks.workunit.client.1.smithi100.stdout:2/391: mkdir d0/da/d29/d47/d5a/d82 0 2024-04-27T07:33:32.613 INFO:tasks.workunit.client.1.smithi100.stdout:2/392: write d0/f24 [4617007,96464] 0 2024-04-27T07:33:32.617 INFO:tasks.workunit.client.1.smithi100.stdout:3/435: dwrite d7/d9/f51 [0,4194304] 0 2024-04-27T07:33:32.617 INFO:tasks.workunit.client.0.smithi082.stdout:9/754: mkdir d9/da/dc/d33/d103 0 2024-04-27T07:33:32.618 INFO:tasks.workunit.client.0.smithi082.stdout:1/791: fsync d4/d15/d49/dab/dc3/d3e/d57/f77 0 2024-04-27T07:33:32.618 INFO:tasks.workunit.client.0.smithi082.stdout:0/996: dwrite da/d3c/d3f/d4c/d95/de9/f13d [0,4194304] 0 2024-04-27T07:33:32.619 INFO:tasks.workunit.client.0.smithi082.stdout:2/837: creat d7/d8/d13/f114 x:0 0 0 2024-04-27T07:33:32.619 INFO:tasks.workunit.client.1.smithi100.stdout:4/405: write d5/d23/f25 [1479745,92059] 0 2024-04-27T07:33:32.619 INFO:tasks.workunit.client.1.smithi100.stdout:3/436: write d7/d9/d26/d2a/f82 [1006186,48802] 0 2024-04-27T07:33:32.621 INFO:tasks.workunit.client.1.smithi100.stdout:8/333: sync 2024-04-27T07:33:32.621 INFO:tasks.workunit.client.0.smithi082.stdout:1/792: fdatasync d4/d15/d29/f47 0 2024-04-27T07:33:32.622 INFO:tasks.workunit.client.0.smithi082.stdout:7/878: creat d3/db/f136 x:0 0 0 2024-04-27T07:33:32.622 INFO:tasks.workunit.client.0.smithi082.stdout:2/838: stat d7/d9/d4f/d66/dae/fa9 0 2024-04-27T07:33:32.623 INFO:tasks.workunit.client.1.smithi100.stdout:8/334: chown d6/l15 8361204 1 2024-04-27T07:33:32.625 INFO:tasks.workunit.client.0.smithi082.stdout:7/879: chown d3/f85 135 1 2024-04-27T07:33:32.625 INFO:tasks.workunit.client.0.smithi082.stdout:2/839: readlink d7/d30/d23/l100 0 2024-04-27T07:33:32.625 INFO:tasks.workunit.client.0.smithi082.stdout:1/793: chown d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/d93/fe6 827 1 2024-04-27T07:33:32.627 INFO:tasks.workunit.client.0.smithi082.stdout:2/840: readlink d7/d8/d13/d94/lc9 0 2024-04-27T07:33:32.629 INFO:tasks.workunit.client.0.smithi082.stdout:6/843: dread d2/d2d/d4a/de4/dcc/d13/f16 [0,4194304] 0 2024-04-27T07:33:32.630 INFO:tasks.workunit.client.0.smithi082.stdout:1/794: mkdir d4/d15/d49/dab/dc3/d4c/d7a/d113 0 2024-04-27T07:33:32.631 INFO:tasks.workunit.client.1.smithi100.stdout:4/406: dwrite d5/d23/f25 [0,4194304] 0 2024-04-27T07:33:32.631 INFO:tasks.workunit.client.1.smithi100.stdout:3/437: symlink d7/d9/d10/d33/d47/l88 0 2024-04-27T07:33:32.631 INFO:tasks.workunit.client.0.smithi082.stdout:6/844: chown d2/d2d/d4a/de4/dcc/d77/dd3/f116 115101190 1 2024-04-27T07:33:32.632 INFO:tasks.workunit.client.0.smithi082.stdout:9/755: creat d9/da/dc/d35/d4a/f104 x:0 0 0 2024-04-27T07:33:32.632 INFO:tasks.workunit.client.0.smithi082.stdout:0/997: creat da/d3c/d3f/d4c/d95/de9/def/d81/f171 x:0 0 0 2024-04-27T07:33:32.633 INFO:tasks.workunit.client.1.smithi100.stdout:4/407: write d5/f32 [2055209,114817] 0 2024-04-27T07:33:32.633 INFO:tasks.workunit.client.1.smithi100.stdout:8/335: mknod d6/d20/d54/c67 0 2024-04-27T07:33:32.633 INFO:tasks.workunit.client.1.smithi100.stdout:0/368: link d1/d30/f52 d1/d8/f7f 0 2024-04-27T07:33:32.633 INFO:tasks.workunit.client.0.smithi082.stdout:6/845: write d2/f60 [7067202,84180] 0 2024-04-27T07:33:32.634 INFO:tasks.workunit.client.0.smithi082.stdout:1/795: write d4/d15/d49/dab/dc3/d3e/d57/d101/ffe [179342,26374] 0 2024-04-27T07:33:32.635 INFO:tasks.workunit.client.0.smithi082.stdout:9/756: fdatasync d9/da/dc/d35/d38/d65/f82 0 2024-04-27T07:33:32.636 INFO:tasks.workunit.client.1.smithi100.stdout:4/408: chown d5/d16/d2e/d5a/l67 5148 1 2024-04-27T07:33:32.636 INFO:tasks.workunit.client.1.smithi100.stdout:2/393: creat d0/da/f83 x:0 0 0 2024-04-27T07:33:32.636 INFO:tasks.workunit.client.0.smithi082.stdout:0/998: chown da/d3c/d3f/d57/dcc/fc0 31 1 2024-04-27T07:33:32.638 INFO:tasks.workunit.client.0.smithi082.stdout:6/846: mkdir d2/d1e/d117 0 2024-04-27T07:33:32.640 INFO:tasks.workunit.client.1.smithi100.stdout:0/369: fdatasync d1/d8/d20/f28 0 2024-04-27T07:33:32.641 INFO:tasks.workunit.client.1.smithi100.stdout:5/298: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:32.642 INFO:tasks.workunit.client.1.smithi100.stdout:1/517: truncate d0/d23/d3a/f41 2190690 0 2024-04-27T07:33:32.643 INFO:tasks.workunit.client.1.smithi100.stdout:4/409: rename d5/d16/d2e/l74 to d5/d16/d19/d46/d53/l89 0 2024-04-27T07:33:32.643 INFO:tasks.workunit.client.0.smithi082.stdout:6/847: rename d2/f74 to d2/d1e/d32/d85/d97/f118 0 2024-04-27T07:33:32.646 INFO:tasks.workunit.client.1.smithi100.stdout:2/394: mknod d0/c84 0 2024-04-27T07:33:32.646 INFO:tasks.workunit.client.0.smithi082.stdout:0/999: creat da/d3c/d3f/d4c/d95/de9/def/d81/de3/f172 x:0 0 0 2024-04-27T07:33:32.647 INFO:tasks.workunit.client.1.smithi100.stdout:2/395: write d0/da/d29/f3c [749735,25059] 0 2024-04-27T07:33:32.648 INFO:tasks.workunit.client.1.smithi100.stdout:5/299: creat d0/d4/d21/d24/d2f/f5c x:0 0 0 2024-04-27T07:33:32.649 INFO:tasks.workunit.client.1.smithi100.stdout:4/410: mkdir d5/d1b/d2c/d7d/d8a 0 2024-04-27T07:33:32.650 INFO:tasks.workunit.client.1.smithi100.stdout:5/300: write d0/d4/d21/d24/d2f/d57/d37/f3f [6029298,39173] 0 2024-04-27T07:33:32.651 INFO:tasks.workunit.client.1.smithi100.stdout:0/370: mkdir d1/d8/d14/d59/d64/d80 0 2024-04-27T07:33:32.652 INFO:tasks.workunit.client.1.smithi100.stdout:0/371: stat d1/d8/d20/f74 0 2024-04-27T07:33:32.653 INFO:tasks.workunit.client.1.smithi100.stdout:2/396: creat d0/da/d29/d6e/d3e/f85 x:0 0 0 2024-04-27T07:33:32.653 INFO:tasks.workunit.client.1.smithi100.stdout:0/372: chown d1/d8/d14 765060669 1 2024-04-27T07:33:32.656 INFO:tasks.workunit.client.1.smithi100.stdout:0/373: write d1/d8/d20/f2b [4367726,52256] 0 2024-04-27T07:33:32.657 INFO:tasks.workunit.client.0.smithi082.stdout:1/796: write d4/d15/d49/dab/dc3/d4c/f9d [263681,120506] 0 2024-04-27T07:33:32.657 INFO:tasks.workunit.client.1.smithi100.stdout:8/336: getdents d6/d1b/d1d/d59 0 2024-04-27T07:33:32.660 INFO:tasks.workunit.client.1.smithi100.stdout:3/438: getdents d7/d9/d26 0 2024-04-27T07:33:32.660 INFO:tasks.workunit.client.0.smithi082.stdout:1/797: unlink d4/d15/d49/d4e/fd6 0 2024-04-27T07:33:32.663 INFO:tasks.workunit.client.1.smithi100.stdout:5/301: creat d0/d4/d21/d24/d2f/d39/d56/f5d x:0 0 0 2024-04-27T07:33:32.664 INFO:tasks.workunit.client.1.smithi100.stdout:8/337: dwrite d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:32.666 INFO:tasks.workunit.client.1.smithi100.stdout:2/397: symlink d0/da/d29/d47/l86 0 2024-04-27T07:33:32.669 INFO:tasks.workunit.client.0.smithi082.stdout:6/848: truncate d2/d1e/d32/d85/d97/f118 6347451 0 2024-04-27T07:33:32.669 INFO:tasks.workunit.client.0.smithi082.stdout:1/798: chown d4/d15/d49/dab/dc3 181 1 2024-04-27T07:33:32.671 INFO:tasks.workunit.client.0.smithi082.stdout:9/757: dwrite d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:32.674 INFO:tasks.workunit.client.1.smithi100.stdout:3/439: creat d7/d9/d10/d22/d7e/f89 x:0 0 0 2024-04-27T07:33:32.679 INFO:tasks.workunit.client.0.smithi082.stdout:9/758: dwrite d9/d2d/f68 [0,4194304] 0 2024-04-27T07:33:32.679 INFO:tasks.workunit.client.1.smithi100.stdout:2/398: mkdir d0/da/d29/d47/d87 0 2024-04-27T07:33:32.680 INFO:tasks.workunit.client.1.smithi100.stdout:2/399: chown d0/d1e/d51 1 1 2024-04-27T07:33:32.681 INFO:tasks.workunit.client.1.smithi100.stdout:0/374: link d1/d8/fc d1/d8/d14/d59/f81 0 2024-04-27T07:33:32.682 INFO:tasks.workunit.client.1.smithi100.stdout:5/302: link d0/d4/c15 d0/d42/c5e 0 2024-04-27T07:33:32.684 INFO:tasks.workunit.client.1.smithi100.stdout:8/338: creat d6/d1b/d1d/f68 x:0 0 0 2024-04-27T07:33:32.688 INFO:tasks.workunit.client.0.smithi082.stdout:9/759: dwrite d9/da/dc/d35/d38/dc5/fd4 [0,4194304] 0 2024-04-27T07:33:32.690 INFO:tasks.workunit.client.1.smithi100.stdout:5/303: read - d0/d4/d21/d3d/f59 zero size 2024-04-27T07:33:32.694 INFO:tasks.workunit.client.1.smithi100.stdout:4/411: dwrite d5/d23/f25 [4194304,4194304] 0 2024-04-27T07:33:32.695 INFO:tasks.workunit.client.1.smithi100.stdout:5/304: fdatasync d0/d4/d21/f2e 0 2024-04-27T07:33:32.698 INFO:tasks.workunit.client.1.smithi100.stdout:0/375: dwrite d1/d8/d14/f50 [0,4194304] 0 2024-04-27T07:33:32.698 INFO:tasks.workunit.client.1.smithi100.stdout:2/400: mkdir d0/da/d29/d47/d87/d88 0 2024-04-27T07:33:32.700 INFO:tasks.workunit.client.1.smithi100.stdout:3/440: dread d7/d9/d26/d2a/f20 [0,4194304] 0 2024-04-27T07:33:32.705 INFO:tasks.workunit.client.1.smithi100.stdout:4/412: creat d5/d1b/d2c/d7d/f8b x:0 0 0 2024-04-27T07:33:32.707 INFO:tasks.workunit.client.1.smithi100.stdout:5/305: mknod d0/d4/d21/d24/d46/c5f 0 2024-04-27T07:33:32.708 INFO:tasks.workunit.client.1.smithi100.stdout:2/401: chown d0/da/d29/d6e/d5d/c73 0 1 2024-04-27T07:33:32.709 INFO:tasks.workunit.client.0.smithi082.stdout:6/849: symlink d2/d81/l119 0 2024-04-27T07:33:32.709 INFO:tasks.workunit.client.1.smithi100.stdout:2/402: truncate d0/da/f50 863553 0 2024-04-27T07:33:32.710 INFO:tasks.workunit.client.1.smithi100.stdout:2/403: stat d0/da/d29/d6e/d5d/f77 0 2024-04-27T07:33:32.710 INFO:tasks.workunit.client.0.smithi082.stdout:1/799: mkdir d4/d15/d49/dab/dc3/d3e/d53/d72/d114 0 2024-04-27T07:33:32.713 INFO:tasks.workunit.client.1.smithi100.stdout:4/413: mknod d5/d16/d19/d21/d6d/c8c 0 2024-04-27T07:33:32.714 INFO:tasks.workunit.client.0.smithi082.stdout:9/760: unlink d9/d2d/d2b/d46/db6/cf3 0 2024-04-27T07:33:32.715 INFO:tasks.workunit.client.1.smithi100.stdout:2/404: creat d0/da/d29/d47/d5a/d82/f89 x:0 0 0 2024-04-27T07:33:32.716 INFO:tasks.workunit.client.0.smithi082.stdout:1/800: truncate d4/d15/f18 3464193 0 2024-04-27T07:33:32.718 INFO:tasks.workunit.client.0.smithi082.stdout:6/850: creat d2/d1e/d32/d7d/d82/f11a x:0 0 0 2024-04-27T07:33:32.718 INFO:tasks.workunit.client.0.smithi082.stdout:1/801: readlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/l9c 0 2024-04-27T07:33:32.720 INFO:tasks.workunit.client.1.smithi100.stdout:3/441: dread d7/d9/fc [0,4194304] 0 2024-04-27T07:33:32.721 INFO:tasks.workunit.client.0.smithi082.stdout:6/851: chown d2/d2d/d4a/de4/dcc/d77/dca 2217 1 2024-04-27T07:33:32.721 INFO:tasks.workunit.client.0.smithi082.stdout:9/761: dwrite d9/da/dc/d35/d38/dc5/fd4 [0,4194304] 0 2024-04-27T07:33:32.724 INFO:tasks.workunit.client.0.smithi082.stdout:1/802: truncate d4/d15/d29/f33 1282072 0 2024-04-27T07:33:32.724 INFO:tasks.workunit.client.1.smithi100.stdout:2/405: dwrite d0/da/d29/d6e/d5d/f77 [0,4194304] 0 2024-04-27T07:33:32.725 INFO:tasks.workunit.client.1.smithi100.stdout:8/339: dread d6/d20/d46/f57 [0,4194304] 0 2024-04-27T07:33:32.731 INFO:tasks.workunit.client.0.smithi082.stdout:6/852: getdents d2/d2d 0 2024-04-27T07:33:32.731 INFO:tasks.workunit.client.1.smithi100.stdout:2/406: unlink d0/da/f83 0 2024-04-27T07:33:32.732 INFO:tasks.workunit.client.0.smithi082.stdout:1/803: dread d4/d15/d49/dab/dc3/d3e/d57/d101/fc9 [0,4194304] 0 2024-04-27T07:33:32.735 INFO:tasks.workunit.client.1.smithi100.stdout:8/340: dwrite d6/d20/f40 [0,4194304] 0 2024-04-27T07:33:32.737 INFO:tasks.workunit.client.1.smithi100.stdout:8/341: chown d6/d1b/d1d/c4a 41092 1 2024-04-27T07:33:32.740 INFO:tasks.workunit.client.1.smithi100.stdout:0/376: truncate d1/d30/f4e 801019 0 2024-04-27T07:33:32.741 INFO:tasks.workunit.client.1.smithi100.stdout:0/377: chown d1/d8/d14/d59/d64 27189 1 2024-04-27T07:33:32.743 INFO:tasks.workunit.client.0.smithi082.stdout:1/804: rmdir d4/d15/d49/dab/dc3/d4c/d7a/de7/dff 0 2024-04-27T07:33:32.746 INFO:tasks.workunit.client.1.smithi100.stdout:2/407: getdents d0/da/d3a 0 2024-04-27T07:33:32.751 INFO:tasks.workunit.client.0.smithi082.stdout:1/805: fdatasync d4/d15/d49/d99/d9a/da9/fbe 0 2024-04-27T07:33:32.751 INFO:tasks.workunit.client.1.smithi100.stdout:5/306: dwrite d0/f1d [0,4194304] 0 2024-04-27T07:33:32.751 INFO:tasks.workunit.client.1.smithi100.stdout:8/342: symlink d6/d1b/d1d/l69 0 2024-04-27T07:33:32.751 INFO:tasks.workunit.client.1.smithi100.stdout:0/378: fsync d1/d8/fc 0 2024-04-27T07:33:32.752 INFO:tasks.workunit.client.1.smithi100.stdout:2/408: mknod d0/da/d29/d6e/d5d/c8a 0 2024-04-27T07:33:32.753 INFO:tasks.workunit.client.1.smithi100.stdout:4/414: dread d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:32.753 INFO:tasks.workunit.client.1.smithi100.stdout:0/379: readlink d1/d8/d20/l18 0 2024-04-27T07:33:32.754 INFO:tasks.workunit.client.1.smithi100.stdout:8/343: symlink d6/d20/d2a/l6a 0 2024-04-27T07:33:32.756 INFO:tasks.workunit.client.1.smithi100.stdout:8/344: chown d6/la 29 1 2024-04-27T07:33:32.757 INFO:tasks.workunit.client.1.smithi100.stdout:5/307: dwrite d0/d4/d21/f4b [0,4194304] 0 2024-04-27T07:33:32.758 INFO:tasks.workunit.client.1.smithi100.stdout:8/345: chown d6/f7 94140 1 2024-04-27T07:33:32.761 INFO:tasks.workunit.client.1.smithi100.stdout:4/415: stat d5/d16/d4c/l78 0 2024-04-27T07:33:32.762 INFO:tasks.workunit.client.1.smithi100.stdout:8/346: write d6/d20/d2a/f44 [2149974,14826] 0 2024-04-27T07:33:32.763 INFO:tasks.workunit.client.0.smithi082.stdout:9/762: write d9/da/dc/d35/d38/da5/d66/f91 [1677424,15934] 0 2024-04-27T07:33:32.764 INFO:tasks.workunit.client.1.smithi100.stdout:5/308: truncate d0/d4/d21/d24/d2f/d57/f55 768574 0 2024-04-27T07:33:32.767 INFO:tasks.workunit.client.1.smithi100.stdout:8/347: write d6/d20/d2a/f44 [2429917,75356] 0 2024-04-27T07:33:32.768 INFO:tasks.workunit.client.0.smithi082.stdout:6/853: dwrite d2/d2d/d4a/de4/dcc/fb2 [0,4194304] 0 2024-04-27T07:33:32.770 INFO:tasks.workunit.client.1.smithi100.stdout:0/380: rename d1/d30/f4e to d1/f82 0 2024-04-27T07:33:32.771 INFO:tasks.workunit.client.1.smithi100.stdout:0/381: chown d1/d38/f47 2493942 1 2024-04-27T07:33:32.774 INFO:tasks.workunit.client.1.smithi100.stdout:5/309: mkdir d0/d58/d60 0 2024-04-27T07:33:32.777 INFO:tasks.workunit.client.1.smithi100.stdout:8/348: rename d6/c13 to d6/d1b/d1d/d59/c6b 0 2024-04-27T07:33:32.779 INFO:tasks.workunit.client.0.smithi082.stdout:6/854: truncate d2/d1e/d32/d85/f94 2771349 0 2024-04-27T07:33:32.780 INFO:tasks.workunit.client.0.smithi082.stdout:6/855: mknod d2/d2d/d4a/de4/dcc/d77/dca/c11b 0 2024-04-27T07:33:32.782 INFO:tasks.workunit.client.1.smithi100.stdout:2/409: truncate d0/da/d29/d47/f5e 1173859 0 2024-04-27T07:33:32.784 INFO:tasks.workunit.client.1.smithi100.stdout:4/416: getdents d5/d23 0 2024-04-27T07:33:32.787 INFO:tasks.workunit.client.0.smithi082.stdout:6/856: truncate d2/d75/f7e 3349696 0 2024-04-27T07:33:32.788 INFO:tasks.workunit.client.1.smithi100.stdout:0/382: creat d1/d8/f83 x:0 0 0 2024-04-27T07:33:32.788 INFO:tasks.workunit.client.0.smithi082.stdout:6/857: mknod d2/d1e/d32/d85/d10c/c11c 0 2024-04-27T07:33:32.789 INFO:tasks.workunit.client.1.smithi100.stdout:0/383: read - d1/d8/d20/f74 zero size 2024-04-27T07:33:32.790 INFO:tasks.workunit.client.1.smithi100.stdout:4/417: chown d5/d16/c27 13073360 1 2024-04-27T07:33:32.790 INFO:tasks.workunit.client.0.smithi082.stdout:6/858: creat d2/d2d/f11d x:0 0 0 2024-04-27T07:33:32.791 INFO:tasks.workunit.client.1.smithi100.stdout:0/384: write d1/d8/d20/f42 [3398205,45269] 0 2024-04-27T07:33:32.791 INFO:tasks.workunit.client.1.smithi100.stdout:8/349: rmdir d6/d1b/d1d 39 2024-04-27T07:33:32.792 INFO:tasks.workunit.client.1.smithi100.stdout:0/385: chown d1/d8/f83 57567 1 2024-04-27T07:33:32.792 INFO:tasks.workunit.client.1.smithi100.stdout:4/418: read d5/f15 [3461281,81575] 0 2024-04-27T07:33:32.793 INFO:tasks.workunit.client.1.smithi100.stdout:4/419: chown d5/d16/c27 1 1 2024-04-27T07:33:32.796 INFO:tasks.workunit.client.1.smithi100.stdout:8/350: dread d6/d20/d50/f52 [0,4194304] 0 2024-04-27T07:33:32.797 INFO:tasks.workunit.client.0.smithi082.stdout:6/859: readlink d2/d2d/d4a/l10b 0 2024-04-27T07:33:32.798 INFO:tasks.workunit.client.1.smithi100.stdout:8/351: fdatasync d6/d20/d2a/f3a 0 2024-04-27T07:33:32.799 INFO:tasks.workunit.client.1.smithi100.stdout:0/386: readlink d1/l12 0 2024-04-27T07:33:32.799 INFO:tasks.workunit.client.1.smithi100.stdout:8/352: readlink d6/d20/l3e 0 2024-04-27T07:33:32.800 INFO:tasks.workunit.client.0.smithi082.stdout:6/860: rmdir d2/d1e/d117 0 2024-04-27T07:33:32.802 INFO:tasks.workunit.client.1.smithi100.stdout:5/310: dread d0/d4/d21/f26 [0,4194304] 0 2024-04-27T07:33:32.802 INFO:tasks.workunit.client.0.smithi082.stdout:6/861: symlink d2/d1e/d32/d85/d97/de2/l11e 0 2024-04-27T07:33:32.802 INFO:tasks.workunit.client.0.smithi082.stdout:5/923: sync 2024-04-27T07:33:32.805 INFO:tasks.workunit.client.0.smithi082.stdout:5/924: creat d8/d29/dea/d5f/df6/dfd/d102/f133 x:0 0 0 2024-04-27T07:33:32.806 INFO:tasks.workunit.client.1.smithi100.stdout:4/420: dwrite d5/d1b/d2c/d3f/f63 [0,4194304] 0 2024-04-27T07:33:32.807 INFO:tasks.workunit.client.0.smithi082.stdout:5/925: rmdir d8/d2e/d85/d10b 0 2024-04-27T07:33:32.808 INFO:tasks.workunit.client.1.smithi100.stdout:5/311: write d0/d4/d21/d24/d2f/d57/d37/d1a/f20 [6005333,95677] 0 2024-04-27T07:33:32.809 INFO:tasks.workunit.client.1.smithi100.stdout:0/387: truncate d1/d30/f3d 507793 0 2024-04-27T07:33:32.811 INFO:tasks.workunit.client.0.smithi082.stdout:5/926: getdents d8/d77/de8/d128/dc7 0 2024-04-27T07:33:32.812 INFO:tasks.workunit.client.1.smithi100.stdout:2/410: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-27T07:33:32.813 INFO:tasks.workunit.client.0.smithi082.stdout:5/927: creat d8/d2e/d85/d103/f134 x:0 0 0 2024-04-27T07:33:32.815 INFO:tasks.workunit.client.1.smithi100.stdout:2/411: write d0/f24 [3434507,62824] 0 2024-04-27T07:33:32.815 INFO:tasks.workunit.client.1.smithi100.stdout:5/312: creat d0/d58/d60/f61 x:0 0 0 2024-04-27T07:33:32.815 INFO:tasks.workunit.client.0.smithi082.stdout:5/928: chown d8/d77/de8/d128/dc7/f12f 51471 1 2024-04-27T07:33:32.815 INFO:tasks.workunit.client.1.smithi100.stdout:4/421: link d5/f88 d5/d1b/d2c/f8d 0 2024-04-27T07:33:32.816 INFO:tasks.workunit.client.1.smithi100.stdout:8/353: dwrite d6/d20/d46/f57 [0,4194304] 0 2024-04-27T07:33:32.817 INFO:tasks.workunit.client.1.smithi100.stdout:0/388: symlink d1/d8/d20/d61/l84 0 2024-04-27T07:33:32.817 INFO:tasks.workunit.client.1.smithi100.stdout:5/313: chown d0/f1d 97323 1 2024-04-27T07:33:32.823 INFO:tasks.workunit.client.0.smithi082.stdout:6/862: dread d2/d2d/d4a/de4/dcc/f17 [0,4194304] 0 2024-04-27T07:33:32.824 INFO:tasks.workunit.client.1.smithi100.stdout:0/389: creat d1/d8/d20/d1e/f85 x:0 0 0 2024-04-27T07:33:32.824 INFO:tasks.workunit.client.0.smithi082.stdout:6/863: stat d2/d2d/d4a/f52 0 2024-04-27T07:33:32.824 INFO:tasks.workunit.client.1.smithi100.stdout:4/422: creat d5/d16/d19/d46/d53/f8e x:0 0 0 2024-04-27T07:33:32.825 INFO:tasks.workunit.client.0.smithi082.stdout:6/864: chown d2/d1e/d80/df5 91979916 1 2024-04-27T07:33:32.826 INFO:tasks.workunit.client.1.smithi100.stdout:8/354: symlink d6/d20/d50/l6c 0 2024-04-27T07:33:32.827 INFO:tasks.workunit.client.1.smithi100.stdout:2/412: dread d0/da/f6b [0,4194304] 0 2024-04-27T07:33:32.830 INFO:tasks.workunit.client.1.smithi100.stdout:4/423: symlink d5/d23/l8f 0 2024-04-27T07:33:32.831 INFO:tasks.workunit.client.0.smithi082.stdout:5/929: dwrite d8/d29/dea/d5f/df6/dfd/d102/d10e/fed [0,4194304] 0 2024-04-27T07:33:32.832 INFO:tasks.workunit.client.0.smithi082.stdout:6/865: link d2/d1e/d32/d85/d97/fc8 d2/d1e/f11f 0 2024-04-27T07:33:32.833 INFO:tasks.workunit.client.0.smithi082.stdout:6/866: chown d2/d45/f6b 723954 1 2024-04-27T07:33:32.836 INFO:tasks.workunit.client.0.smithi082.stdout:6/867: symlink d2/d2e/dae/l120 0 2024-04-27T07:33:32.837 INFO:tasks.workunit.client.0.smithi082.stdout:5/930: creat d8/d29/d4e/f135 x:0 0 0 2024-04-27T07:33:32.838 INFO:tasks.workunit.client.0.smithi082.stdout:5/931: readlink d8/d15/d22/l31 0 2024-04-27T07:33:32.839 INFO:tasks.workunit.client.1.smithi100.stdout:2/413: rename d0/da/d29/d47/d70 to d0/da/d29/d47/d87/d8b 0 2024-04-27T07:33:32.840 INFO:tasks.workunit.client.1.smithi100.stdout:8/355: link d6/d20/d2a/c5a d6/d20/d46/c6d 0 2024-04-27T07:33:32.842 INFO:tasks.workunit.client.1.smithi100.stdout:5/314: dwrite d0/d4/d21/f50 [0,4194304] 0 2024-04-27T07:33:32.842 INFO:tasks.workunit.client.0.smithi082.stdout:5/932: link d8/d29/d4e/d90/l125 d8/d15/d22/l136 0 2024-04-27T07:33:32.843 INFO:tasks.workunit.client.0.smithi082.stdout:6/868: link d2/d1e/d32/l6e d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/d112/l121 0 2024-04-27T07:33:32.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:32 smithi082 ceph-mon[26613]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 253 MiB/s wr, 531 op/s 2024-04-27T07:33:32.843 INFO:tasks.workunit.client.1.smithi100.stdout:2/414: rmdir d0/da/d39 39 2024-04-27T07:33:32.845 INFO:tasks.workunit.client.1.smithi100.stdout:0/390: write d1/d30/f52 [3421096,22248] 0 2024-04-27T07:33:32.846 INFO:tasks.workunit.client.1.smithi100.stdout:8/356: rmdir d6/d20/d50 39 2024-04-27T07:33:32.847 INFO:tasks.workunit.client.1.smithi100.stdout:4/424: dwrite d5/d1b/d2c/f64 [0,4194304] 0 2024-04-27T07:33:32.847 INFO:tasks.workunit.client.1.smithi100.stdout:5/315: truncate d0/d4/fc 4385794 0 2024-04-27T07:33:32.847 INFO:tasks.workunit.client.1.smithi100.stdout:2/415: chown d0/da/d29/c2f 56607 1 2024-04-27T07:33:32.849 INFO:tasks.workunit.client.0.smithi082.stdout:5/933: dwrite d8/d3c/d47/f27 [8388608,4194304] 0 2024-04-27T07:33:32.850 INFO:tasks.workunit.client.1.smithi100.stdout:5/316: write d0/d4/f7 [2136822,112851] 0 2024-04-27T07:33:32.850 INFO:tasks.workunit.client.1.smithi100.stdout:0/391: creat d1/d8/d20/d1e/f86 x:0 0 0 2024-04-27T07:33:32.851 INFO:tasks.workunit.client.1.smithi100.stdout:5/317: fdatasync d0/f10 0 2024-04-27T07:33:32.852 INFO:tasks.workunit.client.1.smithi100.stdout:2/416: dread d0/d1e/f7c [0,4194304] 0 2024-04-27T07:33:32.853 INFO:tasks.workunit.client.0.smithi082.stdout:5/934: rmdir d8/d77/de8/d128 39 2024-04-27T07:33:32.854 INFO:tasks.workunit.client.1.smithi100.stdout:5/318: write d0/d4/d21/f50 [835626,8502] 0 2024-04-27T07:33:32.854 INFO:tasks.workunit.client.1.smithi100.stdout:8/357: fdatasync d6/d20/d2a/f3c 0 2024-04-27T07:33:32.859 INFO:tasks.workunit.client.1.smithi100.stdout:5/319: dread d0/d4/d21/f50 [0,4194304] 0 2024-04-27T07:33:32.859 INFO:tasks.workunit.client.1.smithi100.stdout:4/425: unlink d5/d16/d19/d21/d6d/c76 0 2024-04-27T07:33:32.860 INFO:tasks.workunit.client.1.smithi100.stdout:0/392: creat d1/d8/d14/d59/f87 x:0 0 0 2024-04-27T07:33:32.864 INFO:tasks.workunit.client.1.smithi100.stdout:8/358: unlink d6/d1b/l1f 0 2024-04-27T07:33:32.864 INFO:tasks.workunit.client.1.smithi100.stdout:5/320: mknod d0/d4/d21/d24/d2f/c62 0 2024-04-27T07:33:32.869 INFO:tasks.workunit.client.1.smithi100.stdout:4/426: creat d5/d16/d19/d21/d87/f90 x:0 0 0 2024-04-27T07:33:32.870 INFO:tasks.workunit.client.1.smithi100.stdout:8/359: dread d6/d20/d50/f52 [0,4194304] 0 2024-04-27T07:33:32.872 INFO:tasks.workunit.client.1.smithi100.stdout:4/427: write d5/d16/d4c/f7f [1458314,88461] 0 2024-04-27T07:33:32.873 INFO:tasks.workunit.client.0.smithi082.stdout:5/935: write d8/d77/de8/d128/f9b [481240,35441] 0 2024-04-27T07:33:32.874 INFO:tasks.workunit.client.1.smithi100.stdout:5/321: dwrite d0/d4/d21/d3d/f59 [0,4194304] 0 2024-04-27T07:33:32.875 INFO:tasks.workunit.client.0.smithi082.stdout:5/936: readlink d8/d15/d22/l136 0 2024-04-27T07:33:32.880 INFO:tasks.workunit.client.1.smithi100.stdout:4/428: symlink d5/d16/l91 0 2024-04-27T07:33:32.883 INFO:tasks.workunit.client.1.smithi100.stdout:5/322: rename d0/d4/d21/d24/d2f/d57/d37/d1a/f20 to d0/d4/d21/d24/d2f/d39/d56/f63 0 2024-04-27T07:33:32.883 INFO:tasks.workunit.client.1.smithi100.stdout:2/417: truncate d0/d1e/f31 2736719 0 2024-04-27T07:33:32.884 INFO:tasks.workunit.client.1.smithi100.stdout:2/418: fsync d0/da/d29/f13 0 2024-04-27T07:33:32.885 INFO:tasks.workunit.client.1.smithi100.stdout:4/429: creat d5/d16/d19/d46/d53/f92 x:0 0 0 2024-04-27T07:33:32.887 INFO:tasks.workunit.client.1.smithi100.stdout:6/379: sync 2024-04-27T07:33:32.887 INFO:tasks.workunit.client.1.smithi100.stdout:5/323: dread d0/d4/f11 [0,4194304] 0 2024-04-27T07:33:32.888 INFO:tasks.workunit.client.1.smithi100.stdout:8/360: write d6/f31 [3439558,83476] 0 2024-04-27T07:33:32.889 INFO:tasks.workunit.client.1.smithi100.stdout:2/419: chown d0/c38 43 1 2024-04-27T07:33:32.889 INFO:tasks.workunit.client.1.smithi100.stdout:9/338: sync 2024-04-27T07:33:32.889 INFO:tasks.workunit.client.1.smithi100.stdout:7/317: sync 2024-04-27T07:33:32.889 INFO:tasks.workunit.client.1.smithi100.stdout:5/324: chown d0/f10 824133 1 2024-04-27T07:33:32.892 INFO:tasks.workunit.client.1.smithi100.stdout:4/430: creat d5/d16/f93 x:0 0 0 2024-04-27T07:33:32.893 INFO:tasks.workunit.client.1.smithi100.stdout:2/420: dread - d0/da/d29/d47/d5a/d82/f89 zero size 2024-04-27T07:33:32.893 INFO:tasks.workunit.client.1.smithi100.stdout:5/325: dread - d0/d4/d21/d24/d2f/d57/f53 zero size 2024-04-27T07:33:32.895 INFO:tasks.workunit.client.1.smithi100.stdout:0/393: dread d1/d8/d20/d61/f63 [0,4194304] 0 2024-04-27T07:33:32.897 INFO:tasks.workunit.client.1.smithi100.stdout:7/318: creat d1/dd/d2a/f62 x:0 0 0 2024-04-27T07:33:32.898 INFO:tasks.workunit.client.1.smithi100.stdout:5/326: write d0/f1d [3605224,22092] 0 2024-04-27T07:33:32.900 INFO:tasks.workunit.client.1.smithi100.stdout:0/394: chown d1/d38/c49 5 1 2024-04-27T07:33:32.901 INFO:tasks.workunit.client.1.smithi100.stdout:9/339: truncate d1/d9/d1f/f3c 1805211 0 2024-04-27T07:33:32.901 INFO:tasks.workunit.client.1.smithi100.stdout:5/327: fdatasync d0/d4/d21/d24/d2f/f5c 0 2024-04-27T07:33:32.902 INFO:tasks.workunit.client.0.smithi082.stdout:5/937: dread d8/d42/f54 [0,4194304] 0 2024-04-27T07:33:32.902 INFO:tasks.workunit.client.1.smithi100.stdout:4/431: rename d5/d1b/d2c/d7d/d84/d86 to d5/d16/d19/d21/d77/d94 0 2024-04-27T07:33:32.904 INFO:tasks.workunit.client.0.smithi082.stdout:5/938: dread - d8/d29/d4e/d90/f101 zero size 2024-04-27T07:33:32.904 INFO:tasks.workunit.client.1.smithi100.stdout:0/395: readlink d1/d8/d20/d1e/l34 0 2024-04-27T07:33:32.904 INFO:tasks.workunit.client.1.smithi100.stdout:7/319: unlink d1/f1a 0 2024-04-27T07:33:32.905 INFO:tasks.workunit.client.1.smithi100.stdout:6/380: dwrite de/f69 [0,4194304] 0 2024-04-27T07:33:32.905 INFO:tasks.workunit.client.0.smithi082.stdout:5/939: rmdir d8/d2e/d85/daa 39 2024-04-27T07:33:32.906 INFO:tasks.workunit.client.0.smithi082.stdout:5/940: readlink d8/d2e/d85/lef 0 2024-04-27T07:33:32.906 INFO:tasks.workunit.client.1.smithi100.stdout:7/320: fsync d1/dd/f1e 0 2024-04-27T07:33:32.910 INFO:tasks.workunit.client.1.smithi100.stdout:2/421: dread d0/f12 [0,4194304] 0 2024-04-27T07:33:32.910 INFO:tasks.workunit.client.1.smithi100.stdout:9/340: creat d1/d9/db/d2b/f7f x:0 0 0 2024-04-27T07:33:32.914 INFO:tasks.workunit.client.1.smithi100.stdout:4/432: mkdir d5/d16/d19/d21/d87/d95 0 2024-04-27T07:33:32.914 INFO:tasks.workunit.client.1.smithi100.stdout:2/422: write d0/d1e/d51/f65 [981893,26278] 0 2024-04-27T07:33:32.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:32 smithi100 ceph-mon[34183]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 81 MiB/s rd, 253 MiB/s wr, 531 op/s 2024-04-27T07:33:32.918 INFO:tasks.workunit.client.1.smithi100.stdout:2/423: chown d0/da/d75 4 1 2024-04-27T07:33:32.921 INFO:tasks.workunit.client.1.smithi100.stdout:9/341: dread - d1/d9/d1f/d52/d54/f5f zero size 2024-04-27T07:33:32.922 INFO:tasks.workunit.client.1.smithi100.stdout:8/361: dread d6/d20/d2a/f44 [0,4194304] 0 2024-04-27T07:33:32.923 INFO:tasks.workunit.client.1.smithi100.stdout:6/381: link de/c74 de/d2e/d3f/c88 0 2024-04-27T07:33:32.924 INFO:tasks.workunit.client.0.smithi082.stdout:5/941: dread d8/d3c/d47/f5d [0,4194304] 0 2024-04-27T07:33:32.924 INFO:tasks.workunit.client.1.smithi100.stdout:7/321: dwrite d1/dd/f47 [0,4194304] 0 2024-04-27T07:33:32.925 INFO:tasks.workunit.client.1.smithi100.stdout:9/342: chown d1/d9/f6f 857 1 2024-04-27T07:33:32.926 INFO:tasks.workunit.client.1.smithi100.stdout:2/424: truncate d0/da/d3a/f48 1091733 0 2024-04-27T07:33:32.926 INFO:tasks.workunit.client.0.smithi082.stdout:5/942: fsync d8/d14/f4d 0 2024-04-27T07:33:32.926 INFO:tasks.workunit.client.0.smithi082.stdout:5/943: chown d8/d29/d4e/c99 2827502 1 2024-04-27T07:33:32.927 INFO:tasks.workunit.client.0.smithi082.stdout:5/944: stat d8/d42/d123/f124 0 2024-04-27T07:33:32.928 INFO:tasks.workunit.client.1.smithi100.stdout:6/382: read - de/d58/d21/d23/f3e zero size 2024-04-27T07:33:32.928 INFO:tasks.workunit.client.1.smithi100.stdout:0/396: dwrite d1/d8/d20/f37 [0,4194304] 0 2024-04-27T07:33:32.929 INFO:tasks.workunit.client.0.smithi082.stdout:5/945: mknod d8/d29/dea/c137 0 2024-04-27T07:33:32.929 INFO:tasks.workunit.client.1.smithi100.stdout:5/328: dwrite d0/d4/fc [0,4194304] 0 2024-04-27T07:33:32.929 INFO:tasks.workunit.client.1.smithi100.stdout:4/433: rmdir d5/d1b/d2c/d7d/d84 0 2024-04-27T07:33:32.930 INFO:tasks.workunit.client.1.smithi100.stdout:9/343: dread - d1/d9/d1f/f7a zero size 2024-04-27T07:33:32.931 INFO:tasks.workunit.client.1.smithi100.stdout:2/425: mknod d0/da/d75/c8c 0 2024-04-27T07:33:32.932 INFO:tasks.workunit.client.0.smithi082.stdout:5/946: creat d8/d29/d4e/d90/f138 x:0 0 0 2024-04-27T07:33:32.932 INFO:tasks.workunit.client.1.smithi100.stdout:4/434: dread - d5/d16/d4c/f5d zero size 2024-04-27T07:33:32.934 INFO:tasks.workunit.client.1.smithi100.stdout:7/322: mknod d1/dd/d2a/c63 0 2024-04-27T07:33:32.934 INFO:tasks.workunit.client.1.smithi100.stdout:9/344: chown d1/d9/db/d2b/f7f 3285 1 2024-04-27T07:33:32.934 INFO:tasks.workunit.client.1.smithi100.stdout:6/383: truncate de/d58/d21/d23/f5e 1022359 0 2024-04-27T07:33:32.935 INFO:tasks.workunit.client.1.smithi100.stdout:4/435: chown d5/d1b/d2c/d7d 31573 1 2024-04-27T07:33:32.935 INFO:tasks.workunit.client.0.smithi082.stdout:5/947: unlink d8/d15/f58 0 2024-04-27T07:33:32.936 INFO:tasks.workunit.client.1.smithi100.stdout:5/329: rmdir d0/d4/d21/d24/d2f/d57/d37/d48 39 2024-04-27T07:33:32.937 INFO:tasks.workunit.client.0.smithi082.stdout:5/948: write d8/d3c/d47/f27 [6418423,31113] 0 2024-04-27T07:33:32.937 INFO:tasks.workunit.client.1.smithi100.stdout:6/384: write de/d58/d28/f2d [1634079,83661] 0 2024-04-27T07:33:32.937 INFO:tasks.workunit.client.1.smithi100.stdout:0/397: mkdir d1/d8/d20/d88 0 2024-04-27T07:33:32.938 INFO:tasks.workunit.client.1.smithi100.stdout:8/362: link d6/d1b/d1d/c4d d6/d4c/c6e 0 2024-04-27T07:33:32.941 INFO:tasks.workunit.client.1.smithi100.stdout:7/323: chown d1/dd/d16/d31/d4c/d4d/c39 401785104 1 2024-04-27T07:33:32.942 INFO:tasks.workunit.client.0.smithi082.stdout:5/949: creat d8/d2e/d107/f139 x:0 0 0 2024-04-27T07:33:32.942 INFO:tasks.workunit.client.0.smithi082.stdout:5/950: chown d8/d42 2 1 2024-04-27T07:33:32.944 INFO:tasks.workunit.client.0.smithi082.stdout:5/951: chown d8/d29/dea/d5f/df6/dfd/l10d 29385866 1 2024-04-27T07:33:32.945 INFO:tasks.workunit.client.0.smithi082.stdout:5/952: dread - d8/d29/d4e/d90/f138 zero size 2024-04-27T07:33:32.946 INFO:tasks.workunit.client.1.smithi100.stdout:9/345: mknod d1/d9/d1f/d4a/d67/c80 0 2024-04-27T07:33:32.947 INFO:tasks.workunit.client.0.smithi082.stdout:5/953: creat d8/d15/dca/f13a x:0 0 0 2024-04-27T07:33:32.949 INFO:tasks.workunit.client.1.smithi100.stdout:8/363: dwrite d6/f27 [0,4194304] 0 2024-04-27T07:33:32.950 INFO:tasks.workunit.client.1.smithi100.stdout:8/364: readlink d6/d1b/l4e 0 2024-04-27T07:33:32.950 INFO:tasks.workunit.client.1.smithi100.stdout:7/324: dread d1/dd/d2a/d2c/f2e [0,4194304] 0 2024-04-27T07:33:32.951 INFO:tasks.workunit.client.1.smithi100.stdout:5/330: creat d0/d4/d21/d24/d2f/d39/d56/f64 x:0 0 0 2024-04-27T07:33:32.951 INFO:tasks.workunit.client.1.smithi100.stdout:2/426: dread d0/da/d29/f80 [0,4194304] 0 2024-04-27T07:33:32.956 INFO:tasks.workunit.client.1.smithi100.stdout:6/385: mkdir de/d58/d75/d89 0 2024-04-27T07:33:32.956 INFO:tasks.workunit.client.1.smithi100.stdout:6/386: readlink de/d2e/l45 0 2024-04-27T07:33:32.956 INFO:tasks.workunit.client.1.smithi100.stdout:0/398: mkdir d1/d8/d14/d59/d64/d80/d89 0 2024-04-27T07:33:32.957 INFO:tasks.workunit.client.1.smithi100.stdout:8/365: dread d6/f35 [0,4194304] 0 2024-04-27T07:33:32.959 INFO:tasks.workunit.client.1.smithi100.stdout:5/331: chown d0/d42/c5e 829338696 1 2024-04-27T07:33:32.960 INFO:tasks.workunit.client.1.smithi100.stdout:4/436: rmdir d5/d16/d19/d21/d87/d95 0 2024-04-27T07:33:32.965 INFO:tasks.workunit.client.1.smithi100.stdout:7/325: mknod d1/dd/d16/d4a/d56/c64 0 2024-04-27T07:33:32.966 INFO:tasks.workunit.client.1.smithi100.stdout:2/427: rename d0/da/d29/d6e to d0/da/d29/d47/d5a/d8d 0 2024-04-27T07:33:32.971 INFO:tasks.workunit.client.1.smithi100.stdout:5/332: symlink d0/d4/l65 0 2024-04-27T07:33:32.971 INFO:tasks.workunit.client.1.smithi100.stdout:8/366: dwrite d6/d20/d54/f5b [0,4194304] 0 2024-04-27T07:33:32.974 INFO:tasks.workunit.client.0.smithi082.stdout:5/954: dread d8/d29/dea/d5f/f84 [0,4194304] 0 2024-04-27T07:33:32.975 INFO:tasks.workunit.client.0.smithi082.stdout:5/955: dread - d8/d2e/d85/fd6 zero size 2024-04-27T07:33:32.976 INFO:tasks.workunit.client.0.smithi082.stdout:5/956: fdatasync d8/d2e/f86 0 2024-04-27T07:33:32.977 INFO:tasks.workunit.client.0.smithi082.stdout:5/957: write d8/d15/d22/fe4 [365667,37092] 0 2024-04-27T07:33:32.978 INFO:tasks.workunit.client.1.smithi100.stdout:2/428: dwrite d0/da/d29/d47/d5a/d8d/d5d/f77 [0,4194304] 0 2024-04-27T07:33:32.979 INFO:tasks.workunit.client.0.smithi082.stdout:5/958: mkdir d8/d3c/d64/d13b 0 2024-04-27T07:33:32.980 INFO:tasks.workunit.client.1.smithi100.stdout:9/346: dwrite d1/d9/db/d2b/f36 [0,4194304] 0 2024-04-27T07:33:32.981 INFO:tasks.workunit.client.0.smithi082.stdout:5/959: mkdir d8/d42/d123/d13c 0 2024-04-27T07:33:32.982 INFO:tasks.workunit.client.0.smithi082.stdout:5/960: chown f4 0 1 2024-04-27T07:33:32.983 INFO:tasks.workunit.client.1.smithi100.stdout:4/437: mkdir d5/d1b/d2c/d3f/d96 0 2024-04-27T07:33:32.984 INFO:tasks.workunit.client.1.smithi100.stdout:2/429: dread d0/da/d3a/f48 [0,4194304] 0 2024-04-27T07:33:32.985 INFO:tasks.workunit.client.1.smithi100.stdout:4/438: chown d5/d16/d2e/l35 5081370 1 2024-04-27T07:33:32.986 INFO:tasks.workunit.client.1.smithi100.stdout:0/399: unlink d1/d8/c5f 0 2024-04-27T07:33:32.986 INFO:tasks.workunit.client.1.smithi100.stdout:7/326: rmdir d1/dd/d2a/d2c 39 2024-04-27T07:33:32.989 INFO:tasks.workunit.client.1.smithi100.stdout:9/347: creat d1/d9/d1f/d52/f81 x:0 0 0 2024-04-27T07:33:32.990 INFO:tasks.workunit.client.1.smithi100.stdout:2/430: truncate d0/d1e/f31 1804758 0 2024-04-27T07:33:32.992 INFO:tasks.workunit.client.1.smithi100.stdout:8/367: symlink d6/l6f 0 2024-04-27T07:33:32.995 INFO:tasks.workunit.client.1.smithi100.stdout:7/327: creat d1/d2f/d51/f65 x:0 0 0 2024-04-27T07:33:32.997 INFO:tasks.workunit.client.1.smithi100.stdout:9/348: symlink d1/d76/l82 0 2024-04-27T07:33:32.997 INFO:tasks.workunit.client.1.smithi100.stdout:7/328: chown d1/ca 418 1 2024-04-27T07:33:32.997 INFO:tasks.workunit.client.1.smithi100.stdout:8/368: dread d6/d20/d2a/f44 [0,4194304] 0 2024-04-27T07:33:32.997 INFO:tasks.workunit.client.0.smithi082.stdout:5/961: rename d8/d29/dea/da3/ld3 to d8/d29/dea/d5f/df6/dfd/d102/d10e/l13d 0 2024-04-27T07:33:32.998 INFO:tasks.workunit.client.1.smithi100.stdout:4/439: rename d5/d23/d33/c37 to d5/c97 0 2024-04-27T07:33:32.998 INFO:tasks.workunit.client.0.smithi082.stdout:5/962: chown d8/d15/dca 3309 1 2024-04-27T07:33:32.998 INFO:tasks.workunit.client.1.smithi100.stdout:9/349: write d1/d9/f75 [975770,110226] 0 2024-04-27T07:33:33.001 INFO:tasks.workunit.client.1.smithi100.stdout:2/431: creat d0/da/d29/f8e x:0 0 0 2024-04-27T07:33:33.002 INFO:tasks.workunit.client.1.smithi100.stdout:6/387: dread de/d58/d21/d5b/f6f [0,4194304] 0 2024-04-27T07:33:33.004 INFO:tasks.workunit.client.1.smithi100.stdout:4/440: creat d5/d16/d19/d46/d53/f98 x:0 0 0 2024-04-27T07:33:33.004 INFO:tasks.workunit.client.1.smithi100.stdout:5/333: dread d0/d4/d21/d24/d2f/d57/d37/d1a/f4d [0,4194304] 0 2024-04-27T07:33:33.005 INFO:tasks.workunit.client.0.smithi082.stdout:5/963: write d8/d42/f104 [336924,44552] 0 2024-04-27T07:33:33.005 INFO:tasks.workunit.client.1.smithi100.stdout:9/350: unlink d1/d9/d1f/f27 0 2024-04-27T07:33:33.007 INFO:tasks.workunit.client.1.smithi100.stdout:7/329: creat d1/dd/d16/f66 x:0 0 0 2024-04-27T07:33:33.007 INFO:tasks.workunit.client.0.smithi082.stdout:5/964: fdatasync d8/d29/d4e/f52 0 2024-04-27T07:33:33.008 INFO:tasks.workunit.client.0.smithi082.stdout:5/965: write d8/d15/fdb [3604638,119874] 0 2024-04-27T07:33:33.009 INFO:tasks.workunit.client.1.smithi100.stdout:8/369: rename d6/d1b/l4e to d6/d20/l70 0 2024-04-27T07:33:33.010 INFO:tasks.workunit.client.0.smithi082.stdout:5/966: creat d8/d29/dea/da3/f13e x:0 0 0 2024-04-27T07:33:33.010 INFO:tasks.workunit.client.1.smithi100.stdout:6/388: mknod de/d58/d21/d23/c8a 0 2024-04-27T07:33:33.010 INFO:tasks.workunit.client.1.smithi100.stdout:6/389: chown de/f12 2 1 2024-04-27T07:33:33.011 INFO:tasks.workunit.client.1.smithi100.stdout:4/441: mknod d5/d16/d19/d21/d77/c99 0 2024-04-27T07:33:33.011 INFO:tasks.workunit.client.0.smithi082.stdout:5/967: creat d8/d29/dea/f13f x:0 0 0 2024-04-27T07:33:33.012 INFO:tasks.workunit.client.1.smithi100.stdout:4/442: dread - d5/d16/f7b zero size 2024-04-27T07:33:33.012 INFO:tasks.workunit.client.1.smithi100.stdout:6/390: write de/d58/d21/d24/f2b [8981830,39672] 0 2024-04-27T07:33:33.012 INFO:tasks.workunit.client.1.smithi100.stdout:5/334: creat d0/d4/d21/d24/d46/f66 x:0 0 0 2024-04-27T07:33:33.014 INFO:tasks.workunit.client.1.smithi100.stdout:9/351: dread - d1/f26 zero size 2024-04-27T07:33:33.014 INFO:tasks.workunit.client.0.smithi082.stdout:5/968: read d8/d15/f24 [1300563,10599] 0 2024-04-27T07:33:33.015 INFO:tasks.workunit.client.0.smithi082.stdout:5/969: fsync d8/d3c/d64/db8/f129 0 2024-04-27T07:33:33.015 INFO:tasks.workunit.client.1.smithi100.stdout:7/330: unlink d1/dd/d16/d3e/f41 0 2024-04-27T07:33:33.016 INFO:tasks.workunit.client.0.smithi082.stdout:5/970: write d8/d29/d4e/f135 [80804,104197] 0 2024-04-27T07:33:33.019 INFO:tasks.workunit.client.1.smithi100.stdout:9/352: creat d1/d9/db/d56/f83 x:0 0 0 2024-04-27T07:33:33.020 INFO:tasks.workunit.client.1.smithi100.stdout:5/335: mkdir d0/d4/d21/d24/d2f/d39/d56/d67 0 2024-04-27T07:33:33.022 INFO:tasks.workunit.client.1.smithi100.stdout:4/443: dwrite d5/d16/f93 [0,4194304] 0 2024-04-27T07:33:33.026 INFO:tasks.workunit.client.1.smithi100.stdout:7/331: truncate d1/dd/d2a/d2c/f43 932609 0 2024-04-27T07:33:33.028 INFO:tasks.workunit.client.1.smithi100.stdout:7/332: fdatasync d1/d54/f5f 0 2024-04-27T07:33:33.034 INFO:tasks.workunit.client.1.smithi100.stdout:4/444: symlink d5/d16/l9a 0 2024-04-27T07:33:33.035 INFO:tasks.workunit.client.1.smithi100.stdout:5/336: dwrite d0/d4/d21/d24/f47 [0,4194304] 0 2024-04-27T07:33:33.037 INFO:tasks.workunit.client.1.smithi100.stdout:4/445: symlink d5/d16/d19/d21/l9b 0 2024-04-27T07:33:33.038 INFO:tasks.workunit.client.1.smithi100.stdout:4/446: chown d5/d16/d19/d21/c75 1437451 1 2024-04-27T07:33:33.044 INFO:tasks.workunit.client.1.smithi100.stdout:8/370: truncate d6/f7 4123821 0 2024-04-27T07:33:33.046 INFO:tasks.workunit.client.1.smithi100.stdout:5/337: dwrite d0/d4/d21/f50 [0,4194304] 0 2024-04-27T07:33:33.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/447: dwrite d5/d1b/f6c [0,4194304] 0 2024-04-27T07:33:33.053 INFO:tasks.workunit.client.1.smithi100.stdout:8/371: getdents d6 0 2024-04-27T07:33:33.056 INFO:tasks.workunit.client.1.smithi100.stdout:6/391: dwrite de/d58/d21/d23/f3e [0,4194304] 0 2024-04-27T07:33:33.057 INFO:tasks.workunit.client.1.smithi100.stdout:8/372: dread - d6/d1b/d1d/d59/f51 zero size 2024-04-27T07:33:33.058 INFO:tasks.workunit.client.1.smithi100.stdout:9/353: dread d1/f29 [0,4194304] 0 2024-04-27T07:33:33.063 INFO:tasks.workunit.client.1.smithi100.stdout:5/338: dwrite d0/d58/d60/f61 [0,4194304] 0 2024-04-27T07:33:33.063 INFO:tasks.workunit.client.1.smithi100.stdout:4/448: mknod d5/d16/d19/d21/d2b/c9c 0 2024-04-27T07:33:33.064 INFO:tasks.workunit.client.1.smithi100.stdout:6/392: write de/d58/d21/d23/f39 [518506,104152] 0 2024-04-27T07:33:33.065 INFO:tasks.workunit.client.1.smithi100.stdout:9/354: creat d1/d9/f84 x:0 0 0 2024-04-27T07:33:33.070 INFO:tasks.workunit.client.1.smithi100.stdout:5/339: chown d0/ce 2 1 2024-04-27T07:33:33.070 INFO:tasks.workunit.client.1.smithi100.stdout:6/393: creat de/d58/d28/f8b x:0 0 0 2024-04-27T07:33:33.071 INFO:tasks.workunit.client.1.smithi100.stdout:8/373: dwrite d6/d1b/d1d/f39 [0,4194304] 0 2024-04-27T07:33:33.080 INFO:tasks.workunit.client.1.smithi100.stdout:6/394: dwrite de/d58/d21/f85 [0,4194304] 0 2024-04-27T07:33:33.081 INFO:tasks.workunit.client.1.smithi100.stdout:8/374: dwrite d6/d1b/d1d/f2c [0,4194304] 0 2024-04-27T07:33:33.082 INFO:tasks.workunit.client.1.smithi100.stdout:6/395: truncate de/d58/d28/f59 1699557 0 2024-04-27T07:33:33.086 INFO:tasks.workunit.client.1.smithi100.stdout:8/375: dread d6/f31 [0,4194304] 0 2024-04-27T07:33:33.114 INFO:tasks.workunit.client.1.smithi100.stdout:1/518: sync 2024-04-27T07:33:33.115 INFO:tasks.workunit.client.1.smithi100.stdout:1/519: write d0/da0/f8c [203567,95231] 0 2024-04-27T07:33:33.141 INFO:tasks.workunit.client.1.smithi100.stdout:5/340: creat d0/d4/d21/d24/d2f/d39/d56/d67/f68 x:0 0 0 2024-04-27T07:33:33.145 INFO:tasks.workunit.client.1.smithi100.stdout:9/355: fsync d1/d9/f84 0 2024-04-27T07:33:33.146 INFO:tasks.workunit.client.1.smithi100.stdout:1/520: symlink d0/d1b/d20/d2d/d35/d4d/d60/la3 0 2024-04-27T07:33:33.148 INFO:tasks.workunit.client.1.smithi100.stdout:5/341: creat d0/d4/d21/d24/f69 x:0 0 0 2024-04-27T07:33:33.150 INFO:tasks.workunit.client.1.smithi100.stdout:6/396: write de/d58/f1b [143877,72309] 0 2024-04-27T07:33:33.151 INFO:tasks.workunit.client.1.smithi100.stdout:6/397: read de/d58/d21/d23/f39 [552284,38152] 0 2024-04-27T07:33:33.151 INFO:tasks.workunit.client.1.smithi100.stdout:8/376: rename d6/d1b/d1d/c4d to d6/c71 0 2024-04-27T07:33:33.153 INFO:tasks.workunit.client.1.smithi100.stdout:9/356: chown d1/d9/db/d2b/l3b 0 1 2024-04-27T07:33:33.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/792: sync 2024-04-27T07:33:33.156 INFO:tasks.workunit.client.0.smithi082.stdout:8/793: chown d0/d2b/d80/dca/de6/d87/d42/d7f/dac/lc8 159447 1 2024-04-27T07:33:33.156 INFO:tasks.workunit.client.1.smithi100.stdout:6/398: unlink de/d2e/l42 0 2024-04-27T07:33:33.157 INFO:tasks.workunit.client.0.smithi082.stdout:8/794: mkdir d0/d2b/d80/dca/d105 0 2024-04-27T07:33:33.160 INFO:tasks.workunit.client.1.smithi100.stdout:5/342: dwrite d0/d4/d21/f26 [0,4194304] 0 2024-04-27T07:33:33.161 INFO:tasks.workunit.client.1.smithi100.stdout:5/343: dread - d0/d4/d21/d24/f69 zero size 2024-04-27T07:33:33.161 INFO:tasks.workunit.client.1.smithi100.stdout:1/521: dread d0/d1b/d20/f51 [0,4194304] 0 2024-04-27T07:33:33.162 INFO:tasks.workunit.client.1.smithi100.stdout:9/357: creat d1/f85 x:0 0 0 2024-04-27T07:33:33.163 INFO:tasks.workunit.client.0.smithi082.stdout:8/795: dwrite d0/d2b/d80/dca/de6/d1b/d29/d65/f7c [0,4194304] 0 2024-04-27T07:33:33.166 INFO:tasks.workunit.client.1.smithi100.stdout:1/522: mkdir d0/d1b/d20/d2d/d35/d4d/d60/da4 0 2024-04-27T07:33:33.167 INFO:tasks.workunit.client.0.smithi082.stdout:8/796: symlink d0/d2b/dd5/l106 0 2024-04-27T07:33:33.167 INFO:tasks.workunit.client.0.smithi082.stdout:8/797: fsync d0/d83/fc4 0 2024-04-27T07:33:33.168 INFO:tasks.workunit.client.1.smithi100.stdout:6/399: creat de/d58/d21/f8c x:0 0 0 2024-04-27T07:33:33.171 INFO:tasks.workunit.client.1.smithi100.stdout:5/344: getdents d0/d4/d21/d24/d2f/d57/d37/d48 0 2024-04-27T07:33:33.172 INFO:tasks.workunit.client.1.smithi100.stdout:1/523: write d0/d1b/d20/f94 [373274,24762] 0 2024-04-27T07:33:33.172 INFO:tasks.workunit.client.0.smithi082.stdout:8/798: truncate d0/d2b/d80/dca/de6/d1b/d29/f57 30283 0 2024-04-27T07:33:33.174 INFO:tasks.workunit.client.1.smithi100.stdout:9/358: dwrite d1/d9/f21 [8388608,4194304] 0 2024-04-27T07:33:33.177 INFO:tasks.workunit.client.0.smithi082.stdout:8/799: dwrite d0/d2b/d80/dca/de6/d1b/f2e [0,4194304] 0 2024-04-27T07:33:33.180 INFO:tasks.workunit.client.0.smithi082.stdout:8/800: creat d0/d2b/d80/dca/f107 x:0 0 0 2024-04-27T07:33:33.181 INFO:tasks.workunit.client.1.smithi100.stdout:9/359: rename d1/d9/d1f/f28 to d1/d9/db/d2b/f86 0 2024-04-27T07:33:33.181 INFO:tasks.workunit.client.1.smithi100.stdout:5/345: getdents d0/d4/d21/d24/d2f/d57/d37/d48 0 2024-04-27T07:33:33.185 INFO:tasks.workunit.client.1.smithi100.stdout:5/346: mkdir d0/d4/d21/d24/d2f/d57/d3e/d6a 0 2024-04-27T07:33:33.186 INFO:tasks.workunit.client.1.smithi100.stdout:9/360: dread d1/d9/f42 [0,4194304] 0 2024-04-27T07:33:33.188 INFO:tasks.workunit.client.1.smithi100.stdout:5/347: write d0/d4/d21/d24/d2f/d39/d56/f63 [7061401,32251] 0 2024-04-27T07:33:33.188 INFO:tasks.workunit.client.1.smithi100.stdout:5/348: chown d0/d58/d60/f61 94 1 2024-04-27T07:33:33.189 INFO:tasks.workunit.client.1.smithi100.stdout:5/349: chown d0 109 1 2024-04-27T07:33:33.203 INFO:tasks.workunit.client.1.smithi100.stdout:1/524: dread d0/da0/f91 [0,4194304] 0 2024-04-27T07:33:33.205 INFO:tasks.workunit.client.0.smithi082.stdout:8/801: write d0/d2b/f81 [5124166,106563] 0 2024-04-27T07:33:33.205 INFO:tasks.workunit.client.1.smithi100.stdout:1/525: unlink d0/d1b/f3e 0 2024-04-27T07:33:33.207 INFO:tasks.workunit.client.1.smithi100.stdout:1/526: write d0/d1b/d20/d2d/d35/f7f [2453469,53212] 0 2024-04-27T07:33:33.208 INFO:tasks.workunit.client.0.smithi082.stdout:8/802: unlink d0/d2b/d80/dca/de6/d55/fcf 0 2024-04-27T07:33:33.208 INFO:tasks.workunit.client.1.smithi100.stdout:9/361: dread d1/d9/db/d2b/d31/f35 [0,4194304] 0 2024-04-27T07:33:33.210 INFO:tasks.workunit.client.1.smithi100.stdout:9/362: rmdir d1/d9/d1f/d4a 39 2024-04-27T07:33:33.212 INFO:tasks.workunit.client.1.smithi100.stdout:9/363: fdatasync d1/d9/f42 0 2024-04-27T07:33:33.212 INFO:tasks.workunit.client.0.smithi082.stdout:8/803: dwrite d0/d2b/d80/dca/de6/d1b/f3c [0,4194304] 0 2024-04-27T07:33:33.213 INFO:tasks.workunit.client.1.smithi100.stdout:9/364: dread - d1/d9/db/d2b/d4f/f72 zero size 2024-04-27T07:33:33.213 INFO:tasks.workunit.client.1.smithi100.stdout:1/527: dread d0/f19 [0,4194304] 0 2024-04-27T07:33:33.214 INFO:tasks.workunit.client.1.smithi100.stdout:9/365: dread - d1/d9/db/d2b/d4f/f62 zero size 2024-04-27T07:33:33.215 INFO:tasks.workunit.client.1.smithi100.stdout:1/528: stat d0/d1b/d20/d2d/d35/d4d/d60/la3 0 2024-04-27T07:33:33.216 INFO:tasks.workunit.client.0.smithi082.stdout:8/804: dread d0/d2b/d6f/fc2 [0,4194304] 0 2024-04-27T07:33:33.216 INFO:tasks.workunit.client.1.smithi100.stdout:9/366: dread - d1/d9/d1f/f7a zero size 2024-04-27T07:33:33.216 INFO:tasks.workunit.client.1.smithi100.stdout:1/529: write d0/f18 [1895339,53613] 0 2024-04-27T07:33:33.219 INFO:tasks.workunit.client.0.smithi082.stdout:8/805: dread d0/d2b/d80/dca/de6/d87/fee [0,4194304] 0 2024-04-27T07:33:33.220 INFO:tasks.workunit.client.0.smithi082.stdout:8/806: chown d0/d2b/d9a/da4/laf 2726 1 2024-04-27T07:33:33.221 INFO:tasks.workunit.client.1.smithi100.stdout:9/367: creat d1/d9/db/d2b/d4f/d57/f87 x:0 0 0 2024-04-27T07:33:33.225 INFO:tasks.workunit.client.1.smithi100.stdout:1/530: dwrite d0/d1b/f96 [0,4194304] 0 2024-04-27T07:33:33.227 INFO:tasks.workunit.client.1.smithi100.stdout:9/368: unlink d1/d9/d1f/d52/l74 0 2024-04-27T07:33:33.230 INFO:tasks.workunit.client.1.smithi100.stdout:1/531: link d0/d1b/d20/d2d/d35/l90 d0/d1b/d20/d2d/d35/d65/la5 0 2024-04-27T07:33:33.231 INFO:tasks.workunit.client.1.smithi100.stdout:9/369: symlink d1/d9/db/d56/d5c/l88 0 2024-04-27T07:33:33.236 INFO:tasks.workunit.client.1.smithi100.stdout:9/370: dread d1/f13 [0,4194304] 0 2024-04-27T07:33:33.237 INFO:tasks.workunit.client.1.smithi100.stdout:9/371: stat d1/d9/d1f/d52/f81 0 2024-04-27T07:33:33.238 INFO:tasks.workunit.client.1.smithi100.stdout:9/372: truncate d1/d9/db/d2b/f7d 541277 0 2024-04-27T07:33:33.243 INFO:tasks.workunit.client.1.smithi100.stdout:9/373: getdents d1/d9/db/d56/d5c 0 2024-04-27T07:33:33.245 INFO:tasks.workunit.client.1.smithi100.stdout:9/374: rename d1/d9/db/d2b/d4f/d57/l5a to d1/d9/d1f/d52/d54/l89 0 2024-04-27T07:33:33.247 INFO:tasks.workunit.client.1.smithi100.stdout:9/375: chown d1/d9/d1f/l44 7606360 1 2024-04-27T07:33:33.247 INFO:tasks.workunit.client.1.smithi100.stdout:9/376: readlink d1/d9/db/d56/d5c/l88 0 2024-04-27T07:33:33.249 INFO:tasks.workunit.client.1.smithi100.stdout:9/377: mkdir d1/d9/d1f/d4a/d67/d8a 0 2024-04-27T07:33:33.251 INFO:tasks.workunit.client.1.smithi100.stdout:9/378: creat d1/d9/d1f/f8b x:0 0 0 2024-04-27T07:33:33.253 INFO:tasks.workunit.client.1.smithi100.stdout:9/379: creat d1/d9/db/d56/f8c x:0 0 0 2024-04-27T07:33:33.253 INFO:tasks.workunit.client.1.smithi100.stdout:9/380: chown d1/d9/d1f/d4a/f4d 0 1 2024-04-27T07:33:33.257 INFO:tasks.workunit.client.1.smithi100.stdout:9/381: rmdir d1/d9/db/d2b/d4f 39 2024-04-27T07:33:33.277 INFO:tasks.workunit.client.1.smithi100.stdout:3/442: sync 2024-04-27T07:33:33.278 INFO:tasks.workunit.client.1.smithi100.stdout:3/443: unlink d7/d9/d10/d28/d2c/l31 0 2024-04-27T07:33:33.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/948: sync 2024-04-27T07:33:33.290 INFO:tasks.workunit.client.0.smithi082.stdout:4/949: dread d3/d6/d26/d5e/d11e/d101/fef [0,4194304] 0 2024-04-27T07:33:33.292 INFO:tasks.workunit.client.0.smithi082.stdout:4/950: symlink d3/d6/d26/d5e/d11e/d101/d69/d85/l137 0 2024-04-27T07:33:33.292 INFO:tasks.workunit.client.1.smithi100.stdout:3/444: dread d7/d9/d26/d45/f49 [4194304,4194304] 0 2024-04-27T07:33:33.293 INFO:tasks.workunit.client.1.smithi100.stdout:3/445: write d7/d9/d26/d2a/d5e/f72 [1138391,10597] 0 2024-04-27T07:33:33.294 INFO:tasks.workunit.client.0.smithi082.stdout:4/951: mkdir d3/dab/d138 0 2024-04-27T07:33:33.294 INFO:tasks.workunit.client.0.smithi082.stdout:4/952: chown d3/d6/d26/d5e/d11e/d101/d69/fd0 6 1 2024-04-27T07:33:33.295 INFO:tasks.workunit.client.1.smithi100.stdout:3/446: mkdir d7/d9/d2f/d8a 0 2024-04-27T07:33:33.295 INFO:tasks.workunit.client.1.smithi100.stdout:3/447: fsync d7/f1c 0 2024-04-27T07:33:33.296 INFO:tasks.workunit.client.0.smithi082.stdout:4/953: symlink d3/d6/d26/d5e/d11e/d101/l139 0 2024-04-27T07:33:33.296 INFO:tasks.workunit.client.1.smithi100.stdout:3/448: read d7/d9/d26/d2a/d5e/f72 [248188,122975] 0 2024-04-27T07:33:33.301 INFO:tasks.workunit.client.0.smithi082.stdout:4/954: dwrite d3/d10/d9c/fb3 [4194304,4194304] 0 2024-04-27T07:33:33.304 INFO:tasks.workunit.client.0.smithi082.stdout:4/955: truncate d3/d6/f89 3729429 0 2024-04-27T07:33:33.308 INFO:tasks.workunit.client.0.smithi082.stdout:4/956: rename d3/d6/d26/d5e/d21/l6f to d3/l13a 0 2024-04-27T07:33:33.312 INFO:tasks.workunit.client.1.smithi100.stdout:3/449: read d7/d9/d10/f7b [611597,93637] 0 2024-04-27T07:33:33.312 INFO:tasks.workunit.client.0.smithi082.stdout:8/807: sync 2024-04-27T07:33:33.312 INFO:tasks.workunit.client.0.smithi082.stdout:1/806: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:9/763: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:6/869: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:7/880: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:2/841: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:5/971: sync 2024-04-27T07:33:33.313 INFO:tasks.workunit.client.0.smithi082.stdout:4/957: link d3/d9/fbd d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10b/f13b 0 2024-04-27T07:33:33.314 INFO:tasks.workunit.client.1.smithi100.stdout:3/450: mkdir d7/d9/d26/d45/d8b 0 2024-04-27T07:33:33.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/972: chown d8/d29/d4e/d90/fc2 916 1 2024-04-27T07:33:33.315 INFO:tasks.workunit.client.0.smithi082.stdout:2/842: chown d7/d14/fc2 523575 1 2024-04-27T07:33:33.316 INFO:tasks.workunit.client.0.smithi082.stdout:8/808: mknod d0/d2b/d80/dca/c108 0 2024-04-27T07:33:33.317 INFO:tasks.workunit.client.0.smithi082.stdout:6/870: fdatasync d2/d2d/d4a/fb9 0 2024-04-27T07:33:33.320 INFO:tasks.workunit.client.0.smithi082.stdout:4/958: dwrite d3/d9/f8b [0,4194304] 0 2024-04-27T07:33:33.320 INFO:tasks.workunit.client.0.smithi082.stdout:4/959: stat d3/c83 0 2024-04-27T07:33:33.321 INFO:tasks.workunit.client.0.smithi082.stdout:1/807: mknod d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/d93/c115 0 2024-04-27T07:33:33.321 INFO:tasks.workunit.client.0.smithi082.stdout:1/808: fsync f2 0 2024-04-27T07:33:33.321 INFO:tasks.workunit.client.0.smithi082.stdout:8/809: rmdir d0 39 2024-04-27T07:33:33.324 INFO:tasks.workunit.client.1.smithi100.stdout:3/451: write d7/d9/fc [359701,60712] 0 2024-04-27T07:33:33.325 INFO:tasks.workunit.client.1.smithi100.stdout:3/452: write d7/d9/d10/f3d [870081,127263] 0 2024-04-27T07:33:33.327 INFO:tasks.workunit.client.0.smithi082.stdout:2/843: rename d7/f87 to d7/d8/d99/f115 0 2024-04-27T07:33:33.336 INFO:tasks.workunit.client.0.smithi082.stdout:9/764: dwrite d9/da/dc/d35/d38/d65/f77 [0,4194304] 0 2024-04-27T07:33:33.338 INFO:tasks.workunit.client.0.smithi082.stdout:9/765: write d9/d2d/d2b/d46/d76/dcb/fdc [3731321,96335] 0 2024-04-27T07:33:33.340 INFO:tasks.workunit.client.0.smithi082.stdout:6/871: mknod d2/d2d/d4a/de4/dcc/c122 0 2024-04-27T07:33:33.340 INFO:tasks.workunit.client.0.smithi082.stdout:4/960: fsync d3/fb2 0 2024-04-27T07:33:33.340 INFO:tasks.workunit.client.0.smithi082.stdout:7/881: truncate d3/f1f 3725689 0 2024-04-27T07:33:33.343 INFO:tasks.workunit.client.0.smithi082.stdout:1/809: creat d4/d15/d49/dab/dc3/d3e/d53/d72/d114/f116 x:0 0 0 2024-04-27T07:33:33.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/882: mknod d3/d9/d7c/c137 0 2024-04-27T07:33:33.355 INFO:tasks.workunit.client.0.smithi082.stdout:2/844: getdents d7/d9/d4f/d6e 0 2024-04-27T07:33:33.355 INFO:tasks.workunit.client.0.smithi082.stdout:1/810: mkdir d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117 0 2024-04-27T07:33:33.357 INFO:tasks.workunit.client.0.smithi082.stdout:9/766: dwrite d9/da/fb5 [0,4194304] 0 2024-04-27T07:33:33.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/872: dread d2/d2d/d4a/de4/dcc/f83 [0,4194304] 0 2024-04-27T07:33:33.363 INFO:tasks.workunit.client.0.smithi082.stdout:2/845: readlink d7/d9/d4f/d6e/d82/lc5 0 2024-04-27T07:33:33.363 INFO:tasks.workunit.client.0.smithi082.stdout:4/961: dwrite d3/d9/f45 [0,4194304] 0 2024-04-27T07:33:33.363 INFO:tasks.workunit.client.0.smithi082.stdout:5/973: dwrite d8/d3c/fa0 [0,4194304] 0 2024-04-27T07:33:33.363 INFO:tasks.workunit.client.0.smithi082.stdout:7/883: dread - d3/d49/d97/d3a/d71/da0/ddf/ff7 zero size 2024-04-27T07:33:33.365 INFO:tasks.workunit.client.0.smithi082.stdout:8/810: dread d0/d2b/d80/dca/de6/d1b/f89 [0,4194304] 0 2024-04-27T07:33:33.365 INFO:tasks.workunit.client.0.smithi082.stdout:7/884: stat d3/dfb/f12b 0 2024-04-27T07:33:33.367 INFO:tasks.workunit.client.0.smithi082.stdout:5/974: mkdir d8/d3c/d64/db8/d140 0 2024-04-27T07:33:33.370 INFO:tasks.workunit.client.0.smithi082.stdout:9/767: truncate d9/da/dc/d35/d38/d65/f82 1607390 0 2024-04-27T07:33:33.372 INFO:tasks.workunit.client.0.smithi082.stdout:2/846: symlink d7/d9/d4f/d6e/d82/da4/de0/dec/l116 0 2024-04-27T07:33:33.374 INFO:tasks.workunit.client.0.smithi082.stdout:6/873: rename d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/fcd to d2/d45/f123 0 2024-04-27T07:33:33.375 INFO:tasks.workunit.client.0.smithi082.stdout:1/811: dwrite d4/d15/d1c/fdf [0,4194304] 0 2024-04-27T07:33:33.381 INFO:tasks.workunit.client.0.smithi082.stdout:1/812: read d4/f3a [1218330,101908] 0 2024-04-27T07:33:33.381 INFO:tasks.workunit.client.0.smithi082.stdout:2/847: creat d7/d9/d4f/d6e/d82/da4/de0/f117 x:0 0 0 2024-04-27T07:33:33.382 INFO:tasks.workunit.client.0.smithi082.stdout:4/962: dwrite d3/d6/d26/d5e/d11e/d101/fb0 [0,4194304] 0 2024-04-27T07:33:33.383 INFO:tasks.workunit.client.0.smithi082.stdout:9/768: symlink d9/da/dc/d35/d4a/l105 0 2024-04-27T07:33:33.384 INFO:tasks.workunit.client.1.smithi100.stdout:3/453: unlink d7/d9/d10/f11 0 2024-04-27T07:33:33.385 INFO:tasks.workunit.client.0.smithi082.stdout:8/811: truncate d0/d2b/d80/dca/de6/d1b/d29/d6a/f6b 2518899 0 2024-04-27T07:33:33.386 INFO:tasks.workunit.client.0.smithi082.stdout:8/812: chown d0/d83/la5 0 1 2024-04-27T07:33:33.386 INFO:tasks.workunit.client.0.smithi082.stdout:2/848: rmdir d7/d8/dd9 39 2024-04-27T07:33:33.387 INFO:tasks.workunit.client.0.smithi082.stdout:1/813: mknod d4/d15/d49/da0/d10c/c118 0 2024-04-27T07:33:33.388 INFO:tasks.workunit.client.1.smithi100.stdout:3/454: creat d7/d9/d26/d6c/f8c x:0 0 0 2024-04-27T07:33:33.391 INFO:tasks.workunit.client.0.smithi082.stdout:5/975: truncate d8/d42/f121 4488903 0 2024-04-27T07:33:33.394 INFO:tasks.workunit.client.0.smithi082.stdout:2/849: creat d7/d8/d99/dc8/f118 x:0 0 0 2024-04-27T07:33:33.395 INFO:tasks.workunit.client.1.smithi100.stdout:3/455: dwrite d7/d9/fc [0,4194304] 0 2024-04-27T07:33:33.398 INFO:tasks.workunit.client.1.smithi100.stdout:3/456: mknod d7/c8d 0 2024-04-27T07:33:33.405 INFO:tasks.workunit.client.1.smithi100.stdout:3/457: dwrite d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:33.409 INFO:tasks.workunit.client.1.smithi100.stdout:3/458: mknod d7/d9/d10/c8e 0 2024-04-27T07:33:33.410 INFO:tasks.workunit.client.1.smithi100.stdout:3/459: stat d7/d9/d26/f38 0 2024-04-27T07:33:33.411 INFO:tasks.workunit.client.1.smithi100.stdout:3/460: write d7/d9/d10/f29 [1941257,5324] 0 2024-04-27T07:33:33.413 INFO:tasks.workunit.client.1.smithi100.stdout:3/461: symlink d7/d9/d10/d28/d2c/l8f 0 2024-04-27T07:33:33.413 INFO:tasks.workunit.client.1.smithi100.stdout:3/462: stat d7/d9/d10/d33/f4e 0 2024-04-27T07:33:33.414 INFO:tasks.workunit.client.1.smithi100.stdout:3/463: truncate d7/d9/d10/d28/d2c/f81 775874 0 2024-04-27T07:33:33.416 INFO:tasks.workunit.client.1.smithi100.stdout:0/400: sync 2024-04-27T07:33:33.416 INFO:tasks.workunit.client.1.smithi100.stdout:3/464: write d7/d9/d10/f29 [1876139,105682] 0 2024-04-27T07:33:33.417 INFO:tasks.workunit.client.1.smithi100.stdout:0/401: dread - d1/d8/d20/d1e/f85 zero size 2024-04-27T07:33:33.420 INFO:tasks.workunit.client.1.smithi100.stdout:0/402: mknod d1/d8/d20/d1e/c8a 0 2024-04-27T07:33:33.422 INFO:tasks.workunit.client.1.smithi100.stdout:0/403: fdatasync d1/d30/f3d 0 2024-04-27T07:33:33.423 INFO:tasks.workunit.client.1.smithi100.stdout:0/404: rmdir d1 39 2024-04-27T07:33:33.427 INFO:tasks.workunit.client.1.smithi100.stdout:0/405: mknod d1/d8/c8b 0 2024-04-27T07:33:33.428 INFO:tasks.workunit.client.1.smithi100.stdout:0/406: mknod d1/d8/d14/d59/c8c 0 2024-04-27T07:33:33.429 INFO:tasks.workunit.client.1.smithi100.stdout:0/407: stat d1/d8/d14/d59/c5e 0 2024-04-27T07:33:33.431 INFO:tasks.workunit.client.1.smithi100.stdout:0/408: creat d1/d8/d20/d1e/f8d x:0 0 0 2024-04-27T07:33:33.431 INFO:tasks.workunit.client.1.smithi100.stdout:3/465: write d7/d9/d10/d28/d2c/f34 [366354,117530] 0 2024-04-27T07:33:33.432 INFO:tasks.workunit.client.0.smithi082.stdout:6/874: link d2/d2d/f11d d2/d2d/d4a/de4/dcc/f124 0 2024-04-27T07:33:33.432 INFO:tasks.workunit.client.0.smithi082.stdout:1/814: symlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/l119 0 2024-04-27T07:33:33.433 INFO:tasks.workunit.client.0.smithi082.stdout:9/769: creat d9/da/dc/d88/df7/f106 x:0 0 0 2024-04-27T07:33:33.433 INFO:tasks.workunit.client.0.smithi082.stdout:1/815: readlink d4/l91 0 2024-04-27T07:33:33.436 INFO:tasks.workunit.client.0.smithi082.stdout:5/976: symlink d8/d3c/d47/l141 0 2024-04-27T07:33:33.436 INFO:tasks.workunit.client.0.smithi082.stdout:6/875: creat d2/d2d/d4a/f125 x:0 0 0 2024-04-27T07:33:33.436 INFO:tasks.workunit.client.1.smithi100.stdout:3/466: rename d7/d9/d10/d28/d2c to d7/d9/d10/d33/d90 0 2024-04-27T07:33:33.437 INFO:tasks.workunit.client.0.smithi082.stdout:2/850: rmdir d7/d9/d4f/d6e/d82/da4/de0/dec 39 2024-04-27T07:33:33.437 INFO:tasks.workunit.client.1.smithi100.stdout:3/467: write d7/d9/d10/d22/d7e/f89 [83079,98319] 0 2024-04-27T07:33:33.438 INFO:tasks.workunit.client.0.smithi082.stdout:9/770: rmdir d9/da/dc/d35/d4b 39 2024-04-27T07:33:33.438 INFO:tasks.workunit.client.1.smithi100.stdout:3/468: write d7/f1c [5948332,29841] 0 2024-04-27T07:33:33.441 INFO:tasks.workunit.client.0.smithi082.stdout:7/885: dread d3/f1f [0,4194304] 0 2024-04-27T07:33:33.442 INFO:tasks.workunit.client.1.smithi100.stdout:3/469: dread d7/d9/d10/d22/d7e/f89 [0,4194304] 0 2024-04-27T07:33:33.443 INFO:tasks.workunit.client.0.smithi082.stdout:9/771: chown d9/da/dc/lcd 59071 1 2024-04-27T07:33:33.443 INFO:tasks.workunit.client.1.smithi100.stdout:0/409: truncate d1/d8/d20/f5a 3248477 0 2024-04-27T07:33:33.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/816: dwrite d4/f12 [4194304,4194304] 0 2024-04-27T07:33:33.444 INFO:tasks.workunit.client.0.smithi082.stdout:5/977: write d8/d29/d4e/d90/f138 [964,34114] 0 2024-04-27T07:33:33.444 INFO:tasks.workunit.client.1.smithi100.stdout:0/410: stat d1/d38 0 2024-04-27T07:33:33.444 INFO:tasks.workunit.client.1.smithi100.stdout:3/470: dread - d7/d9/d10/d28/f75 zero size 2024-04-27T07:33:33.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/851: read d7/f51 [6144514,71650] 0 2024-04-27T07:33:33.445 INFO:tasks.workunit.client.0.smithi082.stdout:6/876: link d2/d1e/d80/l92 d2/l126 0 2024-04-27T07:33:33.447 INFO:tasks.workunit.client.1.smithi100.stdout:3/471: unlink d7/d9/d10/d33/f4e 0 2024-04-27T07:33:33.449 INFO:tasks.workunit.client.0.smithi082.stdout:7/886: truncate d3/d49/d97/d3a/d71/da0/f10d 244939 0 2024-04-27T07:33:33.449 INFO:tasks.workunit.client.0.smithi082.stdout:8/813: dread d0/f99 [0,4194304] 0 2024-04-27T07:33:33.452 INFO:tasks.workunit.client.1.smithi100.stdout:3/472: dread d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:33.453 INFO:tasks.workunit.client.0.smithi082.stdout:6/877: readlink d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/d112/l121 0 2024-04-27T07:33:33.453 INFO:tasks.workunit.client.0.smithi082.stdout:5/978: dread d8/d29/f68 [0,4194304] 0 2024-04-27T07:33:33.455 INFO:tasks.workunit.client.0.smithi082.stdout:5/979: stat d8/d14/f120 0 2024-04-27T07:33:33.455 INFO:tasks.workunit.client.0.smithi082.stdout:2/852: write d7/d8/f19 [1763603,87020] 0 2024-04-27T07:33:33.456 INFO:tasks.workunit.client.0.smithi082.stdout:8/814: mknod d0/d2b/d80/dca/d105/c109 0 2024-04-27T07:33:33.456 INFO:tasks.workunit.client.0.smithi082.stdout:6/878: chown d2/d1e/d32/d85/d10c/d113 29512 1 2024-04-27T07:33:33.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/887: truncate d3/d49/d97/d3a/d2a/dac/da9/f12c 434478 0 2024-04-27T07:33:33.459 INFO:tasks.workunit.client.0.smithi082.stdout:9/772: dread d9/da/dc/d35/d38/d65/f77 [0,4194304] 0 2024-04-27T07:33:33.459 INFO:tasks.workunit.client.0.smithi082.stdout:1/817: dwrite d4/d15/d49/dab/dc3/d4c/d7a/f80 [4194304,4194304] 0 2024-04-27T07:33:33.461 INFO:tasks.workunit.client.0.smithi082.stdout:5/980: unlink d8/d77/d7a/fab 0 2024-04-27T07:33:33.461 INFO:tasks.workunit.client.0.smithi082.stdout:6/879: mknod d2/d2d/d4a/c127 0 2024-04-27T07:33:33.462 INFO:tasks.workunit.client.0.smithi082.stdout:9/773: chown d9/da/dc/d73 4 1 2024-04-27T07:33:33.465 INFO:tasks.workunit.client.0.smithi082.stdout:2/853: creat d7/d9/df6/f119 x:0 0 0 2024-04-27T07:33:33.465 INFO:tasks.workunit.client.0.smithi082.stdout:8/815: mkdir d0/d2b/d9a/d10a 0 2024-04-27T07:33:33.466 INFO:tasks.workunit.client.1.smithi100.stdout:3/473: dwrite d7/d9/d10/d33/d90/f81 [0,4194304] 0 2024-04-27T07:33:33.467 INFO:tasks.workunit.client.0.smithi082.stdout:7/888: rename d3/d9/d4f/d61/dd0 to d3/d9/dda/d11e/d138 0 2024-04-27T07:33:33.468 INFO:tasks.workunit.client.1.smithi100.stdout:3/474: stat d7/d9/d10/d33/d90/c3c 0 2024-04-27T07:33:33.472 INFO:tasks.workunit.client.0.smithi082.stdout:1/818: rename d4/d15/d49/d99/l9e to d4/d15/d1c/l11a 0 2024-04-27T07:33:33.473 INFO:tasks.workunit.client.1.smithi100.stdout:0/411: dread d1/d8/d20/f2b [0,4194304] 0 2024-04-27T07:33:33.473 INFO:tasks.workunit.client.0.smithi082.stdout:6/880: mkdir d2/d1e/d32/d85/d10c/d113/d128 0 2024-04-27T07:33:33.475 INFO:tasks.workunit.client.1.smithi100.stdout:3/475: mkdir d7/d9/d10/d3e/d91 0 2024-04-27T07:33:33.476 INFO:tasks.workunit.client.0.smithi082.stdout:2/854: unlink d7/d8/f1f 0 2024-04-27T07:33:33.477 INFO:tasks.workunit.client.1.smithi100.stdout:0/412: mknod d1/d8/d14/d59/c8e 0 2024-04-27T07:33:33.477 INFO:tasks.workunit.client.1.smithi100.stdout:3/476: creat d7/d9/d10/d22/d7e/f92 x:0 0 0 2024-04-27T07:33:33.478 INFO:tasks.workunit.client.0.smithi082.stdout:2/855: read d7/d9/d4f/d66/fb3 [623648,99113] 0 2024-04-27T07:33:33.479 INFO:tasks.workunit.client.1.smithi100.stdout:3/477: truncate d7/d9/d2f/f69 591475 0 2024-04-27T07:33:33.480 INFO:tasks.workunit.client.1.smithi100.stdout:0/413: unlink d1/d30/f5c 0 2024-04-27T07:33:33.480 INFO:tasks.workunit.client.1.smithi100.stdout:3/478: truncate d7/d9/f51 5086944 0 2024-04-27T07:33:33.481 INFO:tasks.workunit.client.1.smithi100.stdout:3/479: chown d7/d9/d26/c58 72307799 1 2024-04-27T07:33:33.482 INFO:tasks.workunit.client.1.smithi100.stdout:3/480: dread - d7/d9/d10/d22/f5b zero size 2024-04-27T07:33:33.483 INFO:tasks.workunit.client.0.smithi082.stdout:1/819: symlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/l11b 0 2024-04-27T07:33:33.485 INFO:tasks.workunit.client.0.smithi082.stdout:5/981: write d8/d3b/fb7 [153166,73040] 0 2024-04-27T07:33:33.486 INFO:tasks.workunit.client.1.smithi100.stdout:3/481: write d7/d9/d10/d22/d7e/f89 [978974,69777] 0 2024-04-27T07:33:33.486 INFO:tasks.workunit.client.0.smithi082.stdout:7/889: getdents d3/d49/d97/d3a/d71 0 2024-04-27T07:33:33.487 INFO:tasks.workunit.client.1.smithi100.stdout:0/414: dwrite d1/d8/f83 [0,4194304] 0 2024-04-27T07:33:33.489 INFO:tasks.workunit.client.0.smithi082.stdout:8/816: write d0/f58 [5216496,66039] 0 2024-04-27T07:33:33.491 INFO:tasks.workunit.client.0.smithi082.stdout:9/774: rename d9/d2d/d2b/d46/d5d/da7/ff1 to d9/da/dc/d35/d38/f107 0 2024-04-27T07:33:33.495 INFO:tasks.workunit.client.0.smithi082.stdout:5/982: dwrite d8/d29/dea/da3/fdf [0,4194304] 0 2024-04-27T07:33:33.498 INFO:tasks.workunit.client.1.smithi100.stdout:0/415: rmdir d1/d8/d14/d59/d64/d80/d89 0 2024-04-27T07:33:33.499 INFO:tasks.workunit.client.0.smithi082.stdout:6/881: rename d2/d1e/d32/d7d/d82 to d2/d1e/d80/df5/d129 0 2024-04-27T07:33:33.499 INFO:tasks.workunit.client.1.smithi100.stdout:3/482: link d7/d9/d10/d3e/d55/l56 d7/d9/d10/d3e/d74/l93 0 2024-04-27T07:33:33.500 INFO:tasks.workunit.client.0.smithi082.stdout:5/983: write d8/d29/d4e/f135 [90104,27225] 0 2024-04-27T07:33:33.501 INFO:tasks.workunit.client.1.smithi100.stdout:0/416: creat d1/d8/d14/d59/f8f x:0 0 0 2024-04-27T07:33:33.502 INFO:tasks.workunit.client.0.smithi082.stdout:8/817: dwrite d0/d2b/d80/fff [0,4194304] 0 2024-04-27T07:33:33.505 INFO:tasks.workunit.client.0.smithi082.stdout:6/882: dread d2/d2d/d4a/de4/dcc/f83 [0,4194304] 0 2024-04-27T07:33:33.507 INFO:tasks.workunit.client.0.smithi082.stdout:5/984: chown d8/c17 29902007 1 2024-04-27T07:33:33.510 INFO:tasks.workunit.client.0.smithi082.stdout:7/890: write d3/d49/d97/d3a/d2a/dac/dae/dce/de4/ffa [1330872,27019] 0 2024-04-27T07:33:33.515 INFO:tasks.workunit.client.0.smithi082.stdout:8/818: creat d0/d2b/d9a/f10b x:0 0 0 2024-04-27T07:33:33.517 INFO:tasks.workunit.client.0.smithi082.stdout:7/891: unlink d3/d49/d97/d3a/d71/da0/fa6 0 2024-04-27T07:33:33.517 INFO:tasks.workunit.client.0.smithi082.stdout:9/775: dread d9/da/f67 [0,4194304] 0 2024-04-27T07:33:33.518 INFO:tasks.workunit.client.0.smithi082.stdout:1/820: dwrite d4/d15/d49/dab/dc3/d3e/f40 [0,4194304] 0 2024-04-27T07:33:33.519 INFO:tasks.workunit.client.0.smithi082.stdout:6/883: link d2/d2d/d4a/de4/dcc/l1a d2/l12a 0 2024-04-27T07:33:33.521 INFO:tasks.workunit.client.0.smithi082.stdout:7/892: rmdir d3/d49/d97/d3a/d2a 39 2024-04-27T07:33:33.523 INFO:tasks.workunit.client.0.smithi082.stdout:7/893: truncate d3/dfb/f64 1648197 0 2024-04-27T07:33:33.523 INFO:tasks.workunit.client.0.smithi082.stdout:7/894: readlink d3/d9/d7c/lca 0 2024-04-27T07:33:33.524 INFO:tasks.workunit.client.0.smithi082.stdout:9/776: symlink d9/da/db0/l108 0 2024-04-27T07:33:33.527 INFO:tasks.workunit.client.0.smithi082.stdout:8/819: rename d0/d2b/d80/dca/de6/d1c/d76/da0/fb3 to d0/d2b/d80/dca/dec/f10c 0 2024-04-27T07:33:33.528 INFO:tasks.workunit.client.0.smithi082.stdout:5/985: write d8/d15/f24 [875472,3175] 0 2024-04-27T07:33:33.529 INFO:tasks.workunit.client.0.smithi082.stdout:9/777: mknod d9/da/dc/d73/c109 0 2024-04-27T07:33:33.530 INFO:tasks.workunit.client.1.smithi100.stdout:3/483: dread d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:33.531 INFO:tasks.workunit.client.0.smithi082.stdout:6/884: mkdir d2/d2d/d4a/de4/dcc/d12b 0 2024-04-27T07:33:33.531 INFO:tasks.workunit.client.1.smithi100.stdout:3/484: creat d7/d9/d10/d33/d90/d3a/f94 x:0 0 0 2024-04-27T07:33:33.536 INFO:tasks.workunit.client.0.smithi082.stdout:9/778: dwrite d9/da/dc/d88/fd1 [0,4194304] 0 2024-04-27T07:33:33.537 INFO:tasks.workunit.client.0.smithi082.stdout:5/986: creat d8/d29/dea/d5f/df6/dfd/d102/d10e/f142 x:0 0 0 2024-04-27T07:33:33.538 INFO:tasks.workunit.client.0.smithi082.stdout:6/885: symlink d2/d3/d9c/l12c 0 2024-04-27T07:33:33.538 INFO:tasks.workunit.client.0.smithi082.stdout:5/987: write f5 [480277,114276] 0 2024-04-27T07:33:33.540 INFO:tasks.workunit.client.0.smithi082.stdout:6/886: read d2/d1e/ffc [1602584,93972] 0 2024-04-27T07:33:33.544 INFO:tasks.workunit.client.0.smithi082.stdout:1/821: link d4/la4 d4/d15/d49/d99/de8/l11c 0 2024-04-27T07:33:33.547 INFO:tasks.workunit.client.0.smithi082.stdout:9/779: rmdir d9/da/dc/d35/d38/dc5/db8 39 2024-04-27T07:33:33.549 INFO:tasks.workunit.client.0.smithi082.stdout:5/988: rmdir d8/d29/dea/d5f/df6/dfd/d102 39 2024-04-27T07:33:33.550 INFO:tasks.workunit.client.1.smithi100.stdout:2/432: sync 2024-04-27T07:33:33.551 INFO:tasks.workunit.client.0.smithi082.stdout:5/989: write d8/d15/f24 [2215575,8340] 0 2024-04-27T07:33:33.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/820: dwrite d0/d2b/d80/dca/de6/d1b/d29/d65/fa2 [0,4194304] 0 2024-04-27T07:33:33.554 INFO:tasks.workunit.client.0.smithi082.stdout:1/822: stat d4/d15/d1c/l11a 0 2024-04-27T07:33:33.554 INFO:tasks.workunit.client.0.smithi082.stdout:5/990: dread d8/d42/f10c [0,4194304] 0 2024-04-27T07:33:33.554 INFO:tasks.workunit.client.0.smithi082.stdout:9/780: mknod d9/da/dc/d88/c10a 0 2024-04-27T07:33:33.557 INFO:tasks.workunit.client.0.smithi082.stdout:9/781: write d9/da/dc/d35/d4a/d50/f102 [882276,41752] 0 2024-04-27T07:33:33.558 INFO:tasks.workunit.client.0.smithi082.stdout:9/782: dread - d9/da/dc/d35/d4a/f104 zero size 2024-04-27T07:33:33.560 INFO:tasks.workunit.client.0.smithi082.stdout:6/887: creat d2/d1e/d32/f12d x:0 0 0 2024-04-27T07:33:33.560 INFO:tasks.workunit.client.0.smithi082.stdout:6/888: readlink d2/d2d/d4a/lf2 0 2024-04-27T07:33:33.562 INFO:tasks.workunit.client.0.smithi082.stdout:9/783: write d9/da/f67 [886958,74018] 0 2024-04-27T07:33:33.566 INFO:tasks.workunit.client.0.smithi082.stdout:8/821: rmdir d0/d2b/d9a/d10a 0 2024-04-27T07:33:33.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/889: rename d2/d2d/d4a/de4/dcc/d13/c71 to d2/d1e/d80/df5/c12e 0 2024-04-27T07:33:33.567 INFO:tasks.workunit.client.0.smithi082.stdout:8/822: symlink d0/d2b/d80/dca/de6/d1c/l10d 0 2024-04-27T07:33:33.568 INFO:tasks.workunit.client.0.smithi082.stdout:9/784: mknod d9/da/dc/d33/d103/c10b 0 2024-04-27T07:33:33.570 INFO:tasks.workunit.client.0.smithi082.stdout:6/890: dread d2/d2d/d4a/de4/dcc/f83 [0,4194304] 0 2024-04-27T07:33:33.571 INFO:tasks.workunit.client.0.smithi082.stdout:9/785: creat d9/d2d/d2b/d46/d5d/da7/f10c x:0 0 0 2024-04-27T07:33:33.572 INFO:tasks.workunit.client.0.smithi082.stdout:8/823: truncate d0/d2b/d80/dca/de6/f1d 3598122 0 2024-04-27T07:33:33.573 INFO:tasks.workunit.client.0.smithi082.stdout:8/824: chown d0/d2b/d80/dca/de6/d55/caa 1 1 2024-04-27T07:33:33.573 INFO:tasks.workunit.client.0.smithi082.stdout:6/891: mknod d2/d2e/d55/c12f 0 2024-04-27T07:33:33.574 INFO:tasks.workunit.client.0.smithi082.stdout:9/786: creat d9/da/dc/f10d x:0 0 0 2024-04-27T07:33:33.576 INFO:tasks.workunit.client.0.smithi082.stdout:6/892: truncate d2/d2d/d3d/fbb 97768 0 2024-04-27T07:33:33.576 INFO:tasks.workunit.client.0.smithi082.stdout:9/787: readlink d9/da/dc/d35/d4a/l105 0 2024-04-27T07:33:33.577 INFO:tasks.workunit.client.1.smithi100.stdout:3/485: write d7/d9/d10/d33/d90/f34 [1337717,119370] 0 2024-04-27T07:33:33.579 INFO:tasks.workunit.client.0.smithi082.stdout:1/823: dread d4/d15/d49/dab/dc3/d3e/d57/d101/f106 [0,4194304] 0 2024-04-27T07:33:33.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/788: truncate d9/d2d/d72/f9c 1494123 0 2024-04-27T07:33:33.580 INFO:tasks.workunit.client.0.smithi082.stdout:9/789: dread - d9/da/dc/d35/d38/fe1 zero size 2024-04-27T07:33:33.580 INFO:tasks.workunit.client.0.smithi082.stdout:6/893: rename d2/d1e/f11f to d2/d3/d9c/f130 0 2024-04-27T07:33:33.582 INFO:tasks.workunit.client.0.smithi082.stdout:6/894: truncate d2/f60 8884715 0 2024-04-27T07:33:33.582 INFO:tasks.workunit.client.1.smithi100.stdout:3/486: dread d7/d9/d26/d2a/f82 [0,4194304] 0 2024-04-27T07:33:33.583 INFO:tasks.workunit.client.1.smithi100.stdout:3/487: stat d7/d9/d10/d33/l83 0 2024-04-27T07:33:33.584 INFO:tasks.workunit.client.0.smithi082.stdout:9/790: creat d9/d2d/d2b/d46/d76/dcb/f10e x:0 0 0 2024-04-27T07:33:33.584 INFO:tasks.workunit.client.1.smithi100.stdout:2/433: write d0/d1e/f7c [930535,116393] 0 2024-04-27T07:33:33.584 INFO:tasks.workunit.client.0.smithi082.stdout:6/895: read - d2/d1e/d80/df5/d129/f10f zero size 2024-04-27T07:33:33.585 INFO:tasks.workunit.client.1.smithi100.stdout:3/488: symlink d7/d9/d26/d6c/l95 0 2024-04-27T07:33:33.586 INFO:tasks.workunit.client.0.smithi082.stdout:1/824: dwrite d4/fd [4194304,4194304] 0 2024-04-27T07:33:33.587 INFO:tasks.workunit.client.1.smithi100.stdout:2/434: mkdir d0/da/d29/d47/d8f 0 2024-04-27T07:33:33.587 INFO:tasks.workunit.client.0.smithi082.stdout:1/825: chown d4/d15/d49/l88 13347 1 2024-04-27T07:33:33.589 INFO:tasks.workunit.client.1.smithi100.stdout:2/435: symlink d0/da/d3a/l90 0 2024-04-27T07:33:33.590 INFO:tasks.workunit.client.0.smithi082.stdout:9/791: dread d9/da/d85/ff2 [0,4194304] 0 2024-04-27T07:33:33.591 INFO:tasks.workunit.client.0.smithi082.stdout:6/896: symlink d2/d2d/d3d/de7/l131 0 2024-04-27T07:33:33.592 INFO:tasks.workunit.client.1.smithi100.stdout:2/436: creat d0/da/d29/d47/f91 x:0 0 0 2024-04-27T07:33:33.594 INFO:tasks.workunit.client.1.smithi100.stdout:2/437: chown d0/da/d29/d47/d5a/d8d/d5d/f5f 1650395 1 2024-04-27T07:33:33.594 INFO:tasks.workunit.client.0.smithi082.stdout:1/826: creat d4/d15/d49/d99/d9a/dc7/f11d x:0 0 0 2024-04-27T07:33:33.596 INFO:tasks.workunit.client.0.smithi082.stdout:8/825: truncate d0/d2b/d80/dca/de6/d1c/f7d 910320 0 2024-04-27T07:33:33.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/792: dwrite d9/da/dc/d35/d4a/d50/f102 [0,4194304] 0 2024-04-27T07:33:33.598 INFO:tasks.workunit.client.0.smithi082.stdout:9/793: chown d9/d48/dd6 12 1 2024-04-27T07:33:33.600 INFO:tasks.workunit.client.0.smithi082.stdout:1/827: read d4/f11 [339673,71965] 0 2024-04-27T07:33:33.600 INFO:tasks.workunit.client.0.smithi082.stdout:6/897: creat d2/f132 x:0 0 0 2024-04-27T07:33:33.602 INFO:tasks.workunit.client.0.smithi082.stdout:8/826: unlink d0/d2b/d80/dca/de6/d87/d46/fb4 0 2024-04-27T07:33:33.606 INFO:tasks.workunit.client.0.smithi082.stdout:6/898: symlink d2/d2d/d4a/de4/dcc/d77/dca/dd6/l133 0 2024-04-27T07:33:33.607 INFO:tasks.workunit.client.0.smithi082.stdout:9/794: mkdir d9/da/dc/d35/d38/dc5/db8/d10f 0 2024-04-27T07:33:33.609 INFO:tasks.workunit.client.1.smithi100.stdout:2/438: truncate d0/f11 2232557 0 2024-04-27T07:33:33.610 INFO:tasks.workunit.client.0.smithi082.stdout:8/827: link d0/d2b/d9a/fd0 d0/d2b/d6f/f10e 0 2024-04-27T07:33:33.610 INFO:tasks.workunit.client.0.smithi082.stdout:9/795: symlink d9/da/d85/l110 0 2024-04-27T07:33:33.611 INFO:tasks.workunit.client.0.smithi082.stdout:6/899: getdents d2/d2e/d106 0 2024-04-27T07:33:33.612 INFO:tasks.workunit.client.0.smithi082.stdout:8/828: dread d0/d2b/d80/dca/de6/d87/fee [0,4194304] 0 2024-04-27T07:33:33.612 INFO:tasks.workunit.client.0.smithi082.stdout:9/796: mknod d9/d2d/d2b/c111 0 2024-04-27T07:33:33.612 INFO:tasks.workunit.client.1.smithi100.stdout:2/439: dread d0/f12 [0,4194304] 0 2024-04-27T07:33:33.613 INFO:tasks.workunit.client.1.smithi100.stdout:3/489: dread d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:33.614 INFO:tasks.workunit.client.1.smithi100.stdout:3/490: readlink d7/d9/d26/d2a/l25 0 2024-04-27T07:33:33.615 INFO:tasks.workunit.client.0.smithi082.stdout:8/829: mkdir d0/d2b/d80/dca/d105/d10f 0 2024-04-27T07:33:33.615 INFO:tasks.workunit.client.1.smithi100.stdout:3/491: readlink d7/d9/l84 0 2024-04-27T07:33:33.616 INFO:tasks.workunit.client.0.smithi082.stdout:8/830: chown d0/d2b/d80/dca/de6/d1c 1 1 2024-04-27T07:33:33.616 INFO:tasks.workunit.client.0.smithi082.stdout:9/797: unlink d9/da/dc/db1/cd2 0 2024-04-27T07:33:33.616 INFO:tasks.workunit.client.1.smithi100.stdout:3/492: rename d7/d9/d2f/d8a to d7/d9/d2f/d8a/d96 22 2024-04-27T07:33:33.616 INFO:tasks.workunit.client.1.smithi100.stdout:2/440: symlink d0/da/d29/d47/d5a/d8d/l92 0 2024-04-27T07:33:33.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/493: rename d7/d9/d10/f3d to d7/d9/d10/d33/d47/f97 0 2024-04-27T07:33:33.620 INFO:tasks.workunit.client.0.smithi082.stdout:9/798: symlink d9/da/dc/d35/d4a/l112 0 2024-04-27T07:33:33.620 INFO:tasks.workunit.client.0.smithi082.stdout:9/799: chown d9/da/db0/l108 144382560 1 2024-04-27T07:33:33.620 INFO:tasks.workunit.client.1.smithi100.stdout:2/441: symlink d0/da/d39/l93 0 2024-04-27T07:33:33.621 INFO:tasks.workunit.client.0.smithi082.stdout:9/800: dread - d9/d48/dd6/ff9 zero size 2024-04-27T07:33:33.621 INFO:tasks.workunit.client.0.smithi082.stdout:9/801: dread - d9/d2d/f57 zero size 2024-04-27T07:33:33.623 INFO:tasks.workunit.client.1.smithi100.stdout:3/494: dread d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:33.623 INFO:tasks.workunit.client.0.smithi082.stdout:9/802: creat d9/d2d/d2b/d46/d5d/da7/f113 x:0 0 0 2024-04-27T07:33:33.625 INFO:tasks.workunit.client.1.smithi100.stdout:2/442: getdents d0/da/d75 0 2024-04-27T07:33:33.625 INFO:tasks.workunit.client.0.smithi082.stdout:9/803: creat d9/d48/dd6/f114 x:0 0 0 2024-04-27T07:33:33.627 INFO:tasks.workunit.client.1.smithi100.stdout:3/495: rename d7/d9/d26/d45/d8b to d7/d9/d26/d2a/d5e/d98 0 2024-04-27T07:33:33.628 INFO:tasks.workunit.client.1.smithi100.stdout:3/496: fdatasync d7/d9/f51 0 2024-04-27T07:33:33.629 INFO:tasks.workunit.client.1.smithi100.stdout:2/443: chown d0/l2b 676639078 1 2024-04-27T07:33:33.630 INFO:tasks.workunit.client.1.smithi100.stdout:3/497: truncate d7/d9/f21 642190 0 2024-04-27T07:33:33.630 INFO:tasks.workunit.client.1.smithi100.stdout:2/444: fdatasync d0/da/d29/f23 0 2024-04-27T07:33:33.631 INFO:tasks.workunit.client.1.smithi100.stdout:2/445: fsync d0/da/d3a/f6f 0 2024-04-27T07:33:33.632 INFO:tasks.workunit.client.1.smithi100.stdout:2/446: write d0/d1e/d51/f52 [4262140,104818] 0 2024-04-27T07:33:33.633 INFO:tasks.workunit.client.0.smithi082.stdout:8/831: truncate d0/d2b/f81 414989 0 2024-04-27T07:33:33.634 INFO:tasks.workunit.client.0.smithi082.stdout:8/832: unlink d0/lb 0 2024-04-27T07:33:33.635 INFO:tasks.workunit.client.1.smithi100.stdout:3/498: dread d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:33.636 INFO:tasks.workunit.client.1.smithi100.stdout:2/447: dread d0/da/d29/d47/d5a/d8d/d5d/f5f [0,4194304] 0 2024-04-27T07:33:33.636 INFO:tasks.workunit.client.0.smithi082.stdout:8/833: symlink d0/d2b/d80/dca/l110 0 2024-04-27T07:33:33.637 INFO:tasks.workunit.client.0.smithi082.stdout:9/804: write d9/da/dc/d33/d5e/faa [689501,80659] 0 2024-04-27T07:33:33.639 INFO:tasks.workunit.client.0.smithi082.stdout:8/834: creat d0/d2b/d9a/da4/f111 x:0 0 0 2024-04-27T07:33:33.641 INFO:tasks.workunit.client.0.smithi082.stdout:9/805: creat d9/da/dc/d33/f115 x:0 0 0 2024-04-27T07:33:33.641 INFO:tasks.workunit.client.1.smithi100.stdout:2/448: mkdir d0/d79/d94 0 2024-04-27T07:33:33.642 INFO:tasks.workunit.client.1.smithi100.stdout:2/449: chown d0/da/lc 22542 1 2024-04-27T07:33:33.644 INFO:tasks.workunit.client.1.smithi100.stdout:3/499: getdents d7/d9/d26/d6c 0 2024-04-27T07:33:33.646 INFO:tasks.workunit.client.1.smithi100.stdout:3/500: fsync d7/d9/d10/d33/f41 0 2024-04-27T07:33:33.647 INFO:tasks.workunit.client.1.smithi100.stdout:2/450: symlink d0/da/d29/d47/l95 0 2024-04-27T07:33:33.649 INFO:tasks.workunit.client.0.smithi082.stdout:9/806: dread d9/da/dc/d33/f47 [0,4194304] 0 2024-04-27T07:33:33.649 INFO:tasks.workunit.client.1.smithi100.stdout:2/451: write d0/da/f1c [1957284,45044] 0 2024-04-27T07:33:33.651 INFO:tasks.workunit.client.1.smithi100.stdout:3/501: rename d7/d9/d26/d6c/f8c to d7/d9/d10/d33/d90/f99 0 2024-04-27T07:33:33.654 INFO:tasks.workunit.client.1.smithi100.stdout:2/452: creat d0/da/d29/d47/d5a/d8d/d5d/f96 x:0 0 0 2024-04-27T07:33:33.655 INFO:tasks.workunit.client.0.smithi082.stdout:9/807: dwrite d9/da/dc/f20 [0,4194304] 0 2024-04-27T07:33:33.655 INFO:tasks.workunit.client.1.smithi100.stdout:3/502: creat d7/d9/d10/d22/f9a x:0 0 0 2024-04-27T07:33:33.655 INFO:tasks.workunit.client.1.smithi100.stdout:2/453: dread - d0/da/d29/f8e zero size 2024-04-27T07:33:33.656 INFO:tasks.workunit.client.1.smithi100.stdout:3/503: truncate d7/d9/d26/d2a/f87 236946 0 2024-04-27T07:33:33.657 INFO:tasks.workunit.client.0.smithi082.stdout:8/835: dread d0/d2b/f4c [8388608,4194304] 0 2024-04-27T07:33:33.657 INFO:tasks.workunit.client.1.smithi100.stdout:2/454: creat d0/d1e/d51/f97 x:0 0 0 2024-04-27T07:33:33.658 INFO:tasks.workunit.client.1.smithi100.stdout:2/455: chown d0/da/d3a/f48 6684247 1 2024-04-27T07:33:33.659 INFO:tasks.workunit.client.0.smithi082.stdout:9/808: getdents d9/d2d/d2b/d46/db6 0 2024-04-27T07:33:33.659 INFO:tasks.workunit.client.1.smithi100.stdout:2/456: write d0/da/d29/f23 [1068909,6502] 0 2024-04-27T07:33:33.659 INFO:tasks.workunit.client.0.smithi082.stdout:8/836: mknod d0/d2b/d9a/da4/d35/c112 0 2024-04-27T07:33:33.661 INFO:tasks.workunit.client.0.smithi082.stdout:9/809: symlink d9/da/dc/d35/l116 0 2024-04-27T07:33:33.662 INFO:tasks.workunit.client.1.smithi100.stdout:3/504: rename d7/d9/d10/d33/d90/l8f to d7/d9/d10/d3e/d74/l9b 0 2024-04-27T07:33:33.662 INFO:tasks.workunit.client.0.smithi082.stdout:8/837: symlink d0/d2b/d80/dca/d105/d10f/l113 0 2024-04-27T07:33:33.663 INFO:tasks.workunit.client.0.smithi082.stdout:9/810: readlink d9/da/dc/d35/d38/da5/leb 0 2024-04-27T07:33:33.663 INFO:tasks.workunit.client.1.smithi100.stdout:2/457: mkdir d0/da/d29/d47/d5a/d8d/d3e/d98 0 2024-04-27T07:33:33.665 INFO:tasks.workunit.client.0.smithi082.stdout:9/811: mkdir d9/da/dc/d35/d38/d65/d117 0 2024-04-27T07:33:33.666 INFO:tasks.workunit.client.1.smithi100.stdout:2/458: symlink d0/da/d29/d47/d5a/d82/l99 0 2024-04-27T07:33:33.669 INFO:tasks.workunit.client.1.smithi100.stdout:3/505: dwrite d7/d9/d10/d22/f9a [0,4194304] 0 2024-04-27T07:33:33.673 INFO:tasks.workunit.client.0.smithi082.stdout:8/838: dwrite d0/d2b/d6f/fd4 [0,4194304] 0 2024-04-27T07:33:33.674 INFO:tasks.workunit.client.1.smithi100.stdout:3/506: unlink d7/d9/d10/d33/d47/f97 0 2024-04-27T07:33:33.678 INFO:tasks.workunit.client.0.smithi082.stdout:9/812: read d9/f51 [3599046,130563] 0 2024-04-27T07:33:33.678 INFO:tasks.workunit.client.0.smithi082.stdout:4/963: sync 2024-04-27T07:33:33.679 INFO:tasks.workunit.client.1.smithi100.stdout:3/507: creat d7/d9/d10/f9c x:0 0 0 2024-04-27T07:33:33.679 INFO:tasks.workunit.client.0.smithi082.stdout:4/964: chown d3/d10/d9c/cdc 32021396 1 2024-04-27T07:33:33.679 INFO:tasks.workunit.client.0.smithi082.stdout:9/813: truncate d9/d2d/d72/f9c 1696498 0 2024-04-27T07:33:33.681 INFO:tasks.workunit.client.0.smithi082.stdout:9/814: read d9/da/dc/d33/d5e/faa [359246,112201] 0 2024-04-27T07:33:33.682 INFO:tasks.workunit.client.1.smithi100.stdout:3/508: getdents d7/d9/d2f/d8a 0 2024-04-27T07:33:33.683 INFO:tasks.workunit.client.1.smithi100.stdout:3/509: write d7/d9/d26/d6c/f80 [4241437,73562] 0 2024-04-27T07:33:33.687 INFO:tasks.workunit.client.1.smithi100.stdout:2/459: truncate d0/da/f28 4161541 0 2024-04-27T07:33:33.688 INFO:tasks.workunit.client.1.smithi100.stdout:3/510: rmdir d7/d9/d2f/d8a 0 2024-04-27T07:33:33.691 INFO:tasks.workunit.client.0.smithi082.stdout:8/839: unlink d0/d2b/d80/dca/de6/d87/d42/d7f/dac/f100 0 2024-04-27T07:33:33.691 INFO:tasks.workunit.client.1.smithi100.stdout:2/460: link d0/da/d29/f23 d0/da/d29/d47/d87/f9a 0 2024-04-27T07:33:33.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/815: chown d9/da/dc/d35/d38/c54 0 1 2024-04-27T07:33:33.693 INFO:tasks.workunit.client.1.smithi100.stdout:3/511: rename d7/d9/d26/d6c to d7/d9/d10/d22/d7e/d9d 0 2024-04-27T07:33:33.694 INFO:tasks.workunit.client.0.smithi082.stdout:4/965: mkdir d3/d10/d13c 0 2024-04-27T07:33:33.694 INFO:tasks.workunit.client.1.smithi100.stdout:8/377: sync 2024-04-27T07:33:33.694 INFO:tasks.workunit.client.1.smithi100.stdout:6/400: sync 2024-04-27T07:33:33.695 INFO:tasks.workunit.client.1.smithi100.stdout:7/333: sync 2024-04-27T07:33:33.695 INFO:tasks.workunit.client.1.smithi100.stdout:4/449: sync 2024-04-27T07:33:33.696 INFO:tasks.workunit.client.1.smithi100.stdout:7/334: truncate d1/dd/f47 5235816 0 2024-04-27T07:33:33.697 INFO:tasks.workunit.client.1.smithi100.stdout:6/401: fsync de/d58/d28/f47 0 2024-04-27T07:33:33.702 INFO:tasks.workunit.client.1.smithi100.stdout:4/450: dwrite d5/d16/d19/d21/d2b/f58 [4194304,4194304] 0 2024-04-27T07:33:33.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/840: mknod d0/d2b/d80/dca/de6/d1c/dc7/c114 0 2024-04-27T07:33:33.706 INFO:tasks.workunit.client.1.smithi100.stdout:6/402: creat de/d58/d75/f8d x:0 0 0 2024-04-27T07:33:33.707 INFO:tasks.workunit.client.0.smithi082.stdout:4/966: symlink d3/d6/d26/d5e/l13d 0 2024-04-27T07:33:33.708 INFO:tasks.workunit.client.0.smithi082.stdout:8/841: mkdir d0/d2b/d80/dca/de6/d87/d46/d4e/d115 0 2024-04-27T07:33:33.709 INFO:tasks.workunit.client.0.smithi082.stdout:9/816: getdents d9/da/dc/db1 0 2024-04-27T07:33:33.709 INFO:tasks.workunit.client.1.smithi100.stdout:6/403: write fd [1033759,107344] 0 2024-04-27T07:33:33.710 INFO:tasks.workunit.client.1.smithi100.stdout:8/378: mkdir d6/d20/d50/d72 0 2024-04-27T07:33:33.711 INFO:tasks.workunit.client.1.smithi100.stdout:4/451: creat d5/d23/d33/f9d x:0 0 0 2024-04-27T07:33:33.711 INFO:tasks.workunit.client.1.smithi100.stdout:6/404: read de/d58/d21/d24/f25 [376292,59265] 0 2024-04-27T07:33:33.712 INFO:tasks.workunit.client.0.smithi082.stdout:8/842: write d0/d2b/d80/dca/de6/d1b/f3c [4639878,102960] 0 2024-04-27T07:33:33.712 INFO:tasks.workunit.client.0.smithi082.stdout:8/843: chown d0/d2b/d80/dca/de6/fc1 9884234 1 2024-04-27T07:33:33.713 INFO:tasks.workunit.client.0.smithi082.stdout:4/967: rename d3/d6/d26/d55/l102 to d3/d10/l13e 0 2024-04-27T07:33:33.720 INFO:tasks.workunit.client.0.smithi082.stdout:4/968: getdents d3/d6/d26/d5e/d12c 0 2024-04-27T07:33:33.721 INFO:tasks.workunit.client.1.smithi100.stdout:8/379: dread d6/f7 [0,4194304] 0 2024-04-27T07:33:33.721 INFO:tasks.workunit.client.0.smithi082.stdout:4/969: stat d3/d10/d9c/cdd 0 2024-04-27T07:33:33.721 INFO:tasks.workunit.client.1.smithi100.stdout:3/512: truncate d7/d9/d26/d2a/f82 548063 0 2024-04-27T07:33:33.722 INFO:tasks.workunit.client.1.smithi100.stdout:3/513: fdatasync d7/d9/d10/d3e/f7c 0 2024-04-27T07:33:33.724 INFO:tasks.workunit.client.0.smithi082.stdout:4/970: fsync d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f106 0 2024-04-27T07:33:33.725 INFO:tasks.workunit.client.1.smithi100.stdout:4/452: write d5/d23/f42 [152113,18815] 0 2024-04-27T07:33:33.726 INFO:tasks.workunit.client.0.smithi082.stdout:4/971: mknod d3/d6/c13f 0 2024-04-27T07:33:33.727 INFO:tasks.workunit.client.1.smithi100.stdout:2/461: dread d0/d1e/f57 [0,4194304] 0 2024-04-27T07:33:33.727 INFO:tasks.workunit.client.1.smithi100.stdout:3/514: fdatasync d7/d9/d26/d2a/d5e/f72 0 2024-04-27T07:33:33.729 INFO:tasks.workunit.client.1.smithi100.stdout:4/453: symlink d5/d16/d4c/l9e 0 2024-04-27T07:33:33.731 INFO:tasks.workunit.client.1.smithi100.stdout:8/380: symlink d6/d4c/l73 0 2024-04-27T07:33:33.735 INFO:tasks.workunit.client.1.smithi100.stdout:4/454: mkdir d5/d16/d19/d21/d77/d94/d9f 0 2024-04-27T07:33:33.737 INFO:tasks.workunit.client.1.smithi100.stdout:8/381: dread - d6/f18 zero size 2024-04-27T07:33:33.737 INFO:tasks.workunit.client.0.smithi082.stdout:8/844: rmdir d0/d2b/d80/dca/de6 39 2024-04-27T07:33:33.738 INFO:tasks.workunit.client.1.smithi100.stdout:6/405: dwrite f7 [0,4194304] 0 2024-04-27T07:33:33.742 INFO:tasks.workunit.client.1.smithi100.stdout:4/455: chown d5/d16/l4e 737469900 1 2024-04-27T07:33:33.743 INFO:tasks.workunit.client.1.smithi100.stdout:8/382: creat d6/d20/d50/f74 x:0 0 0 2024-04-27T07:33:33.744 INFO:tasks.workunit.client.1.smithi100.stdout:6/406: symlink de/d58/d21/d23/l8e 0 2024-04-27T07:33:33.745 INFO:tasks.workunit.client.0.smithi082.stdout:9/817: dwrite d9/da/dc/d35/d38/f107 [0,4194304] 0 2024-04-27T07:33:33.746 INFO:tasks.workunit.client.0.smithi082.stdout:9/818: chown d9/d2d/f59 1947 1 2024-04-27T07:33:33.747 INFO:tasks.workunit.client.1.smithi100.stdout:4/456: rename d5/d16/d19/d21/d2b/c9c to d5/d23/d33/ca0 0 2024-04-27T07:33:33.748 INFO:tasks.workunit.client.0.smithi082.stdout:9/819: write d9/da/f67 [3707230,21830] 0 2024-04-27T07:33:33.749 INFO:tasks.workunit.client.0.smithi082.stdout:8/845: link d0/d2b/d80/dca/de6/d87/d71/ffd d0/d2b/d80/dca/de6/d1c/d76/da0/df9/df5/f116 0 2024-04-27T07:33:33.752 INFO:tasks.workunit.client.0.smithi082.stdout:8/846: rmdir d0/d2b/d80/dca/de6/d1c/d76/da0 39 2024-04-27T07:33:33.752 INFO:tasks.workunit.client.1.smithi100.stdout:6/407: rename de/d58/d28/f79 to de/d58/d75/f8f 0 2024-04-27T07:33:33.752 INFO:tasks.workunit.client.1.smithi100.stdout:4/457: truncate d5/d16/d19/d46/d53/f8e 120262 0 2024-04-27T07:33:33.752 INFO:tasks.workunit.client.1.smithi100.stdout:3/515: truncate d7/d9/d10/d33/d47/f4f 1862355 0 2024-04-27T07:33:33.754 INFO:tasks.workunit.client.1.smithi100.stdout:2/462: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-27T07:33:33.754 INFO:tasks.workunit.client.0.smithi082.stdout:9/820: dwrite d9/da/dc/d88/fd1 [0,4194304] 0 2024-04-27T07:33:33.759 INFO:tasks.workunit.client.1.smithi100.stdout:8/383: mkdir d6/d1b/d75 0 2024-04-27T07:33:33.761 INFO:tasks.workunit.client.1.smithi100.stdout:2/463: creat d0/da/d75/f9b x:0 0 0 2024-04-27T07:33:33.763 INFO:tasks.workunit.client.1.smithi100.stdout:8/384: write d6/d20/d2a/f3c [1973578,28963] 0 2024-04-27T07:33:33.764 INFO:tasks.workunit.client.1.smithi100.stdout:3/516: dwrite d7/d9/d26/f38 [0,4194304] 0 2024-04-27T07:33:33.770 INFO:tasks.workunit.client.1.smithi100.stdout:4/458: rename d5/d16/d19/d21/f3a to d5/d16/fa1 0 2024-04-27T07:33:33.771 INFO:tasks.workunit.client.1.smithi100.stdout:8/385: dread d6/d1b/d1d/d59/f56 [0,4194304] 0 2024-04-27T07:33:33.774 INFO:tasks.workunit.client.1.smithi100.stdout:3/517: creat d7/f9e x:0 0 0 2024-04-27T07:33:33.775 INFO:tasks.workunit.client.1.smithi100.stdout:4/459: symlink d5/d1b/d2c/la2 0 2024-04-27T07:33:33.779 INFO:tasks.workunit.client.1.smithi100.stdout:8/386: fdatasync d6/d20/d54/f5b 0 2024-04-27T07:33:33.782 INFO:tasks.workunit.client.1.smithi100.stdout:4/460: dwrite d5/f82 [0,4194304] 0 2024-04-27T07:33:33.783 INFO:tasks.workunit.client.1.smithi100.stdout:3/518: symlink d7/d9/d10/d3e/d91/l9f 0 2024-04-27T07:33:33.786 INFO:tasks.workunit.client.0.smithi082.stdout:8/847: write d0/d2b/d80/dca/de6/d1c/f7d [412024,50213] 0 2024-04-27T07:33:33.792 INFO:tasks.workunit.client.0.smithi082.stdout:8/848: dread d0/d2b/d6f/fd4 [0,4194304] 0 2024-04-27T07:33:33.793 INFO:tasks.workunit.client.0.smithi082.stdout:8/849: fdatasync d0/d2b/d80/dca/de6/d87/f28 0 2024-04-27T07:33:33.794 INFO:tasks.workunit.client.1.smithi100.stdout:8/387: dwrite d6/ff [4194304,4194304] 0 2024-04-27T07:33:33.794 INFO:tasks.workunit.client.1.smithi100.stdout:4/461: dwrite d5/d16/f93 [0,4194304] 0 2024-04-27T07:33:33.796 INFO:tasks.workunit.client.0.smithi082.stdout:8/850: unlink d0/d2b/d80/dca/de6/lbe 0 2024-04-27T07:33:33.796 INFO:tasks.workunit.client.1.smithi100.stdout:8/388: write d6/f18 [787277,3698] 0 2024-04-27T07:33:33.798 INFO:tasks.workunit.client.0.smithi082.stdout:8/851: creat d0/d2b/d6f/f117 x:0 0 0 2024-04-27T07:33:33.800 INFO:tasks.workunit.client.1.smithi100.stdout:6/408: dread de/d2e/f55 [0,4194304] 0 2024-04-27T07:33:33.804 INFO:tasks.workunit.client.1.smithi100.stdout:2/464: getdents d0/da/d75 0 2024-04-27T07:33:33.808 INFO:tasks.workunit.client.1.smithi100.stdout:6/409: mkdir de/d58/d90 0 2024-04-27T07:33:33.809 INFO:tasks.workunit.client.1.smithi100.stdout:8/389: dwrite d6/d1b/f2d [0,4194304] 0 2024-04-27T07:33:33.811 INFO:tasks.workunit.client.1.smithi100.stdout:2/465: mknod d0/da/d29/d47/d5a/c9c 0 2024-04-27T07:33:33.812 INFO:tasks.workunit.client.1.smithi100.stdout:3/519: dread d7/d9/d26/d2a/f20 [0,4194304] 0 2024-04-27T07:33:33.814 INFO:tasks.workunit.client.1.smithi100.stdout:8/390: mkdir d6/d20/d50/d76 0 2024-04-27T07:33:33.815 INFO:tasks.workunit.client.0.smithi082.stdout:8/852: write d0/d2b/d9a/da4/d35/f75 [1684356,111981] 0 2024-04-27T07:33:33.818 INFO:tasks.workunit.client.1.smithi100.stdout:6/410: mkdir de/d58/d21/d91 0 2024-04-27T07:33:33.820 INFO:tasks.workunit.client.1.smithi100.stdout:8/391: mkdir d6/d1b/d1d/d77 0 2024-04-27T07:33:33.821 INFO:tasks.workunit.client.1.smithi100.stdout:3/520: dwrite d7/d9/d10/d28/f52 [0,4194304] 0 2024-04-27T07:33:33.821 INFO:tasks.workunit.client.0.smithi082.stdout:8/853: rename d0/d2b/d80/dca/de6/d1c/d76/da0/df9/df5/f116 to d0/d2b/d80/dca/de6/d87/d46/d4e/d115/f118 0 2024-04-27T07:33:33.822 INFO:tasks.workunit.client.1.smithi100.stdout:6/411: symlink de/d58/d75/l92 0 2024-04-27T07:33:33.822 INFO:tasks.workunit.client.0.smithi082.stdout:8/854: creat d0/d2b/d9a/da4/f119 x:0 0 0 2024-04-27T07:33:33.824 INFO:tasks.workunit.client.1.smithi100.stdout:8/392: truncate d6/f27 5079197 0 2024-04-27T07:33:33.824 INFO:tasks.workunit.client.1.smithi100.stdout:8/393: stat d6/d20/d50/l6c 0 2024-04-27T07:33:33.825 INFO:tasks.workunit.client.0.smithi082.stdout:8/855: creat d0/d2b/d80/dca/de6/d87/d42/d7f/d82/f11a x:0 0 0 2024-04-27T07:33:33.827 INFO:tasks.workunit.client.0.smithi082.stdout:8/856: mkdir d0/d2b/d80/dca/de6/d1b/d29/d6a/d11b 0 2024-04-27T07:33:33.828 INFO:tasks.workunit.client.0.smithi082.stdout:8/857: rmdir d0/d2b/d80/dca/de6/d1c/d76/da0 39 2024-04-27T07:33:33.829 INFO:tasks.workunit.client.0.smithi082.stdout:8/858: write d0/d2b/d80/dca/de6/d1b/d29/f9e [7417769,31026] 0 2024-04-27T07:33:33.837 INFO:tasks.workunit.client.1.smithi100.stdout:5/350: sync 2024-04-27T07:33:33.839 INFO:tasks.workunit.client.1.smithi100.stdout:9/382: sync 2024-04-27T07:33:33.839 INFO:tasks.workunit.client.1.smithi100.stdout:3/521: creat d7/d9/d10/d3e/d91/fa0 x:0 0 0 2024-04-27T07:33:33.842 INFO:tasks.workunit.client.1.smithi100.stdout:4/462: dread d5/fe [0,4194304] 0 2024-04-27T07:33:33.842 INFO:tasks.workunit.client.1.smithi100.stdout:6/412: unlink de/d58/d28/l65 0 2024-04-27T07:33:33.843 INFO:tasks.workunit.client.1.smithi100.stdout:5/351: rmdir d0/d4/d21/d24/d2f/d39 39 2024-04-27T07:33:33.843 INFO:tasks.workunit.client.1.smithi100.stdout:3/522: rmdir d7/d9/d26 39 2024-04-27T07:33:33.844 INFO:tasks.workunit.client.1.smithi100.stdout:9/383: fdatasync d1/d9/db/d2b/d31/f63 0 2024-04-27T07:33:33.846 INFO:tasks.workunit.client.1.smithi100.stdout:6/413: unlink de/d2e/f3b 0 2024-04-27T07:33:33.847 INFO:tasks.workunit.client.0.smithi082.stdout:8/859: dwrite d0/d2b/d80/dca/de6/d87/d42/d7f/d82/f8c [0,4194304] 0 2024-04-27T07:33:33.851 INFO:tasks.workunit.client.0.smithi082.stdout:8/860: mkdir d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/d11c 0 2024-04-27T07:33:33.851 INFO:tasks.workunit.client.0.smithi082.stdout:2/856: sync 2024-04-27T07:33:33.852 INFO:tasks.workunit.client.1.smithi100.stdout:9/384: symlink d1/d9/d1f/d4a/d67/l8d 0 2024-04-27T07:33:33.853 INFO:tasks.workunit.client.1.smithi100.stdout:4/463: mknod d5/d1b/d2c/d7d/d8a/ca3 0 2024-04-27T07:33:33.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/857: truncate d7/d8/d13/fb8 1548840 0 2024-04-27T07:33:33.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/861: mkdir d0/d2b/d80/dca/de6/d1c/d76/da0/d11d 0 2024-04-27T07:33:33.856 INFO:tasks.workunit.client.0.smithi082.stdout:8/862: mkdir d0/d2b/d80/dca/de6/d1c/d76/d11e 0 2024-04-27T07:33:33.927 INFO:tasks.workunit.client.0.smithi082.stdout:8/863: rename d0/d2b/d80/dca/de6/d1c/d76/da0/df9 to d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/d11c/d11f 22 2024-04-27T07:33:33.927 INFO:tasks.workunit.client.0.smithi082.stdout:8/864: rmdir d0/d2b/d80/dca/de6/d1b/d29/d65/de3 0 2024-04-27T07:33:33.928 INFO:tasks.workunit.client.0.smithi082.stdout:2/858: dread d7/d30/d61/f85 [0,4194304] 0 2024-04-27T07:33:33.928 INFO:tasks.workunit.client.0.smithi082.stdout:2/859: write d7/d8/d13/fb5 [260716,114659] 0 2024-04-27T07:33:33.928 INFO:tasks.workunit.client.0.smithi082.stdout:8/865: dwrite d0/d2b/d80/dca/de6/f1d [0,4194304] 0 2024-04-27T07:33:33.928 INFO:tasks.workunit.client.0.smithi082.stdout:8/866: fdatasync d0/d83/fc4 0 2024-04-27T07:33:33.928 INFO:tasks.workunit.client.0.smithi082.stdout:2/860: dwrite d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:33.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/861: fsync d7/d8/d13/f4b 0 2024-04-27T07:33:33.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/862: readlink d7/d9/d4f/d6e/d82/lc5 0 2024-04-27T07:33:33.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/863: mkdir d7/d14/d11a 0 2024-04-27T07:33:33.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/864: chown d7/d9/d4f/d66/dd6/le1 7 1 2024-04-27T07:33:33.930 INFO:tasks.workunit.client.0.smithi082.stdout:8/867: write d0/d83/f95 [113279,88520] 0 2024-04-27T07:33:33.930 INFO:tasks.workunit.client.0.smithi082.stdout:8/868: mknod d0/d2b/d80/dca/de6/d1c/d76/da0/df9/df5/c120 0 2024-04-27T07:33:33.930 INFO:tasks.workunit.client.0.smithi082.stdout:8/869: dwrite d0/d2b/d80/dca/de6/d87/d71/fed [0,4194304] 0 2024-04-27T07:33:33.931 INFO:tasks.workunit.client.0.smithi082.stdout:2/865: write d7/d9/d4f/d6e/d82/dc6/f98 [5207695,56541] 0 2024-04-27T07:33:33.931 INFO:tasks.workunit.client.0.smithi082.stdout:8/870: write d0/d2b/d9a/da4/f34 [3011391,77307] 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:8/394: write d6/f7 [4411754,6700] 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:4/464: creat d5/d16/d2e/fa4 x:0 0 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:4/465: read d5/d16/f93 [2925165,113946] 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:6/414: dread de/d58/d21/d24/f7e [0,4194304] 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:3/523: link d7/d9/d10/d22/c3b d7/d9/d10/d33/ca1 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:6/415: creat de/d2e/d86/f93 x:0 0 0 2024-04-27T07:33:33.932 INFO:tasks.workunit.client.1.smithi100.stdout:5/352: truncate d0/d4/d21/f4b 3765948 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/524: dwrite d7/f9e [0,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/525: readlink d7/d9/d26/d2a/d5e/l4d 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:5/353: dwrite d0/d4/d21/d24/d46/f66 [0,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:8/395: dread d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:8/396: write d6/f7 [4047235,81280] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/526: link d7/d9/d10/d22/f5b d7/d9/d10/d33/d90/d3a/fa2 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/527: stat d7/d9/d10/d33/c7f 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:5/354: creat d0/d4/d21/d24/d2f/d39/d56/f6b x:0 0 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:6/416: dread de/d58/d28/f30 [0,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/528: link d7/d9/d26/f38 d7/d9/d10/d3e/d74/fa3 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:3/529: rename d7/d9/d26/d2a/d5e/f6e to d7/d9/d10/d28/fa4 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:6/417: dwrite de/f17 [4194304,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:5/355: dwrite d0/d58/d60/f61 [0,4194304] 0 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:6/418: chown fd 0 1 2024-04-27T07:33:33.933 INFO:tasks.workunit.client.1.smithi100.stdout:6/419: creat de/d58/d28/f94 x:0 0 0 2024-04-27T07:33:33.934 INFO:tasks.workunit.client.1.smithi100.stdout:3/530: mkdir d7/d9/da5 0 2024-04-27T07:33:33.934 INFO:tasks.workunit.client.1.smithi100.stdout:6/420: rename de/d58/d75/f76 to de/f95 0 2024-04-27T07:33:33.934 INFO:tasks.workunit.client.1.smithi100.stdout:5/356: link d0/d4/c1f d0/d4/d21/d24/d46/c6c 0 2024-04-27T07:33:33.934 INFO:tasks.workunit.client.1.smithi100.stdout:3/531: dwrite d7/d9/d2f/f69 [0,4194304] 0 2024-04-27T07:33:33.934 INFO:tasks.workunit.client.1.smithi100.stdout:5/357: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:33.935 INFO:tasks.workunit.client.0.smithi082.stdout:2/866: dread d7/d8/d13/fb8 [0,4194304] 0 2024-04-27T07:33:33.936 INFO:tasks.workunit.client.1.smithi100.stdout:3/532: rename d7/d9/d10/d3e/d91/fa0 to d7/d9/d26/d2a/d5e/fa6 0 2024-04-27T07:33:33.937 INFO:tasks.workunit.client.0.smithi082.stdout:2/867: truncate d7/d31/d54/fab 2242993 0 2024-04-27T07:33:33.940 INFO:tasks.workunit.client.1.smithi100.stdout:8/397: dwrite d6/d20/f33 [0,4194304] 0 2024-04-27T07:33:33.942 INFO:tasks.workunit.client.1.smithi100.stdout:5/358: dwrite d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:33.946 INFO:tasks.workunit.client.1.smithi100.stdout:5/359: mkdir d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d 0 2024-04-27T07:33:33.948 INFO:tasks.workunit.client.1.smithi100.stdout:3/533: creat d7/d9/fa7 x:0 0 0 2024-04-27T07:33:33.949 INFO:tasks.workunit.client.1.smithi100.stdout:5/360: creat d0/d58/f6e x:0 0 0 2024-04-27T07:33:33.951 INFO:tasks.workunit.client.1.smithi100.stdout:5/361: stat d0/d4/d21/d24/d2f/d57/d37/f1b 0 2024-04-27T07:33:33.951 INFO:tasks.workunit.client.0.smithi082.stdout:2/868: write d7/d8/d13/d94/fad [2093142,22045] 0 2024-04-27T07:33:33.952 INFO:tasks.workunit.client.1.smithi100.stdout:3/534: mkdir d7/d9/d10/d3e/d74/da8 0 2024-04-27T07:33:33.955 INFO:tasks.workunit.client.1.smithi100.stdout:5/362: mknod d0/d4/d21/d24/c6f 0 2024-04-27T07:33:33.955 INFO:tasks.workunit.client.0.smithi082.stdout:8/871: dwrite d0/d2b/d80/dca/de6/d1b/f89 [4194304,4194304] 0 2024-04-27T07:33:33.955 INFO:tasks.workunit.client.0.smithi082.stdout:2/869: mknod d7/d8/c11b 0 2024-04-27T07:33:33.958 INFO:tasks.workunit.client.0.smithi082.stdout:8/872: creat d0/d2b/d80/dca/dec/f121 x:0 0 0 2024-04-27T07:33:33.958 INFO:tasks.workunit.client.0.smithi082.stdout:2/870: mknod d7/d9/c11c 0 2024-04-27T07:33:33.959 INFO:tasks.workunit.client.0.smithi082.stdout:8/873: stat d0/d2b/d80/dca/de6/l88 0 2024-04-27T07:33:33.960 INFO:tasks.workunit.client.1.smithi100.stdout:3/535: mkdir d7/da9 0 2024-04-27T07:33:33.960 INFO:tasks.workunit.client.0.smithi082.stdout:2/871: write d7/d9/fd8 [1281077,87962] 0 2024-04-27T07:33:33.961 INFO:tasks.workunit.client.1.smithi100.stdout:3/536: write d7/f1c [2111804,31107] 0 2024-04-27T07:33:33.962 INFO:tasks.workunit.client.1.smithi100.stdout:5/363: dwrite d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:33.965 INFO:tasks.workunit.client.0.smithi082.stdout:8/874: getdents d0 0 2024-04-27T07:33:33.969 INFO:tasks.workunit.client.0.smithi082.stdout:2/872: link d7/d9/d4f/d6e/d82/da4/c106 d7/d8/d99/dc8/df1/c11d 0 2024-04-27T07:33:33.970 INFO:tasks.workunit.client.1.smithi100.stdout:6/421: truncate de/d58/f37 4263121 0 2024-04-27T07:33:33.971 INFO:tasks.workunit.client.1.smithi100.stdout:3/537: dread d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:33.972 INFO:tasks.workunit.client.0.smithi082.stdout:2/873: creat d7/d8/d99/f11e x:0 0 0 2024-04-27T07:33:33.975 INFO:tasks.workunit.client.1.smithi100.stdout:3/538: read d7/d9/fc [1886701,120057] 0 2024-04-27T07:33:33.976 INFO:tasks.workunit.client.1.smithi100.stdout:6/422: getdents de/d58/d21/d23 0 2024-04-27T07:33:33.978 INFO:tasks.workunit.client.1.smithi100.stdout:3/539: creat d7/d9/d26/d2a/d5e/faa x:0 0 0 2024-04-27T07:33:33.979 INFO:tasks.workunit.client.0.smithi082.stdout:2/874: dwrite d7/d8/d99/f111 [0,4194304] 0 2024-04-27T07:33:33.979 INFO:tasks.workunit.client.1.smithi100.stdout:3/540: read d7/d9/d2f/f5d [3247833,69374] 0 2024-04-27T07:33:33.982 INFO:tasks.workunit.client.1.smithi100.stdout:3/541: dread d7/d9/d10/f7b [0,4194304] 0 2024-04-27T07:33:33.982 INFO:tasks.workunit.client.0.smithi082.stdout:8/875: dwrite d0/d2b/d9a/de5/f9d [0,4194304] 0 2024-04-27T07:33:33.985 INFO:tasks.workunit.client.1.smithi100.stdout:3/542: write d7/d9/d26/d45/f49 [4763525,14361] 0 2024-04-27T07:33:33.990 INFO:tasks.workunit.client.1.smithi100.stdout:3/543: chown d7/d9/d10/d33/d47/l88 10 1 2024-04-27T07:33:33.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/876: getdents d0/d2b/d80/dca/de6/d1b/d53 0 2024-04-27T07:33:33.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/877: chown d0/d2b/d80/dca/c108 38 1 2024-04-27T07:33:33.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/878: rmdir d0 39 2024-04-27T07:33:33.991 INFO:tasks.workunit.client.1.smithi100.stdout:6/423: dread fd [0,4194304] 0 2024-04-27T07:33:33.992 INFO:tasks.workunit.client.0.smithi082.stdout:8/879: read - d0/d2b/d9a/fd0 zero size 2024-04-27T07:33:33.995 INFO:tasks.workunit.client.0.smithi082.stdout:8/880: symlink d0/d2b/d9a/l122 0 2024-04-27T07:33:33.997 INFO:tasks.workunit.client.0.smithi082.stdout:2/875: dwrite d7/d8/d13/f2b [0,4194304] 0 2024-04-27T07:33:33.997 INFO:tasks.workunit.client.0.smithi082.stdout:8/881: write d0/d2b/d9a/da4/f119 [1027847,54788] 0 2024-04-27T07:33:33.998 INFO:tasks.workunit.client.0.smithi082.stdout:8/882: chown d0/d2b/d80/dca/de6/f1d 3986 1 2024-04-27T07:33:34.000 INFO:tasks.workunit.client.0.smithi082.stdout:2/876: unlink d7/d8/d13/f2b 0 2024-04-27T07:33:34.001 INFO:tasks.workunit.client.0.smithi082.stdout:8/883: truncate d0/d2b/d80/dca/de6/d1b/d53/fa8 510948 0 2024-04-27T07:33:34.004 INFO:tasks.workunit.client.0.smithi082.stdout:2/877: rename d7/d30/d61 to d7/d14/d11f 0 2024-04-27T07:33:34.004 INFO:tasks.workunit.client.0.smithi082.stdout:8/884: write d0/d2b/d80/dca/de6/d87/d71/f5d [4548009,20215] 0 2024-04-27T07:33:34.006 INFO:tasks.workunit.client.0.smithi082.stdout:8/885: chown d0/d2b/d80/dca/de6/d87/d42/d7f/d82/f11a 52069 1 2024-04-27T07:33:34.010 INFO:tasks.workunit.client.1.smithi100.stdout:3/544: truncate d7/d9/d10/d28/f52 3655368 0 2024-04-27T07:33:34.010 INFO:tasks.workunit.client.1.smithi100.stdout:6/424: write de/d58/d21/d24/f46 [4683691,35198] 0 2024-04-27T07:33:34.011 INFO:tasks.workunit.client.1.smithi100.stdout:3/545: mknod d7/d9/d26/d2a/cab 0 2024-04-27T07:33:34.015 INFO:tasks.workunit.client.1.smithi100.stdout:3/546: creat d7/d9/fac x:0 0 0 2024-04-27T07:33:34.015 INFO:tasks.workunit.client.1.smithi100.stdout:6/425: dwrite de/f5c [0,4194304] 0 2024-04-27T07:33:34.016 INFO:tasks.workunit.client.0.smithi082.stdout:2/878: dwrite d7/d8/d13/f4b [0,4194304] 0 2024-04-27T07:33:34.017 INFO:tasks.workunit.client.0.smithi082.stdout:2/879: dread - d7/d8/d99/ff0 zero size 2024-04-27T07:33:34.019 INFO:tasks.workunit.client.1.smithi100.stdout:6/426: creat de/d2e/f96 x:0 0 0 2024-04-27T07:33:34.020 INFO:tasks.workunit.client.0.smithi082.stdout:2/880: unlink d7/d8/f112 0 2024-04-27T07:33:34.021 INFO:tasks.workunit.client.1.smithi100.stdout:3/547: readlink d7/d9/d10/d3e/d74/l9b 0 2024-04-27T07:33:34.022 INFO:tasks.workunit.client.1.smithi100.stdout:3/548: write d7/f9e [5142034,1582] 0 2024-04-27T07:33:34.024 INFO:tasks.workunit.client.1.smithi100.stdout:6/427: creat de/d58/d90/f97 x:0 0 0 2024-04-27T07:33:34.033 INFO:tasks.workunit.client.1.smithi100.stdout:3/549: dwrite d7/d9/d10/d33/d90/f99 [0,4194304] 0 2024-04-27T07:33:34.034 INFO:tasks.workunit.client.0.smithi082.stdout:2/881: dwrite d7/d9/d4f/d66/dae/f79 [0,4194304] 0 2024-04-27T07:33:34.035 INFO:tasks.workunit.client.1.smithi100.stdout:3/550: truncate d7/d9/d10/d22/d7e/f92 61100 0 2024-04-27T07:33:34.040 INFO:tasks.workunit.client.1.smithi100.stdout:3/551: getdents d7/d9/d10/d33/d47 0 2024-04-27T07:33:34.040 INFO:tasks.workunit.client.1.smithi100.stdout:1/532: sync 2024-04-27T07:33:34.040 INFO:tasks.workunit.client.1.smithi100.stdout:0/417: sync 2024-04-27T07:33:34.041 INFO:tasks.workunit.client.1.smithi100.stdout:0/418: fsync d1/d8/d14/d59/f5b 0 2024-04-27T07:33:34.044 INFO:tasks.workunit.client.1.smithi100.stdout:1/533: mknod d0/da0/ca6 0 2024-04-27T07:33:34.045 INFO:tasks.workunit.client.1.smithi100.stdout:3/552: mkdir d7/dad 0 2024-04-27T07:33:34.046 INFO:tasks.workunit.client.1.smithi100.stdout:0/419: mknod d1/d8/d14/c90 0 2024-04-27T07:33:34.047 INFO:tasks.workunit.client.1.smithi100.stdout:1/534: symlink d0/d1f/d97/la7 0 2024-04-27T07:33:34.048 INFO:tasks.workunit.client.1.smithi100.stdout:0/420: fsync d1/d30/f36 0 2024-04-27T07:33:34.048 INFO:tasks.workunit.client.1.smithi100.stdout:6/428: dwrite de/d58/f37 [0,4194304] 0 2024-04-27T07:33:34.048 INFO:tasks.workunit.client.1.smithi100.stdout:3/553: write d7/d9/d26/f59 [1827327,93566] 0 2024-04-27T07:33:34.049 INFO:tasks.workunit.client.1.smithi100.stdout:6/429: chown de/d58/f37 1153 1 2024-04-27T07:33:34.051 INFO:tasks.workunit.client.1.smithi100.stdout:6/430: stat de/d58/d28/f2d 0 2024-04-27T07:33:34.051 INFO:tasks.workunit.client.1.smithi100.stdout:1/535: chown d0/l1c 792 1 2024-04-27T07:33:34.053 INFO:tasks.workunit.client.1.smithi100.stdout:0/421: unlink d1/d8/d20/f1c 0 2024-04-27T07:33:34.054 INFO:tasks.workunit.client.1.smithi100.stdout:3/554: mknod d7/d9/d26/d2a/d5e/cae 0 2024-04-27T07:33:34.055 INFO:tasks.workunit.client.0.smithi082.stdout:2/882: truncate d7/d9/fce 4037913 0 2024-04-27T07:33:34.055 INFO:tasks.workunit.client.1.smithi100.stdout:6/431: fsync de/d58/f36 0 2024-04-27T07:33:34.056 INFO:tasks.workunit.client.0.smithi082.stdout:2/883: fdatasync d7/d8/d13/d94/fad 0 2024-04-27T07:33:34.056 INFO:tasks.workunit.client.1.smithi100.stdout:1/536: symlink d0/d1b/da1/la8 0 2024-04-27T07:33:34.059 INFO:tasks.workunit.client.1.smithi100.stdout:3/555: rename d7/d9/d26/d45 to d7/dad/daf 0 2024-04-27T07:33:34.060 INFO:tasks.workunit.client.1.smithi100.stdout:6/432: mknod de/d58/d90/c98 0 2024-04-27T07:33:34.061 INFO:tasks.workunit.client.1.smithi100.stdout:6/433: readlink de/d58/d75/l92 0 2024-04-27T07:33:34.062 INFO:tasks.workunit.client.1.smithi100.stdout:3/556: mkdir d7/d9/d10/d28/db0 0 2024-04-27T07:33:34.063 INFO:tasks.workunit.client.1.smithi100.stdout:1/537: symlink d0/d1b/d20/d2d/d35/d4d/d60/da4/la9 0 2024-04-27T07:33:34.065 INFO:tasks.workunit.client.1.smithi100.stdout:6/434: symlink de/l99 0 2024-04-27T07:33:34.066 INFO:tasks.workunit.client.1.smithi100.stdout:6/435: fsync de/d58/d21/f61 0 2024-04-27T07:33:34.068 INFO:tasks.workunit.client.1.smithi100.stdout:6/436: dread - de/d58/d28/f4f zero size 2024-04-27T07:33:34.068 INFO:tasks.workunit.client.1.smithi100.stdout:3/557: dwrite d7/d9/d26/f59 [0,4194304] 0 2024-04-27T07:33:34.069 INFO:tasks.workunit.client.1.smithi100.stdout:0/422: getdents d1/d8/d20/d72 0 2024-04-27T07:33:34.070 INFO:tasks.workunit.client.1.smithi100.stdout:1/538: read d0/f14 [941237,86003] 0 2024-04-27T07:33:34.070 INFO:tasks.workunit.client.1.smithi100.stdout:3/558: stat d7/d9/d10/d33/d47/c48 0 2024-04-27T07:33:34.070 INFO:tasks.workunit.client.1.smithi100.stdout:6/437: dread - de/d58/d21/f83 zero size 2024-04-27T07:33:34.071 INFO:tasks.workunit.client.1.smithi100.stdout:0/423: chown d1/d8/d20/f28 475878 1 2024-04-27T07:33:34.073 INFO:tasks.workunit.client.1.smithi100.stdout:3/559: write d7/d9/d26/d2a/d5e/f72 [1581169,40459] 0 2024-04-27T07:33:34.078 INFO:tasks.workunit.client.1.smithi100.stdout:0/424: unlink d1/d30/f33 0 2024-04-27T07:33:34.080 INFO:tasks.workunit.client.1.smithi100.stdout:3/560: chown d7/d9/d10/d33/ca1 114396343 1 2024-04-27T07:33:34.085 INFO:tasks.workunit.client.1.smithi100.stdout:6/438: rmdir de/d58/d75/d89 0 2024-04-27T07:33:34.086 INFO:tasks.workunit.client.1.smithi100.stdout:1/539: dread d0/d23/f29 [0,4194304] 0 2024-04-27T07:33:34.088 INFO:tasks.workunit.client.1.smithi100.stdout:3/561: rename d7/d9/d10/d22/d7e to d7/d9/d10/d3e/d74/db1 0 2024-04-27T07:33:34.090 INFO:tasks.workunit.client.1.smithi100.stdout:3/562: fdatasync d7/d9/d26/d2a/d5e/f60 0 2024-04-27T07:33:34.090 INFO:tasks.workunit.client.1.smithi100.stdout:0/425: mknod d1/c91 0 2024-04-27T07:33:34.093 INFO:tasks.workunit.client.1.smithi100.stdout:6/439: dwrite de/d58/d28/f8b [0,4194304] 0 2024-04-27T07:33:34.099 INFO:tasks.workunit.client.1.smithi100.stdout:3/563: dwrite d7/f1c [0,4194304] 0 2024-04-27T07:33:34.099 INFO:tasks.workunit.client.1.smithi100.stdout:6/440: creat de/d2e/d86/f9a x:0 0 0 2024-04-27T07:33:34.100 INFO:tasks.workunit.client.1.smithi100.stdout:3/564: readlink d7/d9/l84 0 2024-04-27T07:33:34.102 INFO:tasks.workunit.client.1.smithi100.stdout:3/565: write d7/d9/d10/d33/d90/f2e [4037857,101284] 0 2024-04-27T07:33:34.103 INFO:tasks.workunit.client.1.smithi100.stdout:6/441: truncate de/d58/d21/d5b/f7f 541279 0 2024-04-27T07:33:34.104 INFO:tasks.workunit.client.1.smithi100.stdout:6/442: write de/d58/d28/f8b [100082,85056] 0 2024-04-27T07:33:34.110 INFO:tasks.workunit.client.1.smithi100.stdout:6/443: getdents de/d2e/d3f/d80 0 2024-04-27T07:33:34.110 INFO:tasks.workunit.client.1.smithi100.stdout:1/540: dread d0/d1b/d20/d2d/d35/f7f [0,4194304] 0 2024-04-27T07:33:34.111 INFO:tasks.workunit.client.1.smithi100.stdout:6/444: write de/d58/d21/d24/f54 [59703,124183] 0 2024-04-27T07:33:34.113 INFO:tasks.workunit.client.1.smithi100.stdout:6/445: mkdir de/d9b 0 2024-04-27T07:33:34.117 INFO:tasks.workunit.client.1.smithi100.stdout:1/541: dwrite d0/d1b/d20/d2d/f83 [0,4194304] 0 2024-04-27T07:33:34.118 INFO:tasks.workunit.client.1.smithi100.stdout:6/446: link de/d2e/d3f/f6d de/d58/d21/d24/f9c 0 2024-04-27T07:33:34.121 INFO:tasks.workunit.client.1.smithi100.stdout:1/542: creat d0/d1b/d20/d2d/d35/d65/faa x:0 0 0 2024-04-27T07:33:34.122 INFO:tasks.workunit.client.1.smithi100.stdout:6/447: rmdir de/d58/d21/d5b 39 2024-04-27T07:33:34.123 INFO:tasks.workunit.client.1.smithi100.stdout:1/543: symlink d0/d1f/d27/d40/lab 0 2024-04-27T07:33:34.125 INFO:tasks.workunit.client.1.smithi100.stdout:6/448: symlink de/d2e/l9d 0 2024-04-27T07:33:34.127 INFO:tasks.workunit.client.1.smithi100.stdout:1/544: mkdir d0/d1b/d20/d2d/d35/dac 0 2024-04-27T07:33:34.127 INFO:tasks.workunit.client.1.smithi100.stdout:3/566: write d7/d9/d26/d2a/f82 [213335,100570] 0 2024-04-27T07:33:34.132 INFO:tasks.workunit.client.1.smithi100.stdout:0/426: dread d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:34.133 INFO:tasks.workunit.client.1.smithi100.stdout:3/567: dread d7/dad/daf/f49 [4194304,4194304] 0 2024-04-27T07:33:34.135 INFO:tasks.workunit.client.1.smithi100.stdout:1/545: rename d0/d1f/d27/f87 to d0/d1b/d20/d2d/d35/d4d/d60/fad 0 2024-04-27T07:33:34.137 INFO:tasks.workunit.client.1.smithi100.stdout:0/427: creat d1/d8/d20/d88/f92 x:0 0 0 2024-04-27T07:33:34.138 INFO:tasks.workunit.client.1.smithi100.stdout:1/546: mkdir d0/d23/d3a/dae 0 2024-04-27T07:33:34.141 INFO:tasks.workunit.client.1.smithi100.stdout:1/547: chown d0/d1b/d20/d2d/d35/l8e 1422394 1 2024-04-27T07:33:34.141 INFO:tasks.workunit.client.1.smithi100.stdout:3/568: dwrite d7/d9/d10/d33/d90/f57 [0,4194304] 0 2024-04-27T07:33:34.142 INFO:tasks.workunit.client.1.smithi100.stdout:6/449: dread de/f10 [0,4194304] 0 2024-04-27T07:33:34.143 INFO:tasks.workunit.client.1.smithi100.stdout:0/428: creat d1/d38/d3a/d54/f93 x:0 0 0 2024-04-27T07:33:34.148 INFO:tasks.workunit.client.1.smithi100.stdout:3/569: dread d7/d9/d2f/f69 [0,4194304] 0 2024-04-27T07:33:34.149 INFO:tasks.workunit.client.1.smithi100.stdout:0/429: creat d1/d38/f94 x:0 0 0 2024-04-27T07:33:34.150 INFO:tasks.workunit.client.1.smithi100.stdout:3/570: chown d7/d9/d10/d33/d90/l4c 58 1 2024-04-27T07:33:34.150 INFO:tasks.workunit.client.1.smithi100.stdout:0/430: stat d1/d8/fc 0 2024-04-27T07:33:34.154 INFO:tasks.workunit.client.1.smithi100.stdout:3/571: rename d7/d9/d10/d33/d90/l73 to d7/d9/d26/lb2 0 2024-04-27T07:33:34.158 INFO:tasks.workunit.client.1.smithi100.stdout:3/572: mkdir d7/d9/d26/d2a/db3 0 2024-04-27T07:33:34.159 INFO:tasks.workunit.client.1.smithi100.stdout:0/431: getdents d1/d8/d20/d1e 0 2024-04-27T07:33:34.161 INFO:tasks.workunit.client.1.smithi100.stdout:1/548: rename d0/d1f/d27/d40/l4a to d0/laf 0 2024-04-27T07:33:34.163 INFO:tasks.workunit.client.1.smithi100.stdout:0/432: symlink d1/d8/d20/d61/d6a/l95 0 2024-04-27T07:33:34.165 INFO:tasks.workunit.client.1.smithi100.stdout:6/450: dread de/d58/d21/d24/f2b [0,4194304] 0 2024-04-27T07:33:34.165 INFO:tasks.workunit.client.1.smithi100.stdout:0/433: read d1/f39 [43594,7707] 0 2024-04-27T07:33:34.171 INFO:tasks.workunit.client.1.smithi100.stdout:0/434: mkdir d1/d8/d20/d72/d96 0 2024-04-27T07:33:34.171 INFO:tasks.workunit.client.1.smithi100.stdout:6/451: creat de/d2e/d3f/d80/f9e x:0 0 0 2024-04-27T07:33:34.172 INFO:tasks.workunit.client.1.smithi100.stdout:1/549: write d0/f14 [2599716,111518] 0 2024-04-27T07:33:34.172 INFO:tasks.workunit.client.1.smithi100.stdout:6/452: write de/d2e/f78 [566371,7209] 0 2024-04-27T07:33:34.172 INFO:tasks.workunit.client.1.smithi100.stdout:1/550: chown d0/da0/f74 3257634 1 2024-04-27T07:33:34.174 INFO:tasks.workunit.client.1.smithi100.stdout:6/453: chown de/d58/d28/f59 15 1 2024-04-27T07:33:34.176 INFO:tasks.workunit.client.1.smithi100.stdout:0/435: link d1/d8/d14/f50 d1/d8/d20/d61/d6a/f97 0 2024-04-27T07:33:34.176 INFO:tasks.workunit.client.0.smithi082.stdout:7/895: sync 2024-04-27T07:33:34.177 INFO:tasks.workunit.client.1.smithi100.stdout:6/454: mkdir de/d58/d21/d24/d9f 0 2024-04-27T07:33:34.178 INFO:tasks.workunit.client.1.smithi100.stdout:6/455: stat de/d58/f36 0 2024-04-27T07:33:34.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/896: readlink d3/d49/d97/l1c 0 2024-04-27T07:33:34.179 INFO:tasks.workunit.client.1.smithi100.stdout:6/456: mkdir de/d58/d21/d23/da0 0 2024-04-27T07:33:34.182 INFO:tasks.workunit.client.1.smithi100.stdout:1/551: write d0/d23/d3a/f41 [874476,82504] 0 2024-04-27T07:33:34.182 INFO:tasks.workunit.client.0.smithi082.stdout:7/897: link d3/d49/d97/d3a/d71/da0/ddf/ff7 d3/d49/d97/d3a/d2a/dac/d91/d102/f139 0 2024-04-27T07:33:34.183 INFO:tasks.workunit.client.1.smithi100.stdout:1/552: write d0/d1b/d20/d2d/f83 [2421768,117611] 0 2024-04-27T07:33:34.184 INFO:tasks.workunit.client.1.smithi100.stdout:7/335: sync 2024-04-27T07:33:34.185 INFO:tasks.workunit.client.1.smithi100.stdout:7/336: chown d1/d2f/d51 12124945 1 2024-04-27T07:33:34.187 INFO:tasks.workunit.client.1.smithi100.stdout:1/553: truncate d0/d1b/d20/d2d/d35/d65/f76 937130 0 2024-04-27T07:33:34.187 INFO:tasks.workunit.client.1.smithi100.stdout:7/337: write d1/dd/d16/d31/d4c/d4d/f25 [1672891,63666] 0 2024-04-27T07:33:34.191 INFO:tasks.workunit.client.1.smithi100.stdout:1/554: creat d0/d1b/da1/fb0 x:0 0 0 2024-04-27T07:33:34.192 INFO:tasks.workunit.client.0.smithi082.stdout:7/898: dwrite d3/d49/f51 [0,4194304] 0 2024-04-27T07:33:34.192 INFO:tasks.workunit.client.1.smithi100.stdout:7/338: creat d1/dd/d16/d31/d4c/d4d/d3b/f67 x:0 0 0 2024-04-27T07:33:34.197 INFO:tasks.workunit.client.0.smithi082.stdout:7/899: rename d3/dfb/l111 to d3/l13a 0 2024-04-27T07:33:34.202 INFO:tasks.workunit.client.0.smithi082.stdout:7/900: link d3/d49/d97/d3a/d71/da0/ddf/l120 d3/dfb/da1/db6/l13b 0 2024-04-27T07:33:34.202 INFO:tasks.workunit.client.0.smithi082.stdout:7/901: stat d3/d49/d97/d3a/d2a/f30 0 2024-04-27T07:33:34.204 INFO:tasks.workunit.client.0.smithi082.stdout:7/902: mknod d3/d9/d4f/d61/d12a/c13c 0 2024-04-27T07:33:34.205 INFO:tasks.workunit.client.0.smithi082.stdout:7/903: chown d3/dfb/da1/da3/ff0 58141169 1 2024-04-27T07:33:34.206 INFO:tasks.workunit.client.0.smithi082.stdout:7/904: rmdir d3/d49/d97/d3a/d71/d109 39 2024-04-27T07:33:34.208 INFO:tasks.workunit.client.0.smithi082.stdout:7/905: truncate d3/d49/d97/d3a/f21 693562 0 2024-04-27T07:33:34.209 INFO:tasks.workunit.client.0.smithi082.stdout:7/906: read - d3/d49/d97/d3a/d71/f7e zero size 2024-04-27T07:33:34.209 INFO:tasks.workunit.client.0.smithi082.stdout:7/907: stat d3/db 0 2024-04-27T07:33:34.211 INFO:tasks.workunit.client.0.smithi082.stdout:7/908: mkdir d3/d9/d13d 0 2024-04-27T07:33:34.212 INFO:tasks.workunit.client.0.smithi082.stdout:7/909: creat d3/db/f13e x:0 0 0 2024-04-27T07:33:34.223 INFO:tasks.workunit.client.0.smithi082.stdout:7/910: dread d3/f9b [0,4194304] 0 2024-04-27T07:33:34.226 INFO:tasks.workunit.client.0.smithi082.stdout:7/911: getdents d3/d9/d4f/d61 0 2024-04-27T07:33:34.239 INFO:tasks.workunit.client.1.smithi100.stdout:1/555: symlink d0/d1b/d20/d2d/d35/d65/lb1 0 2024-04-27T07:33:34.242 INFO:tasks.workunit.client.1.smithi100.stdout:6/457: dread de/d58/d21/f26 [0,4194304] 0 2024-04-27T07:33:34.242 INFO:tasks.workunit.client.1.smithi100.stdout:6/458: chown de/l99 2 1 2024-04-27T07:33:34.243 INFO:tasks.workunit.client.1.smithi100.stdout:7/339: link d1/dd/d16/f26 d1/dd/d2a/f68 0 2024-04-27T07:33:34.244 INFO:tasks.workunit.client.1.smithi100.stdout:7/340: readlink d1/l4 0 2024-04-27T07:33:34.244 INFO:tasks.workunit.client.1.smithi100.stdout:1/556: creat d0/d1b/d20/d2d/d35/dac/fb2 x:0 0 0 2024-04-27T07:33:34.246 INFO:tasks.workunit.client.1.smithi100.stdout:7/341: write d1/d2f/d51/f65 [326538,42336] 0 2024-04-27T07:33:34.250 INFO:tasks.workunit.client.1.smithi100.stdout:6/459: dwrite de/d58/d75/f8d [0,4194304] 0 2024-04-27T07:33:34.252 INFO:tasks.workunit.client.1.smithi100.stdout:7/342: unlink d1/dd/d16/d3e/l58 0 2024-04-27T07:33:34.252 INFO:tasks.workunit.client.0.smithi082.stdout:1/828: sync 2024-04-27T07:33:34.253 INFO:tasks.workunit.client.0.smithi082.stdout:6/900: sync 2024-04-27T07:33:34.253 INFO:tasks.workunit.client.0.smithi082.stdout:5/991: sync 2024-04-27T07:33:34.254 INFO:tasks.workunit.client.0.smithi082.stdout:6/901: chown d2/d2d/d4a/lf2 0 1 2024-04-27T07:33:34.255 INFO:tasks.workunit.client.0.smithi082.stdout:1/829: write d4/d15/d49/dab/dc3/d3e/d53/d72/d114/f116 [441619,96173] 0 2024-04-27T07:33:34.256 INFO:tasks.workunit.client.1.smithi100.stdout:1/557: getdents d0/d1f/d27/d40 0 2024-04-27T07:33:34.256 INFO:tasks.workunit.client.1.smithi100.stdout:6/460: dread de/d58/d21/d5b/f7f [0,4194304] 0 2024-04-27T07:33:34.260 INFO:tasks.workunit.client.0.smithi082.stdout:5/992: creat d8/d14/f143 x:0 0 0 2024-04-27T07:33:34.260 INFO:tasks.workunit.client.0.smithi082.stdout:6/902: dread d2/d3/fd [0,4194304] 0 2024-04-27T07:33:34.261 INFO:tasks.workunit.client.1.smithi100.stdout:1/558: dread d0/d1b/d20/d2d/f83 [0,4194304] 0 2024-04-27T07:33:34.261 INFO:tasks.workunit.client.0.smithi082.stdout:6/903: fdatasync d2/d2e/f30 0 2024-04-27T07:33:34.262 INFO:tasks.workunit.client.1.smithi100.stdout:6/461: creat de/d2e/d3f/d80/fa1 x:0 0 0 2024-04-27T07:33:34.263 INFO:tasks.workunit.client.0.smithi082.stdout:1/830: dwrite d4/d15/d49/dab/dc3/f9b [0,4194304] 0 2024-04-27T07:33:34.264 INFO:tasks.workunit.client.0.smithi082.stdout:1/831: write d4/d15/d49/dab/feb [974789,44481] 0 2024-04-27T07:33:34.265 INFO:tasks.workunit.client.1.smithi100.stdout:1/559: creat d0/d1f/d97/fb3 x:0 0 0 2024-04-27T07:33:34.266 INFO:tasks.workunit.client.0.smithi082.stdout:5/993: rename d8/d29/dea/l12b to d8/d29/dea/d5f/l144 0 2024-04-27T07:33:34.267 INFO:tasks.workunit.client.0.smithi082.stdout:1/832: getdents d4/d15/d49/dab/dc3/d3e/d46/dcf 0 2024-04-27T07:33:34.269 INFO:tasks.workunit.client.0.smithi082.stdout:1/833: readlink d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/db7/lcb 0 2024-04-27T07:33:34.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/904: rename d2/d1e/d80/df5/d129 to d2/d1e/d32/d85/d10c/d113/d134 0 2024-04-27T07:33:34.273 INFO:tasks.workunit.client.1.smithi100.stdout:6/462: dwrite de/d58/d21/d5b/f6f [4194304,4194304] 0 2024-04-27T07:33:34.274 INFO:tasks.workunit.client.0.smithi082.stdout:5/994: dwrite d8/d3c/d64/db8/f129 [0,4194304] 0 2024-04-27T07:33:34.276 INFO:tasks.workunit.client.0.smithi082.stdout:1/834: mknod d4/d15/d49/dab/dc3/d3e/d57/d101/d97/c11e 0 2024-04-27T07:33:34.277 INFO:tasks.workunit.client.0.smithi082.stdout:5/995: chown d8/d2e/d85/daa/lee 599 1 2024-04-27T07:33:34.277 INFO:tasks.workunit.client.1.smithi100.stdout:6/463: fsync de/d58/f36 0 2024-04-27T07:33:34.281 INFO:tasks.workunit.client.0.smithi082.stdout:5/996: chown d8/d29/dea/d5f/df6/dfd/d102/d10e/d8b/l111 461742 1 2024-04-27T07:33:34.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/560: dwrite d0/d1b/d20/d2d/d35/f69 [0,4194304] 0 2024-04-27T07:33:34.282 INFO:tasks.workunit.client.1.smithi100.stdout:7/343: dread d1/dd/d16/d31/d4c/d4d/d3b/f45 [0,4194304] 0 2024-04-27T07:33:34.282 INFO:tasks.workunit.client.0.smithi082.stdout:5/997: creat d8/d29/dea/f145 x:0 0 0 2024-04-27T07:33:34.283 INFO:tasks.workunit.client.0.smithi082.stdout:5/998: chown d8/d77/de8/d128/dc7 7729262 1 2024-04-27T07:33:34.283 INFO:tasks.workunit.client.1.smithi100.stdout:6/464: dread f6 [0,4194304] 0 2024-04-27T07:33:34.284 INFO:tasks.workunit.client.1.smithi100.stdout:7/344: dread - d1/dd/d16/d4a/d56/f5e zero size 2024-04-27T07:33:34.285 INFO:tasks.workunit.client.0.smithi082.stdout:5/999: fsync d8/d29/f68 0 2024-04-27T07:33:34.289 INFO:tasks.workunit.client.1.smithi100.stdout:6/465: creat de/d58/d21/d23/d73/fa2 x:0 0 0 2024-04-27T07:33:34.290 INFO:tasks.workunit.client.1.smithi100.stdout:1/561: getdents d0/da0 0 2024-04-27T07:33:34.292 INFO:tasks.workunit.client.1.smithi100.stdout:6/466: truncate de/d58/d75/f8f 1277467 0 2024-04-27T07:33:34.293 INFO:tasks.workunit.client.1.smithi100.stdout:1/562: rename d0/d1f/d27 to d0/d1f/d6d/db4 0 2024-04-27T07:33:34.293 INFO:tasks.workunit.client.0.smithi082.stdout:6/905: dread d2/d45/dc2/fcb [0,4194304] 0 2024-04-27T07:33:34.295 INFO:tasks.workunit.client.1.smithi100.stdout:1/563: mknod d0/d23/d3a/dae/cb5 0 2024-04-27T07:33:34.296 INFO:tasks.workunit.client.0.smithi082.stdout:6/906: symlink d2/d1e/d32/d85/d10c/d113/l135 0 2024-04-27T07:33:34.296 INFO:tasks.workunit.client.0.smithi082.stdout:6/907: truncate d2/f8c 4666739 0 2024-04-27T07:33:34.297 INFO:tasks.workunit.client.1.smithi100.stdout:1/564: unlink d0/d1f/d6d/db4/d40/c95 0 2024-04-27T07:33:34.297 INFO:tasks.workunit.client.0.smithi082.stdout:6/908: write d2/d2d/d4a/f52 [176538,81629] 0 2024-04-27T07:33:34.300 INFO:tasks.workunit.client.0.smithi082.stdout:6/909: rename d2/c99 to d2/d1e/d32/d85/d8a/c136 0 2024-04-27T07:33:34.304 INFO:tasks.workunit.client.0.smithi082.stdout:6/910: rename d2/d2e/l73 to d2/d1e/d32/d85/d97/de2/l137 0 2024-04-27T07:33:34.307 INFO:tasks.workunit.client.1.smithi100.stdout:7/345: dread d1/f32 [0,4194304] 0 2024-04-27T07:33:34.308 INFO:tasks.workunit.client.1.smithi100.stdout:7/346: dread - d1/dd/d2a/f62 zero size 2024-04-27T07:33:34.309 INFO:tasks.workunit.client.1.smithi100.stdout:7/347: rmdir d1/dd/d16/d4a 39 2024-04-27T07:33:34.310 INFO:tasks.workunit.client.1.smithi100.stdout:7/348: fdatasync d1/dd/d16/f66 0 2024-04-27T07:33:34.310 INFO:tasks.workunit.client.0.smithi082.stdout:6/911: dwrite d2/d2d/d4a/de4/dcc/f83 [0,4194304] 0 2024-04-27T07:33:34.311 INFO:tasks.workunit.client.1.smithi100.stdout:7/349: symlink d1/l69 0 2024-04-27T07:33:34.313 INFO:tasks.workunit.client.0.smithi082.stdout:6/912: read d2/d2d/d4a/de4/dcc/d13/f33 [881020,55991] 0 2024-04-27T07:33:34.313 INFO:tasks.workunit.client.0.smithi082.stdout:6/913: stat d2/d2d/d4a/de4/cb1 0 2024-04-27T07:33:34.315 INFO:tasks.workunit.client.1.smithi100.stdout:7/350: creat d1/dd/d16/d31/d4c/d4d/f6a x:0 0 0 2024-04-27T07:33:34.315 INFO:tasks.workunit.client.0.smithi082.stdout:6/914: readlink d2/d1e/d32/d85/d93/l9a 0 2024-04-27T07:33:34.316 INFO:tasks.workunit.client.1.smithi100.stdout:7/351: chown d1/dd/d16/d31/d4c/d4d/d3b/c49 1801229 1 2024-04-27T07:33:34.316 INFO:tasks.workunit.client.0.smithi082.stdout:6/915: read - d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/fab zero size 2024-04-27T07:33:34.316 INFO:tasks.workunit.client.0.smithi082.stdout:6/916: chown d2/d1e/d32/lb3 386 1 2024-04-27T07:33:34.317 INFO:tasks.workunit.client.1.smithi100.stdout:7/352: chown d1/dd/d16/d31/d4c/d4d/d3b/f46 13 1 2024-04-27T07:33:34.318 INFO:tasks.workunit.client.1.smithi100.stdout:7/353: write d1/dd/d16/d31/d4c/d4d/d3b/f67 [801607,19688] 0 2024-04-27T07:33:34.318 INFO:tasks.workunit.client.0.smithi082.stdout:6/917: creat d2/d1e/d32/d85/f138 x:0 0 0 2024-04-27T07:33:34.321 INFO:tasks.workunit.client.0.smithi082.stdout:6/918: rename d2/l4c to d2/d81/l139 0 2024-04-27T07:33:34.322 INFO:tasks.workunit.client.1.smithi100.stdout:7/354: creat d1/dd/d16/d31/d4c/d4d/f6b x:0 0 0 2024-04-27T07:33:34.322 INFO:tasks.workunit.client.1.smithi100.stdout:7/355: write d1/fc [768918,130552] 0 2024-04-27T07:33:34.333 INFO:tasks.workunit.client.1.smithi100.stdout:7/356: dwrite d1/f15 [0,4194304] 0 2024-04-27T07:33:34.335 INFO:tasks.workunit.client.0.smithi082.stdout:6/919: dwrite d2/d45/f6f [0,4194304] 0 2024-04-27T07:33:34.337 INFO:tasks.workunit.client.1.smithi100.stdout:7/357: write d1/dd/d2a/f68 [524289,103004] 0 2024-04-27T07:33:34.338 INFO:tasks.workunit.client.0.smithi082.stdout:6/920: creat d2/d3/da8/f13a x:0 0 0 2024-04-27T07:33:34.338 INFO:tasks.workunit.client.0.smithi082.stdout:6/921: chown d2/d2d/d4a/de4/cb1 217 1 2024-04-27T07:33:34.340 INFO:tasks.workunit.client.1.smithi100.stdout:7/358: symlink d1/dd/d16/d31/d4c/l6c 0 2024-04-27T07:33:34.342 INFO:tasks.workunit.client.0.smithi082.stdout:6/922: creat d2/d2d/d4a/de4/dcc/d77/dca/dd6/f13b x:0 0 0 2024-04-27T07:33:34.347 INFO:tasks.workunit.client.1.smithi100.stdout:7/359: dwrite d1/dd/d2a/f62 [0,4194304] 0 2024-04-27T07:33:34.348 INFO:tasks.workunit.client.0.smithi082.stdout:6/923: dwrite d2/f132 [0,4194304] 0 2024-04-27T07:33:34.350 INFO:tasks.workunit.client.0.smithi082.stdout:6/924: write d2/d3/d9c/fbf [59055,55248] 0 2024-04-27T07:33:34.351 INFO:tasks.workunit.client.1.smithi100.stdout:7/360: truncate d1/dd/fe 234009 0 2024-04-27T07:33:34.353 INFO:tasks.workunit.client.1.smithi100.stdout:7/361: symlink d1/dd/d16/d31/l6d 0 2024-04-27T07:33:34.354 INFO:tasks.workunit.client.0.smithi082.stdout:6/925: creat d2/d1e/d32/d85/d8a/f13c x:0 0 0 2024-04-27T07:33:34.359 INFO:tasks.workunit.client.0.smithi082.stdout:6/926: dwrite d2/d2e/dae/fb8 [0,4194304] 0 2024-04-27T07:33:34.362 INFO:tasks.workunit.client.1.smithi100.stdout:7/362: dwrite d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:34.364 INFO:tasks.workunit.client.0.smithi082.stdout:6/927: symlink d2/d2e/d6c/df1/l13d 0 2024-04-27T07:33:34.365 INFO:tasks.workunit.client.1.smithi100.stdout:7/363: mkdir d1/d2f/d6e 0 2024-04-27T07:33:34.365 INFO:tasks.workunit.client.0.smithi082.stdout:6/928: chown d2/d1e/d32/d85/d93/ldb 24 1 2024-04-27T07:33:34.367 INFO:tasks.workunit.client.0.smithi082.stdout:6/929: creat d2/d2d/d3d/f13e x:0 0 0 2024-04-27T07:33:34.371 INFO:tasks.workunit.client.0.smithi082.stdout:6/930: rename d2/d2d/d3d/de7/f110 to d2/d3/d9c/f13f 0 2024-04-27T07:33:34.374 INFO:tasks.workunit.client.0.smithi082.stdout:6/931: symlink d2/l140 0 2024-04-27T07:33:34.374 INFO:tasks.workunit.client.0.smithi082.stdout:6/932: chown d2/d1e/d32/d85/d8a 47103 1 2024-04-27T07:33:34.376 INFO:tasks.workunit.client.0.smithi082.stdout:6/933: mkdir d2/d2e/d6c/d141 0 2024-04-27T07:33:34.379 INFO:tasks.workunit.client.0.smithi082.stdout:6/934: getdents d2/d2d/d4a/de4/dcc/d77 0 2024-04-27T07:33:34.380 INFO:tasks.workunit.client.0.smithi082.stdout:6/935: truncate d2/d3/da8/fba 1808311 0 2024-04-27T07:33:34.381 INFO:tasks.workunit.client.1.smithi100.stdout:7/364: truncate d1/dd/f1e 3680371 0 2024-04-27T07:33:34.382 INFO:tasks.workunit.client.1.smithi100.stdout:7/365: mkdir d1/d2f/d51/d6f 0 2024-04-27T07:33:34.386 INFO:tasks.workunit.client.0.smithi082.stdout:6/936: getdents d2/d2d/d4a/de4/dcc/d77/dca/dd6/d107/d112 0 2024-04-27T07:33:34.386 INFO:tasks.workunit.client.0.smithi082.stdout:6/937: mknod d2/d2d/d4a/de4/dcc/d77/c142 0 2024-04-27T07:33:34.387 INFO:tasks.workunit.client.1.smithi100.stdout:7/366: unlink d1/dd/d16/d31/d4c/d4d/f57 0 2024-04-27T07:33:34.387 INFO:tasks.workunit.client.1.smithi100.stdout:7/367: chown d1/dd/d16/d31/d4c/d4d/l35 965737187 1 2024-04-27T07:33:34.387 INFO:tasks.workunit.client.0.smithi082.stdout:6/938: creat d2/d3/d9c/f143 x:0 0 0 2024-04-27T07:33:34.388 INFO:tasks.workunit.client.0.smithi082.stdout:6/939: readlink d2/l12a 0 2024-04-27T07:33:34.389 INFO:tasks.workunit.client.0.smithi082.stdout:6/940: write d2/d1e/d32/d85/f138 [62567,76351] 0 2024-04-27T07:33:34.391 INFO:tasks.workunit.client.0.smithi082.stdout:9/821: sync 2024-04-27T07:33:34.391 INFO:tasks.workunit.client.0.smithi082.stdout:4/972: sync 2024-04-27T07:33:34.391 INFO:tasks.workunit.client.0.smithi082.stdout:2/884: sync 2024-04-27T07:33:34.391 INFO:tasks.workunit.client.0.smithi082.stdout:8/886: sync 2024-04-27T07:33:34.391 INFO:tasks.workunit.client.0.smithi082.stdout:6/941: symlink d2/d2d/d4a/de4/dcc/d77/dd3/l144 0 2024-04-27T07:33:34.392 INFO:tasks.workunit.client.1.smithi100.stdout:7/368: rename d1/d2f to d1/dd/d16/d70 0 2024-04-27T07:33:34.393 INFO:tasks.workunit.client.0.smithi082.stdout:8/887: dread - d0/d2b/d9a/de5/feb zero size 2024-04-27T07:33:34.394 INFO:tasks.workunit.client.1.smithi100.stdout:7/369: write d1/f33 [2297882,70297] 0 2024-04-27T07:33:34.394 INFO:tasks.workunit.client.1.smithi100.stdout:7/370: readlink d1/l4 0 2024-04-27T07:33:34.395 INFO:tasks.workunit.client.0.smithi082.stdout:2/885: chown d7/d9/d4f/d6e/d82/dc6/f98 4 1 2024-04-27T07:33:34.395 INFO:tasks.workunit.client.1.smithi100.stdout:7/371: write d1/dd/d2a/f62 [4150522,92063] 0 2024-04-27T07:33:34.396 INFO:tasks.workunit.client.1.smithi100.stdout:7/372: readlink d1/dd/d16/d31/l50 0 2024-04-27T07:33:34.397 INFO:tasks.workunit.client.0.smithi082.stdout:2/886: truncate d7/d9/df6/f119 838965 0 2024-04-27T07:33:34.398 INFO:tasks.workunit.client.0.smithi082.stdout:8/888: mknod d0/d2b/d80/dca/de6/d1c/d76/d11e/c123 0 2024-04-27T07:33:34.403 INFO:tasks.workunit.client.0.smithi082.stdout:2/887: dread d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:34.403 INFO:tasks.workunit.client.1.smithi100.stdout:7/373: getdents d1/dd/d16/d4a/d56 0 2024-04-27T07:33:34.406 INFO:tasks.workunit.client.1.smithi100.stdout:7/374: rename d1/dd/d16/d70/c5c to d1/dd/d16/d70/d51/c71 0 2024-04-27T07:33:34.407 INFO:tasks.workunit.client.1.smithi100.stdout:7/375: stat d1/dd/d16/d31/d4c/d4d/c39 0 2024-04-27T07:33:34.407 INFO:tasks.workunit.client.1.smithi100.stdout:2/466: sync 2024-04-27T07:33:34.408 INFO:tasks.workunit.client.1.smithi100.stdout:7/376: dread - d1/dd/d16/d31/d4c/d4d/f6b zero size 2024-04-27T07:33:34.409 INFO:tasks.workunit.client.0.smithi082.stdout:8/889: dwrite d0/d2b/d9a/da4/d35/fbd [4194304,4194304] 0 2024-04-27T07:33:34.410 INFO:tasks.workunit.client.1.smithi100.stdout:7/377: read d1/dd/d16/f2d [227380,40760] 0 2024-04-27T07:33:34.411 INFO:tasks.workunit.client.1.smithi100.stdout:2/467: rmdir d0/da/d29/d47 39 2024-04-27T07:33:34.411 INFO:tasks.workunit.client.1.smithi100.stdout:7/378: read d1/dd/f1e [2951295,19258] 0 2024-04-27T07:33:34.412 INFO:tasks.workunit.client.0.smithi082.stdout:4/973: dwrite d3/d9/fbd [0,4194304] 0 2024-04-27T07:33:34.415 INFO:tasks.workunit.client.0.smithi082.stdout:7/912: sync 2024-04-27T07:33:34.415 INFO:tasks.workunit.client.0.smithi082.stdout:1/835: sync 2024-04-27T07:33:34.416 INFO:tasks.workunit.client.0.smithi082.stdout:4/974: unlink d3/d6/c42 0 2024-04-27T07:33:34.417 INFO:tasks.workunit.client.1.smithi100.stdout:7/379: rename d1/dd/d16/d4a/d56/c64 to d1/dd/d16/d3e/c72 0 2024-04-27T07:33:34.417 INFO:tasks.workunit.client.0.smithi082.stdout:8/890: truncate d0/d2b/d80/dca/de6/d1b/f1e 3792614 0 2024-04-27T07:33:34.417 INFO:tasks.workunit.client.0.smithi082.stdout:1/836: readlink d4/d15/d49/d99/d9a/dc7/df9/lf7 0 2024-04-27T07:33:34.417 INFO:tasks.workunit.client.1.smithi100.stdout:7/380: write d1/d54/f5f [679350,9500] 0 2024-04-27T07:33:34.418 INFO:tasks.workunit.client.0.smithi082.stdout:2/888: write d7/d9/d4f/d66/dae/fa9 [2216142,107993] 0 2024-04-27T07:33:34.419 INFO:tasks.workunit.client.1.smithi100.stdout:7/381: truncate d1/dd/f47 5470625 0 2024-04-27T07:33:34.419 INFO:tasks.workunit.client.0.smithi082.stdout:1/837: chown d4/d15/d29/c3c 3 1 2024-04-27T07:33:34.422 INFO:tasks.workunit.client.0.smithi082.stdout:8/891: write d0/d2b/d6f/f78 [9159263,127058] 0 2024-04-27T07:33:34.422 INFO:tasks.workunit.client.1.smithi100.stdout:7/382: creat d1/dd/d16/d4a/f73 x:0 0 0 2024-04-27T07:33:34.423 INFO:tasks.workunit.client.0.smithi082.stdout:9/822: dread d9/f21 [0,4194304] 0 2024-04-27T07:33:34.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/942: dread d2/d1e/d32/d85/d97/f118 [0,4194304] 0 2024-04-27T07:33:34.426 INFO:tasks.workunit.client.0.smithi082.stdout:1/838: mknod d4/d15/d49/d99/d9a/dc7/df9/c11f 0 2024-04-27T07:33:34.427 INFO:tasks.workunit.client.0.smithi082.stdout:2/889: truncate d7/d9/d4f/d66/f8e 507227 0 2024-04-27T07:33:34.428 INFO:tasks.workunit.client.0.smithi082.stdout:1/839: readlink d4/d15/d49/d99/d9a/dc7/df9/lf7 0 2024-04-27T07:33:34.429 INFO:tasks.workunit.client.1.smithi100.stdout:7/383: dwrite d1/dd/d16/d4a/f73 [0,4194304] 0 2024-04-27T07:33:34.429 INFO:tasks.workunit.client.0.smithi082.stdout:9/823: mkdir d9/d2d/d2b/d46/d5d/d6f/d118 0 2024-04-27T07:33:34.431 INFO:tasks.workunit.client.1.smithi100.stdout:7/384: read - d1/dd/d16/d4a/d56/f5e zero size 2024-04-27T07:33:34.432 INFO:tasks.workunit.client.1.smithi100.stdout:7/385: getdents d1/dd/d16/d70/d6e 0 2024-04-27T07:33:34.432 INFO:tasks.workunit.client.0.smithi082.stdout:6/943: creat d2/d3/d1b/f145 x:0 0 0 2024-04-27T07:33:34.433 INFO:tasks.workunit.client.1.smithi100.stdout:7/386: read - d1/dd/d16/d31/d4c/d4d/f6b zero size 2024-04-27T07:33:34.434 INFO:tasks.workunit.client.1.smithi100.stdout:7/387: truncate d1/dd/d16/f26 4412183 0 2024-04-27T07:33:34.435 INFO:tasks.workunit.client.0.smithi082.stdout:2/890: symlink d7/d31/d54/l120 0 2024-04-27T07:33:34.435 INFO:tasks.workunit.client.1.smithi100.stdout:7/388: write d1/f33 [1424546,107721] 0 2024-04-27T07:33:34.435 INFO:tasks.workunit.client.0.smithi082.stdout:7/913: dread d3/d49/d97/d3a/f68 [0,4194304] 0 2024-04-27T07:33:34.436 INFO:tasks.workunit.client.1.smithi100.stdout:7/389: write d1/f32 [182860,30960] 0 2024-04-27T07:33:34.437 INFO:tasks.workunit.client.1.smithi100.stdout:7/390: chown d1/dd/f47 1458793876 1 2024-04-27T07:33:34.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/944: write d2/d75/fbe [1142813,57818] 0 2024-04-27T07:33:34.438 INFO:tasks.workunit.client.0.smithi082.stdout:4/975: dread d3/d6/f58 [0,4194304] 0 2024-04-27T07:33:34.439 INFO:tasks.workunit.client.0.smithi082.stdout:8/892: creat d0/d2b/d80/dca/de6/d1c/d76/f124 x:0 0 0 2024-04-27T07:33:34.439 INFO:tasks.workunit.client.0.smithi082.stdout:2/891: creat d7/d9/f121 x:0 0 0 2024-04-27T07:33:34.443 INFO:tasks.workunit.client.0.smithi082.stdout:6/945: chown d2/d3/l12 56 1 2024-04-27T07:33:34.443 INFO:tasks.workunit.client.0.smithi082.stdout:4/976: write d3/d9/fbd [113166,94315] 0 2024-04-27T07:33:34.443 INFO:tasks.workunit.client.0.smithi082.stdout:9/824: mknod d9/da/dc/d73/dbb/c119 0 2024-04-27T07:33:34.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/840: creat d4/d15/d49/d99/de8/d102/f120 x:0 0 0 2024-04-27T07:33:34.444 INFO:tasks.workunit.client.0.smithi082.stdout:7/914: symlink d3/d49/d97/d6c/ddc/l13f 0 2024-04-27T07:33:34.444 INFO:tasks.workunit.client.1.smithi100.stdout:7/391: dwrite d1/dd/d16/f66 [0,4194304] 0 2024-04-27T07:33:34.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/892: creat d7/d9/d4f/d6e/d82/dc6/f122 x:0 0 0 2024-04-27T07:33:34.446 INFO:tasks.workunit.client.0.smithi082.stdout:6/946: creat d2/d2e/d6c/df1/f146 x:0 0 0 2024-04-27T07:33:34.447 INFO:tasks.workunit.client.1.smithi100.stdout:7/392: creat d1/dd/d16/d31/d4c/d4d/d3b/d40/f74 x:0 0 0 2024-04-27T07:33:34.448 INFO:tasks.workunit.client.0.smithi082.stdout:8/893: truncate d0/d2b/d80/dca/de6/fc1 564965 0 2024-04-27T07:33:34.450 INFO:tasks.workunit.client.0.smithi082.stdout:8/894: write d0/d2b/d9a/da4/d35/f75 [1921553,65198] 0 2024-04-27T07:33:34.451 INFO:tasks.workunit.client.1.smithi100.stdout:7/393: mkdir d1/d75 0 2024-04-27T07:33:34.451 INFO:tasks.workunit.client.0.smithi082.stdout:7/915: creat d3/db1/f140 x:0 0 0 2024-04-27T07:33:34.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/825: rename d9/d2d/d2b/d46/le7 to d9/da/dc/d33/d5e/l11a 0 2024-04-27T07:33:34.453 INFO:tasks.workunit.client.1.smithi100.stdout:7/394: symlink d1/dd/d16/d2b/l76 0 2024-04-27T07:33:34.455 INFO:tasks.workunit.client.0.smithi082.stdout:2/893: mkdir d7/d9/d4f/d6e/d123 0 2024-04-27T07:33:34.456 INFO:tasks.workunit.client.0.smithi082.stdout:6/947: symlink d2/d1e/d32/d7d/dbc/l147 0 2024-04-27T07:33:34.458 INFO:tasks.workunit.client.1.smithi100.stdout:7/395: dread d1/dd/d2a/d2c/f2e [0,4194304] 0 2024-04-27T07:33:34.458 INFO:tasks.workunit.client.0.smithi082.stdout:8/895: rmdir d0/d2b/d9a/da4/d35 39 2024-04-27T07:33:34.459 INFO:tasks.workunit.client.1.smithi100.stdout:7/396: getdents d1/d75 0 2024-04-27T07:33:34.461 INFO:tasks.workunit.client.1.smithi100.stdout:7/397: symlink d1/dd/d16/d70/d51/d6f/l77 0 2024-04-27T07:33:34.462 INFO:tasks.workunit.client.0.smithi082.stdout:4/977: rename d3/fba to d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10b/f140 0 2024-04-27T07:33:34.464 INFO:tasks.workunit.client.0.smithi082.stdout:7/916: truncate d3/d49/d97/d3a/d2a/f57 240895 0 2024-04-27T07:33:34.465 INFO:tasks.workunit.client.1.smithi100.stdout:7/398: fsync d1/dd/d16/d4a/f73 0 2024-04-27T07:33:34.465 INFO:tasks.workunit.client.0.smithi082.stdout:9/826: dread - d9/da/dc/d35/d38/da5/faf zero size 2024-04-27T07:33:34.466 INFO:tasks.workunit.client.0.smithi082.stdout:9/827: chown d9/da/dc/d35/d4a/d7e/ce5 163272246 1 2024-04-27T07:33:34.467 INFO:tasks.workunit.client.1.smithi100.stdout:7/399: mkdir d1/dd/d16/d31/d4c/d4d/d3b/d40/d78 0 2024-04-27T07:33:34.467 INFO:tasks.workunit.client.0.smithi082.stdout:4/978: dread d3/d9/fbd [0,4194304] 0 2024-04-27T07:33:34.468 INFO:tasks.workunit.client.1.smithi100.stdout:7/400: creat d1/dd/d16/d70/f79 x:0 0 0 2024-04-27T07:33:34.469 INFO:tasks.workunit.client.0.smithi082.stdout:4/979: dread - d3/d6/d26/d5e/d11e/d101/d69/df5/f132 zero size 2024-04-27T07:33:34.470 INFO:tasks.workunit.client.1.smithi100.stdout:7/401: mknod d1/dd/d16/d70/d51/c7a 0 2024-04-27T07:33:34.471 INFO:tasks.workunit.client.0.smithi082.stdout:7/917: creat d3/d49/d97/d3a/d2a/dac/da9/f141 x:0 0 0 2024-04-27T07:33:34.471 INFO:tasks.workunit.client.1.smithi100.stdout:7/402: write d1/d54/f5f [1163083,15781] 0 2024-04-27T07:33:34.472 INFO:tasks.workunit.client.1.smithi100.stdout:7/403: stat d1/f32 0 2024-04-27T07:33:34.473 INFO:tasks.workunit.client.1.smithi100.stdout:7/404: unlink d1/dd/d16/l55 0 2024-04-27T07:33:34.474 INFO:tasks.workunit.client.0.smithi082.stdout:4/980: write d3/d6/d26/d55/dc5/fc9 [48070,4955] 0 2024-04-27T07:33:34.476 INFO:tasks.workunit.client.0.smithi082.stdout:6/948: creat d2/d1e/d32/d85/d10c/d113/d134/f148 x:0 0 0 2024-04-27T07:33:34.477 INFO:tasks.workunit.client.0.smithi082.stdout:6/949: read - d2/d3/d1b/f145 zero size 2024-04-27T07:33:34.478 INFO:tasks.workunit.client.0.smithi082.stdout:9/828: creat d9/d2d/d2b/d46/d5d/d6f/d118/f11b x:0 0 0 2024-04-27T07:33:34.480 INFO:tasks.workunit.client.0.smithi082.stdout:7/918: rename d3/db1/f117 to d3/d49/d97/d3a/d2a/dac/d91/d102/f142 0 2024-04-27T07:33:34.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/981: mkdir d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d141 0 2024-04-27T07:33:34.484 INFO:tasks.workunit.client.1.smithi100.stdout:7/405: dread d1/f6 [0,4194304] 0 2024-04-27T07:33:34.486 INFO:tasks.workunit.client.1.smithi100.stdout:7/406: mknod d1/dd/d16/d70/c7b 0 2024-04-27T07:33:34.486 INFO:tasks.workunit.client.0.smithi082.stdout:8/896: write d0/d2b/d9a/de5/fce [3938622,40714] 0 2024-04-27T07:33:34.487 INFO:tasks.workunit.client.0.smithi082.stdout:9/829: fdatasync d9/d2d/d2b/d46/f58 0 2024-04-27T07:33:34.487 INFO:tasks.workunit.client.0.smithi082.stdout:8/897: readlink d0/d2b/d9a/da4/laf 0 2024-04-27T07:33:34.488 INFO:tasks.workunit.client.0.smithi082.stdout:7/919: creat d3/d9/d4f/d9a/f143 x:0 0 0 2024-04-27T07:33:34.489 INFO:tasks.workunit.client.0.smithi082.stdout:8/898: fdatasync d0/d2b/d80/dca/de6/d1b/d53/fd3 0 2024-04-27T07:33:34.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/899: readlink d0/d2b/d80/dca/l110 0 2024-04-27T07:33:34.491 INFO:tasks.workunit.client.0.smithi082.stdout:9/830: creat d9/d48/dd6/f11c x:0 0 0 2024-04-27T07:33:34.492 INFO:tasks.workunit.client.1.smithi100.stdout:7/407: dwrite d1/d54/f5f [0,4194304] 0 2024-04-27T07:33:34.492 INFO:tasks.workunit.client.0.smithi082.stdout:9/831: chown d9/d2d/d2b/d46 116820 1 2024-04-27T07:33:34.494 INFO:tasks.workunit.client.0.smithi082.stdout:7/920: creat d3/d9/dda/d11e/f144 x:0 0 0 2024-04-27T07:33:34.494 INFO:tasks.workunit.client.0.smithi082.stdout:4/982: dwrite d3/d6/d26/d55/ffc [0,4194304] 0 2024-04-27T07:33:34.495 INFO:tasks.workunit.client.1.smithi100.stdout:7/408: creat d1/dd/d16/d3e/f7c x:0 0 0 2024-04-27T07:33:34.496 INFO:tasks.workunit.client.0.smithi082.stdout:4/983: fdatasync d3/d6/f3e 0 2024-04-27T07:33:34.496 INFO:tasks.workunit.client.1.smithi100.stdout:7/409: read d1/dd/d16/d70/f36 [25783,20062] 0 2024-04-27T07:33:34.496 INFO:tasks.workunit.client.1.smithi100.stdout:7/410: chown d1/ca 15772 1 2024-04-27T07:33:34.497 INFO:tasks.workunit.client.0.smithi082.stdout:8/900: mkdir d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/d11c/d125 0 2024-04-27T07:33:34.498 INFO:tasks.workunit.client.1.smithi100.stdout:7/411: mknod d1/dd/d16/d31/c7d 0 2024-04-27T07:33:34.498 INFO:tasks.workunit.client.0.smithi082.stdout:9/832: mknod d9/d2d/d2b/d46/db6/c11d 0 2024-04-27T07:33:34.500 INFO:tasks.workunit.client.1.smithi100.stdout:7/412: symlink d1/dd/d16/d31/d4c/l7e 0 2024-04-27T07:33:34.501 INFO:tasks.workunit.client.1.smithi100.stdout:7/413: fsync d1/dd/d2a/f68 0 2024-04-27T07:33:34.502 INFO:tasks.workunit.client.1.smithi100.stdout:7/414: mkdir d1/dd/d16/d2b/d7f 0 2024-04-27T07:33:34.503 INFO:tasks.workunit.client.0.smithi082.stdout:6/950: write d2/d1e/d32/d7d/fc5 [905443,72331] 0 2024-04-27T07:33:34.503 INFO:tasks.workunit.client.1.smithi100.stdout:7/415: readlink d1/dd/d16/d31/d4c/l6c 0 2024-04-27T07:33:34.506 INFO:tasks.workunit.client.0.smithi082.stdout:8/901: creat d0/d2b/d80/dca/de6/d87/d42/d7f/f126 x:0 0 0 2024-04-27T07:33:34.506 INFO:tasks.workunit.client.0.smithi082.stdout:7/921: fsync d3/dfb/da1/f10e 0 2024-04-27T07:33:34.507 INFO:tasks.workunit.client.0.smithi082.stdout:7/922: stat d3/d9/d4f/d61/lcd 0 2024-04-27T07:33:34.509 INFO:tasks.workunit.client.0.smithi082.stdout:9/833: mknod d9/da/dc/d35/d4b/c11e 0 2024-04-27T07:33:34.510 INFO:tasks.workunit.client.0.smithi082.stdout:9/834: dread - d9/da/dc/d88/df7/f106 zero size 2024-04-27T07:33:34.510 INFO:tasks.workunit.client.0.smithi082.stdout:6/951: creat d2/d1e/d32/d7d/dbc/f149 x:0 0 0 2024-04-27T07:33:34.511 INFO:tasks.workunit.client.0.smithi082.stdout:9/835: chown d9/da/dc/f20 762641144 1 2024-04-27T07:33:34.511 INFO:tasks.workunit.client.0.smithi082.stdout:6/952: chown d2/d2d/d4a/ff3 17959061 1 2024-04-27T07:33:34.513 INFO:tasks.workunit.client.0.smithi082.stdout:8/902: symlink d0/d2b/d92/l127 0 2024-04-27T07:33:34.514 INFO:tasks.workunit.client.0.smithi082.stdout:9/836: rmdir d9/d2d/d2b/d46/d5d/d6f/d118 39 2024-04-27T07:33:34.514 INFO:tasks.workunit.client.0.smithi082.stdout:9/837: read - d9/d2d/d72/fe8 zero size 2024-04-27T07:33:34.515 INFO:tasks.workunit.client.0.smithi082.stdout:6/953: symlink d2/d1e/d32/d85/d10c/l14a 0 2024-04-27T07:33:34.516 INFO:tasks.workunit.client.0.smithi082.stdout:9/838: write d9/da/dc/d35/d38/dc5/ffa [441233,93741] 0 2024-04-27T07:33:34.517 INFO:tasks.workunit.client.0.smithi082.stdout:9/839: readlink d9/da/dc/d33/d5e/le6 0 2024-04-27T07:33:34.518 INFO:tasks.workunit.client.0.smithi082.stdout:7/923: link d3/d9/d4f/d9a/fe7 d3/dfb/da1/da3/f145 0 2024-04-27T07:33:34.520 INFO:tasks.workunit.client.0.smithi082.stdout:8/903: unlink d0/d2b/d80/dca/de6/c62 0 2024-04-27T07:33:34.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/954: mkdir d2/d2d/d4a/de4/dcc/d14b 0 2024-04-27T07:33:34.524 INFO:tasks.workunit.client.0.smithi082.stdout:8/904: rmdir d0/d2b/d80/dca/de6/d1c/d76/da0/df9/df5 39 2024-04-27T07:33:34.526 INFO:tasks.workunit.client.0.smithi082.stdout:7/924: dwrite d3/d49/d97/d3a/d2a/dac/d91/d102/f11a [8388608,4194304] 0 2024-04-27T07:33:34.527 INFO:tasks.workunit.client.0.smithi082.stdout:8/905: chown d0/d2b/d80/dca/de6/d87/fee 27 1 2024-04-27T07:33:34.529 INFO:tasks.workunit.client.0.smithi082.stdout:6/955: rename d2/d1e/d32/d7d/dbc to d2/d1e/d32/d85/d14c 0 2024-04-27T07:33:34.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/925: truncate d3/d49/d97/d3a/d2a/dac/d91/d102/f122 725953 0 2024-04-27T07:33:34.530 INFO:tasks.workunit.client.0.smithi082.stdout:8/906: rmdir d0/d2b/d80/dca/de6/d87/d42/d7f 39 2024-04-27T07:33:34.532 INFO:tasks.workunit.client.0.smithi082.stdout:8/907: chown d0/d2b/d80/dca/de6/d87/d42/d7f/d82/cba 2019999 1 2024-04-27T07:33:34.536 INFO:tasks.workunit.client.0.smithi082.stdout:7/926: link d3/d49/l105 d3/d49/d97/l146 0 2024-04-27T07:33:34.539 INFO:tasks.workunit.client.0.smithi082.stdout:8/908: creat d0/d2b/d80/dca/de6/d87/f128 x:0 0 0 2024-04-27T07:33:34.542 INFO:tasks.workunit.client.0.smithi082.stdout:9/840: dwrite d9/da/dc/d33/d5e/faa [0,4194304] 0 2024-04-27T07:33:34.542 INFO:tasks.workunit.client.0.smithi082.stdout:8/909: read d0/d2b/d80/dca/de6/fc1 [73726,49286] 0 2024-04-27T07:33:34.544 INFO:tasks.workunit.client.0.smithi082.stdout:7/927: rename d3/db1/c11f to d3/d49/d97/d3a/d2a/dac/d91/d102/c147 0 2024-04-27T07:33:34.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/910: rmdir d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/d11c/d125 0 2024-04-27T07:33:34.553 INFO:tasks.workunit.client.0.smithi082.stdout:9/841: getdents d9/da/dc/d35/d4a/d7e 0 2024-04-27T07:33:34.553 INFO:tasks.workunit.client.0.smithi082.stdout:7/928: getdents d3/d49/d97/d6c/ddc 0 2024-04-27T07:33:34.554 INFO:tasks.workunit.client.0.smithi082.stdout:8/911: creat d0/d2b/d80/dca/de6/d1c/d76/da0/f129 x:0 0 0 2024-04-27T07:33:34.554 INFO:tasks.workunit.client.0.smithi082.stdout:7/929: chown d3/d49/d97/d3a/d2a/dac/f90 225 1 2024-04-27T07:33:34.558 INFO:tasks.workunit.client.0.smithi082.stdout:7/930: stat d3/d9/d4f/l9d 0 2024-04-27T07:33:34.560 INFO:tasks.workunit.client.0.smithi082.stdout:8/912: dread d0/d2b/d9a/da4/d35/fbd [4194304,4194304] 0 2024-04-27T07:33:34.561 INFO:tasks.workunit.client.0.smithi082.stdout:8/913: symlink d0/d2b/d80/dca/de6/d1c/l12a 0 2024-04-27T07:33:34.563 INFO:tasks.workunit.client.0.smithi082.stdout:8/914: mkdir d0/d2b/d80/dca/de6/d1c/d76/da0/d12b 0 2024-04-27T07:33:34.564 INFO:tasks.workunit.client.0.smithi082.stdout:8/915: chown d0/d2b/d9a/fd0 0 1 2024-04-27T07:33:34.564 INFO:tasks.workunit.client.0.smithi082.stdout:9/842: write d9/da/dc/d33/f47 [3528181,44758] 0 2024-04-27T07:33:34.565 INFO:tasks.workunit.client.0.smithi082.stdout:8/916: rmdir d0 39 2024-04-27T07:33:34.569 INFO:tasks.workunit.client.0.smithi082.stdout:8/917: symlink d0/d2b/d9a/da4/l12c 0 2024-04-27T07:33:34.570 INFO:tasks.workunit.client.0.smithi082.stdout:9/843: write d9/da/fa3 [336148,116903] 0 2024-04-27T07:33:34.570 INFO:tasks.workunit.client.0.smithi082.stdout:9/844: chown d9/da/l1c 70 1 2024-04-27T07:33:34.574 INFO:tasks.workunit.client.1.smithi100.stdout:9/385: sync 2024-04-27T07:33:34.575 INFO:tasks.workunit.client.0.smithi082.stdout:9/845: getdents d9/da/dc/d35/d38 0 2024-04-27T07:33:34.575 INFO:tasks.workunit.client.0.smithi082.stdout:7/931: dread d3/db/f46 [0,4194304] 0 2024-04-27T07:33:34.576 INFO:tasks.workunit.client.0.smithi082.stdout:7/932: symlink d3/de9/l148 0 2024-04-27T07:33:34.578 INFO:tasks.workunit.client.0.smithi082.stdout:7/933: unlink d3/d9/d4f/d9a/cf1 0 2024-04-27T07:33:34.582 INFO:tasks.workunit.client.0.smithi082.stdout:7/934: getdents d3/d9/d4f 0 2024-04-27T07:33:34.582 INFO:tasks.workunit.client.1.smithi100.stdout:7/416: dwrite d1/dd/d16/f66 [0,4194304] 0 2024-04-27T07:33:34.583 INFO:tasks.workunit.client.0.smithi082.stdout:7/935: dread - d3/d49/d97/d3a/d71/da0/ddf/f114 zero size 2024-04-27T07:33:34.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/936: link d3/db/c84 d3/d9/d7c/c149 0 2024-04-27T07:33:34.590 INFO:tasks.workunit.client.0.smithi082.stdout:7/937: rename d3/d49/d97/d3a/d2a/dac/d91/fa5 to d3/db/dc1/f14a 0 2024-04-27T07:33:34.591 INFO:tasks.workunit.client.1.smithi100.stdout:7/417: getdents d1/dd/d16/d31 0 2024-04-27T07:33:34.592 INFO:tasks.workunit.client.1.smithi100.stdout:9/386: dwrite d1/f29 [0,4194304] 0 2024-04-27T07:33:34.599 INFO:tasks.workunit.client.1.smithi100.stdout:7/418: write d1/d54/f5f [4649876,105949] 0 2024-04-27T07:33:34.599 INFO:tasks.workunit.client.1.smithi100.stdout:9/387: write d1/d9/db/f4e [578586,3875] 0 2024-04-27T07:33:34.601 INFO:tasks.workunit.client.1.smithi100.stdout:9/388: chown d1/d9/f25 3 1 2024-04-27T07:33:34.602 INFO:tasks.workunit.client.1.smithi100.stdout:9/389: chown d1/d9/d1f/f7a 74376100 1 2024-04-27T07:33:34.605 INFO:tasks.workunit.client.1.smithi100.stdout:7/419: truncate d1/dd/d16/d31/d4c/d4d/d3b/f45 1647755 0 2024-04-27T07:33:34.606 INFO:tasks.workunit.client.1.smithi100.stdout:7/420: fsync d1/dd/d16/d4a/d56/f5e 0 2024-04-27T07:33:34.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/938: dwrite d3/d9/f2d [0,4194304] 0 2024-04-27T07:33:34.609 INFO:tasks.workunit.client.0.smithi082.stdout:7/939: write d3/d49/d97/d3a/d71/da0/ddf/f114 [271331,48909] 0 2024-04-27T07:33:34.609 INFO:tasks.workunit.client.1.smithi100.stdout:7/421: read d1/fc [1411898,4508] 0 2024-04-27T07:33:34.609 INFO:tasks.workunit.client.1.smithi100.stdout:7/422: chown d1/c10 258553025 1 2024-04-27T07:33:34.610 INFO:tasks.workunit.client.0.smithi082.stdout:7/940: fdatasync d3/d49/d97/d3a/d2a/dac/d91/f106 0 2024-04-27T07:33:34.611 INFO:tasks.workunit.client.1.smithi100.stdout:9/390: dread d1/d9/d1f/f3a [0,4194304] 0 2024-04-27T07:33:34.612 INFO:tasks.workunit.client.1.smithi100.stdout:7/423: symlink d1/dd/d16/d70/d51/d6f/l80 0 2024-04-27T07:33:34.615 INFO:tasks.workunit.client.0.smithi082.stdout:7/941: dwrite d3/db1/fee [0,4194304] 0 2024-04-27T07:33:34.615 INFO:tasks.workunit.client.1.smithi100.stdout:9/391: creat d1/d9/d1f/f8e x:0 0 0 2024-04-27T07:33:34.616 INFO:tasks.workunit.client.0.smithi082.stdout:7/942: chown d3/d9/d7c/f8f 1286 1 2024-04-27T07:33:34.617 INFO:tasks.workunit.client.0.smithi082.stdout:7/943: readlink d3/d9/d7c/l8b 0 2024-04-27T07:33:34.617 INFO:tasks.workunit.client.1.smithi100.stdout:7/424: dread d1/dd/d2a/f62 [0,4194304] 0 2024-04-27T07:33:34.619 INFO:tasks.workunit.client.1.smithi100.stdout:9/392: unlink d1/d9/db/d2b/l73 0 2024-04-27T07:33:34.620 INFO:tasks.workunit.client.1.smithi100.stdout:9/393: dread - d1/d9/db/d2b/f7f zero size 2024-04-27T07:33:34.622 INFO:tasks.workunit.client.0.smithi082.stdout:7/944: link d3/d49/d97/f6a d3/db/d12e/f14b 0 2024-04-27T07:33:34.622 INFO:tasks.workunit.client.1.smithi100.stdout:9/394: fdatasync d1/d9/db/f4e 0 2024-04-27T07:33:34.622 INFO:tasks.workunit.client.0.smithi082.stdout:7/945: dread - d3/db/f13e zero size 2024-04-27T07:33:34.624 INFO:tasks.workunit.client.1.smithi100.stdout:7/425: dwrite d1/dd/d16/d31/d4c/d4d/f6b [0,4194304] 0 2024-04-27T07:33:34.627 INFO:tasks.workunit.client.0.smithi082.stdout:7/946: dwrite d3/d49/d97/d3a/f92 [0,4194304] 0 2024-04-27T07:33:34.632 INFO:tasks.workunit.client.1.smithi100.stdout:9/395: dwrite d1/d9/d1f/d52/d54/f5f [0,4194304] 0 2024-04-27T07:33:34.632 INFO:tasks.workunit.client.0.smithi082.stdout:7/947: getdents d3/d49/d97/d3a/d71/da0 0 2024-04-27T07:33:34.633 INFO:tasks.workunit.client.0.smithi082.stdout:7/948: truncate d3/dfb/da1/f10e 969440 0 2024-04-27T07:33:34.636 INFO:tasks.workunit.client.0.smithi082.stdout:7/949: dread d3/d49/d97/d3a/d2a/f57 [0,4194304] 0 2024-04-27T07:33:34.637 INFO:tasks.workunit.client.1.smithi100.stdout:7/426: dwrite d1/dd/d16/d31/d4c/d4d/f25 [0,4194304] 0 2024-04-27T07:33:34.637 INFO:tasks.workunit.client.0.smithi082.stdout:7/950: chown d3/d49/d97/d3a/f68 5871 1 2024-04-27T07:33:34.638 INFO:tasks.workunit.client.0.smithi082.stdout:7/951: fsync d3/d49/d97/d3a/f127 0 2024-04-27T07:33:34.639 INFO:tasks.workunit.client.1.smithi100.stdout:9/396: creat d1/d9/d1f/d71/f8f x:0 0 0 2024-04-27T07:33:34.639 INFO:tasks.workunit.client.0.smithi082.stdout:7/952: dread - d3/fc8 zero size 2024-04-27T07:33:34.640 INFO:tasks.workunit.client.1.smithi100.stdout:7/427: read - d1/dd/d16/d31/d4c/d4d/f6a zero size 2024-04-27T07:33:34.640 INFO:tasks.workunit.client.1.smithi100.stdout:9/397: creat d1/d9/d1f/d71/f90 x:0 0 0 2024-04-27T07:33:34.641 INFO:tasks.workunit.client.0.smithi082.stdout:7/953: chown d3/d49/d97/d3a/d2a/dac/da9/f12c 129290302 1 2024-04-27T07:33:34.642 INFO:tasks.workunit.client.1.smithi100.stdout:7/428: rename d1/dd/d16/d31/d4c/d4d/d3b/f3f to d1/dd/d16/d31/d4c/f81 0 2024-04-27T07:33:34.645 INFO:tasks.workunit.client.0.smithi082.stdout:7/954: creat d3/db/d12e/f14c x:0 0 0 2024-04-27T07:33:34.646 INFO:tasks.workunit.client.1.smithi100.stdout:7/429: symlink d1/dd/d16/d4a/d56/l82 0 2024-04-27T07:33:34.647 INFO:tasks.workunit.client.0.smithi082.stdout:7/955: mkdir d3/db/d12e/d14d 0 2024-04-27T07:33:34.648 INFO:tasks.workunit.client.0.smithi082.stdout:7/956: chown d3/d9/d4f/f6b 0 1 2024-04-27T07:33:34.649 INFO:tasks.workunit.client.1.smithi100.stdout:7/430: creat d1/dd/d16/d2b/d7f/f83 x:0 0 0 2024-04-27T07:33:34.652 INFO:tasks.workunit.client.0.smithi082.stdout:7/957: creat d3/d9/d4f/d61/d12a/f14e x:0 0 0 2024-04-27T07:33:34.663 INFO:tasks.workunit.client.0.smithi082.stdout:7/958: write d3/d9/d4f/d61/fc9 [690157,75104] 0 2024-04-27T07:33:34.664 INFO:tasks.workunit.client.0.smithi082.stdout:7/959: creat d3/d9/d13d/f14f x:0 0 0 2024-04-27T07:33:34.668 INFO:tasks.workunit.client.0.smithi082.stdout:7/960: link d3/de9/feb d3/d49/d97/d3a/d2a/dac/dae/dce/f150 0 2024-04-27T07:33:34.668 INFO:tasks.workunit.client.1.smithi100.stdout:7/431: fsync d1/dd/d16/d31/d4c/d4d/f6b 0 2024-04-27T07:33:34.669 INFO:tasks.workunit.client.1.smithi100.stdout:7/432: dread - d1/dd/d16/d70/f79 zero size 2024-04-27T07:33:34.671 INFO:tasks.workunit.client.1.smithi100.stdout:7/433: write d1/dd/d16/d70/d51/f65 [599593,90500] 0 2024-04-27T07:33:34.678 INFO:tasks.workunit.client.0.smithi082.stdout:7/961: truncate d3/d49/d97/d3a/fad 240996 0 2024-04-27T07:33:34.714 INFO:tasks.workunit.client.0.smithi082.stdout:7/962: write d3/d49/d97/d3a/d2a/dac/d91/f12d [61274,124149] 0 2024-04-27T07:33:34.716 INFO:tasks.workunit.client.0.smithi082.stdout:7/963: creat d3/d9/dda/d11e/f151 x:0 0 0 2024-04-27T07:33:34.719 INFO:tasks.workunit.client.0.smithi082.stdout:7/964: dread d3/d49/d97/d3a/f21 [0,4194304] 0 2024-04-27T07:33:34.720 INFO:tasks.workunit.client.0.smithi082.stdout:7/965: getdents d3/d9/d4f/d9a/de1 0 2024-04-27T07:33:34.721 INFO:tasks.workunit.client.0.smithi082.stdout:7/966: stat d3/d49/d97/d3a/d2a/f2b 0 2024-04-27T07:33:34.722 INFO:tasks.workunit.client.0.smithi082.stdout:7/967: symlink d3/de9/d125/l152 0 2024-04-27T07:33:34.723 INFO:tasks.workunit.client.0.smithi082.stdout:7/968: creat d3/d9/dda/f153 x:0 0 0 2024-04-27T07:33:34.726 INFO:tasks.workunit.client.0.smithi082.stdout:7/969: rename d3/d49/d97/c33 to d3/d49/d97/d3a/d2a/dac/dae/dce/c154 0 2024-04-27T07:33:34.727 INFO:tasks.workunit.client.0.smithi082.stdout:7/970: creat d3/d49/d97/d3a/d2a/dac/da9/f155 x:0 0 0 2024-04-27T07:33:34.730 INFO:tasks.workunit.client.0.smithi082.stdout:7/971: rename d3/db1/f140 to d3/de9/d125/f156 0 2024-04-27T07:33:34.734 INFO:tasks.workunit.client.0.smithi082.stdout:7/972: dwrite d3/d49/d97/d3a/d71/fcc [0,4194304] 0 2024-04-27T07:33:34.735 INFO:tasks.workunit.client.0.smithi082.stdout:7/973: chown d3/d9/d4f 15512 1 2024-04-27T07:33:34.736 INFO:tasks.workunit.client.0.smithi082.stdout:7/974: write d3/d49/d97/d3a/d71/da0/f10d [990186,431] 0 2024-04-27T07:33:34.744 INFO:tasks.workunit.client.1.smithi100.stdout:4/466: sync 2024-04-27T07:33:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:34 smithi082 ceph-mon[26613]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 199 MiB/s wr, 378 op/s 2024-04-27T07:33:34.871 INFO:tasks.workunit.client.0.smithi082.stdout:7/975: dwrite d3/d49/d97/d3a/d71/f7e [0,4194304] 0 2024-04-27T07:33:34.872 INFO:tasks.workunit.client.1.smithi100.stdout:8/398: sync 2024-04-27T07:33:34.874 INFO:tasks.workunit.client.0.smithi082.stdout:7/976: dread d3/f85 [0,4194304] 0 2024-04-27T07:33:34.875 INFO:tasks.workunit.client.0.smithi082.stdout:7/977: chown d3/d49/f10c 43 1 2024-04-27T07:33:34.878 INFO:tasks.workunit.client.1.smithi100.stdout:8/399: rename d6/l6f to d6/d1b/l78 0 2024-04-27T07:33:34.881 INFO:tasks.workunit.client.1.smithi100.stdout:8/400: mkdir d6/d1b/d79 0 2024-04-27T07:33:34.881 INFO:tasks.workunit.client.0.smithi082.stdout:7/978: write d3/dfb/f83 [919513,899] 0 2024-04-27T07:33:34.887 INFO:tasks.workunit.client.1.smithi100.stdout:8/401: dwrite d6/d20/f33 [0,4194304] 0 2024-04-27T07:33:34.889 INFO:tasks.workunit.client.1.smithi100.stdout:8/402: chown d6/f10 93 1 2024-04-27T07:33:34.890 INFO:tasks.workunit.client.0.smithi082.stdout:7/979: dwrite d3/d49/d97/f1e [0,4194304] 0 2024-04-27T07:33:34.890 INFO:tasks.workunit.client.1.smithi100.stdout:8/403: symlink d6/d20/l7a 0 2024-04-27T07:33:34.892 INFO:tasks.workunit.client.1.smithi100.stdout:8/404: symlink d6/d1b/d1d/d59/d4f/l7b 0 2024-04-27T07:33:34.893 INFO:tasks.workunit.client.0.smithi082.stdout:7/980: symlink d3/d49/d97/d6c/l157 0 2024-04-27T07:33:34.894 INFO:tasks.workunit.client.1.smithi100.stdout:8/405: symlink d6/d1b/d1d/d77/l7c 0 2024-04-27T07:33:34.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:34 smithi100 ceph-mon[34183]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 199 MiB/s wr, 378 op/s 2024-04-27T07:33:34.921 INFO:tasks.workunit.client.0.smithi082.stdout:1/841: sync 2024-04-27T07:33:34.921 INFO:tasks.workunit.client.0.smithi082.stdout:2/894: sync 2024-04-27T07:33:34.922 INFO:tasks.workunit.client.0.smithi082.stdout:7/981: dread d3/d49/f10c [0,4194304] 0 2024-04-27T07:33:34.923 INFO:tasks.workunit.client.1.smithi100.stdout:8/406: dread d6/d20/d2a/f37 [0,4194304] 0 2024-04-27T07:33:34.924 INFO:tasks.workunit.client.0.smithi082.stdout:1/842: mknod d4/d15/d49/d99/d9a/c121 0 2024-04-27T07:33:34.924 INFO:tasks.workunit.client.0.smithi082.stdout:1/843: fsync d4/fa1 0 2024-04-27T07:33:34.925 INFO:tasks.workunit.client.0.smithi082.stdout:7/982: write d3/d9/d4f/faa [2116246,37330] 0 2024-04-27T07:33:34.925 INFO:tasks.workunit.client.1.smithi100.stdout:8/407: rmdir d6/d1b/d79 0 2024-04-27T07:33:34.926 INFO:tasks.workunit.client.1.smithi100.stdout:8/408: dread - d6/d20/d50/f61 zero size 2024-04-27T07:33:34.926 INFO:tasks.workunit.client.0.smithi082.stdout:2/895: link d7/d8/d99/fda d7/d9/d4f/d6e/f124 0 2024-04-27T07:33:34.930 INFO:tasks.workunit.client.0.smithi082.stdout:2/896: truncate d7/d31/dde/fff 947637 0 2024-04-27T07:33:34.931 INFO:tasks.workunit.client.0.smithi082.stdout:1/844: dwrite d4/d15/d49/dab/feb [0,4194304] 0 2024-04-27T07:33:34.931 INFO:tasks.workunit.client.1.smithi100.stdout:8/409: dwrite d6/f18 [0,4194304] 0 2024-04-27T07:33:34.933 INFO:tasks.workunit.client.0.smithi082.stdout:1/845: write d4/d15/d49/dab/dc3/d3e/d57/d101/d98/fd8 [1976870,6783] 0 2024-04-27T07:33:34.933 INFO:tasks.workunit.client.0.smithi082.stdout:7/983: link d3/f53 d3/d49/d97/d3a/f158 0 2024-04-27T07:33:34.934 INFO:tasks.workunit.client.1.smithi100.stdout:8/410: symlink d6/d1b/d1d/l7d 0 2024-04-27T07:33:34.934 INFO:tasks.workunit.client.1.smithi100.stdout:5/364: sync 2024-04-27T07:33:34.935 INFO:tasks.workunit.client.0.smithi082.stdout:2/897: symlink d7/d8/d13/l125 0 2024-04-27T07:33:34.935 INFO:tasks.workunit.client.1.smithi100.stdout:8/411: write d6/d1b/f42 [4906147,59107] 0 2024-04-27T07:33:34.935 INFO:tasks.workunit.client.1.smithi100.stdout:5/365: chown d0/d4/d21/f50 507317050 1 2024-04-27T07:33:34.937 INFO:tasks.workunit.client.0.smithi082.stdout:7/984: read d3/d49/d97/d3a/d71/da0/ddf/f114 [82787,24188] 0 2024-04-27T07:33:34.937 INFO:tasks.workunit.client.0.smithi082.stdout:2/898: rmdir d7/d30 39 2024-04-27T07:33:34.939 INFO:tasks.workunit.client.0.smithi082.stdout:7/985: chown d3/db/ff 748 1 2024-04-27T07:33:34.940 INFO:tasks.workunit.client.1.smithi100.stdout:5/366: rename d0/f10 to d0/d4/f70 0 2024-04-27T07:33:34.942 INFO:tasks.workunit.client.0.smithi082.stdout:2/899: symlink d7/d30/l126 0 2024-04-27T07:33:34.942 INFO:tasks.workunit.client.0.smithi082.stdout:7/986: fsync d3/d49/d97/d3a/d2a/dac/da9/f155 0 2024-04-27T07:33:34.943 INFO:tasks.workunit.client.1.smithi100.stdout:8/412: rename d6/d20/d2a/l6a to d6/d20/d50/d72/l7e 0 2024-04-27T07:33:34.943 INFO:tasks.workunit.client.0.smithi082.stdout:1/846: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/d98/fd8 [4194304,4194304] 0 2024-04-27T07:33:34.944 INFO:tasks.workunit.client.0.smithi082.stdout:7/987: chown d3/d9/d4f/d9a/fea 86830 1 2024-04-27T07:33:34.945 INFO:tasks.workunit.client.0.smithi082.stdout:2/900: write d7/d9/d4f/d6e/d82/da4/de0/f117 [565070,67033] 0 2024-04-27T07:33:34.945 INFO:tasks.workunit.client.1.smithi100.stdout:5/367: unlink d0/d4/d21/d24/d2f/d39/d56/f63 0 2024-04-27T07:33:34.946 INFO:tasks.workunit.client.0.smithi082.stdout:7/988: chown d3/d49/d97/d3a/d71/da0 0 1 2024-04-27T07:33:34.946 INFO:tasks.workunit.client.0.smithi082.stdout:7/989: dread - d3/db/d12e/f14c zero size 2024-04-27T07:33:34.948 INFO:tasks.workunit.client.1.smithi100.stdout:8/413: creat d6/d4c/f7f x:0 0 0 2024-04-27T07:33:34.949 INFO:tasks.workunit.client.0.smithi082.stdout:7/990: write d3/d9/dda/d11e/d138/f112 [867465,69130] 0 2024-04-27T07:33:34.950 INFO:tasks.workunit.client.1.smithi100.stdout:5/368: rename d0/d4/d21/d24/d2f/d57/f53 to d0/d4/d21/d24/d46/f71 0 2024-04-27T07:33:34.952 INFO:tasks.workunit.client.1.smithi100.stdout:8/414: write d6/f3b [1675074,111186] 0 2024-04-27T07:33:34.952 INFO:tasks.workunit.client.0.smithi082.stdout:7/991: mkdir d3/db/d12e/d159 0 2024-04-27T07:33:34.953 INFO:tasks.workunit.client.1.smithi100.stdout:5/369: dread - d0/d4/d21/d24/d2f/d39/d56/d67/f68 zero size 2024-04-27T07:33:34.954 INFO:tasks.workunit.client.1.smithi100.stdout:8/415: fdatasync d6/d1b/d1d/d59/f58 0 2024-04-27T07:33:34.955 INFO:tasks.workunit.client.0.smithi082.stdout:1/847: dwrite d4/d15/d49/dab/dc3/d3e/d53/d72/fac [0,4194304] 0 2024-04-27T07:33:34.955 INFO:tasks.workunit.client.0.smithi082.stdout:7/992: write d3/d9/f37 [7086519,2365] 0 2024-04-27T07:33:34.956 INFO:tasks.workunit.client.1.smithi100.stdout:5/370: mkdir d0/d4/d21/d24/d2f/d57/d37/d1a/d72 0 2024-04-27T07:33:34.957 INFO:tasks.workunit.client.0.smithi082.stdout:2/901: dwrite d7/d14/d11f/f65 [0,4194304] 0 2024-04-27T07:33:34.962 INFO:tasks.workunit.client.1.smithi100.stdout:8/416: dwrite d6/d1b/f42 [4194304,4194304] 0 2024-04-27T07:33:34.962 INFO:tasks.workunit.client.0.smithi082.stdout:2/902: read d7/d8/d99/f115 [3741650,91285] 0 2024-04-27T07:33:34.965 INFO:tasks.workunit.client.1.smithi100.stdout:5/371: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 x:0 0 0 2024-04-27T07:33:34.966 INFO:tasks.workunit.client.1.smithi100.stdout:8/417: mknod d6/d1b/d1d/d77/c80 0 2024-04-27T07:33:34.969 INFO:tasks.workunit.client.1.smithi100.stdout:8/418: fsync d6/d1b/d1d/d59/f56 0 2024-04-27T07:33:34.974 INFO:tasks.workunit.client.0.smithi082.stdout:4/984: sync 2024-04-27T07:33:34.974 INFO:tasks.workunit.client.1.smithi100.stdout:5/372: mknod d0/d4/d21/d24/d2f/d57/d3e/d6a/c74 0 2024-04-27T07:33:34.991 INFO:tasks.workunit.client.1.smithi100.stdout:2/468: sync 2024-04-27T07:33:34.991 INFO:tasks.workunit.client.1.smithi100.stdout:3/573: sync 2024-04-27T07:33:34.991 INFO:tasks.workunit.client.1.smithi100.stdout:6/467: sync 2024-04-27T07:33:34.991 INFO:tasks.workunit.client.1.smithi100.stdout:0/436: sync 2024-04-27T07:33:34.992 INFO:tasks.workunit.client.1.smithi100.stdout:4/467: sync 2024-04-27T07:33:34.992 INFO:tasks.workunit.client.1.smithi100.stdout:1/565: sync 2024-04-27T07:33:34.992 INFO:tasks.workunit.client.1.smithi100.stdout:9/398: sync 2024-04-27T07:33:34.992 INFO:tasks.workunit.client.1.smithi100.stdout:7/434: sync 2024-04-27T07:33:34.994 INFO:tasks.workunit.client.1.smithi100.stdout:1/566: write d0/f14 [820112,71645] 0 2024-04-27T07:33:34.997 INFO:tasks.workunit.client.1.smithi100.stdout:5/373: creat d0/d4/d21/d24/d2f/d57/d3e/d6a/f75 x:0 0 0 2024-04-27T07:33:34.997 INFO:tasks.workunit.client.1.smithi100.stdout:0/437: rmdir d1/d8/d20/d88 39 2024-04-27T07:33:35.006 INFO:tasks.workunit.client.0.smithi082.stdout:7/993: unlink d3/d49/d97/l66 0 2024-04-27T07:33:35.008 INFO:tasks.workunit.client.0.smithi082.stdout:2/903: mknod d7/d9/d4f/d66/c127 0 2024-04-27T07:33:35.010 INFO:tasks.workunit.client.0.smithi082.stdout:7/994: creat d3/de9/f15a x:0 0 0 2024-04-27T07:33:35.012 INFO:tasks.workunit.client.0.smithi082.stdout:7/995: truncate d3/dfb/da1/db6/f126 443456 0 2024-04-27T07:33:35.012 INFO:tasks.workunit.client.0.smithi082.stdout:1/848: link d4/f35 d4/d15/d49/dab/dc3/d3e/d46/dcf/f122 0 2024-04-27T07:33:35.016 INFO:tasks.workunit.client.0.smithi082.stdout:2/904: chown d7/d30/d23/ff8 40 1 2024-04-27T07:33:35.018 INFO:tasks.workunit.client.0.smithi082.stdout:1/849: read - d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/fd7 zero size 2024-04-27T07:33:35.018 INFO:tasks.workunit.client.0.smithi082.stdout:2/905: dread - d7/d8/d99/dc8/f118 zero size 2024-04-27T07:33:35.019 INFO:tasks.workunit.client.0.smithi082.stdout:7/996: dwrite d3/d9/d4f/d9a/fbe [4194304,4194304] 0 2024-04-27T07:33:35.019 INFO:tasks.workunit.client.0.smithi082.stdout:1/850: chown d4/d15/fd9 15777385 1 2024-04-27T07:33:35.020 INFO:tasks.workunit.client.0.smithi082.stdout:7/997: chown d3/d49/d97/d3a/d2a 103510 1 2024-04-27T07:33:35.021 INFO:tasks.workunit.client.0.smithi082.stdout:2/906: symlink d7/d9/df6/l128 0 2024-04-27T07:33:35.024 INFO:tasks.workunit.client.0.smithi082.stdout:8/918: sync 2024-04-27T07:33:35.024 INFO:tasks.workunit.client.0.smithi082.stdout:6/956: sync 2024-04-27T07:33:35.024 INFO:tasks.workunit.client.0.smithi082.stdout:9/846: sync 2024-04-27T07:33:35.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/998: symlink d3/dfb/da1/db6/l15b 0 2024-04-27T07:33:35.025 INFO:tasks.workunit.client.0.smithi082.stdout:2/907: dread d7/d8/d99/f111 [0,4194304] 0 2024-04-27T07:33:35.028 INFO:tasks.workunit.client.0.smithi082.stdout:1/851: unlink d4/d15/d1c/c5b 0 2024-04-27T07:33:35.031 INFO:tasks.workunit.client.1.smithi100.stdout:3/574: creat d7/d9/d10/d3e/d74/fb4 x:0 0 0 2024-04-27T07:33:35.033 INFO:tasks.workunit.client.1.smithi100.stdout:4/468: truncate d5/d16/d19/d46/f81 2840151 0 2024-04-27T07:33:35.033 INFO:tasks.workunit.client.1.smithi100.stdout:6/468: chown de/d58/f36 2561 1 2024-04-27T07:33:35.033 INFO:tasks.workunit.client.1.smithi100.stdout:1/567: creat d0/d1b/d20/d2d/d35/d4d/d60/fb6 x:0 0 0 2024-04-27T07:33:35.034 INFO:tasks.workunit.client.1.smithi100.stdout:7/435: write d1/dd/d16/d4a/f73 [1552061,57429] 0 2024-04-27T07:33:35.034 INFO:tasks.workunit.client.0.smithi082.stdout:9/847: creat d9/da/dc/d35/d4a/d61/f11f x:0 0 0 2024-04-27T07:33:35.034 INFO:tasks.workunit.client.0.smithi082.stdout:9/848: chown d9/d2d/f59 59 1 2024-04-27T07:33:35.034 INFO:tasks.workunit.client.1.smithi100.stdout:0/438: creat d1/d8/d20/d61/f98 x:0 0 0 2024-04-27T07:33:35.035 INFO:tasks.workunit.client.0.smithi082.stdout:7/999: mkdir d3/d49/d97/d3a/d71/da0/ddf/d15c 0 2024-04-27T07:33:35.035 INFO:tasks.workunit.client.1.smithi100.stdout:5/374: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d30/l33 88 1 2024-04-27T07:33:35.036 INFO:tasks.workunit.client.1.smithi100.stdout:0/439: readlink d1/l35 0 2024-04-27T07:33:35.038 INFO:tasks.workunit.client.1.smithi100.stdout:8/419: creat d6/d20/f81 x:0 0 0 2024-04-27T07:33:35.039 INFO:tasks.workunit.client.0.smithi082.stdout:6/957: unlink d2/d1e/d32/f4e 0 2024-04-27T07:33:35.041 INFO:tasks.workunit.client.0.smithi082.stdout:2/908: dread d7/d30/d23/fb7 [0,4194304] 0 2024-04-27T07:33:35.042 INFO:tasks.workunit.client.1.smithi100.stdout:3/575: write d7/d9/d10/d3e/f7c [5167630,116455] 0 2024-04-27T07:33:35.042 INFO:tasks.workunit.client.1.smithi100.stdout:7/436: dread - d1/dd/d16/d2b/d7f/f83 zero size 2024-04-27T07:33:35.046 INFO:tasks.workunit.client.1.smithi100.stdout:0/440: mkdir d1/d8/d14/d59/d99 0 2024-04-27T07:33:35.048 INFO:tasks.workunit.client.1.smithi100.stdout:7/437: fdatasync d1/dd/f5d 0 2024-04-27T07:33:35.049 INFO:tasks.workunit.client.0.smithi082.stdout:2/909: mknod d7/d14/c129 0 2024-04-27T07:33:35.049 INFO:tasks.workunit.client.1.smithi100.stdout:9/399: dwrite d1/d9/d1f/f3a [0,4194304] 0 2024-04-27T07:33:35.050 INFO:tasks.workunit.client.1.smithi100.stdout:0/441: unlink d1/d30/l31 0 2024-04-27T07:33:35.052 INFO:tasks.workunit.client.1.smithi100.stdout:6/469: dread de/d58/d21/d23/f5e [0,4194304] 0 2024-04-27T07:33:35.052 INFO:tasks.workunit.client.0.smithi082.stdout:9/849: rename d9/da/dc/d35/d38/lbf to d9/da/dc/l120 0 2024-04-27T07:33:35.053 INFO:tasks.workunit.client.1.smithi100.stdout:5/375: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/c76 0 2024-04-27T07:33:35.056 INFO:tasks.workunit.client.0.smithi082.stdout:6/958: rmdir d2/d1e/d32/d85/d10c/d113/d128 0 2024-04-27T07:33:35.056 INFO:tasks.workunit.client.0.smithi082.stdout:9/850: fsync d9/da/dc/d35/d4a/fca 0 2024-04-27T07:33:35.059 INFO:tasks.workunit.client.1.smithi100.stdout:0/442: truncate d1/d8/d20/d61/f63 4776994 0 2024-04-27T07:33:35.060 INFO:tasks.workunit.client.1.smithi100.stdout:3/576: symlink d7/d9/d10/d3e/lb5 0 2024-04-27T07:33:35.060 INFO:tasks.workunit.client.1.smithi100.stdout:0/443: chown d1 155242845 1 2024-04-27T07:33:35.061 INFO:tasks.workunit.client.0.smithi082.stdout:6/959: rename d2/d2e/d55/f104 to d2/d1e/d32/d85/d10c/d113/f14d 0 2024-04-27T07:33:35.062 INFO:tasks.workunit.client.1.smithi100.stdout:4/469: creat d5/d16/d19/d21/d77/fa5 x:0 0 0 2024-04-27T07:33:35.066 INFO:tasks.workunit.client.0.smithi082.stdout:9/851: mkdir d9/da/dc/d121 0 2024-04-27T07:33:35.067 INFO:tasks.workunit.client.1.smithi100.stdout:0/444: creat d1/d8/d14/d59/f9a x:0 0 0 2024-04-27T07:33:35.067 INFO:tasks.workunit.client.1.smithi100.stdout:1/568: dread d0/d1b/d20/f38 [0,4194304] 0 2024-04-27T07:33:35.068 INFO:tasks.workunit.client.0.smithi082.stdout:2/910: link d7/d30/d23/fac d7/d8/dd9/f12a 0 2024-04-27T07:33:35.069 INFO:tasks.workunit.client.1.smithi100.stdout:9/400: mkdir d1/d9/db/d2b/d4f/d91 0 2024-04-27T07:33:35.069 INFO:tasks.workunit.client.1.smithi100.stdout:4/470: write d5/d16/d19/d46/d53/f8e [623695,48155] 0 2024-04-27T07:33:35.069 INFO:tasks.workunit.client.0.smithi082.stdout:2/911: chown d7/d8/d99/db4/ld0 15866605 1 2024-04-27T07:33:35.070 INFO:tasks.workunit.client.1.smithi100.stdout:0/445: chown d1/d8/f7f 65211 1 2024-04-27T07:33:35.071 INFO:tasks.workunit.client.1.smithi100.stdout:0/446: chown d1/d8/c8b 11089 1 2024-04-27T07:33:35.072 INFO:tasks.workunit.client.0.smithi082.stdout:6/960: creat d2/d1e/d32/f14e x:0 0 0 2024-04-27T07:33:35.073 INFO:tasks.workunit.client.0.smithi082.stdout:2/912: mkdir d7/d9/d4f/d6e/d12b 0 2024-04-27T07:33:35.074 INFO:tasks.workunit.client.0.smithi082.stdout:2/913: write d7/d9/d4f/d6e/d82/da4/f10d [592251,85331] 0 2024-04-27T07:33:35.075 INFO:tasks.workunit.client.1.smithi100.stdout:5/376: rename d0/d4/d21/d24/d2f/d57/d37/d48/l4f to d0/d4/d21/d24/d46/l77 0 2024-04-27T07:33:35.079 INFO:tasks.workunit.client.1.smithi100.stdout:1/569: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:35.081 INFO:tasks.workunit.client.1.smithi100.stdout:1/570: write d0/f19 [35452,2437] 0 2024-04-27T07:33:35.085 INFO:tasks.workunit.client.0.smithi082.stdout:9/852: dread d9/d2d/d2b/d46/d76/dcb/fdc [0,4194304] 0 2024-04-27T07:33:35.087 INFO:tasks.workunit.client.1.smithi100.stdout:8/420: truncate d6/ff 562543 0 2024-04-27T07:33:35.087 INFO:tasks.workunit.client.0.smithi082.stdout:9/853: fsync f5 0 2024-04-27T07:33:35.089 INFO:tasks.workunit.client.1.smithi100.stdout:0/447: unlink d1/f5 0 2024-04-27T07:33:35.089 INFO:tasks.workunit.client.1.smithi100.stdout:8/421: truncate d6/d20/d2a/f3a 9406675 0 2024-04-27T07:33:35.091 INFO:tasks.workunit.client.0.smithi082.stdout:6/961: dread d2/d45/f6b [0,4194304] 0 2024-04-27T07:33:35.092 INFO:tasks.workunit.client.1.smithi100.stdout:6/470: link de/d58/d21/d5b/l5f de/d58/d21/d24/d9f/la3 0 2024-04-27T07:33:35.092 INFO:tasks.workunit.client.0.smithi082.stdout:6/962: write d2/d2d/d4a/de4/dcc/d13/f1c [414760,702] 0 2024-04-27T07:33:35.096 INFO:tasks.workunit.client.1.smithi100.stdout:5/377: symlink d0/d4/d21/d24/d2f/d39/d56/l78 0 2024-04-27T07:33:35.096 INFO:tasks.workunit.client.0.smithi082.stdout:6/963: creat d2/d1e/d32/d85/d10c/d113/d134/f14f x:0 0 0 2024-04-27T07:33:35.099 INFO:tasks.workunit.client.0.smithi082.stdout:6/964: rename d2/d3/d9c/f130 to d2/d2d/d4a/de4/dcc/d77/dd3/f150 0 2024-04-27T07:33:35.100 INFO:tasks.workunit.client.1.smithi100.stdout:1/571: creat d0/d1b/d20/d2d/d35/d4d/d60/da4/fb7 x:0 0 0 2024-04-27T07:33:35.100 INFO:tasks.workunit.client.1.smithi100.stdout:6/471: dread de/d58/d21/d24/f2b [4194304,4194304] 0 2024-04-27T07:33:35.100 INFO:tasks.workunit.client.0.smithi082.stdout:6/965: dread d2/d1e/d32/d85/d10c/d113/f14d [0,4194304] 0 2024-04-27T07:33:35.101 INFO:tasks.workunit.client.1.smithi100.stdout:7/438: dwrite d1/dd/fe [0,4194304] 0 2024-04-27T07:33:35.102 INFO:tasks.workunit.client.0.smithi082.stdout:6/966: mknod d2/d1e/d32/d85/d10c/c151 0 2024-04-27T07:33:35.103 INFO:tasks.workunit.client.0.smithi082.stdout:6/967: chown d2/d2d/d4a/de4/dcc/d77 81 1 2024-04-27T07:33:35.104 INFO:tasks.workunit.client.0.smithi082.stdout:6/968: readlink d2/d2d/lf6 0 2024-04-27T07:33:35.104 INFO:tasks.workunit.client.1.smithi100.stdout:0/448: creat d1/d8/d14/d59/f9b x:0 0 0 2024-04-27T07:33:35.105 INFO:tasks.workunit.client.1.smithi100.stdout:1/572: write d0/d1b/d20/d2d/d35/d4d/d60/fb6 [487161,68772] 0 2024-04-27T07:33:35.106 INFO:tasks.workunit.client.1.smithi100.stdout:8/422: mknod d6/d4c/c82 0 2024-04-27T07:33:35.107 INFO:tasks.workunit.client.0.smithi082.stdout:6/969: mkdir d2/d1e/d32/d85/d97/de2/d152 0 2024-04-27T07:33:35.108 INFO:tasks.workunit.client.1.smithi100.stdout:7/439: stat d1/dd/d16/d70/d51/d6f/l80 0 2024-04-27T07:33:35.108 INFO:tasks.workunit.client.1.smithi100.stdout:3/577: truncate d7/d9/d26/f44 1306038 0 2024-04-27T07:33:35.109 INFO:tasks.workunit.client.1.smithi100.stdout:4/471: write d5/d16/d19/f3d [862296,77403] 0 2024-04-27T07:33:35.109 INFO:tasks.workunit.client.0.smithi082.stdout:6/970: mkdir d2/d1e/d80/df5/d153 0 2024-04-27T07:33:35.110 INFO:tasks.workunit.client.1.smithi100.stdout:5/378: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a/d34 39 2024-04-27T07:33:35.110 INFO:tasks.workunit.client.1.smithi100.stdout:6/472: truncate de/d58/d90/f97 702079 0 2024-04-27T07:33:35.112 INFO:tasks.workunit.client.1.smithi100.stdout:4/472: read - d5/d16/d4c/f5d zero size 2024-04-27T07:33:35.113 INFO:tasks.workunit.client.1.smithi100.stdout:7/440: chown d1/dd/d16/d31/d4c/d4d/l35 37057860 1 2024-04-27T07:33:35.115 INFO:tasks.workunit.client.0.smithi082.stdout:6/971: dwrite d2/f8c [4194304,4194304] 0 2024-04-27T07:33:35.116 INFO:tasks.workunit.client.1.smithi100.stdout:4/473: chown d5/d16/d19/d46 0 1 2024-04-27T07:33:35.122 INFO:tasks.workunit.client.1.smithi100.stdout:7/441: symlink d1/dd/d16/d70/d51/l84 0 2024-04-27T07:33:35.124 INFO:tasks.workunit.client.0.smithi082.stdout:6/972: link d2/d2d/d4a/de4/dcc/f17 d2/d2e/d6a/f154 0 2024-04-27T07:33:35.124 INFO:tasks.workunit.client.1.smithi100.stdout:1/573: dread d0/f16 [0,4194304] 0 2024-04-27T07:33:35.125 INFO:tasks.workunit.client.0.smithi082.stdout:4/985: symlink d3/d6/d26/d5e/d11e/d101/l142 0 2024-04-27T07:33:35.128 INFO:tasks.workunit.client.1.smithi100.stdout:5/379: rename d0/d4/f7 to d0/d4/d21/d24/d2f/f79 0 2024-04-27T07:33:35.128 INFO:tasks.workunit.client.1.smithi100.stdout:3/578: dwrite d7/d9/d26/d2a/d5e/f60 [0,4194304] 0 2024-04-27T07:33:35.132 INFO:tasks.workunit.client.0.smithi082.stdout:6/973: dwrite d2/d3/d1b/f145 [0,4194304] 0 2024-04-27T07:33:35.132 INFO:tasks.workunit.client.0.smithi082.stdout:4/986: dread d3/d6/d26/d5e/d11e/d101/fb5 [0,4194304] 0 2024-04-27T07:33:35.132 INFO:tasks.workunit.client.1.smithi100.stdout:7/442: readlink d1/dd/d16/d31/d4c/l6c 0 2024-04-27T07:33:35.133 INFO:tasks.workunit.client.1.smithi100.stdout:2/469: sync 2024-04-27T07:33:35.133 INFO:tasks.workunit.client.1.smithi100.stdout:8/423: dwrite d6/d1b/d1d/d59/f51 [0,4194304] 0 2024-04-27T07:33:35.134 INFO:tasks.workunit.client.1.smithi100.stdout:7/443: fdatasync d1/f32 0 2024-04-27T07:33:35.136 INFO:tasks.workunit.client.1.smithi100.stdout:9/401: dwrite d1/d9/d1f/d4a/f4d [0,4194304] 0 2024-04-27T07:33:35.136 INFO:tasks.workunit.client.0.smithi082.stdout:6/974: mkdir d2/d3/d9c/d155 0 2024-04-27T07:33:35.139 INFO:tasks.workunit.client.1.smithi100.stdout:2/470: chown d0/da/d39/c4e 116064 1 2024-04-27T07:33:35.144 INFO:tasks.workunit.client.0.smithi082.stdout:4/987: dwrite d3/d6/d26/d5e/d11e/d101/d69/df5/f132 [0,4194304] 0 2024-04-27T07:33:35.151 INFO:tasks.workunit.client.0.smithi082.stdout:4/988: rmdir d3/d6/d26/d5e/d11e/d101/d69/d85 39 2024-04-27T07:33:35.153 INFO:tasks.workunit.client.1.smithi100.stdout:0/449: dwrite d1/d8/d20/d61/d6a/f97 [4194304,4194304] 0 2024-04-27T07:33:35.153 INFO:tasks.workunit.client.1.smithi100.stdout:6/473: dwrite de/f1e [0,4194304] 0 2024-04-27T07:33:35.154 INFO:tasks.workunit.client.0.smithi082.stdout:9/854: dwrite d9/da/dc/d35/d38/f49 [0,4194304] 0 2024-04-27T07:33:35.156 INFO:tasks.workunit.client.1.smithi100.stdout:7/444: symlink d1/dd/l85 0 2024-04-27T07:33:35.157 INFO:tasks.workunit.client.1.smithi100.stdout:3/579: symlink d7/d9/d10/d33/d90/d3a/lb6 0 2024-04-27T07:33:35.161 INFO:tasks.workunit.client.1.smithi100.stdout:3/580: write d7/d9/d10/d3e/d74/db1/d9d/f80 [3388577,5365] 0 2024-04-27T07:33:35.166 INFO:tasks.workunit.client.0.smithi082.stdout:4/989: mknod d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/c143 0 2024-04-27T07:33:35.167 INFO:tasks.workunit.client.1.smithi100.stdout:2/471: mknod d0/da/d29/d47/d5a/d8d/d3e/d98/c9d 0 2024-04-27T07:33:35.167 INFO:tasks.workunit.client.1.smithi100.stdout:9/402: getdents d1/d9/db/d56 0 2024-04-27T07:33:35.170 INFO:tasks.workunit.client.0.smithi082.stdout:4/990: truncate d3/d6/f89 4592953 0 2024-04-27T07:33:35.171 INFO:tasks.workunit.client.0.smithi082.stdout:2/914: write d7/d8/d99/fda [683648,113472] 0 2024-04-27T07:33:35.172 INFO:tasks.workunit.client.1.smithi100.stdout:7/445: creat d1/dd/d16/d4a/d56/f86 x:0 0 0 2024-04-27T07:33:35.172 INFO:tasks.workunit.client.1.smithi100.stdout:6/474: dwrite de/d58/d21/d24/f25 [0,4194304] 0 2024-04-27T07:33:35.173 INFO:tasks.workunit.client.1.smithi100.stdout:2/472: mkdir d0/d79/d9e 0 2024-04-27T07:33:35.173 INFO:tasks.workunit.client.0.smithi082.stdout:2/915: fsync d7/d8/d99/dc8/df1/ffd 0 2024-04-27T07:33:35.175 INFO:tasks.workunit.client.1.smithi100.stdout:9/403: mkdir d1/d9/d1f/d71/d92 0 2024-04-27T07:33:35.175 INFO:tasks.workunit.client.0.smithi082.stdout:1/852: mknod d4/d15/d49/dab/dc3/d3e/c123 0 2024-04-27T07:33:35.176 INFO:tasks.workunit.client.1.smithi100.stdout:9/404: dread - d1/d9/db/d2b/f7f zero size 2024-04-27T07:33:35.178 INFO:tasks.workunit.client.1.smithi100.stdout:2/473: mknod d0/da/d29/d47/d5a/d8d/d5d/c9f 0 2024-04-27T07:33:35.178 INFO:tasks.workunit.client.0.smithi082.stdout:4/991: dread - d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/fc1 zero size 2024-04-27T07:33:35.179 INFO:tasks.workunit.client.0.smithi082.stdout:2/916: mknod d7/d8/d99/dc8/c12c 0 2024-04-27T07:33:35.179 INFO:tasks.workunit.client.0.smithi082.stdout:4/992: write d3/d9/f8b [4523188,128123] 0 2024-04-27T07:33:35.181 INFO:tasks.workunit.client.1.smithi100.stdout:7/446: rename d1/dd/d16/d31/d4c/d4d/d3b/d40/f4e to d1/dd/d16/d70/d51/d6f/f87 0 2024-04-27T07:33:35.181 INFO:tasks.workunit.client.0.smithi082.stdout:2/917: chown d7/d14/c129 267254615 1 2024-04-27T07:33:35.182 INFO:tasks.workunit.client.0.smithi082.stdout:2/918: write d7/d8/d99/fda [1545305,53781] 0 2024-04-27T07:33:35.184 INFO:tasks.workunit.client.1.smithi100.stdout:3/581: link d7/d9/d10/d22/l54 d7/d9/d10/d33/d90/lb7 0 2024-04-27T07:33:35.185 INFO:tasks.workunit.client.1.smithi100.stdout:6/475: dwrite de/d58/d75/f8f [0,4194304] 0 2024-04-27T07:33:35.187 INFO:tasks.workunit.client.1.smithi100.stdout:3/582: write d7/d9/d10/d33/d90/d3a/f94 [105268,9258] 0 2024-04-27T07:33:35.187 INFO:tasks.workunit.client.1.smithi100.stdout:6/476: truncate de/d2e/f77 320719 0 2024-04-27T07:33:35.188 INFO:tasks.workunit.client.1.smithi100.stdout:2/474: rename d0/da/d29/l72 to d0/da/d29/d47/d87/d8b/la0 0 2024-04-27T07:33:35.189 INFO:tasks.workunit.client.1.smithi100.stdout:0/450: link d1/d8/f2e d1/d38/f9c 0 2024-04-27T07:33:35.192 INFO:tasks.workunit.client.0.smithi082.stdout:2/919: mkdir d7/d30/d23/d12d 0 2024-04-27T07:33:35.193 INFO:tasks.workunit.client.1.smithi100.stdout:8/424: dread d6/f8 [0,4194304] 0 2024-04-27T07:33:35.193 INFO:tasks.workunit.client.1.smithi100.stdout:6/477: symlink de/d2e/d86/la4 0 2024-04-27T07:33:35.194 INFO:tasks.workunit.client.1.smithi100.stdout:7/447: mknod d1/dd/d16/d2b/d7f/c88 0 2024-04-27T07:33:35.194 INFO:tasks.workunit.client.1.smithi100.stdout:0/451: readlink d1/d8/d20/l1a 0 2024-04-27T07:33:35.195 INFO:tasks.workunit.client.0.smithi082.stdout:4/993: dwrite d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f47 [4194304,4194304] 0 2024-04-27T07:33:35.195 INFO:tasks.workunit.client.1.smithi100.stdout:6/478: chown de/d58/d21/f32 564 1 2024-04-27T07:33:35.196 INFO:tasks.workunit.client.0.smithi082.stdout:4/994: chown d3/d9/f65 1185639489 1 2024-04-27T07:33:35.196 INFO:tasks.workunit.client.1.smithi100.stdout:9/405: creat d1/d9/db/f93 x:0 0 0 2024-04-27T07:33:35.198 INFO:tasks.workunit.client.1.smithi100.stdout:6/479: chown de/d58/d21/d5b 21 1 2024-04-27T07:33:35.198 INFO:tasks.workunit.client.1.smithi100.stdout:2/475: truncate d0/da/d29/f23 3259095 0 2024-04-27T07:33:35.198 INFO:tasks.workunit.client.1.smithi100.stdout:0/452: write d1/d8/d20/f7b [45973,13196] 0 2024-04-27T07:33:35.203 INFO:tasks.workunit.client.1.smithi100.stdout:1/574: truncate d0/d23/d3a/f41 348355 0 2024-04-27T07:33:35.203 INFO:tasks.workunit.client.0.smithi082.stdout:2/920: read d7/d31/f67 [3369009,66862] 0 2024-04-27T07:33:35.203 INFO:tasks.workunit.client.0.smithi082.stdout:9/855: dread d9/d2d/d2b/d46/f8b [0,4194304] 0 2024-04-27T07:33:35.204 INFO:tasks.workunit.client.0.smithi082.stdout:2/921: mkdir d7/d9/d4f/d66/dd6/d12e 0 2024-04-27T07:33:35.205 INFO:tasks.workunit.client.0.smithi082.stdout:2/922: chown d7/d8/d99/f11e 511 1 2024-04-27T07:33:35.205 INFO:tasks.workunit.client.1.smithi100.stdout:6/480: chown de/d58/f36 29 1 2024-04-27T07:33:35.208 INFO:tasks.workunit.client.0.smithi082.stdout:9/856: truncate d9/da/f64 47234 0 2024-04-27T07:33:35.210 INFO:tasks.workunit.client.0.smithi082.stdout:2/923: chown c5 8 1 2024-04-27T07:33:35.212 INFO:tasks.workunit.client.0.smithi082.stdout:9/857: rename d9/d2d/fd0 to d9/da/d85/f122 0 2024-04-27T07:33:35.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/975: write d2/d1e/d32/d85/d97/fc8 [804360,90617] 0 2024-04-27T07:33:35.215 INFO:tasks.workunit.client.0.smithi082.stdout:9/858: chown d9/da/dc/c29 361738 1 2024-04-27T07:33:35.215 INFO:tasks.workunit.client.0.smithi082.stdout:9/859: chown f7 73121 1 2024-04-27T07:33:35.216 INFO:tasks.workunit.client.0.smithi082.stdout:2/924: mkdir d7/d8/d12f 0 2024-04-27T07:33:35.218 INFO:tasks.workunit.client.1.smithi100.stdout:2/476: mkdir d0/da/d29/d47/da1 0 2024-04-27T07:33:35.219 INFO:tasks.workunit.client.0.smithi082.stdout:8/919: creat d0/d2b/d80/dca/f12d x:0 0 0 2024-04-27T07:33:35.220 INFO:tasks.workunit.client.0.smithi082.stdout:2/925: creat d7/d31/d54/f130 x:0 0 0 2024-04-27T07:33:35.222 INFO:tasks.workunit.client.1.smithi100.stdout:5/380: dread d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:35.222 INFO:tasks.workunit.client.1.smithi100.stdout:8/425: dread d6/f3b [0,4194304] 0 2024-04-27T07:33:35.225 INFO:tasks.workunit.client.0.smithi082.stdout:9/860: link d9/d48/dd6/ff9 d9/da/dc/d33/d103/f123 0 2024-04-27T07:33:35.226 INFO:tasks.workunit.client.1.smithi100.stdout:1/575: rmdir d0/d1f/d6d 39 2024-04-27T07:33:35.226 INFO:tasks.workunit.client.1.smithi100.stdout:7/448: dwrite d1/dd/d16/d2b/d7f/f83 [0,4194304] 0 2024-04-27T07:33:35.226 INFO:tasks.workunit.client.1.smithi100.stdout:8/426: dread - d6/d4c/f7f zero size 2024-04-27T07:33:35.227 INFO:tasks.workunit.client.0.smithi082.stdout:6/976: link d2/d3/l89 d2/d3/l156 0 2024-04-27T07:33:35.228 INFO:tasks.workunit.client.0.smithi082.stdout:4/995: write d3/d10/f3d [3091257,62161] 0 2024-04-27T07:33:35.228 INFO:tasks.workunit.client.1.smithi100.stdout:2/477: mknod d0/d79/ca2 0 2024-04-27T07:33:35.229 INFO:tasks.workunit.client.1.smithi100.stdout:6/481: rmdir de/d58/d90 39 2024-04-27T07:33:35.230 INFO:tasks.workunit.client.0.smithi082.stdout:9/861: unlink d9/f51 0 2024-04-27T07:33:35.231 INFO:tasks.workunit.client.1.smithi100.stdout:0/453: dwrite d1/d30/f52 [0,4194304] 0 2024-04-27T07:33:35.231 INFO:tasks.workunit.client.0.smithi082.stdout:2/926: link d7/f10a d7/d9/d4f/d66/dd6/f131 0 2024-04-27T07:33:35.232 INFO:tasks.workunit.client.0.smithi082.stdout:6/977: write d2/d45/f42 [2447537,8693] 0 2024-04-27T07:33:35.233 INFO:tasks.workunit.client.0.smithi082.stdout:8/920: creat d0/d2b/d80/dca/de6/d1c/d76/da0/df9/f12e x:0 0 0 2024-04-27T07:33:35.234 INFO:tasks.workunit.client.0.smithi082.stdout:4/996: mknod d3/d6/d26/df2/c144 0 2024-04-27T07:33:35.235 INFO:tasks.workunit.client.1.smithi100.stdout:5/381: creat d0/d4/d21/d24/d2f/d57/d3e/d6a/f7a x:0 0 0 2024-04-27T07:33:35.238 INFO:tasks.workunit.client.0.smithi082.stdout:6/978: rename d2/d1e/d32/d85/d8a to d2/d45/d157 0 2024-04-27T07:33:35.239 INFO:tasks.workunit.client.0.smithi082.stdout:6/979: chown d2/d1e/d32/d85/d14c/l10d 8030 1 2024-04-27T07:33:35.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/921: mknod d0/d2b/d80/dca/de6/d87/d46/d4e/d115/c12f 0 2024-04-27T07:33:35.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/922: chown d0/d2b/d9a/l122 206596 1 2024-04-27T07:33:35.241 INFO:tasks.workunit.client.1.smithi100.stdout:8/427: creat d6/d1b/d75/f83 x:0 0 0 2024-04-27T07:33:35.243 INFO:tasks.workunit.client.1.smithi100.stdout:3/583: dread d7/d9/d10/d22/f9a [0,4194304] 0 2024-04-27T07:33:35.244 INFO:tasks.workunit.client.1.smithi100.stdout:1/576: dwrite d0/f14 [4194304,4194304] 0 2024-04-27T07:33:35.244 INFO:tasks.workunit.client.0.smithi082.stdout:4/997: creat d3/d6/d26/d5e/d11e/d101/d69/d85/db8/d10c/f145 x:0 0 0 2024-04-27T07:33:35.244 INFO:tasks.workunit.client.1.smithi100.stdout:0/454: link d1/d8/d14/d59/f87 d1/d30/f9d 0 2024-04-27T07:33:35.245 INFO:tasks.workunit.client.1.smithi100.stdout:5/382: write d0/d4/d21/d24/d2f/d39/d56/d67/f68 [824393,13824] 0 2024-04-27T07:33:35.245 INFO:tasks.workunit.client.0.smithi082.stdout:8/923: dread d0/d2b/d80/dca/de6/ff0 [0,4194304] 0 2024-04-27T07:33:35.247 INFO:tasks.workunit.client.1.smithi100.stdout:2/478: rmdir d0/da/d29/d47/d8f 0 2024-04-27T07:33:35.247 INFO:tasks.workunit.client.0.smithi082.stdout:8/924: readlink d0/d2b/d80/dca/de6/d87/l2d 0 2024-04-27T07:33:35.248 INFO:tasks.workunit.client.0.smithi082.stdout:8/925: write d0/d2b/d80/dca/de6/d1b/f89 [836076,45524] 0 2024-04-27T07:33:35.249 INFO:tasks.workunit.client.1.smithi100.stdout:1/577: read d0/da0/f91 [2862683,66617] 0 2024-04-27T07:33:35.252 INFO:tasks.workunit.client.0.smithi082.stdout:8/926: symlink d0/d2b/d6f/l130 0 2024-04-27T07:33:35.253 INFO:tasks.workunit.client.1.smithi100.stdout:6/482: rename de/d58/d28/l38 to de/d58/d21/la5 0 2024-04-27T07:33:35.255 INFO:tasks.workunit.client.1.smithi100.stdout:3/584: unlink d7/d9/d26/d2a/d5e/faa 0 2024-04-27T07:33:35.257 INFO:tasks.workunit.client.1.smithi100.stdout:8/428: dread d6/d1b/d1d/d59/f51 [0,4194304] 0 2024-04-27T07:33:35.258 INFO:tasks.workunit.client.1.smithi100.stdout:0/455: dread d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:35.258 INFO:tasks.workunit.client.0.smithi082.stdout:9/862: write d9/da/fbe [988433,29918] 0 2024-04-27T07:33:35.261 INFO:tasks.workunit.client.1.smithi100.stdout:7/449: rename d1/dd/d16/d31/d4c/d4d/f6a to d1/dd/d16/d4a/f89 0 2024-04-27T07:33:35.262 INFO:tasks.workunit.client.1.smithi100.stdout:0/456: chown d1/d8/d14/d59/f81 4846902 1 2024-04-27T07:33:35.263 INFO:tasks.workunit.client.1.smithi100.stdout:2/479: dwrite d0/da/f6d [0,4194304] 0 2024-04-27T07:33:35.265 INFO:tasks.workunit.client.1.smithi100.stdout:6/483: mknod de/d9b/ca6 0 2024-04-27T07:33:35.265 INFO:tasks.workunit.client.1.smithi100.stdout:1/578: dwrite d0/f85 [4194304,4194304] 0 2024-04-27T07:33:35.266 INFO:tasks.workunit.client.0.smithi082.stdout:2/927: dwrite d7/d14/d11f/fa5 [4194304,4194304] 0 2024-04-27T07:33:35.267 INFO:tasks.workunit.client.0.smithi082.stdout:9/863: rmdir d9/da/dc/d35/d38/d65/d117 0 2024-04-27T07:33:35.268 INFO:tasks.workunit.client.1.smithi100.stdout:5/383: rename d0/d4/d21/d24/d2f/d57/d3e/d6a/c74 to d0/d4/d21/d24/d2f/d57/d37/d48/c7b 0 2024-04-27T07:33:35.271 INFO:tasks.workunit.client.0.smithi082.stdout:6/980: dwrite d2/d2d/d4a/fb9 [0,4194304] 0 2024-04-27T07:33:35.271 INFO:tasks.workunit.client.0.smithi082.stdout:9/864: write d9/da/dc/d73/dbb/fcf [1008904,62515] 0 2024-04-27T07:33:35.273 INFO:tasks.workunit.client.1.smithi100.stdout:6/484: mknod de/d58/d21/d5b/ca7 0 2024-04-27T07:33:35.273 INFO:tasks.workunit.client.0.smithi082.stdout:2/928: creat d7/d9/d4f/d66/dae/dd1/f132 x:0 0 0 2024-04-27T07:33:35.275 INFO:tasks.workunit.client.1.smithi100.stdout:1/579: rename d0/d1f/c58 to d0/d23/d3a/cb8 0 2024-04-27T07:33:35.276 INFO:tasks.workunit.client.1.smithi100.stdout:8/429: creat d6/d20/f84 x:0 0 0 2024-04-27T07:33:35.277 INFO:tasks.workunit.client.0.smithi082.stdout:9/865: stat d9/da/dc/d88/d93 0 2024-04-27T07:33:35.278 INFO:tasks.workunit.client.0.smithi082.stdout:4/998: dwrite f2 [4194304,4194304] 0 2024-04-27T07:33:35.278 INFO:tasks.workunit.client.1.smithi100.stdout:7/450: creat d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a x:0 0 0 2024-04-27T07:33:35.279 INFO:tasks.workunit.client.1.smithi100.stdout:0/457: dwrite d1/d8/d20/f7b [0,4194304] 0 2024-04-27T07:33:35.279 INFO:tasks.workunit.client.1.smithi100.stdout:3/585: getdents d7/d9/d26 0 2024-04-27T07:33:35.280 INFO:tasks.workunit.client.0.smithi082.stdout:6/981: fsync d2/d2d/d4a/de4/dcc/d13/f1c 0 2024-04-27T07:33:35.283 INFO:tasks.workunit.client.0.smithi082.stdout:2/929: creat d7/d9/d4f/d66/dd6/d12e/f133 x:0 0 0 2024-04-27T07:33:35.284 INFO:tasks.workunit.client.0.smithi082.stdout:6/982: symlink d2/d2d/d3d/de7/l158 0 2024-04-27T07:33:35.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/999: rmdir d3/d6/d26/d5e/d11e/d101/d69/df5/d10a 39 2024-04-27T07:33:35.285 INFO:tasks.workunit.client.1.smithi100.stdout:3/586: chown d7/d9/d10 4802769 1 2024-04-27T07:33:35.286 INFO:tasks.workunit.client.1.smithi100.stdout:2/480: dwrite d0/da/d29/d47/d5a/d8d/d5d/f96 [0,4194304] 0 2024-04-27T07:33:35.286 INFO:tasks.workunit.client.1.smithi100.stdout:5/384: rename d0/d4/d21/d24/d2f/d57/d37/d1a/d72 to d0/d4/d21/d24/d2f/d39/d7c 0 2024-04-27T07:33:35.286 INFO:tasks.workunit.client.1.smithi100.stdout:6/485: mknod de/d58/d75/ca8 0 2024-04-27T07:33:35.286 INFO:tasks.workunit.client.1.smithi100.stdout:1/580: dread - d0/d1b/d20/d2d/d35/d65/faa zero size 2024-04-27T07:33:35.286 INFO:tasks.workunit.client.0.smithi082.stdout:2/930: unlink d7/d9/d4f/d6e/ldd 0 2024-04-27T07:33:35.287 INFO:tasks.workunit.client.0.smithi082.stdout:6/983: creat d2/d2d/d3d/de7/f159 x:0 0 0 2024-04-27T07:33:35.288 INFO:tasks.workunit.client.1.smithi100.stdout:6/486: symlink de/d58/d28/la9 0 2024-04-27T07:33:35.292 INFO:tasks.workunit.client.0.smithi082.stdout:6/984: truncate d2/d3/f6 490138 0 2024-04-27T07:33:35.292 INFO:tasks.workunit.client.0.smithi082.stdout:2/931: dwrite f3 [0,4194304] 0 2024-04-27T07:33:35.294 INFO:tasks.workunit.client.1.smithi100.stdout:0/458: write d1/d8/d20/d1e/f86 [119900,85162] 0 2024-04-27T07:33:35.294 INFO:tasks.workunit.client.0.smithi082.stdout:6/985: creat d2/d1e/d32/d7d/f15a x:0 0 0 2024-04-27T07:33:35.295 INFO:tasks.workunit.client.0.smithi082.stdout:2/932: symlink d7/d9/d4f/d6e/d123/l134 0 2024-04-27T07:33:35.298 INFO:tasks.workunit.client.0.smithi082.stdout:2/933: chown d7/d9/d4f/d66/f8e 1989188906 1 2024-04-27T07:33:35.298 INFO:tasks.workunit.client.0.smithi082.stdout:2/934: fsync d7/d31/d54/f130 0 2024-04-27T07:33:35.299 INFO:tasks.workunit.client.1.smithi100.stdout:8/430: write d6/f41 [3930850,34255] 0 2024-04-27T07:33:35.299 INFO:tasks.workunit.client.1.smithi100.stdout:3/587: mknod d7/d9/d10/d33/cb8 0 2024-04-27T07:33:35.300 INFO:tasks.workunit.client.1.smithi100.stdout:7/451: chown d1/dd/d16/d31/d4c/d4d/d3b/f45 0 1 2024-04-27T07:33:35.304 INFO:tasks.workunit.client.1.smithi100.stdout:6/487: mkdir de/d58/d21/d24/d9f/daa 0 2024-04-27T07:33:35.304 INFO:tasks.workunit.client.0.smithi082.stdout:2/935: dwrite d7/d9/d4f/d66/dae/f79 [4194304,4194304] 0 2024-04-27T07:33:35.305 INFO:tasks.workunit.client.1.smithi100.stdout:5/385: write d0/d4/d21/d3d/f59 [2572355,84303] 0 2024-04-27T07:33:35.305 INFO:tasks.workunit.client.1.smithi100.stdout:0/459: dread - d1/d8/d14/d59/f9b zero size 2024-04-27T07:33:35.305 INFO:tasks.workunit.client.0.smithi082.stdout:2/936: chown d7/d31/d54/l70 30814266 1 2024-04-27T07:33:35.306 INFO:tasks.workunit.client.0.smithi082.stdout:2/937: readlink d7/d8/d13/l125 0 2024-04-27T07:33:35.308 INFO:tasks.workunit.client.1.smithi100.stdout:2/481: dwrite d0/da/d29/d47/f91 [0,4194304] 0 2024-04-27T07:33:35.308 INFO:tasks.workunit.client.0.smithi082.stdout:2/938: mkdir d7/d8/d99/d135 0 2024-04-27T07:33:35.310 INFO:tasks.workunit.client.1.smithi100.stdout:5/386: fdatasync d0/d4/d21/f3a 0 2024-04-27T07:33:35.310 INFO:tasks.workunit.client.1.smithi100.stdout:8/431: creat d6/d20/d2a/f85 x:0 0 0 2024-04-27T07:33:35.310 INFO:tasks.workunit.client.1.smithi100.stdout:0/460: readlink d1/d8/d20/l18 0 2024-04-27T07:33:35.311 INFO:tasks.workunit.client.0.smithi082.stdout:2/939: creat d7/d9/d4f/d6e/d82/da4/f136 x:0 0 0 2024-04-27T07:33:35.311 INFO:tasks.workunit.client.1.smithi100.stdout:3/588: truncate d7/dad/daf/f49 9204851 0 2024-04-27T07:33:35.313 INFO:tasks.workunit.client.0.smithi082.stdout:2/940: mkdir d7/d9/d4f/d6e/d82/dc6/dfc/d137 0 2024-04-27T07:33:35.314 INFO:tasks.workunit.client.0.smithi082.stdout:2/941: truncate d7/d14/fb6 4237373 0 2024-04-27T07:33:35.315 INFO:tasks.workunit.client.1.smithi100.stdout:8/432: chown d6/f8 908028941 1 2024-04-27T07:33:35.316 INFO:tasks.workunit.client.0.smithi082.stdout:2/942: symlink d7/d8/dd9/l138 0 2024-04-27T07:33:35.317 INFO:tasks.workunit.client.1.smithi100.stdout:8/433: write d6/f8 [4521351,128511] 0 2024-04-27T07:33:35.317 INFO:tasks.workunit.client.1.smithi100.stdout:3/589: fdatasync d7/f1c 0 2024-04-27T07:33:35.317 INFO:tasks.workunit.client.1.smithi100.stdout:6/488: symlink de/d58/d21/d23/da0/lab 0 2024-04-27T07:33:35.318 INFO:tasks.workunit.client.1.smithi100.stdout:0/461: creat d1/d8/d14/d59/d99/f9e x:0 0 0 2024-04-27T07:33:35.319 INFO:tasks.workunit.client.1.smithi100.stdout:1/581: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:35.321 INFO:tasks.workunit.client.0.smithi082.stdout:2/943: rename d7/d9/d4f/d6e/d82/da4/de0/le2 to d7/l139 0 2024-04-27T07:33:35.321 INFO:tasks.workunit.client.1.smithi100.stdout:7/452: dread d1/dd/d16/d31/d4c/d4d/d3b/f67 [0,4194304] 0 2024-04-27T07:33:35.324 INFO:tasks.workunit.client.0.smithi082.stdout:2/944: creat d7/d8/d13/f13a x:0 0 0 2024-04-27T07:33:35.325 INFO:tasks.workunit.client.1.smithi100.stdout:3/590: read f6 [1193828,110996] 0 2024-04-27T07:33:35.326 INFO:tasks.workunit.client.1.smithi100.stdout:0/462: unlink d1/d8/d20/d61/f63 0 2024-04-27T07:33:35.326 INFO:tasks.workunit.client.0.smithi082.stdout:2/945: creat d7/d8/d13/f13b x:0 0 0 2024-04-27T07:33:35.327 INFO:tasks.workunit.client.1.smithi100.stdout:6/489: symlink de/d2e/d3f/d80/lac 0 2024-04-27T07:33:35.328 INFO:tasks.workunit.client.0.smithi082.stdout:2/946: fsync d7/d8/d13/fdb 0 2024-04-27T07:33:35.329 INFO:tasks.workunit.client.1.smithi100.stdout:8/434: creat d6/d20/d50/d72/f86 x:0 0 0 2024-04-27T07:33:35.332 INFO:tasks.workunit.client.1.smithi100.stdout:6/490: truncate de/d2e/d3f/f87 973218 0 2024-04-27T07:33:35.334 INFO:tasks.workunit.client.1.smithi100.stdout:0/463: creat d1/d8/d20/d61/f9f x:0 0 0 2024-04-27T07:33:35.334 INFO:tasks.workunit.client.1.smithi100.stdout:2/482: dwrite d0/da/d29/d47/d5a/d8d/d3e/f85 [0,4194304] 0 2024-04-27T07:33:35.336 INFO:tasks.workunit.client.1.smithi100.stdout:6/491: write de/d58/f37 [4586751,43049] 0 2024-04-27T07:33:35.338 INFO:tasks.workunit.client.1.smithi100.stdout:2/483: dread - d0/da/d75/f9b zero size 2024-04-27T07:33:35.339 INFO:tasks.workunit.client.1.smithi100.stdout:5/387: getdents d0/d4/d21/d24/d2f/d57/d37/d1a/d34 0 2024-04-27T07:33:35.342 INFO:tasks.workunit.client.1.smithi100.stdout:6/492: mknod de/d58/d75/cad 0 2024-04-27T07:33:35.343 INFO:tasks.workunit.client.1.smithi100.stdout:8/435: rmdir d6/d20/d50/d76 0 2024-04-27T07:33:35.344 INFO:tasks.workunit.client.1.smithi100.stdout:6/493: chown de/f69 2019264 1 2024-04-27T07:33:35.344 INFO:tasks.workunit.client.1.smithi100.stdout:1/582: dread d0/d1b/d20/d2d/f83 [0,4194304] 0 2024-04-27T07:33:35.349 INFO:tasks.workunit.client.1.smithi100.stdout:0/464: dwrite d1/d8/d20/f37 [0,4194304] 0 2024-04-27T07:33:35.351 INFO:tasks.workunit.client.1.smithi100.stdout:6/494: truncate de/d58/d21/d5b/f7f 1192415 0 2024-04-27T07:33:35.352 INFO:tasks.workunit.client.0.smithi082.stdout:9/866: dwrite d9/d2d/f59 [0,4194304] 0 2024-04-27T07:33:35.352 INFO:tasks.workunit.client.1.smithi100.stdout:2/484: rename d0/d1e/d51 to d0/da/d29/d47/da1/da3 0 2024-04-27T07:33:35.353 INFO:tasks.workunit.client.1.smithi100.stdout:6/495: fdatasync de/d58/f7c 0 2024-04-27T07:33:35.354 INFO:tasks.workunit.client.1.smithi100.stdout:5/388: dwrite d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:35.354 INFO:tasks.workunit.client.0.smithi082.stdout:9/867: symlink d9/d2d/d2b/d46/d5d/l124 0 2024-04-27T07:33:35.355 INFO:tasks.workunit.client.1.smithi100.stdout:6/496: dread - de/d58/d21/d23/d73/fa2 zero size 2024-04-27T07:33:35.355 INFO:tasks.workunit.client.1.smithi100.stdout:8/436: unlink d6/d20/d50/d72/l7e 0 2024-04-27T07:33:35.358 INFO:tasks.workunit.client.1.smithi100.stdout:1/583: creat d0/d1b/d20/d2d/d35/d65/fb9 x:0 0 0 2024-04-27T07:33:35.361 INFO:tasks.workunit.client.1.smithi100.stdout:1/584: truncate d0/d1b/d20/d2d/d35/d65/faa 891867 0 2024-04-27T07:33:35.362 INFO:tasks.workunit.client.1.smithi100.stdout:0/465: unlink d1/d8/ff 0 2024-04-27T07:33:35.364 INFO:tasks.workunit.client.1.smithi100.stdout:0/466: write d1/d38/f4a [1337437,58856] 0 2024-04-27T07:33:35.364 INFO:tasks.workunit.client.1.smithi100.stdout:4/474: sync 2024-04-27T07:33:35.368 INFO:tasks.workunit.client.1.smithi100.stdout:5/389: chown d0/d4/d21/l43 2973 1 2024-04-27T07:33:35.370 INFO:tasks.workunit.client.1.smithi100.stdout:6/497: rename de/d58/d21/d5b/f66 to de/d9b/fae 0 2024-04-27T07:33:35.375 INFO:tasks.workunit.client.1.smithi100.stdout:8/437: dwrite d6/d20/d2a/f44 [4194304,4194304] 0 2024-04-27T07:33:35.377 INFO:tasks.workunit.client.1.smithi100.stdout:4/475: rmdir d5/d1b/d2c 39 2024-04-27T07:33:35.378 INFO:tasks.workunit.client.1.smithi100.stdout:5/390: creat d0/d42/f7d x:0 0 0 2024-04-27T07:33:35.380 INFO:tasks.workunit.client.1.smithi100.stdout:8/438: read d6/d1b/f42 [3685969,22349] 0 2024-04-27T07:33:35.380 INFO:tasks.workunit.client.1.smithi100.stdout:1/585: mkdir d0/d1f/d6d/dba 0 2024-04-27T07:33:35.382 INFO:tasks.workunit.client.1.smithi100.stdout:2/485: creat d0/d1e/fa4 x:0 0 0 2024-04-27T07:33:35.382 INFO:tasks.workunit.client.1.smithi100.stdout:3/591: dread d7/d9/d10/d33/d90/f99 [0,4194304] 0 2024-04-27T07:33:35.384 INFO:tasks.workunit.client.0.smithi082.stdout:6/986: write d2/d2d/d4a/de4/dcc/d13/f21 [765069,83867] 0 2024-04-27T07:33:35.386 INFO:tasks.workunit.client.1.smithi100.stdout:0/467: getdents d1/d8/d20/d72/d96 0 2024-04-27T07:33:35.387 INFO:tasks.workunit.client.1.smithi100.stdout:6/498: creat de/d58/d21/d91/faf x:0 0 0 2024-04-27T07:33:35.389 INFO:tasks.workunit.client.1.smithi100.stdout:4/476: unlink d5/d16/d19/d46/d53/f8e 0 2024-04-27T07:33:35.389 INFO:tasks.workunit.client.0.smithi082.stdout:2/947: truncate d7/d8/f19 2449759 0 2024-04-27T07:33:35.390 INFO:tasks.workunit.client.1.smithi100.stdout:4/477: chown d5/d16/l4e 241419588 1 2024-04-27T07:33:35.390 INFO:tasks.workunit.client.1.smithi100.stdout:5/391: mknod d0/d4/d21/d24/d2f/d39/d56/d67/c7e 0 2024-04-27T07:33:35.392 INFO:tasks.workunit.client.0.smithi082.stdout:2/948: creat d7/d9/d4f/d6e/d82/dc6/dfc/d137/f13c x:0 0 0 2024-04-27T07:33:35.393 INFO:tasks.workunit.client.1.smithi100.stdout:1/586: symlink d0/d1b/d20/d2d/d35/d65/lbb 0 2024-04-27T07:33:35.395 INFO:tasks.workunit.client.1.smithi100.stdout:2/486: chown d0/c49 1455260039 1 2024-04-27T07:33:35.398 INFO:tasks.workunit.client.1.smithi100.stdout:7/453: write d1/d54/f61 [942323,125573] 0 2024-04-27T07:33:35.399 INFO:tasks.workunit.client.0.smithi082.stdout:2/949: write d7/d8/d99/fd4 [291827,100304] 0 2024-04-27T07:33:35.399 INFO:tasks.workunit.client.1.smithi100.stdout:5/392: dwrite d0/d4/d21/d24/d46/f66 [0,4194304] 0 2024-04-27T07:33:35.402 INFO:tasks.workunit.client.0.smithi082.stdout:2/950: mkdir d7/d9/d4f/d6e/d82/dc6/dfc/d137/d13d 0 2024-04-27T07:33:35.406 INFO:tasks.workunit.client.1.smithi100.stdout:1/587: truncate d0/d1b/d20/d2d/d35/d4d/d60/fb6 1356278 0 2024-04-27T07:33:35.406 INFO:tasks.workunit.client.1.smithi100.stdout:8/439: unlink d6/l15 0 2024-04-27T07:33:35.406 INFO:tasks.workunit.client.1.smithi100.stdout:3/592: rename d7/d9/f51 to d7/d9/d10/d28/db0/fb9 0 2024-04-27T07:33:35.408 INFO:tasks.workunit.client.1.smithi100.stdout:0/468: symlink d1/d8/d20/la0 0 2024-04-27T07:33:35.412 INFO:tasks.workunit.client.1.smithi100.stdout:7/454: unlink d1/dd/f42 0 2024-04-27T07:33:35.413 INFO:tasks.workunit.client.1.smithi100.stdout:9/406: sync 2024-04-27T07:33:35.414 INFO:tasks.workunit.client.1.smithi100.stdout:2/487: creat d0/da/d29/d47/d87/d8b/fa5 x:0 0 0 2024-04-27T07:33:35.416 INFO:tasks.workunit.client.0.smithi082.stdout:2/951: dwrite d7/d8/f110 [8388608,4194304] 0 2024-04-27T07:33:35.420 INFO:tasks.workunit.client.1.smithi100.stdout:7/455: dwrite d1/dd/f47 [4194304,4194304] 0 2024-04-27T07:33:35.422 INFO:tasks.workunit.client.0.smithi082.stdout:2/952: dwrite f3 [0,4194304] 0 2024-04-27T07:33:35.423 INFO:tasks.workunit.client.0.smithi082.stdout:2/953: read - d7/d9/d4f/d66/dae/dd1/f132 zero size 2024-04-27T07:33:35.425 INFO:tasks.workunit.client.1.smithi100.stdout:5/393: dread d0/d58/d60/f61 [0,4194304] 0 2024-04-27T07:33:35.426 INFO:tasks.workunit.client.1.smithi100.stdout:6/499: rename de/d58/d21/d23/d73/fa2 to de/d2e/fb0 0 2024-04-27T07:33:35.428 INFO:tasks.workunit.client.0.smithi082.stdout:2/954: creat d7/d30/d23/f13e x:0 0 0 2024-04-27T07:33:35.429 INFO:tasks.workunit.client.1.smithi100.stdout:3/593: creat d7/d9/d10/d28/db0/fba x:0 0 0 2024-04-27T07:33:35.430 INFO:tasks.workunit.client.1.smithi100.stdout:7/456: dwrite d1/dd/f47 [0,4194304] 0 2024-04-27T07:33:35.432 INFO:tasks.workunit.client.1.smithi100.stdout:7/457: chown d1/f15 195 1 2024-04-27T07:33:35.434 INFO:tasks.workunit.client.1.smithi100.stdout:9/407: dread - d1/f26 zero size 2024-04-27T07:33:35.435 INFO:tasks.workunit.client.1.smithi100.stdout:9/408: dread - d1/f26 zero size 2024-04-27T07:33:35.437 INFO:tasks.workunit.client.1.smithi100.stdout:4/478: creat d5/d23/fa6 x:0 0 0 2024-04-27T07:33:35.437 INFO:tasks.workunit.client.1.smithi100.stdout:5/394: dwrite d0/d4/d21/d24/f69 [0,4194304] 0 2024-04-27T07:33:35.438 INFO:tasks.workunit.client.0.smithi082.stdout:2/955: dread d7/d30/d23/ff8 [0,4194304] 0 2024-04-27T07:33:35.439 INFO:tasks.workunit.client.0.smithi082.stdout:2/956: chown d7/d31/l40 503 1 2024-04-27T07:33:35.442 INFO:tasks.workunit.client.0.smithi082.stdout:2/957: write d7/d9/d4f/d6e/d82/da4/fe4 [733728,39966] 0 2024-04-27T07:33:35.442 INFO:tasks.workunit.client.1.smithi100.stdout:1/588: mknod d0/d1f/d6d/db4/d4e/cbc 0 2024-04-27T07:33:35.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/958: creat d7/d9/d4f/d6e/d82/da4/f13f x:0 0 0 2024-04-27T07:33:35.445 INFO:tasks.workunit.client.1.smithi100.stdout:2/488: rename d0/da/d29/d47/d5a/d8d/d5d/c73 to d0/da/d3a/ca6 0 2024-04-27T07:33:35.447 INFO:tasks.workunit.client.1.smithi100.stdout:2/489: write d0/d1e/fa4 [102315,47266] 0 2024-04-27T07:33:35.447 INFO:tasks.workunit.client.0.smithi082.stdout:2/959: creat d7/d9/d4f/d6e/d82/da4/f140 x:0 0 0 2024-04-27T07:33:35.450 INFO:tasks.workunit.client.1.smithi100.stdout:7/458: mkdir d1/dd/d16/d3e/d8b 0 2024-04-27T07:33:35.451 INFO:tasks.workunit.client.0.smithi082.stdout:2/960: link d7/d9/d4f/d6e/ced d7/d9/d4f/d6e/d82/c141 0 2024-04-27T07:33:35.452 INFO:tasks.workunit.client.1.smithi100.stdout:7/459: read - d1/dd/d16/d31/d4c/d4d/d3b/d40/f74 zero size 2024-04-27T07:33:35.452 INFO:tasks.workunit.client.1.smithi100.stdout:5/395: mknod d0/d4/d21/d24/d2f/d39/d56/d67/c7f 0 2024-04-27T07:33:35.456 INFO:tasks.workunit.client.1.smithi100.stdout:3/594: unlink d7/d9/d10/d28/f52 0 2024-04-27T07:33:35.458 INFO:tasks.workunit.client.1.smithi100.stdout:7/460: write d1/dd/d16/d31/d4c/d4d/d3b/f67 [1210562,125229] 0 2024-04-27T07:33:35.459 INFO:tasks.workunit.client.1.smithi100.stdout:4/479: link d5/d23/f25 d5/d23/d33/fa7 0 2024-04-27T07:33:35.459 INFO:tasks.workunit.client.0.smithi082.stdout:2/961: truncate d7/d9/df6/f119 36747 0 2024-04-27T07:33:35.460 INFO:tasks.workunit.client.1.smithi100.stdout:3/595: mkdir d7/d9/d10/d33/d90/dbb 0 2024-04-27T07:33:35.461 INFO:tasks.workunit.client.1.smithi100.stdout:2/490: getdents d0/da/d29/d47/da1 0 2024-04-27T07:33:35.461 INFO:tasks.workunit.client.1.smithi100.stdout:7/461: truncate d1/dd/d16/d4a/d56/f5e 746562 0 2024-04-27T07:33:35.463 INFO:tasks.workunit.client.1.smithi100.stdout:7/462: chown d1/dd/d16/d4a/d56/l82 1277098 1 2024-04-27T07:33:35.463 INFO:tasks.workunit.client.1.smithi100.stdout:2/491: mkdir d0/d79/da7 0 2024-04-27T07:33:35.466 INFO:tasks.workunit.client.0.smithi082.stdout:2/962: dwrite d7/d30/d23/ff8 [0,4194304] 0 2024-04-27T07:33:35.468 INFO:tasks.workunit.client.0.smithi082.stdout:2/963: creat d7/d9/d4f/d66/dae/dd1/f142 x:0 0 0 2024-04-27T07:33:35.468 INFO:tasks.workunit.client.1.smithi100.stdout:3/596: creat d7/d9/d10/d33/d90/dbb/fbc x:0 0 0 2024-04-27T07:33:35.471 INFO:tasks.workunit.client.1.smithi100.stdout:6/500: dread de/d58/f29 [0,4194304] 0 2024-04-27T07:33:35.474 INFO:tasks.workunit.client.0.smithi082.stdout:2/964: write d7/d8/d13/fdb [1744243,97245] 0 2024-04-27T07:33:35.476 INFO:tasks.workunit.client.0.smithi082.stdout:2/965: mknod d7/d30/d23/d12d/c143 0 2024-04-27T07:33:35.478 INFO:tasks.workunit.client.0.smithi082.stdout:2/966: mknod d7/d9/d4f/d66/dd6/c144 0 2024-04-27T07:33:35.479 INFO:tasks.workunit.client.1.smithi100.stdout:6/501: unlink de/d2e/d3f/l41 0 2024-04-27T07:33:35.479 INFO:tasks.workunit.client.0.smithi082.stdout:2/967: chown d7/d31/dde/fff 0 1 2024-04-27T07:33:35.480 INFO:tasks.workunit.client.1.smithi100.stdout:4/480: getdents d5/d23 0 2024-04-27T07:33:35.480 INFO:tasks.workunit.client.0.smithi082.stdout:2/968: mkdir d7/d31/d145 0 2024-04-27T07:33:35.482 INFO:tasks.workunit.client.1.smithi100.stdout:8/440: write d6/f35 [444008,89959] 0 2024-04-27T07:33:35.482 INFO:tasks.workunit.client.1.smithi100.stdout:3/597: dwrite d7/d9/d10/f9c [0,4194304] 0 2024-04-27T07:33:35.485 INFO:tasks.workunit.client.1.smithi100.stdout:2/492: dwrite d0/da/d29/d47/d5a/d8d/f4b [0,4194304] 0 2024-04-27T07:33:35.485 INFO:tasks.workunit.client.1.smithi100.stdout:1/589: dread d0/d1b/d20/d2d/d35/f72 [0,4194304] 0 2024-04-27T07:33:35.490 INFO:tasks.workunit.client.1.smithi100.stdout:6/502: mknod de/d2e/d3f/d80/cb1 0 2024-04-27T07:33:35.491 INFO:tasks.workunit.client.0.smithi082.stdout:2/969: write d7/d31/f67 [3324993,22346] 0 2024-04-27T07:33:35.495 INFO:tasks.workunit.client.1.smithi100.stdout:8/441: creat d6/d20/d50/d72/f87 x:0 0 0 2024-04-27T07:33:35.497 INFO:tasks.workunit.client.1.smithi100.stdout:0/469: dwrite d1/d8/f2e [0,4194304] 0 2024-04-27T07:33:35.499 INFO:tasks.workunit.client.1.smithi100.stdout:8/442: chown d6/d1b/d1d/d59/f56 2214 1 2024-04-27T07:33:35.499 INFO:tasks.workunit.client.1.smithi100.stdout:1/590: rmdir d0/d1f/d97 39 2024-04-27T07:33:35.502 INFO:tasks.workunit.client.1.smithi100.stdout:6/503: dwrite de/d58/d21/d23/f3e [0,4194304] 0 2024-04-27T07:33:35.503 INFO:tasks.workunit.client.1.smithi100.stdout:2/493: mknod d0/d79/da7/ca8 0 2024-04-27T07:33:35.504 INFO:tasks.workunit.client.1.smithi100.stdout:0/470: chown d1/d8/d20/f37 0 1 2024-04-27T07:33:35.505 INFO:tasks.workunit.client.1.smithi100.stdout:8/443: rmdir d6/d1b/d75 39 2024-04-27T07:33:35.507 INFO:tasks.workunit.client.1.smithi100.stdout:6/504: chown de/d2e/d86 81 1 2024-04-27T07:33:35.508 INFO:tasks.workunit.client.1.smithi100.stdout:3/598: dwrite d7/dad/daf/f49 [4194304,4194304] 0 2024-04-27T07:33:35.510 INFO:tasks.workunit.client.1.smithi100.stdout:8/444: dread - d6/d20/d50/f61 zero size 2024-04-27T07:33:35.516 INFO:tasks.workunit.client.1.smithi100.stdout:6/505: getdents de 0 2024-04-27T07:33:35.517 INFO:tasks.workunit.client.1.smithi100.stdout:3/599: creat d7/d9/d10/d28/db0/fbd x:0 0 0 2024-04-27T07:33:35.518 INFO:tasks.workunit.client.1.smithi100.stdout:8/445: mknod d6/d20/d46/c88 0 2024-04-27T07:33:35.522 INFO:tasks.workunit.client.1.smithi100.stdout:1/591: dwrite d0/d1b/d20/f99 [0,4194304] 0 2024-04-27T07:33:35.523 INFO:tasks.workunit.client.1.smithi100.stdout:7/463: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f45 [0,4194304] 0 2024-04-27T07:33:35.524 INFO:tasks.workunit.client.1.smithi100.stdout:0/471: rename d1/d8/d20/d61/f98 to d1/d8/fa1 0 2024-04-27T07:33:35.526 INFO:tasks.workunit.client.1.smithi100.stdout:2/494: dread d0/da/d29/d47/d5a/d8d/d3e/f85 [0,4194304] 0 2024-04-27T07:33:35.530 INFO:tasks.workunit.client.1.smithi100.stdout:4/481: dwrite d5/d16/d2e/f38 [0,4194304] 0 2024-04-27T07:33:35.538 INFO:tasks.workunit.client.1.smithi100.stdout:1/592: creat d0/d1b/d20/d2d/d35/d4d/d60/fbd x:0 0 0 2024-04-27T07:33:35.539 INFO:tasks.workunit.client.1.smithi100.stdout:6/506: dread de/d58/d28/f6a [0,4194304] 0 2024-04-27T07:33:35.541 INFO:tasks.workunit.client.1.smithi100.stdout:4/482: creat d5/d1b/d65/fa8 x:0 0 0 2024-04-27T07:33:35.541 INFO:tasks.workunit.client.1.smithi100.stdout:0/472: symlink d1/d8/d20/d72/d96/la2 0 2024-04-27T07:33:35.542 INFO:tasks.workunit.client.1.smithi100.stdout:3/600: dwrite d7/d9/d10/d33/d90/d3a/f94 [0,4194304] 0 2024-04-27T07:33:35.543 INFO:tasks.workunit.client.1.smithi100.stdout:4/483: stat d5/f6 0 2024-04-27T07:33:35.544 INFO:tasks.workunit.client.1.smithi100.stdout:3/601: stat d7/d9/d26/d2a/f87 0 2024-04-27T07:33:35.547 INFO:tasks.workunit.client.1.smithi100.stdout:3/602: stat d7/d9/d26/d2a/c1b 0 2024-04-27T07:33:35.547 INFO:tasks.workunit.client.1.smithi100.stdout:3/603: chown d7 14284142 1 2024-04-27T07:33:35.547 INFO:tasks.workunit.client.1.smithi100.stdout:2/495: rmdir d0/d79/d9e 0 2024-04-27T07:33:35.550 INFO:tasks.workunit.client.1.smithi100.stdout:1/593: creat d0/d1f/d97/fbe x:0 0 0 2024-04-27T07:33:35.553 INFO:tasks.workunit.client.1.smithi100.stdout:7/464: getdents d1/dd/d2a/d2c 0 2024-04-27T07:33:35.554 INFO:tasks.workunit.client.1.smithi100.stdout:4/484: creat d5/d16/d19/d46/d53/d7e/fa9 x:0 0 0 2024-04-27T07:33:35.556 INFO:tasks.workunit.client.1.smithi100.stdout:6/507: creat de/d58/d21/fb2 x:0 0 0 2024-04-27T07:33:35.558 INFO:tasks.workunit.client.1.smithi100.stdout:3/604: dwrite d7/d9/d10/d3e/d74/db1/f89 [0,4194304] 0 2024-04-27T07:33:35.560 INFO:tasks.workunit.client.1.smithi100.stdout:0/473: link d1/d8/d20/d72/l7a d1/d8/d20/d61/d66/la3 0 2024-04-27T07:33:35.561 INFO:tasks.workunit.client.0.smithi082.stdout:2/970: dread d7/d30/f86 [0,4194304] 0 2024-04-27T07:33:35.563 INFO:tasks.workunit.client.1.smithi100.stdout:0/474: readlink d1/d38/l3e 0 2024-04-27T07:33:35.563 INFO:tasks.workunit.client.1.smithi100.stdout:7/465: fdatasync d1/dd/d16/d70/d51/d6f/f87 0 2024-04-27T07:33:35.564 INFO:tasks.workunit.client.0.smithi082.stdout:2/971: creat d7/f146 x:0 0 0 2024-04-27T07:33:35.568 INFO:tasks.workunit.client.1.smithi100.stdout:6/508: rename de/cf to de/d58/d21/d5b/cb3 0 2024-04-27T07:33:35.568 INFO:tasks.workunit.client.1.smithi100.stdout:1/594: link d0/d1b/d20/d2d/d35/l8e d0/d1f/d6d/db4/d4e/lbf 0 2024-04-27T07:33:35.569 INFO:tasks.workunit.client.1.smithi100.stdout:7/466: fsync d1/dd/d16/d3e/f7c 0 2024-04-27T07:33:35.570 INFO:tasks.workunit.client.1.smithi100.stdout:3/605: dwrite d7/d9/fa7 [0,4194304] 0 2024-04-27T07:33:35.570 INFO:tasks.workunit.client.1.smithi100.stdout:8/446: dread d6/d1b/f22 [0,4194304] 0 2024-04-27T07:33:35.572 INFO:tasks.workunit.client.0.smithi082.stdout:2/972: dwrite d7/d30/d23/fcf [4194304,4194304] 0 2024-04-27T07:33:35.574 INFO:tasks.workunit.client.1.smithi100.stdout:3/606: stat d7/d9/d10/d33/d90/f99 0 2024-04-27T07:33:35.574 INFO:tasks.workunit.client.1.smithi100.stdout:8/447: fsync d6/d20/d46/f5c 0 2024-04-27T07:33:35.574 INFO:tasks.workunit.client.1.smithi100.stdout:0/475: creat d1/d38/d3a/fa4 x:0 0 0 2024-04-27T07:33:35.575 INFO:tasks.workunit.client.1.smithi100.stdout:3/607: read - d7/d9/d10/d33/d90/dbb/fbc zero size 2024-04-27T07:33:35.576 INFO:tasks.workunit.client.1.smithi100.stdout:1/595: chown d0/d1f/d6d/db4/f39 0 1 2024-04-27T07:33:35.577 INFO:tasks.workunit.client.1.smithi100.stdout:8/448: creat d6/d20/d50/f89 x:0 0 0 2024-04-27T07:33:35.577 INFO:tasks.workunit.client.1.smithi100.stdout:0/476: read - d1/d8/d20/d61/f9f zero size 2024-04-27T07:33:35.578 INFO:tasks.workunit.client.1.smithi100.stdout:7/467: write d1/dd/d16/d31/d4c/f81 [2127323,111395] 0 2024-04-27T07:33:35.578 INFO:tasks.workunit.client.0.smithi082.stdout:2/973: rename d7/d31/d54/f96 to d7/d8/d13/d94/f147 0 2024-04-27T07:33:35.584 INFO:tasks.workunit.client.0.smithi082.stdout:2/974: dwrite d7/d30/d23/fcf [4194304,4194304] 0 2024-04-27T07:33:35.585 INFO:tasks.workunit.client.1.smithi100.stdout:6/509: getdents de/d58/d21/d23/d73 0 2024-04-27T07:33:35.585 INFO:tasks.workunit.client.0.smithi082.stdout:2/975: fdatasync d7/d30/d23/ff8 0 2024-04-27T07:33:35.586 INFO:tasks.workunit.client.1.smithi100.stdout:6/510: readlink lb 0 2024-04-27T07:33:35.590 INFO:tasks.workunit.client.1.smithi100.stdout:8/449: rename d6/f35 to d6/d20/d50/f8a 0 2024-04-27T07:33:35.590 INFO:tasks.workunit.client.1.smithi100.stdout:6/511: write de/d58/d21/d24/f54 [774658,40010] 0 2024-04-27T07:33:35.592 INFO:tasks.workunit.client.1.smithi100.stdout:0/477: dwrite d1/d8/f7f [0,4194304] 0 2024-04-27T07:33:35.593 INFO:tasks.workunit.client.0.smithi082.stdout:2/976: dwrite d7/d8/f74 [0,4194304] 0 2024-04-27T07:33:35.597 INFO:tasks.workunit.client.0.smithi082.stdout:2/977: creat d7/d30/f148 x:0 0 0 2024-04-27T07:33:35.602 INFO:tasks.workunit.client.1.smithi100.stdout:6/512: truncate f8 1299047 0 2024-04-27T07:33:35.602 INFO:tasks.workunit.client.1.smithi100.stdout:4/485: write d5/d1b/d2c/f8d [445556,76972] 0 2024-04-27T07:33:35.606 INFO:tasks.workunit.client.1.smithi100.stdout:8/450: mkdir d6/d20/d8b 0 2024-04-27T07:33:35.607 INFO:tasks.workunit.client.1.smithi100.stdout:4/486: write d5/d16/d19/d21/d77/fa5 [532651,103894] 0 2024-04-27T07:33:35.611 INFO:tasks.workunit.client.1.smithi100.stdout:6/513: mknod de/d58/d75/cb4 0 2024-04-27T07:33:35.611 INFO:tasks.workunit.client.1.smithi100.stdout:8/451: dread d6/d20/d50/f52 [0,4194304] 0 2024-04-27T07:33:35.614 INFO:tasks.workunit.client.1.smithi100.stdout:8/452: mkdir d6/d20/d8b/d8c 0 2024-04-27T07:33:35.618 INFO:tasks.workunit.client.1.smithi100.stdout:6/514: dwrite de/d58/d21/d23/f84 [0,4194304] 0 2024-04-27T07:33:35.622 INFO:tasks.workunit.client.0.smithi082.stdout:2/978: dwrite d7/d9/d4f/d66/dae/f8c [0,4194304] 0 2024-04-27T07:33:35.626 INFO:tasks.workunit.client.1.smithi100.stdout:7/468: dread d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:35.626 INFO:tasks.workunit.client.1.smithi100.stdout:6/515: symlink de/d58/d21/d23/d73/lb5 0 2024-04-27T07:33:35.627 INFO:tasks.workunit.client.0.smithi082.stdout:2/979: rename d7/d30/d23/l100 to d7/d8/d99/dc8/l149 0 2024-04-27T07:33:35.628 INFO:tasks.workunit.client.0.smithi082.stdout:2/980: readlink d7/d9/d4f/d6e/d82/lc5 0 2024-04-27T07:33:35.629 INFO:tasks.workunit.client.1.smithi100.stdout:3/608: truncate d7/d9/d10/d33/d90/f57 415985 0 2024-04-27T07:33:35.630 INFO:tasks.workunit.client.1.smithi100.stdout:4/487: dread d5/d16/d19/d46/f81 [0,4194304] 0 2024-04-27T07:33:35.630 INFO:tasks.workunit.client.1.smithi100.stdout:8/453: dwrite d6/d20/d50/f74 [0,4194304] 0 2024-04-27T07:33:35.630 INFO:tasks.workunit.client.0.smithi082.stdout:2/981: stat d7/d31/l26 0 2024-04-27T07:33:35.630 INFO:tasks.workunit.client.1.smithi100.stdout:1/596: dwrite d0/d1b/d20/d2d/f2e [0,4194304] 0 2024-04-27T07:33:35.631 INFO:tasks.workunit.client.0.smithi082.stdout:2/982: mkdir d7/d9/d4f/d66/dae/d14a 0 2024-04-27T07:33:35.638 INFO:tasks.workunit.client.1.smithi100.stdout:3/609: write d7/d9/d26/d2a/d5e/f72 [1886755,67143] 0 2024-04-27T07:33:35.638 INFO:tasks.workunit.client.1.smithi100.stdout:8/454: rename d6/d20/d50/f61 to d6/d20/d8b/f8d 0 2024-04-27T07:33:35.639 INFO:tasks.workunit.client.1.smithi100.stdout:6/516: creat de/d58/d90/fb6 x:0 0 0 2024-04-27T07:33:35.640 INFO:tasks.workunit.client.1.smithi100.stdout:3/610: stat d7/d9/d10/d33/d90 0 2024-04-27T07:33:35.642 INFO:tasks.workunit.client.1.smithi100.stdout:4/488: fsync d5/d16/f26 0 2024-04-27T07:33:35.643 INFO:tasks.workunit.client.1.smithi100.stdout:8/455: dread - d6/d20/d50/d72/f86 zero size 2024-04-27T07:33:35.644 INFO:tasks.workunit.client.1.smithi100.stdout:0/478: dwrite d1/d38/f60 [0,4194304] 0 2024-04-27T07:33:35.644 INFO:tasks.workunit.client.1.smithi100.stdout:1/597: creat d0/d1f/d6d/db4/d4e/d7b/fc0 x:0 0 0 2024-04-27T07:33:35.646 INFO:tasks.workunit.client.1.smithi100.stdout:3/611: fdatasync d7/dad/daf/f49 0 2024-04-27T07:33:35.647 INFO:tasks.workunit.client.1.smithi100.stdout:7/469: getdents d1 0 2024-04-27T07:33:35.648 INFO:tasks.workunit.client.0.smithi082.stdout:2/983: dwrite d7/d8/d99/f111 [4194304,4194304] 0 2024-04-27T07:33:35.650 INFO:tasks.workunit.client.1.smithi100.stdout:4/489: fdatasync d5/d16/f93 0 2024-04-27T07:33:35.651 INFO:tasks.workunit.client.1.smithi100.stdout:3/612: dread - d7/d9/d26/d2a/d5e/fa6 zero size 2024-04-27T07:33:35.651 INFO:tasks.workunit.client.0.smithi082.stdout:2/984: mknod d7/d14/d11a/c14b 0 2024-04-27T07:33:35.652 INFO:tasks.workunit.client.0.smithi082.stdout:2/985: write d7/d14/d11f/f71 [13287534,72991] 0 2024-04-27T07:33:35.654 INFO:tasks.workunit.client.0.smithi082.stdout:2/986: symlink d7/d8/d99/l14c 0 2024-04-27T07:33:35.655 INFO:tasks.workunit.client.0.smithi082.stdout:2/987: readlink d7/d14/l2f 0 2024-04-27T07:33:35.655 INFO:tasks.workunit.client.1.smithi100.stdout:4/490: rename d5 to d5/d16/d19/d21/d77/d94/d9f/daa 22 2024-04-27T07:33:35.655 INFO:tasks.workunit.client.1.smithi100.stdout:7/470: rmdir d1/dd/d16/d31/d4c/d4d 39 2024-04-27T07:33:35.656 INFO:tasks.workunit.client.1.smithi100.stdout:7/471: readlink d1/dd/d16/d4a/d56/l82 0 2024-04-27T07:33:35.656 INFO:tasks.workunit.client.0.smithi082.stdout:2/988: write d7/d31/d54/f130 [426839,44143] 0 2024-04-27T07:33:35.657 INFO:tasks.workunit.client.0.smithi082.stdout:2/989: dread - d7/d8/d99/dc8/f118 zero size 2024-04-27T07:33:35.657 INFO:tasks.workunit.client.1.smithi100.stdout:1/598: mknod d0/cc1 0 2024-04-27T07:33:35.660 INFO:tasks.workunit.client.1.smithi100.stdout:6/517: dread de/d58/d21/d24/f27 [4194304,4194304] 0 2024-04-27T07:33:35.662 INFO:tasks.workunit.client.1.smithi100.stdout:4/491: dread d5/d16/d19/d21/d77/fa5 [0,4194304] 0 2024-04-27T07:33:35.663 INFO:tasks.workunit.client.1.smithi100.stdout:7/472: write d1/dd/d16/d31/d4c/d4d/f6b [2117256,34196] 0 2024-04-27T07:33:35.663 INFO:tasks.workunit.client.0.smithi082.stdout:2/990: dwrite d7/d14/d11f/fa5 [4194304,4194304] 0 2024-04-27T07:33:35.664 INFO:tasks.workunit.client.1.smithi100.stdout:1/599: creat d0/d1f/fc2 x:0 0 0 2024-04-27T07:33:35.667 INFO:tasks.workunit.client.1.smithi100.stdout:6/518: symlink de/d58/d21/d23/lb7 0 2024-04-27T07:33:35.667 INFO:tasks.workunit.client.0.smithi082.stdout:2/991: mknod d7/d8/dd9/c14d 0 2024-04-27T07:33:35.673 INFO:tasks.workunit.client.1.smithi100.stdout:6/519: creat de/d2e/d86/fb8 x:0 0 0 2024-04-27T07:33:35.673 INFO:tasks.workunit.client.1.smithi100.stdout:1/600: dwrite d0/d1b/d20/d2d/d35/f89 [0,4194304] 0 2024-04-27T07:33:35.676 INFO:tasks.workunit.client.1.smithi100.stdout:1/601: readlink d0/d1f/d6d/db4/d4e/l6a 0 2024-04-27T07:33:35.676 INFO:tasks.workunit.client.1.smithi100.stdout:7/473: symlink d1/dd/d2a/l8c 0 2024-04-27T07:33:35.677 INFO:tasks.workunit.client.1.smithi100.stdout:8/456: write d6/d20/d2a/f65 [3400831,123189] 0 2024-04-27T07:33:35.677 INFO:tasks.workunit.client.1.smithi100.stdout:6/520: mkdir de/d58/d21/d24/d9f/db9 0 2024-04-27T07:33:35.680 INFO:tasks.workunit.client.1.smithi100.stdout:1/602: mknod d0/d1b/d20/d2d/d35/d4d/cc3 0 2024-04-27T07:33:35.681 INFO:tasks.workunit.client.1.smithi100.stdout:7/474: symlink d1/dd/d16/d2b/l8d 0 2024-04-27T07:33:35.683 INFO:tasks.workunit.client.1.smithi100.stdout:6/521: mknod de/d2e/d3f/cba 0 2024-04-27T07:33:35.684 INFO:tasks.workunit.client.1.smithi100.stdout:1/603: creat d0/da0/fc4 x:0 0 0 2024-04-27T07:33:35.686 INFO:tasks.workunit.client.1.smithi100.stdout:7/475: creat d1/d75/f8e x:0 0 0 2024-04-27T07:33:35.688 INFO:tasks.workunit.client.1.smithi100.stdout:8/457: dwrite d6/d20/d46/f5c [0,4194304] 0 2024-04-27T07:33:35.690 INFO:tasks.workunit.client.1.smithi100.stdout:7/476: dread - d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a zero size 2024-04-27T07:33:35.690 INFO:tasks.workunit.client.1.smithi100.stdout:1/604: rmdir d0/d1f/d6d/db4/d4e/d7b 39 2024-04-27T07:33:35.692 INFO:tasks.workunit.client.1.smithi100.stdout:6/522: getdents de/d2e 0 2024-04-27T07:33:35.692 INFO:tasks.workunit.client.1.smithi100.stdout:0/479: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:35.695 INFO:tasks.workunit.client.1.smithi100.stdout:7/477: rmdir d1/dd/d16/d70/d51/d6f 39 2024-04-27T07:33:35.698 INFO:tasks.workunit.client.1.smithi100.stdout:7/478: write d1/dd/d16/d4a/d56/f86 [141722,84102] 0 2024-04-27T07:33:35.700 INFO:tasks.workunit.client.1.smithi100.stdout:8/458: rename d6/d20/d54/f5b to d6/f8e 0 2024-04-27T07:33:35.702 INFO:tasks.workunit.client.1.smithi100.stdout:0/480: dwrite d1/d8/f7f [4194304,4194304] 0 2024-04-27T07:33:35.704 INFO:tasks.workunit.client.1.smithi100.stdout:8/459: fdatasync d6/d20/d2a/f49 0 2024-04-27T07:33:35.708 INFO:tasks.workunit.client.1.smithi100.stdout:6/523: dwrite de/d2e/d3f/f60 [0,4194304] 0 2024-04-27T07:33:35.709 INFO:tasks.workunit.client.0.smithi082.stdout:2/992: dread d7/d9/fce [0,4194304] 0 2024-04-27T07:33:35.711 INFO:tasks.workunit.client.1.smithi100.stdout:4/492: dwrite d5/d23/f25 [0,4194304] 0 2024-04-27T07:33:35.717 INFO:tasks.workunit.client.1.smithi100.stdout:6/524: symlink de/d2e/d86/lbb 0 2024-04-27T07:33:35.721 INFO:tasks.workunit.client.1.smithi100.stdout:8/460: creat d6/d1b/d75/f8f x:0 0 0 2024-04-27T07:33:35.722 INFO:tasks.workunit.client.1.smithi100.stdout:4/493: dread - d5/d23/d33/f9d zero size 2024-04-27T07:33:35.722 INFO:tasks.workunit.client.1.smithi100.stdout:6/525: readlink de/d2e/d86/la4 0 2024-04-27T07:33:35.723 INFO:tasks.workunit.client.0.smithi082.stdout:1/853: sync 2024-04-27T07:33:35.723 INFO:tasks.workunit.client.0.smithi082.stdout:8/927: sync 2024-04-27T07:33:35.724 INFO:tasks.workunit.client.1.smithi100.stdout:0/481: dwrite d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:35.726 INFO:tasks.workunit.client.1.smithi100.stdout:4/494: write d5/f88 [801268,42987] 0 2024-04-27T07:33:35.727 INFO:tasks.workunit.client.0.smithi082.stdout:2/993: chown d7/d31/d54/fab 111 1 2024-04-27T07:33:35.728 INFO:tasks.workunit.client.0.smithi082.stdout:2/994: write d7/d30/f36 [1497725,23106] 0 2024-04-27T07:33:35.729 INFO:tasks.workunit.client.0.smithi082.stdout:2/995: chown d7/d31/dde/def 193528027 1 2024-04-27T07:33:35.729 INFO:tasks.workunit.client.0.smithi082.stdout:8/928: chown d0/d2b/d80/dca/de6/d1c/d76/da0/df9/lfe 41 1 2024-04-27T07:33:35.730 INFO:tasks.workunit.client.1.smithi100.stdout:6/526: write de/d58/d21/d24/f2b [7998420,76347] 0 2024-04-27T07:33:35.731 INFO:tasks.workunit.client.1.smithi100.stdout:0/482: fdatasync d1/d8/d20/f7b 0 2024-04-27T07:33:35.732 INFO:tasks.workunit.client.0.smithi082.stdout:8/929: fsync d0/d2b/d80/dca/de6/d87/d71/f5d 0 2024-04-27T07:33:35.734 INFO:tasks.workunit.client.0.smithi082.stdout:1/854: link d4/d15/d1c/l11a d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/l124 0 2024-04-27T07:33:35.735 INFO:tasks.workunit.client.1.smithi100.stdout:1/605: dwrite d0/d23/f29 [0,4194304] 0 2024-04-27T07:33:35.737 INFO:tasks.workunit.client.0.smithi082.stdout:8/930: mknod d0/d2b/d80/dca/de6/d87/d42/d7f/c131 0 2024-04-27T07:33:35.738 INFO:tasks.workunit.client.1.smithi100.stdout:7/479: dread d1/f15 [0,4194304] 0 2024-04-27T07:33:35.739 INFO:tasks.workunit.client.0.smithi082.stdout:2/996: link d7/d9/d4f/d66/dd6/d12e/f133 d7/d9/df6/f14e 0 2024-04-27T07:33:35.743 INFO:tasks.workunit.client.1.smithi100.stdout:0/483: link d1/d8/d20/d61/d6a/f70 d1/d38/d3a/fa5 0 2024-04-27T07:33:35.747 INFO:tasks.workunit.client.1.smithi100.stdout:1/606: creat d0/d1f/d6d/db4/d4e/fc5 x:0 0 0 2024-04-27T07:33:35.748 INFO:tasks.workunit.client.1.smithi100.stdout:6/527: dwrite de/d58/d75/f8f [0,4194304] 0 2024-04-27T07:33:35.752 INFO:tasks.workunit.client.1.smithi100.stdout:0/484: creat d1/d8/d14/d59/d64/d80/fa6 x:0 0 0 2024-04-27T07:33:35.752 INFO:tasks.workunit.client.1.smithi100.stdout:7/480: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f46 [0,4194304] 0 2024-04-27T07:33:35.754 INFO:tasks.workunit.client.1.smithi100.stdout:0/485: read d1/d30/f73 [328441,118335] 0 2024-04-27T07:33:35.758 INFO:tasks.workunit.client.1.smithi100.stdout:1/607: rename d0/d1b/d20/d2d/d35/d65/faa to d0/d1b/d20/d2d/d35/d65/fc6 0 2024-04-27T07:33:35.760 INFO:tasks.workunit.client.1.smithi100.stdout:6/528: dwrite de/d2e/d86/fb8 [0,4194304] 0 2024-04-27T07:33:35.761 INFO:tasks.workunit.client.1.smithi100.stdout:1/608: read - d0/d1b/da1/fb0 zero size 2024-04-27T07:33:35.766 INFO:tasks.workunit.client.1.smithi100.stdout:6/529: rename fc to de/d58/d21/d24/d9f/fbc 0 2024-04-27T07:33:35.767 INFO:tasks.workunit.client.1.smithi100.stdout:6/530: write de/f69 [695085,641] 0 2024-04-27T07:33:35.767 INFO:tasks.workunit.client.0.smithi082.stdout:2/997: dread d7/d31/f67 [0,4194304] 0 2024-04-27T07:33:35.768 INFO:tasks.workunit.client.1.smithi100.stdout:7/481: creat d1/dd/d16/d31/d4c/f8f x:0 0 0 2024-04-27T07:33:35.769 INFO:tasks.workunit.client.1.smithi100.stdout:0/486: creat d1/d38/fa7 x:0 0 0 2024-04-27T07:33:35.770 INFO:tasks.workunit.client.0.smithi082.stdout:2/998: symlink d7/d9/d4f/d66/dd6/d12e/l14f 0 2024-04-27T07:33:35.770 INFO:tasks.workunit.client.1.smithi100.stdout:7/482: chown d1/dd/d16/d4a/d56/f86 29242819 1 2024-04-27T07:33:35.771 INFO:tasks.workunit.client.0.smithi082.stdout:2/999: chown d7/d9/c12 230793 1 2024-04-27T07:33:35.774 INFO:tasks.workunit.client.1.smithi100.stdout:8/461: truncate d6/d20/d2a/f55 227274 0 2024-04-27T07:33:35.776 INFO:tasks.workunit.client.1.smithi100.stdout:1/609: truncate d0/d1b/d20/d2d/d35/f9b 3727514 0 2024-04-27T07:33:35.777 INFO:tasks.workunit.client.1.smithi100.stdout:7/483: symlink d1/dd/d16/d4a/l90 0 2024-04-27T07:33:35.778 INFO:tasks.workunit.client.1.smithi100.stdout:0/487: dwrite d1/d8/d20/d1e/f8d [0,4194304] 0 2024-04-27T07:33:35.778 INFO:tasks.workunit.client.1.smithi100.stdout:4/495: truncate d5/fc 2429672 0 2024-04-27T07:33:35.780 INFO:tasks.workunit.client.1.smithi100.stdout:0/488: write d1/d8/d14/f41 [2810538,57262] 0 2024-04-27T07:33:35.780 INFO:tasks.workunit.client.1.smithi100.stdout:6/531: link f7 de/fbd 0 2024-04-27T07:33:35.782 INFO:tasks.workunit.client.1.smithi100.stdout:1/610: write d0/d1b/d20/d2d/d35/d65/f76 [195747,99467] 0 2024-04-27T07:33:35.783 INFO:tasks.workunit.client.1.smithi100.stdout:8/462: fsync d6/d1b/d1d/f32 0 2024-04-27T07:33:35.785 INFO:tasks.workunit.client.1.smithi100.stdout:4/496: write d5/d16/d19/d21/f41 [8727067,109217] 0 2024-04-27T07:33:35.787 INFO:tasks.workunit.client.1.smithi100.stdout:8/463: dread - d6/d1b/d75/f83 zero size 2024-04-27T07:33:35.788 INFO:tasks.workunit.client.1.smithi100.stdout:7/484: dread d1/dd/d16/d4a/d56/f86 [0,4194304] 0 2024-04-27T07:33:35.791 INFO:tasks.workunit.client.1.smithi100.stdout:2/496: sync 2024-04-27T07:33:35.791 INFO:tasks.workunit.client.1.smithi100.stdout:5/396: sync 2024-04-27T07:33:35.791 INFO:tasks.workunit.client.1.smithi100.stdout:9/409: sync 2024-04-27T07:33:35.792 INFO:tasks.workunit.client.0.smithi082.stdout:1/855: write d4/d15/d49/fc2 [773664,33905] 0 2024-04-27T07:33:35.793 INFO:tasks.workunit.client.0.smithi082.stdout:1/856: stat d4/d15/d49/dab/dc3/d4c 0 2024-04-27T07:33:35.794 INFO:tasks.workunit.client.1.smithi100.stdout:7/485: read d1/f33 [1060364,40678] 0 2024-04-27T07:33:35.796 INFO:tasks.workunit.client.1.smithi100.stdout:8/464: dwrite d6/d1b/d75/f8f [0,4194304] 0 2024-04-27T07:33:35.797 INFO:tasks.workunit.client.1.smithi100.stdout:1/611: mkdir d0/d1f/d6d/dc7 0 2024-04-27T07:33:35.798 INFO:tasks.workunit.client.0.smithi082.stdout:8/931: dwrite d0/d2b/d80/dca/de6/d1c/d76/da0/fcc [0,4194304] 0 2024-04-27T07:33:35.804 INFO:tasks.workunit.client.1.smithi100.stdout:2/497: dwrite d0/da/f1c [0,4194304] 0 2024-04-27T07:33:35.807 INFO:tasks.workunit.client.0.smithi082.stdout:8/932: link d0/d2b/d80/dca/de6/d1c/d76/da0/lf8 d0/d2b/d80/dca/de9/dbf/dd2/l132 0 2024-04-27T07:33:35.808 INFO:tasks.workunit.client.1.smithi100.stdout:4/497: dwrite d5/fe [0,4194304] 0 2024-04-27T07:33:35.808 INFO:tasks.workunit.client.0.smithi082.stdout:8/933: chown d0/d2b/d9a/da4/l12c 457 1 2024-04-27T07:33:35.809 INFO:tasks.workunit.client.1.smithi100.stdout:4/498: chown d5/d1b/d2c 11 1 2024-04-27T07:33:35.810 INFO:tasks.workunit.client.1.smithi100.stdout:4/499: chown d5/d16/d19/d21/d2b/f51 1913235 1 2024-04-27T07:33:35.814 INFO:tasks.workunit.client.1.smithi100.stdout:5/397: rename d0/d4/d21/d3d/f59 to d0/d4/d21/d24/d46/f80 0 2024-04-27T07:33:35.814 INFO:tasks.workunit.client.1.smithi100.stdout:7/486: rename d1/dd to d1/dd/d16/d4a/d91 22 2024-04-27T07:33:35.815 INFO:tasks.workunit.client.0.smithi082.stdout:9/868: sync 2024-04-27T07:33:35.815 INFO:tasks.workunit.client.0.smithi082.stdout:6/987: sync 2024-04-27T07:33:35.815 INFO:tasks.workunit.client.1.smithi100.stdout:8/465: mknod d6/d1b/d75/c90 0 2024-04-27T07:33:35.817 INFO:tasks.workunit.client.1.smithi100.stdout:6/532: write de/d58/d28/f4d [811043,88400] 0 2024-04-27T07:33:35.818 INFO:tasks.workunit.client.1.smithi100.stdout:6/533: chown de/d58/d21/f83 1256 1 2024-04-27T07:33:35.819 INFO:tasks.workunit.client.0.smithi082.stdout:6/988: mkdir d2/d2d/d4a/de4/d15b 0 2024-04-27T07:33:35.820 INFO:tasks.workunit.client.1.smithi100.stdout:4/500: creat d5/d16/d19/d21/d2b/fab x:0 0 0 2024-04-27T07:33:35.821 INFO:tasks.workunit.client.0.smithi082.stdout:9/869: fdatasync d9/da/dc/d35/d38/dc5/ffa 0 2024-04-27T07:33:35.821 INFO:tasks.workunit.client.0.smithi082.stdout:1/857: dread d4/f12 [4194304,4194304] 0 2024-04-27T07:33:35.823 INFO:tasks.workunit.client.0.smithi082.stdout:6/989: write d2/d1e/d32/d85/d10c/d113/f14d [37308,13334] 0 2024-04-27T07:33:35.824 INFO:tasks.workunit.client.0.smithi082.stdout:6/990: chown d2/d3/fd 48524520 1 2024-04-27T07:33:35.825 INFO:tasks.workunit.client.0.smithi082.stdout:1/858: mknod d4/d15/d49/da0/d10c/c125 0 2024-04-27T07:33:35.825 INFO:tasks.workunit.client.1.smithi100.stdout:8/466: mkdir d6/d20/d54/d91 0 2024-04-27T07:33:35.825 INFO:tasks.workunit.client.1.smithi100.stdout:0/489: dwrite d1/d8/d20/f26 [0,4194304] 0 2024-04-27T07:33:35.826 INFO:tasks.workunit.client.0.smithi082.stdout:6/991: dread - d2/d2d/d4a/f125 zero size 2024-04-27T07:33:35.827 INFO:tasks.workunit.client.0.smithi082.stdout:6/992: mknod d2/d2e/dae/c15c 0 2024-04-27T07:33:35.828 INFO:tasks.workunit.client.1.smithi100.stdout:9/410: creat d1/f94 x:0 0 0 2024-04-27T07:33:35.829 INFO:tasks.workunit.client.0.smithi082.stdout:1/859: symlink d4/d15/d49/dab/dc3/l126 0 2024-04-27T07:33:35.829 INFO:tasks.workunit.client.1.smithi100.stdout:6/534: symlink de/d2e/d3f/d80/lbe 0 2024-04-27T07:33:35.829 INFO:tasks.workunit.client.0.smithi082.stdout:6/993: mkdir d2/d2e/d55/dd0/d15d 0 2024-04-27T07:33:35.830 INFO:tasks.workunit.client.1.smithi100.stdout:6/535: fdatasync de/d58/d28/f2d 0 2024-04-27T07:33:35.831 INFO:tasks.workunit.client.0.smithi082.stdout:1/860: creat d4/d15/d49/f127 x:0 0 0 2024-04-27T07:33:35.832 INFO:tasks.workunit.client.1.smithi100.stdout:8/467: mknod d6/d1b/d1d/d59/c92 0 2024-04-27T07:33:35.836 INFO:tasks.workunit.client.0.smithi082.stdout:6/994: getdents d2/d2e/d6c/df1 0 2024-04-27T07:33:35.836 INFO:tasks.workunit.client.1.smithi100.stdout:9/411: rename d1/d9/f1b to d1/d9/d1f/d52/d54/f95 0 2024-04-27T07:33:35.839 INFO:tasks.workunit.client.1.smithi100.stdout:8/468: creat d6/d1b/d1d/d77/f93 x:0 0 0 2024-04-27T07:33:35.840 INFO:tasks.workunit.client.0.smithi082.stdout:1/861: dwrite d4/d15/d49/d99/f110 [0,4194304] 0 2024-04-27T07:33:35.842 INFO:tasks.workunit.client.0.smithi082.stdout:9/870: write d9/d48/fdf [947660,19743] 0 2024-04-27T07:33:35.842 INFO:tasks.workunit.client.1.smithi100.stdout:6/536: link de/d58/d28/f8b de/d58/d21/d24/d9f/fbf 0 2024-04-27T07:33:35.845 INFO:tasks.workunit.client.0.smithi082.stdout:8/934: dread d0/d2b/d80/dca/de6/d87/d71/f5d [0,4194304] 0 2024-04-27T07:33:35.846 INFO:tasks.workunit.client.1.smithi100.stdout:7/487: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:35.846 INFO:tasks.workunit.client.0.smithi082.stdout:9/871: creat d9/da/dc/d35/d4a/d50/f125 x:0 0 0 2024-04-27T07:33:35.847 INFO:tasks.workunit.client.1.smithi100.stdout:5/398: getdents d0/d4/d21/d3d 0 2024-04-27T07:33:35.848 INFO:tasks.workunit.client.0.smithi082.stdout:8/935: stat d0/d2b/d80/dca/de6/f18 0 2024-04-27T07:33:35.848 INFO:tasks.workunit.client.0.smithi082.stdout:8/936: dread - d0/d2b/d9a/f10b zero size 2024-04-27T07:33:35.849 INFO:tasks.workunit.client.0.smithi082.stdout:9/872: creat d9/da/dc/d35/d4b/f126 x:0 0 0 2024-04-27T07:33:35.854 INFO:tasks.workunit.client.1.smithi100.stdout:5/399: rmdir d0/d4/d21/d24 39 2024-04-27T07:33:35.855 INFO:tasks.workunit.client.1.smithi100.stdout:7/488: dwrite d1/dd/d16/d31/f60 [0,4194304] 0 2024-04-27T07:33:35.857 INFO:tasks.workunit.client.1.smithi100.stdout:5/400: creat d0/d42/f81 x:0 0 0 2024-04-27T07:33:35.858 INFO:tasks.workunit.client.1.smithi100.stdout:6/537: dwrite de/d58/d21/d24/f27 [4194304,4194304] 0 2024-04-27T07:33:35.860 INFO:tasks.workunit.client.1.smithi100.stdout:5/401: write d0/f1d [571625,66420] 0 2024-04-27T07:33:35.865 INFO:tasks.workunit.client.1.smithi100.stdout:6/538: dread de/d2e/d3f/f87 [0,4194304] 0 2024-04-27T07:33:35.865 INFO:tasks.workunit.client.0.smithi082.stdout:6/995: dwrite d2/d1e/d32/d7d/ff7 [0,4194304] 0 2024-04-27T07:33:35.866 INFO:tasks.workunit.client.0.smithi082.stdout:1/862: dwrite d4/f35 [4194304,4194304] 0 2024-04-27T07:33:35.868 INFO:tasks.workunit.client.1.smithi100.stdout:7/489: dwrite d1/dd/d16/f66 [0,4194304] 0 2024-04-27T07:33:35.869 INFO:tasks.workunit.client.1.smithi100.stdout:6/539: readlink de/d58/d21/d24/l7b 0 2024-04-27T07:33:35.870 INFO:tasks.workunit.client.0.smithi082.stdout:9/873: dwrite d9/d2d/d72/f8a [0,4194304] 0 2024-04-27T07:33:35.871 INFO:tasks.workunit.client.1.smithi100.stdout:0/490: truncate d1/d38/f9c 1063257 0 2024-04-27T07:33:35.872 INFO:tasks.workunit.client.1.smithi100.stdout:0/491: chown d1/d38/c49 108 1 2024-04-27T07:33:35.874 INFO:tasks.workunit.client.1.smithi100.stdout:6/540: mkdir de/d2e/dc0 0 2024-04-27T07:33:35.875 INFO:tasks.workunit.client.0.smithi082.stdout:8/937: dwrite d0/d2b/d80/dca/de6/d87/d46/d4e/d115/f118 [0,4194304] 0 2024-04-27T07:33:35.881 INFO:tasks.workunit.client.1.smithi100.stdout:9/412: truncate d1/d9/db/d2b/d31/f50 263890 0 2024-04-27T07:33:35.882 INFO:tasks.workunit.client.0.smithi082.stdout:6/996: creat d2/d2d/d4a/de4/dcc/d77/dd3/f15e x:0 0 0 2024-04-27T07:33:35.883 INFO:tasks.workunit.client.0.smithi082.stdout:8/938: dread d0/d2b/d80/dca/de6/d87/d71/ffd [0,4194304] 0 2024-04-27T07:33:35.885 INFO:tasks.workunit.client.1.smithi100.stdout:8/469: truncate d6/d1b/d1d/f39 3150445 0 2024-04-27T07:33:35.886 INFO:tasks.workunit.client.0.smithi082.stdout:8/939: readlink d0/d2b/d80/dca/de6/d87/l48 0 2024-04-27T07:33:35.886 INFO:tasks.workunit.client.1.smithi100.stdout:0/492: rmdir d1/d30 39 2024-04-27T07:33:35.886 INFO:tasks.workunit.client.0.smithi082.stdout:8/940: dread - d0/d2b/d9a/da4/f111 zero size 2024-04-27T07:33:35.887 INFO:tasks.workunit.client.0.smithi082.stdout:6/997: truncate d2/d2d/d4a/de4/dcc/d77/dd3/f150 939485 0 2024-04-27T07:33:35.888 INFO:tasks.workunit.client.1.smithi100.stdout:0/493: truncate d1/d8/d14/d59/f9a 868788 0 2024-04-27T07:33:35.889 INFO:tasks.workunit.client.1.smithi100.stdout:5/402: link d0/d4/d21/d24/d2f/d39/d56/d67/f68 d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 0 2024-04-27T07:33:35.890 INFO:tasks.workunit.client.1.smithi100.stdout:6/541: dread de/f12 [0,4194304] 0 2024-04-27T07:33:35.891 INFO:tasks.workunit.client.0.smithi082.stdout:6/998: unlink d2/d1e/d32/d85/d10c/d113/d134/c96 0 2024-04-27T07:33:35.892 INFO:tasks.workunit.client.1.smithi100.stdout:7/490: rename d1/dd/d16/d31/d4c/d4d/f25 to d1/dd/d16/d70/d51/d6f/f92 0 2024-04-27T07:33:35.893 INFO:tasks.workunit.client.1.smithi100.stdout:8/470: readlink d6/l12 0 2024-04-27T07:33:35.893 INFO:tasks.workunit.client.0.smithi082.stdout:6/999: stat d2/d2d/d4a/de4/dcc/d77/dd3/f116 0 2024-04-27T07:33:35.894 INFO:tasks.workunit.client.1.smithi100.stdout:8/471: read d6/d1b/d75/f8f [2320294,79599] 0 2024-04-27T07:33:35.897 INFO:tasks.workunit.client.1.smithi100.stdout:7/491: write d1/f15 [3783599,103368] 0 2024-04-27T07:33:35.899 INFO:tasks.workunit.client.1.smithi100.stdout:6/542: link de/d58/d21/d24/f2b de/d58/d21/d24/d9f/fc1 0 2024-04-27T07:33:35.901 INFO:tasks.workunit.client.1.smithi100.stdout:6/543: write de/f1e [4840326,17534] 0 2024-04-27T07:33:35.902 INFO:tasks.workunit.client.1.smithi100.stdout:8/472: dread d6/f45 [0,4194304] 0 2024-04-27T07:33:35.902 INFO:tasks.workunit.client.1.smithi100.stdout:5/403: rmdir d0/d4/d21/d3d 0 2024-04-27T07:33:35.905 INFO:tasks.workunit.client.1.smithi100.stdout:4/501: dread d5/fc [0,4194304] 0 2024-04-27T07:33:35.905 INFO:tasks.workunit.client.1.smithi100.stdout:9/413: rename d1/d9/db/d2b/d4f/c5e to d1/d9/db/c96 0 2024-04-27T07:33:35.911 INFO:tasks.workunit.client.1.smithi100.stdout:4/502: creat d5/d16/d19/d21/fac x:0 0 0 2024-04-27T07:33:35.914 INFO:tasks.workunit.client.1.smithi100.stdout:4/503: mkdir d5/d16/d19/d21/d6d/dad 0 2024-04-27T07:33:35.916 INFO:tasks.workunit.client.0.smithi082.stdout:1/863: truncate d4/d15/d49/dab/dc3/d3e/d53/d72/fac 1644250 0 2024-04-27T07:33:35.916 INFO:tasks.workunit.client.0.smithi082.stdout:8/941: dread d0/d2b/d80/dca/de6/f1d [0,4194304] 0 2024-04-27T07:33:35.916 INFO:tasks.workunit.client.1.smithi100.stdout:7/492: rename d1/dd/d16/d4a/d56/f5e to d1/dd/d2a/f93 0 2024-04-27T07:33:35.917 INFO:tasks.workunit.client.0.smithi082.stdout:1/864: dread - d4/d15/d49/dab/dc3/d3e/f10b zero size 2024-04-27T07:33:35.918 INFO:tasks.workunit.client.1.smithi100.stdout:9/414: dwrite d1/d9/db/d2b/f34 [0,4194304] 0 2024-04-27T07:33:35.921 INFO:tasks.workunit.client.0.smithi082.stdout:1/865: creat d4/d15/d49/d99/d9a/f128 x:0 0 0 2024-04-27T07:33:35.924 INFO:tasks.workunit.client.1.smithi100.stdout:4/504: chown d5/c97 19658785 1 2024-04-27T07:33:35.924 INFO:tasks.workunit.client.0.smithi082.stdout:1/866: chown d4/d15/d49/da0/d10c/c125 403419 1 2024-04-27T07:33:35.926 INFO:tasks.workunit.client.0.smithi082.stdout:8/942: dwrite d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/fd6 [0,4194304] 0 2024-04-27T07:33:35.928 INFO:tasks.workunit.client.1.smithi100.stdout:3/613: sync 2024-04-27T07:33:35.929 INFO:tasks.workunit.client.1.smithi100.stdout:4/505: read d5/d16/fa1 [239654,124421] 0 2024-04-27T07:33:35.929 INFO:tasks.workunit.client.1.smithi100.stdout:3/614: write d7/d9/d10/d28/db0/fba [938377,104684] 0 2024-04-27T07:33:35.930 INFO:tasks.workunit.client.0.smithi082.stdout:1/867: mkdir d4/d15/d49/dab/dc3/d3e/d53/d72/d114/d129 0 2024-04-27T07:33:35.930 INFO:tasks.workunit.client.1.smithi100.stdout:7/493: creat d1/dd/d16/d4a/d56/f94 x:0 0 0 2024-04-27T07:33:35.932 INFO:tasks.workunit.client.1.smithi100.stdout:3/615: dread d7/d9/d10/d3e/d74/db1/f92 [0,4194304] 0 2024-04-27T07:33:35.933 INFO:tasks.workunit.client.1.smithi100.stdout:7/494: dread d1/dd/d16/d4a/d56/f86 [0,4194304] 0 2024-04-27T07:33:35.934 INFO:tasks.workunit.client.0.smithi082.stdout:8/943: rename d0/d2b/d9a/de5 to d0/d2b/d9a/da4/d133 0 2024-04-27T07:33:35.934 INFO:tasks.workunit.client.1.smithi100.stdout:5/404: rename d0/d58/f6e to d0/d4/d21/d24/d2f/d57/d37/d1a/f83 0 2024-04-27T07:33:35.939 INFO:tasks.workunit.client.1.smithi100.stdout:3/616: creat d7/d9/d10/d28/db0/fbe x:0 0 0 2024-04-27T07:33:35.942 INFO:tasks.workunit.client.1.smithi100.stdout:9/415: rename d1/d9/db/d56/c6a to d1/d9/d1f/d4a/c97 0 2024-04-27T07:33:35.943 INFO:tasks.workunit.client.1.smithi100.stdout:6/544: write de/d2e/d3f/f6d [2909970,34917] 0 2024-04-27T07:33:35.945 INFO:tasks.workunit.client.1.smithi100.stdout:3/617: readlink d7/d9/lb 0 2024-04-27T07:33:35.945 INFO:tasks.workunit.client.1.smithi100.stdout:8/473: truncate d6/f18 1269866 0 2024-04-27T07:33:35.946 INFO:tasks.workunit.client.0.smithi082.stdout:1/868: dwrite d4/f1e [0,4194304] 0 2024-04-27T07:33:35.946 INFO:tasks.workunit.client.1.smithi100.stdout:7/495: dwrite d1/dd/d16/d70/d51/d6f/f92 [0,4194304] 0 2024-04-27T07:33:35.948 INFO:tasks.workunit.client.1.smithi100.stdout:5/405: rename d0/d4/d21/d24/d2f/d57/d3e/d6a to d0/d4/d21/d24/d2f/d39/d56/d67/d84 0 2024-04-27T07:33:35.950 INFO:tasks.workunit.client.0.smithi082.stdout:1/869: creat d4/d15/d49/dab/dc3/d3e/d57/d101/d98/f12a x:0 0 0 2024-04-27T07:33:35.950 INFO:tasks.workunit.client.1.smithi100.stdout:9/416: fdatasync d1/f26 0 2024-04-27T07:33:35.952 INFO:tasks.workunit.client.0.smithi082.stdout:1/870: chown d4/d15/d49/dab/dc3/d4c/cd0 1 1 2024-04-27T07:33:35.954 INFO:tasks.workunit.client.1.smithi100.stdout:5/406: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 0 1 2024-04-27T07:33:35.955 INFO:tasks.workunit.client.1.smithi100.stdout:3/618: creat d7/dad/fbf x:0 0 0 2024-04-27T07:33:35.955 INFO:tasks.workunit.client.0.smithi082.stdout:1/871: mkdir d4/d15/d49/d99/de8/d102/d12b 0 2024-04-27T07:33:35.958 INFO:tasks.workunit.client.1.smithi100.stdout:5/407: dread - d0/d42/f81 zero size 2024-04-27T07:33:35.959 INFO:tasks.workunit.client.0.smithi082.stdout:8/944: dwrite d0/d2b/d80/dca/de6/d1c/fb0 [0,4194304] 0 2024-04-27T07:33:35.964 INFO:tasks.workunit.client.1.smithi100.stdout:5/408: write d0/f1d [985568,53228] 0 2024-04-27T07:33:35.966 INFO:tasks.workunit.client.0.smithi082.stdout:8/945: dread d0/d2b/d80/dca/de6/d87/d42/f5b [0,4194304] 0 2024-04-27T07:33:35.967 INFO:tasks.workunit.client.1.smithi100.stdout:8/474: dwrite d6/d1b/d75/f83 [0,4194304] 0 2024-04-27T07:33:35.967 INFO:tasks.workunit.client.1.smithi100.stdout:7/496: dread d1/dd/d16/d31/d4c/d4d/d3b/f67 [0,4194304] 0 2024-04-27T07:33:35.969 INFO:tasks.workunit.client.1.smithi100.stdout:9/417: link d1/d9/d1f/f7a d1/d9/d1f/f98 0 2024-04-27T07:33:35.970 INFO:tasks.workunit.client.0.smithi082.stdout:1/872: write d4/d15/d1c/f2c [3922507,100195] 0 2024-04-27T07:33:35.971 INFO:tasks.workunit.client.0.smithi082.stdout:1/873: chown d4/d15/d49/dab/dc3/d4c/d7a/d8c/le0 826941 1 2024-04-27T07:33:35.972 INFO:tasks.workunit.client.0.smithi082.stdout:1/874: chown d4/d15/d49/dab/feb 1177481395 1 2024-04-27T07:33:35.972 INFO:tasks.workunit.client.1.smithi100.stdout:4/506: dread d5/f15 [0,4194304] 0 2024-04-27T07:33:35.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/875: readlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/l11b 0 2024-04-27T07:33:35.974 INFO:tasks.workunit.client.1.smithi100.stdout:0/494: dwrite d1/d38/f9c [0,4194304] 0 2024-04-27T07:33:35.976 INFO:tasks.workunit.client.0.smithi082.stdout:1/876: mknod d4/d15/d49/dab/dc3/d4c/d7a/de7/c12c 0 2024-04-27T07:33:35.976 INFO:tasks.workunit.client.0.smithi082.stdout:1/877: readlink d4/d15/l2e 0 2024-04-27T07:33:35.986 INFO:tasks.workunit.client.1.smithi100.stdout:6/545: dread de/d58/d21/d24/d9f/fc1 [0,4194304] 0 2024-04-27T07:33:35.987 INFO:tasks.workunit.client.1.smithi100.stdout:4/507: rename d5/d16/d19/d21 to d5/d16/d19/d21/d77/dae 22 2024-04-27T07:33:35.992 INFO:tasks.workunit.client.1.smithi100.stdout:8/475: dwrite d6/d20/f81 [0,4194304] 0 2024-04-27T07:33:35.992 INFO:tasks.workunit.client.1.smithi100.stdout:6/546: truncate de/d58/f7c 1132339 0 2024-04-27T07:33:35.995 INFO:tasks.workunit.client.1.smithi100.stdout:5/409: dwrite d0/d4/d21/d24/d46/f66 [0,4194304] 0 2024-04-27T07:33:35.996 INFO:tasks.workunit.client.0.smithi082.stdout:8/946: write d0/d2b/d80/dca/de6/d87/f3f [294268,43242] 0 2024-04-27T07:33:35.997 INFO:tasks.workunit.client.1.smithi100.stdout:6/547: fsync de/d58/d28/f2f 0 2024-04-27T07:33:35.997 INFO:tasks.workunit.client.0.smithi082.stdout:1/878: write d4/d15/d49/d99/fb6 [513254,102306] 0 2024-04-27T07:33:35.998 INFO:tasks.workunit.client.1.smithi100.stdout:0/495: mkdir d1/d8/da8 0 2024-04-27T07:33:36.003 INFO:tasks.workunit.client.1.smithi100.stdout:5/410: dread - d0/d4/d21/d24/d2f/f5c zero size 2024-04-27T07:33:36.004 INFO:tasks.workunit.client.1.smithi100.stdout:8/476: write d6/d1b/d75/f83 [5008278,101737] 0 2024-04-27T07:33:36.004 INFO:tasks.workunit.client.0.smithi082.stdout:1/879: write d4/d15/d49/fc2 [85204,126707] 0 2024-04-27T07:33:36.004 INFO:tasks.workunit.client.0.smithi082.stdout:8/947: creat d0/f134 x:0 0 0 2024-04-27T07:33:36.004 INFO:tasks.workunit.client.0.smithi082.stdout:1/880: dread - d4/d15/d49/d99/d9a/f128 zero size 2024-04-27T07:33:36.004 INFO:tasks.workunit.client.0.smithi082.stdout:1/881: write d4/d15/d49/d99/fb6 [1626533,81443] 0 2024-04-27T07:33:36.005 INFO:tasks.workunit.client.1.smithi100.stdout:8/477: stat d6/d1b/d1d/d59/d4f/l7b 0 2024-04-27T07:33:36.007 INFO:tasks.workunit.client.1.smithi100.stdout:6/548: symlink de/d9b/lc2 0 2024-04-27T07:33:36.008 INFO:tasks.workunit.client.0.smithi082.stdout:1/882: symlink d4/d15/d49/dab/dc3/d3e/d57/d101/d98/l12d 0 2024-04-27T07:33:36.008 INFO:tasks.workunit.client.1.smithi100.stdout:3/619: truncate d7/f1f 115311 0 2024-04-27T07:33:36.009 INFO:tasks.workunit.client.1.smithi100.stdout:3/620: fdatasync d7/d9/d26/f59 0 2024-04-27T07:33:36.010 INFO:tasks.workunit.client.0.smithi082.stdout:1/883: stat d4/d15/d49/da0/c7e 0 2024-04-27T07:33:36.011 INFO:tasks.workunit.client.1.smithi100.stdout:3/621: chown d7/dad/daf/f49 19329 1 2024-04-27T07:33:36.011 INFO:tasks.workunit.client.1.smithi100.stdout:5/411: creat d0/d4/d21/d24/d2f/d39/d56/f85 x:0 0 0 2024-04-27T07:33:36.012 INFO:tasks.workunit.client.0.smithi082.stdout:8/948: stat d0/d2b/d80/dca/de6/c2f 0 2024-04-27T07:33:36.012 INFO:tasks.workunit.client.1.smithi100.stdout:7/497: link d1/dd/d16/d70/d51/d6f/f92 d1/dd/d16/d31/d4c/d4d/f95 0 2024-04-27T07:33:36.013 INFO:tasks.workunit.client.1.smithi100.stdout:9/418: getdents d1/d9/d1f/d52/d54 0 2024-04-27T07:33:36.014 INFO:tasks.workunit.client.1.smithi100.stdout:7/498: truncate d1/dd/d2a/d2c/f43 1953402 0 2024-04-27T07:33:36.014 INFO:tasks.workunit.client.1.smithi100.stdout:7/499: chown d1/dd/d16/d31/d4c/d4d/d3b/f67 740723 1 2024-04-27T07:33:36.021 INFO:tasks.workunit.client.0.smithi082.stdout:8/949: dread d0/d2b/d80/dca/de6/d87/fee [0,4194304] 0 2024-04-27T07:33:36.024 INFO:tasks.workunit.client.0.smithi082.stdout:8/950: mkdir d0/d2b/d80/dca/de6/d1b/d29/d6a/d11b/d135 0 2024-04-27T07:33:36.031 INFO:tasks.workunit.client.0.smithi082.stdout:1/884: dread d4/d15/d49/dab/dc3/d3e/d46/f50 [0,4194304] 0 2024-04-27T07:33:36.034 INFO:tasks.workunit.client.0.smithi082.stdout:1/885: dread d4/d15/d49/fc2 [0,4194304] 0 2024-04-27T07:33:36.035 INFO:tasks.workunit.client.0.smithi082.stdout:8/951: dread d0/d2b/d9a/da4/f41 [0,4194304] 0 2024-04-27T07:33:36.037 INFO:tasks.workunit.client.0.smithi082.stdout:1/886: fsync d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/fd7 0 2024-04-27T07:33:36.040 INFO:tasks.workunit.client.0.smithi082.stdout:1/887: mknod d4/d15/d49/dab/dc3/d4c/d7a/de7/c12e 0 2024-04-27T07:33:36.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/888: creat d4/d15/da7/f12f x:0 0 0 2024-04-27T07:33:36.044 INFO:tasks.workunit.client.0.smithi082.stdout:1/889: write d4/d15/da7/f12f [1038981,16987] 0 2024-04-27T07:33:36.044 INFO:tasks.workunit.client.0.smithi082.stdout:8/952: truncate d0/d2b/d80/dca/de6/d1c/f85 3950613 0 2024-04-27T07:33:36.046 INFO:tasks.workunit.client.0.smithi082.stdout:8/953: symlink d0/d2b/d80/dca/de6/d1b/d29/l136 0 2024-04-27T07:33:36.047 INFO:tasks.workunit.client.0.smithi082.stdout:1/890: mkdir d4/d15/d49/dab/dc3/d3e/d57/d130 0 2024-04-27T07:33:36.047 INFO:tasks.workunit.client.0.smithi082.stdout:8/954: dread - d0/d2b/d80/dca/de6/d87/d42/d7f/d82/f11a zero size 2024-04-27T07:33:36.048 INFO:tasks.workunit.client.0.smithi082.stdout:8/955: fsync d0/d2b/d80/dca/de6/d1c/d76/da0/f129 0 2024-04-27T07:33:36.049 INFO:tasks.workunit.client.0.smithi082.stdout:1/891: symlink d4/d15/d49/dab/dc3/dd3/l131 0 2024-04-27T07:33:36.050 INFO:tasks.workunit.client.0.smithi082.stdout:8/956: readlink d0/l66 0 2024-04-27T07:33:36.051 INFO:tasks.workunit.client.0.smithi082.stdout:1/892: dread - d4/d15/d49/dab/dc3/d3e/d57/da5/ffa zero size 2024-04-27T07:33:36.052 INFO:tasks.workunit.client.0.smithi082.stdout:8/957: symlink d0/d2b/l137 0 2024-04-27T07:33:36.052 INFO:tasks.workunit.client.0.smithi082.stdout:1/893: write d4/d15/d49/fc2 [1621538,35938] 0 2024-04-27T07:33:36.053 INFO:tasks.workunit.client.0.smithi082.stdout:8/958: read - d0/d2b/d80/dca/de6/d1c/fea zero size 2024-04-27T07:33:36.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/959: unlink d0/d2b/d80/dca/de6/d87/l2d 0 2024-04-27T07:33:36.057 INFO:tasks.workunit.client.0.smithi082.stdout:8/960: creat d0/d2b/d80/dca/de6/d87/f138 x:0 0 0 2024-04-27T07:33:36.058 INFO:tasks.workunit.client.0.smithi082.stdout:8/961: dread - d0/d2b/d80/dca/dec/f121 zero size 2024-04-27T07:33:36.059 INFO:tasks.workunit.client.0.smithi082.stdout:8/962: stat d0/d2b/d80/dca/de6/d87/d42/d7f/dac/lc8 0 2024-04-27T07:33:36.117 INFO:tasks.workunit.client.1.smithi100.stdout:8/478: mkdir d6/d1b/d1d/d59/d94 0 2024-04-27T07:33:36.119 INFO:tasks.workunit.client.1.smithi100.stdout:3/622: rename d7/f1c to d7/dad/fc0 0 2024-04-27T07:33:36.120 INFO:tasks.workunit.client.1.smithi100.stdout:4/508: dread d5/d16/d19/d21/d2b/f51 [0,4194304] 0 2024-04-27T07:33:36.121 INFO:tasks.workunit.client.0.smithi082.stdout:8/963: write d0/d2b/d80/dca/de6/d1c/f85 [4098873,35176] 0 2024-04-27T07:33:36.122 INFO:tasks.workunit.client.1.smithi100.stdout:9/419: chown d1/d9/db/c19 88 1 2024-04-27T07:33:36.123 INFO:tasks.workunit.client.1.smithi100.stdout:5/412: write d0/d4/d21/d24/d2f/f79 [4249770,90588] 0 2024-04-27T07:33:36.124 INFO:tasks.workunit.client.1.smithi100.stdout:8/479: creat d6/d4c/f95 x:0 0 0 2024-04-27T07:33:36.125 INFO:tasks.workunit.client.0.smithi082.stdout:8/964: rename d0/d2b/d80/dca/de6/d87/d42/d7f/d82 to d0/d2b/d80/dca/de6/d55/d139 0 2024-04-27T07:33:36.127 INFO:tasks.workunit.client.1.smithi100.stdout:9/420: read d1/f29 [3608609,69055] 0 2024-04-27T07:33:36.127 INFO:tasks.workunit.client.0.smithi082.stdout:8/965: mknod d0/d2b/d80/dca/de6/d1b/d29/d6a/c13a 0 2024-04-27T07:33:36.128 INFO:tasks.workunit.client.1.smithi100.stdout:0/496: getdents d1/d8/d14 0 2024-04-27T07:33:36.129 INFO:tasks.workunit.client.0.smithi082.stdout:8/966: creat d0/d2b/d80/dca/de6/d1c/d76/da0/d11d/f13b x:0 0 0 2024-04-27T07:33:36.130 INFO:tasks.workunit.client.1.smithi100.stdout:4/509: mknod d5/d16/caf 0 2024-04-27T07:33:36.130 INFO:tasks.workunit.client.0.smithi082.stdout:8/967: dread - d0/d2b/d80/dca/f12d zero size 2024-04-27T07:33:36.130 INFO:tasks.workunit.client.0.smithi082.stdout:8/968: fsync d0/d2b/d9a/da4/f34 0 2024-04-27T07:33:36.131 INFO:tasks.workunit.client.1.smithi100.stdout:7/500: dwrite d1/dd/d16/d70/f79 [0,4194304] 0 2024-04-27T07:33:36.132 INFO:tasks.workunit.client.0.smithi082.stdout:8/969: fsync d0/d2b/d9a/da4/fc5 0 2024-04-27T07:33:36.132 INFO:tasks.workunit.client.1.smithi100.stdout:7/501: dread - d1/dd/d16/d4a/f89 zero size 2024-04-27T07:33:36.136 INFO:tasks.workunit.client.1.smithi100.stdout:7/502: write d1/dd/d16/d70/d51/d6f/f87 [665515,86584] 0 2024-04-27T07:33:36.139 INFO:tasks.workunit.client.1.smithi100.stdout:7/503: chown d1/d54/f5f 5695 1 2024-04-27T07:33:36.140 INFO:tasks.workunit.client.1.smithi100.stdout:5/413: dwrite d0/d4/d21/f50 [0,4194304] 0 2024-04-27T07:33:36.143 INFO:tasks.workunit.client.1.smithi100.stdout:9/421: creat d1/d9/d1f/d52/d54/f99 x:0 0 0 2024-04-27T07:33:36.143 INFO:tasks.workunit.client.1.smithi100.stdout:4/510: mkdir d5/d1b/d2c/d50/db0 0 2024-04-27T07:33:36.144 INFO:tasks.workunit.client.1.smithi100.stdout:4/511: fsync d5/d16/d4c/f7f 0 2024-04-27T07:33:36.148 INFO:tasks.workunit.client.1.smithi100.stdout:3/623: dread d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:36.148 INFO:tasks.workunit.client.1.smithi100.stdout:7/504: mknod d1/dd/d16/d31/d4c/d4d/d3b/d40/c96 0 2024-04-27T07:33:36.149 INFO:tasks.workunit.client.1.smithi100.stdout:5/414: mknod d0/d4/d21/d24/d2f/d39/d7c/c86 0 2024-04-27T07:33:36.150 INFO:tasks.workunit.client.0.smithi082.stdout:8/970: truncate d0/d2b/d9a/da4/f34 3709773 0 2024-04-27T07:33:36.152 INFO:tasks.workunit.client.0.smithi082.stdout:8/971: creat d0/d2b/d92/f13c x:0 0 0 2024-04-27T07:33:36.153 INFO:tasks.workunit.client.1.smithi100.stdout:7/505: dread d1/dd/d16/d70/f79 [0,4194304] 0 2024-04-27T07:33:36.154 INFO:tasks.workunit.client.1.smithi100.stdout:8/480: rename d6/d1b/f42 to d6/d20/f96 0 2024-04-27T07:33:36.156 INFO:tasks.workunit.client.1.smithi100.stdout:5/415: dread d0/d4/d21/d24/f47 [0,4194304] 0 2024-04-27T07:33:36.156 INFO:tasks.workunit.client.1.smithi100.stdout:0/497: write d1/d30/f3d [373866,91906] 0 2024-04-27T07:33:36.156 INFO:tasks.workunit.client.1.smithi100.stdout:9/422: read d1/d9/db/d2b/f86 [1361401,90029] 0 2024-04-27T07:33:36.157 INFO:tasks.workunit.client.0.smithi082.stdout:8/972: write d0/d2b/d80/dca/de6/d1c/fea [612796,41801] 0 2024-04-27T07:33:36.158 INFO:tasks.workunit.client.1.smithi100.stdout:5/416: stat d0/d4/d21/d24/d2f/d57/d37/d1a/d31/c5b 0 2024-04-27T07:33:36.160 INFO:tasks.workunit.client.1.smithi100.stdout:7/506: rmdir d1/dd/d16/d31 39 2024-04-27T07:33:36.161 INFO:tasks.workunit.client.0.smithi082.stdout:8/973: rename d0/d2b/d80/dca/de6/d87/d42/f5b to d0/d2b/d80/dca/d105/f13d 0 2024-04-27T07:33:36.162 INFO:tasks.workunit.client.1.smithi100.stdout:3/624: rename d7/c8d to d7/d9/d10/d22/cc1 0 2024-04-27T07:33:36.162 INFO:tasks.workunit.client.0.smithi082.stdout:8/974: read - d0/d2b/d80/dca/de6/d55/d139/f104 zero size 2024-04-27T07:33:36.162 INFO:tasks.workunit.client.1.smithi100.stdout:3/625: chown d7/dad/fc0 133529 1 2024-04-27T07:33:36.163 INFO:tasks.workunit.client.1.smithi100.stdout:4/512: mknod d5/d16/d19/d21/d77/d94/d9f/cb1 0 2024-04-27T07:33:36.164 INFO:tasks.workunit.client.1.smithi100.stdout:4/513: fsync d5/d16/d4c/f7c 0 2024-04-27T07:33:36.164 INFO:tasks.workunit.client.0.smithi082.stdout:8/975: mkdir d0/d2b/d80/dca/de6/d87/d42/d7f/dac/d13e 0 2024-04-27T07:33:36.167 INFO:tasks.workunit.client.1.smithi100.stdout:5/417: mknod d0/d4/d21/d24/c87 0 2024-04-27T07:33:36.170 INFO:tasks.workunit.client.1.smithi100.stdout:7/507: rmdir d1/dd/d2a 39 2024-04-27T07:33:36.173 INFO:tasks.workunit.client.1.smithi100.stdout:3/626: rename d7/d9/d10/c37 to d7/d9/d10/d33/d47/cc2 0 2024-04-27T07:33:36.174 INFO:tasks.workunit.client.1.smithi100.stdout:4/514: mknod d5/d16/d19/d21/cb2 0 2024-04-27T07:33:36.176 INFO:tasks.workunit.client.1.smithi100.stdout:1/612: sync 2024-04-27T07:33:36.176 INFO:tasks.workunit.client.1.smithi100.stdout:2/498: sync 2024-04-27T07:33:36.176 INFO:tasks.workunit.client.1.smithi100.stdout:2/499: stat d0/d79/ca2 0 2024-04-27T07:33:36.177 INFO:tasks.workunit.client.1.smithi100.stdout:9/423: mknod d1/d9/d1f/d4a/d67/d8a/c9a 0 2024-04-27T07:33:36.179 INFO:tasks.workunit.client.1.smithi100.stdout:5/418: chown d0/d4/d21/f4b 16067 1 2024-04-27T07:33:36.180 INFO:tasks.workunit.client.1.smithi100.stdout:3/627: symlink d7/d9/d10/d22/lc3 0 2024-04-27T07:33:36.181 INFO:tasks.workunit.client.0.smithi082.stdout:8/976: dread d0/d2b/d9a/da4/d35/fbd [4194304,4194304] 0 2024-04-27T07:33:36.182 INFO:tasks.workunit.client.0.smithi082.stdout:8/977: write d0/d2b/d80/dca/de6/d1b/f2e [1399884,14162] 0 2024-04-27T07:33:36.183 INFO:tasks.workunit.client.1.smithi100.stdout:7/508: fsync d1/dd/d16/d31/d4c/d4d/f6b 0 2024-04-27T07:33:36.184 INFO:tasks.workunit.client.1.smithi100.stdout:1/613: rename d0/d1b/d20/d2d/d35/d65/lbb to d0/d1f/d97/lc8 0 2024-04-27T07:33:36.185 INFO:tasks.workunit.client.1.smithi100.stdout:2/500: chown d0/da/d29/d47/d87/d8b/la0 275 1 2024-04-27T07:33:36.185 INFO:tasks.workunit.client.1.smithi100.stdout:5/419: write d0/fa [2141922,92761] 0 2024-04-27T07:33:36.186 INFO:tasks.workunit.client.0.smithi082.stdout:9/874: sync 2024-04-27T07:33:36.188 INFO:tasks.workunit.client.1.smithi100.stdout:7/509: stat d1/d54/f5f 0 2024-04-27T07:33:36.188 INFO:tasks.workunit.client.1.smithi100.stdout:0/498: link d1/d38/d3a/d54/c6c d1/d8/d14/d59/d64/ca9 0 2024-04-27T07:33:36.188 INFO:tasks.workunit.client.0.smithi082.stdout:9/875: chown d9/d2d/d72 2105 1 2024-04-27T07:33:36.188 INFO:tasks.workunit.client.0.smithi082.stdout:9/876: fdatasync d9/da/dc/d33/f115 0 2024-04-27T07:33:36.189 INFO:tasks.workunit.client.1.smithi100.stdout:4/515: dwrite d5/d16/d4c/f7f [0,4194304] 0 2024-04-27T07:33:36.189 INFO:tasks.workunit.client.0.smithi082.stdout:9/877: stat d9/d2d/d2b/d46/db6/cb7 0 2024-04-27T07:33:36.190 INFO:tasks.workunit.client.0.smithi082.stdout:9/878: mkdir d9/da/dc/d33/d5e/d127 0 2024-04-27T07:33:36.192 INFO:tasks.workunit.client.1.smithi100.stdout:8/481: dwrite d6/f18 [0,4194304] 0 2024-04-27T07:33:36.193 INFO:tasks.workunit.client.0.smithi082.stdout:9/879: read d9/da/dc/f20 [3905627,84005] 0 2024-04-27T07:33:36.198 INFO:tasks.workunit.client.1.smithi100.stdout:9/424: rename d1/d9/d1f/d71 to d1/d9/d1f/d52/d54/d61/d9b 0 2024-04-27T07:33:36.198 INFO:tasks.workunit.client.1.smithi100.stdout:8/482: read d6/f27 [2382630,53389] 0 2024-04-27T07:33:36.201 INFO:tasks.workunit.client.1.smithi100.stdout:3/628: dwrite d7/d9/d10/d28/f77 [0,4194304] 0 2024-04-27T07:33:36.201 INFO:tasks.workunit.client.0.smithi082.stdout:8/978: dread d0/f99 [0,4194304] 0 2024-04-27T07:33:36.203 INFO:tasks.workunit.client.0.smithi082.stdout:8/979: chown d0/d2b/d80/dca/de6/d1b/l91 47994358 1 2024-04-27T07:33:36.204 INFO:tasks.workunit.client.1.smithi100.stdout:4/516: fsync d5/f8 0 2024-04-27T07:33:36.205 INFO:tasks.workunit.client.1.smithi100.stdout:0/499: dwrite d1/d8/d14/f50 [0,4194304] 0 2024-04-27T07:33:36.206 INFO:tasks.workunit.client.0.smithi082.stdout:8/980: write d0/d2b/d80/dca/de6/d87/d42/d7f/ff7 [520074,47441] 0 2024-04-27T07:33:36.208 INFO:tasks.workunit.client.1.smithi100.stdout:7/510: symlink d1/dd/d16/d70/d51/d6f/l97 0 2024-04-27T07:33:36.208 INFO:tasks.workunit.client.1.smithi100.stdout:4/517: write d5/fe [4574514,115408] 0 2024-04-27T07:33:36.211 INFO:tasks.workunit.client.1.smithi100.stdout:1/614: mknod d0/d1b/d20/cc9 0 2024-04-27T07:33:36.211 INFO:tasks.workunit.client.0.smithi082.stdout:9/880: dwrite d9/da/dc/db1/fbc [0,4194304] 0 2024-04-27T07:33:36.212 INFO:tasks.workunit.client.1.smithi100.stdout:7/511: write d1/dd/f4b [746071,35512] 0 2024-04-27T07:33:36.212 INFO:tasks.workunit.client.1.smithi100.stdout:9/425: dwrite d1/d9/db/f93 [0,4194304] 0 2024-04-27T07:33:36.213 INFO:tasks.workunit.client.0.smithi082.stdout:8/981: dread d0/d2b/d80/dca/de6/f9 [4194304,4194304] 0 2024-04-27T07:33:36.214 INFO:tasks.workunit.client.1.smithi100.stdout:3/629: chown d7/d9/d10/d33/d90/f81 12 1 2024-04-27T07:33:36.214 INFO:tasks.workunit.client.1.smithi100.stdout:8/483: mknod d6/d1b/d75/c97 0 2024-04-27T07:33:36.215 INFO:tasks.workunit.client.1.smithi100.stdout:9/426: read - d1/d9/d1f/f8b zero size 2024-04-27T07:33:36.217 INFO:tasks.workunit.client.1.smithi100.stdout:4/518: fdatasync d5/d16/d19/d21/f41 0 2024-04-27T07:33:36.217 INFO:tasks.workunit.client.0.smithi082.stdout:9/881: creat d9/da/dc/d35/d38/da5/d66/d97/f128 x:0 0 0 2024-04-27T07:33:36.218 INFO:tasks.workunit.client.1.smithi100.stdout:9/427: write d1/d9/d1f/f68 [867861,91329] 0 2024-04-27T07:33:36.220 INFO:tasks.workunit.client.0.smithi082.stdout:9/882: dread - d9/da/dc/d33/f89 zero size 2024-04-27T07:33:36.222 INFO:tasks.workunit.client.1.smithi100.stdout:2/501: creat d0/da/d29/d47/d5a/d8d/fa9 x:0 0 0 2024-04-27T07:33:36.231 INFO:tasks.workunit.client.1.smithi100.stdout:9/428: dwrite d1/d9/db/d56/f83 [0,4194304] 0 2024-04-27T07:33:36.234 INFO:tasks.workunit.client.1.smithi100.stdout:4/519: link d5/d16/d19/d46/d53/f92 d5/d16/d19/d21/fb3 0 2024-04-27T07:33:36.236 INFO:tasks.workunit.client.1.smithi100.stdout:2/502: creat d0/da/d29/d47/d87/d88/faa x:0 0 0 2024-04-27T07:33:36.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/520: dread d5/d16/d19/d21/d77/fa5 [0,4194304] 0 2024-04-27T07:33:36.238 INFO:tasks.workunit.client.1.smithi100.stdout:0/500: getdents d1/d8/d20/d61 0 2024-04-27T07:33:36.239 INFO:tasks.workunit.client.1.smithi100.stdout:0/501: dread - d1/d38/f94 zero size 2024-04-27T07:33:36.241 INFO:tasks.workunit.client.1.smithi100.stdout:2/503: unlink d0/l18 0 2024-04-27T07:33:36.242 INFO:tasks.workunit.client.1.smithi100.stdout:2/504: fsync d0/da/d29/d47/f4f 0 2024-04-27T07:33:36.243 INFO:tasks.workunit.client.1.smithi100.stdout:0/502: read d1/d38/d3a/f48 [4133537,34861] 0 2024-04-27T07:33:36.247 INFO:tasks.workunit.client.1.smithi100.stdout:2/505: creat d0/da/d29/d47/d5a/d8d/d3e/d98/fab x:0 0 0 2024-04-27T07:33:36.247 INFO:tasks.workunit.client.0.smithi082.stdout:8/982: dread d0/d2b/d80/dca/de6/f18 [0,4194304] 0 2024-04-27T07:33:36.250 INFO:tasks.workunit.client.0.smithi082.stdout:8/983: truncate d0/d2b/d80/fbb 231023 0 2024-04-27T07:33:36.250 INFO:tasks.workunit.client.0.smithi082.stdout:8/984: dread - d0/d2b/d80/dca/de6/d1c/d76/da0/d11d/f13b zero size 2024-04-27T07:33:36.252 INFO:tasks.workunit.client.0.smithi082.stdout:8/985: rmdir d0/d2b/d80/dca/de6/d87/d71 39 2024-04-27T07:33:36.252 INFO:tasks.workunit.client.1.smithi100.stdout:0/503: creat d1/d8/d20/faa x:0 0 0 2024-04-27T07:33:36.256 INFO:tasks.workunit.client.1.smithi100.stdout:0/504: creat d1/d8/d20/d72/fab x:0 0 0 2024-04-27T07:33:36.256 INFO:tasks.workunit.client.0.smithi082.stdout:8/986: getdents d0/d2b/d80/dca/de6/d55/d139 0 2024-04-27T07:33:36.256 INFO:tasks.workunit.client.1.smithi100.stdout:7/512: write d1/dd/d16/d31/d4c/d4d/f95 [352017,73413] 0 2024-04-27T07:33:36.257 INFO:tasks.workunit.client.0.smithi082.stdout:8/987: dread d0/d2b/d80/dca/de6/d1b/d29/f57 [0,4194304] 0 2024-04-27T07:33:36.258 INFO:tasks.workunit.client.1.smithi100.stdout:1/615: truncate d0/d1b/d20/d2d/d35/f7f 1308696 0 2024-04-27T07:33:36.258 INFO:tasks.workunit.client.1.smithi100.stdout:2/506: dwrite d0/da/d29/d47/d5a/d8d/d3e/f85 [0,4194304] 0 2024-04-27T07:33:36.258 INFO:tasks.workunit.client.1.smithi100.stdout:0/505: chown d1/f39 33820 1 2024-04-27T07:33:36.259 INFO:tasks.workunit.client.0.smithi082.stdout:8/988: creat d0/d2b/d80/dca/de6/d1c/d76/da0/f13f x:0 0 0 2024-04-27T07:33:36.261 INFO:tasks.workunit.client.0.smithi082.stdout:8/989: fsync d0/d2b/d80/dca/de6/d87/d71/fed 0 2024-04-27T07:33:36.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/990: write d0/d2b/d80/dca/dec/f121 [848225,105114] 0 2024-04-27T07:33:36.263 INFO:tasks.workunit.client.0.smithi082.stdout:8/991: write d0/d2b/f4c [3340552,65469] 0 2024-04-27T07:33:36.265 INFO:tasks.workunit.client.1.smithi100.stdout:7/513: write d1/dd/d16/d70/d51/d6f/f87 [4164342,9632] 0 2024-04-27T07:33:36.265 INFO:tasks.workunit.client.1.smithi100.stdout:2/507: readlink d0/da/d29/l22 0 2024-04-27T07:33:36.265 INFO:tasks.workunit.client.1.smithi100.stdout:3/630: dread d7/dad/daf/f49 [4194304,4194304] 0 2024-04-27T07:33:36.265 INFO:tasks.workunit.client.1.smithi100.stdout:1/616: chown d0/d1f/d97/f9a 58467 1 2024-04-27T07:33:36.266 INFO:tasks.workunit.client.1.smithi100.stdout:8/484: dread d6/f17 [0,4194304] 0 2024-04-27T07:33:36.268 INFO:tasks.workunit.client.1.smithi100.stdout:9/429: dread d1/d9/d1f/d52/d54/f95 [0,4194304] 0 2024-04-27T07:33:36.269 INFO:tasks.workunit.client.1.smithi100.stdout:2/508: rmdir d0/da/d3a 39 2024-04-27T07:33:36.269 INFO:tasks.workunit.client.1.smithi100.stdout:9/430: dread - d1/d9/db/d56/f8c zero size 2024-04-27T07:33:36.270 INFO:tasks.workunit.client.1.smithi100.stdout:2/509: truncate d0/f12 2673663 0 2024-04-27T07:33:36.271 INFO:tasks.workunit.client.1.smithi100.stdout:7/514: unlink d1/dd/f4b 0 2024-04-27T07:33:36.271 INFO:tasks.workunit.client.1.smithi100.stdout:8/485: creat d6/d20/d50/f98 x:0 0 0 2024-04-27T07:33:36.272 INFO:tasks.workunit.client.1.smithi100.stdout:7/515: fdatasync d1/dd/d16/d70/f59 0 2024-04-27T07:33:36.273 INFO:tasks.workunit.client.1.smithi100.stdout:1/617: chown d0/d1f/d6d/db4/d6c/c7a 0 1 2024-04-27T07:33:36.274 INFO:tasks.workunit.client.1.smithi100.stdout:8/486: fdatasync d6/d20/d50/f74 0 2024-04-27T07:33:36.274 INFO:tasks.workunit.client.1.smithi100.stdout:7/516: write d1/dd/d16/d4a/d56/f94 [400094,28514] 0 2024-04-27T07:33:36.275 INFO:tasks.workunit.client.1.smithi100.stdout:3/631: mkdir d7/d9/d26/d2a/dc4 0 2024-04-27T07:33:36.276 INFO:tasks.workunit.client.0.smithi082.stdout:8/992: dwrite d0/d2b/d6f/f70 [0,4194304] 0 2024-04-27T07:33:36.277 INFO:tasks.workunit.client.1.smithi100.stdout:0/506: dread d1/f82 [0,4194304] 0 2024-04-27T07:33:36.277 INFO:tasks.workunit.client.1.smithi100.stdout:8/487: readlink d6/d20/d50/l6c 0 2024-04-27T07:33:36.278 INFO:tasks.workunit.client.1.smithi100.stdout:9/431: mkdir d1/d9/db/d2b/d9c 0 2024-04-27T07:33:36.278 INFO:tasks.workunit.client.0.smithi082.stdout:8/993: mkdir d0/d2b/d9a/da4/d35/d140 0 2024-04-27T07:33:36.280 INFO:tasks.workunit.client.0.smithi082.stdout:8/994: creat d0/d2b/d9a/da4/d35/f141 x:0 0 0 2024-04-27T07:33:36.281 INFO:tasks.workunit.client.1.smithi100.stdout:1/618: mknod d0/d1f/d6d/db4/d6c/cca 0 2024-04-27T07:33:36.282 INFO:tasks.workunit.client.0.smithi082.stdout:8/995: mkdir d0/d2b/d80/dca/de6/d1c/d76/da0/df9/dc6/d11c/d142 0 2024-04-27T07:33:36.283 INFO:tasks.workunit.client.0.smithi082.stdout:8/996: write d0/d2b/d9a/da4/f119 [238370,85284] 0 2024-04-27T07:33:36.285 INFO:tasks.workunit.client.1.smithi100.stdout:6/549: sync 2024-04-27T07:33:36.288 INFO:tasks.workunit.client.1.smithi100.stdout:7/517: write d1/dd/d2a/f62 [4957376,101075] 0 2024-04-27T07:33:36.290 INFO:tasks.workunit.client.1.smithi100.stdout:9/432: dwrite d1/d9/d1f/f3a [4194304,4194304] 0 2024-04-27T07:33:36.290 INFO:tasks.workunit.client.1.smithi100.stdout:8/488: dwrite d6/d20/f84 [0,4194304] 0 2024-04-27T07:33:36.291 INFO:tasks.workunit.client.1.smithi100.stdout:2/510: link d0/da/d29/d47/f4a d0/da/d29/d47/d5a/d82/fac 0 2024-04-27T07:33:36.294 INFO:tasks.workunit.client.1.smithi100.stdout:8/489: write d6/d20/d2a/f49 [3981468,115589] 0 2024-04-27T07:33:36.294 INFO:tasks.workunit.client.1.smithi100.stdout:1/619: creat d0/d23/d3a/dae/fcb x:0 0 0 2024-04-27T07:33:36.295 INFO:tasks.workunit.client.0.smithi082.stdout:8/997: dwrite d0/d2b/d80/dca/de6/f9 [0,4194304] 0 2024-04-27T07:33:36.297 INFO:tasks.workunit.client.0.smithi082.stdout:8/998: chown d0/d2b/d80/dca/de6/d87/d42/l7e 845921870 1 2024-04-27T07:33:36.297 INFO:tasks.workunit.client.1.smithi100.stdout:3/632: creat d7/d9/d26/d2a/db3/fc5 x:0 0 0 2024-04-27T07:33:36.298 INFO:tasks.workunit.client.1.smithi100.stdout:2/511: truncate d0/da/d29/f8e 875551 0 2024-04-27T07:33:36.302 INFO:tasks.workunit.client.0.smithi082.stdout:8/999: read d0/d2b/d80/dca/de6/d87/d42/d7f/ff7 [379366,38983] 0 2024-04-27T07:33:36.309 INFO:tasks.workunit.client.1.smithi100.stdout:6/550: dwrite de/d2e/d3f/d80/f9e [0,4194304] 0 2024-04-27T07:33:36.311 INFO:tasks.workunit.client.1.smithi100.stdout:7/518: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f46 [0,4194304] 0 2024-04-27T07:33:36.312 INFO:tasks.workunit.client.1.smithi100.stdout:0/507: link d1/d38/d3a/f3c d1/d38/d3a/d54/fac 0 2024-04-27T07:33:36.320 INFO:tasks.workunit.client.1.smithi100.stdout:8/490: mkdir d6/d20/d99 0 2024-04-27T07:33:36.320 INFO:tasks.workunit.client.1.smithi100.stdout:9/433: dwrite d1/d9/db/d2b/f36 [4194304,4194304] 0 2024-04-27T07:33:36.322 INFO:tasks.workunit.client.1.smithi100.stdout:2/512: rmdir d0 39 2024-04-27T07:33:36.322 INFO:tasks.workunit.client.1.smithi100.stdout:3/633: dwrite d7/d9/d10/d33/d90/d3a/f94 [0,4194304] 0 2024-04-27T07:33:36.325 INFO:tasks.workunit.client.1.smithi100.stdout:6/551: unlink de/f16 0 2024-04-27T07:33:36.326 INFO:tasks.workunit.client.1.smithi100.stdout:1/620: creat d0/d1f/d6d/dc7/fcc x:0 0 0 2024-04-27T07:33:36.327 INFO:tasks.workunit.client.1.smithi100.stdout:3/634: truncate d7/d9/d10/d3e/d74/fb4 909318 0 2024-04-27T07:33:36.329 INFO:tasks.workunit.client.1.smithi100.stdout:6/552: write de/d58/d21/d5b/f6f [9188527,128374] 0 2024-04-27T07:33:36.329 INFO:tasks.workunit.client.1.smithi100.stdout:7/519: rename d1/dd/d16/d31/l50 to d1/l98 0 2024-04-27T07:33:36.330 INFO:tasks.workunit.client.1.smithi100.stdout:8/491: mkdir d6/d1b/d75/d9a 0 2024-04-27T07:33:36.332 INFO:tasks.workunit.client.1.smithi100.stdout:3/635: dread - d7/d9/d10/d33/d90/dbb/fbc zero size 2024-04-27T07:33:36.332 INFO:tasks.workunit.client.1.smithi100.stdout:9/434: mknod d1/d76/c9d 0 2024-04-27T07:33:36.334 INFO:tasks.workunit.client.1.smithi100.stdout:1/621: mkdir d0/d1b/d20/d2d/d35/d4d/d60/dcd 0 2024-04-27T07:33:36.334 INFO:tasks.workunit.client.1.smithi100.stdout:6/553: chown de/d58/d21/d24/d9f/db9 473 1 2024-04-27T07:33:36.335 INFO:tasks.workunit.client.1.smithi100.stdout:6/554: stat de/d58/d21/d24/c3d 0 2024-04-27T07:33:36.335 INFO:tasks.workunit.client.1.smithi100.stdout:6/555: readlink de/d58/l1d 0 2024-04-27T07:33:36.337 INFO:tasks.workunit.client.0.smithi082.stdout:1/894: sync 2024-04-27T07:33:36.337 INFO:tasks.workunit.client.1.smithi100.stdout:0/508: rename d1/d8/d14/d59/f9a to d1/d8/d14/d59/d99/fad 0 2024-04-27T07:33:36.339 INFO:tasks.workunit.client.1.smithi100.stdout:0/509: write d1/d8/d20/f3b [4641927,91420] 0 2024-04-27T07:33:36.340 INFO:tasks.workunit.client.1.smithi100.stdout:3/636: creat d7/dad/daf/fc6 x:0 0 0 2024-04-27T07:33:36.341 INFO:tasks.workunit.client.1.smithi100.stdout:9/435: unlink d1/d9/db/l3d 0 2024-04-27T07:33:36.341 INFO:tasks.workunit.client.1.smithi100.stdout:3/637: write d7/d9/d10/f15 [1807664,39309] 0 2024-04-27T07:33:36.343 INFO:tasks.workunit.client.1.smithi100.stdout:6/556: unlink de/d2e/fb0 0 2024-04-27T07:33:36.346 INFO:tasks.workunit.client.1.smithi100.stdout:0/510: unlink d1/d38/c7e 0 2024-04-27T07:33:36.348 INFO:tasks.workunit.client.1.smithi100.stdout:0/511: write d1/d38/d3a/fa4 [286212,43076] 0 2024-04-27T07:33:36.348 INFO:tasks.workunit.client.1.smithi100.stdout:3/638: dwrite d7/d9/d10/f9c [0,4194304] 0 2024-04-27T07:33:36.352 INFO:tasks.workunit.client.1.smithi100.stdout:1/622: creat d0/d1b/d20/fce x:0 0 0 2024-04-27T07:33:36.352 INFO:tasks.workunit.client.1.smithi100.stdout:9/436: mknod d1/d9/db/d2b/c9e 0 2024-04-27T07:33:36.354 INFO:tasks.workunit.client.1.smithi100.stdout:8/492: link d6/c71 d6/d20/d50/d72/c9b 0 2024-04-27T07:33:36.358 INFO:tasks.workunit.client.1.smithi100.stdout:0/512: mkdir d1/d38/dae 0 2024-04-27T07:33:36.361 INFO:tasks.workunit.client.0.smithi082.stdout:1/895: write d4/d15/d49/dab/dc3/d3e/d53/d72/fe5 [342984,60120] 0 2024-04-27T07:33:36.362 INFO:tasks.workunit.client.1.smithi100.stdout:6/557: getdents de/d9b 0 2024-04-27T07:33:36.364 INFO:tasks.workunit.client.1.smithi100.stdout:0/513: symlink d1/d8/d20/d61/laf 0 2024-04-27T07:33:36.364 INFO:tasks.workunit.client.1.smithi100.stdout:8/493: dwrite d6/d20/d50/f98 [0,4194304] 0 2024-04-27T07:33:36.364 INFO:tasks.workunit.client.0.smithi082.stdout:1/896: creat d4/d15/d49/dab/dc3/d3e/d46/dcf/f132 x:0 0 0 2024-04-27T07:33:36.365 INFO:tasks.workunit.client.0.smithi082.stdout:1/897: stat d4/d15/d49/dab/dc3/d3e/d53/d72/cd4 0 2024-04-27T07:33:36.366 INFO:tasks.workunit.client.1.smithi100.stdout:3/639: dread d7/d9/d10/f7b [0,4194304] 0 2024-04-27T07:33:36.367 INFO:tasks.workunit.client.0.smithi082.stdout:1/898: creat d4/d15/d49/d99/de8/f133 x:0 0 0 2024-04-27T07:33:36.368 INFO:tasks.workunit.client.0.smithi082.stdout:1/899: write d4/f35 [1914718,128607] 0 2024-04-27T07:33:36.375 INFO:tasks.workunit.client.1.smithi100.stdout:8/494: getdents d6/d1b/d1d/d59/d94 0 2024-04-27T07:33:36.376 INFO:tasks.workunit.client.1.smithi100.stdout:8/495: write d6/d20/d2a/f3a [9397426,49827] 0 2024-04-27T07:33:36.379 INFO:tasks.workunit.client.1.smithi100.stdout:2/513: write d0/da/fd [2636985,31398] 0 2024-04-27T07:33:36.379 INFO:tasks.workunit.client.1.smithi100.stdout:8/496: read d6/d1b/d1d/d59/f56 [78915,120262] 0 2024-04-27T07:33:36.381 INFO:tasks.workunit.client.0.smithi082.stdout:1/900: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/f9f [0,4194304] 0 2024-04-27T07:33:36.381 INFO:tasks.workunit.client.1.smithi100.stdout:1/623: dread d0/d1b/f96 [0,4194304] 0 2024-04-27T07:33:36.385 INFO:tasks.workunit.client.1.smithi100.stdout:0/514: creat d1/fb0 x:0 0 0 2024-04-27T07:33:36.387 INFO:tasks.workunit.client.0.smithi082.stdout:1/901: dwrite d4/d15/d49/dab/dc3/d3e/f87 [0,4194304] 0 2024-04-27T07:33:36.390 INFO:tasks.workunit.client.1.smithi100.stdout:7/520: rename d1/dd/d16/d70/d51/l84 to d1/dd/d16/d70/d6e/l99 0 2024-04-27T07:33:36.394 INFO:tasks.workunit.client.1.smithi100.stdout:1/624: dwrite d0/d1f/fc2 [0,4194304] 0 2024-04-27T07:33:36.394 INFO:tasks.workunit.client.1.smithi100.stdout:2/514: creat d0/d79/fad x:0 0 0 2024-04-27T07:33:36.394 INFO:tasks.workunit.client.0.smithi082.stdout:1/902: dread d4/d15/da7/f12f [0,4194304] 0 2024-04-27T07:33:36.395 INFO:tasks.workunit.client.1.smithi100.stdout:1/625: truncate d0/d1b/d20/d2d/f2e 4288278 0 2024-04-27T07:33:36.396 INFO:tasks.workunit.client.0.smithi082.stdout:1/903: chown d4/la4 59253 1 2024-04-27T07:33:36.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/904: creat d4/d15/d49/d99/f134 x:0 0 0 2024-04-27T07:33:36.401 INFO:tasks.workunit.client.0.smithi082.stdout:1/905: creat d4/d15/d49/d99/de8/f135 x:0 0 0 2024-04-27T07:33:36.401 INFO:tasks.workunit.client.1.smithi100.stdout:7/521: creat d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f9a x:0 0 0 2024-04-27T07:33:36.403 INFO:tasks.workunit.client.0.smithi082.stdout:1/906: creat d4/d15/d49/dab/dc3/d3e/d57/da5/f136 x:0 0 0 2024-04-27T07:33:36.404 INFO:tasks.workunit.client.1.smithi100.stdout:6/558: truncate de/d2e/d86/fb8 867345 0 2024-04-27T07:33:36.405 INFO:tasks.workunit.client.0.smithi082.stdout:9/883: sync 2024-04-27T07:33:36.405 INFO:tasks.workunit.client.0.smithi082.stdout:1/907: creat d4/d15/d49/d99/d9a/dc7/df9/f137 x:0 0 0 2024-04-27T07:33:36.406 INFO:tasks.workunit.client.1.smithi100.stdout:2/515: mkdir d0/da/d29/d47/dae 0 2024-04-27T07:33:36.406 INFO:tasks.workunit.client.1.smithi100.stdout:3/640: write d7/f1f [355137,35713] 0 2024-04-27T07:33:36.407 INFO:tasks.workunit.client.1.smithi100.stdout:2/516: stat d0/da/d29/d47/d5a/d8d/fa9 0 2024-04-27T07:33:36.407 INFO:tasks.workunit.client.1.smithi100.stdout:7/522: unlink d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f9a 0 2024-04-27T07:33:36.408 INFO:tasks.workunit.client.0.smithi082.stdout:1/908: creat d4/d15/d49/da0/f138 x:0 0 0 2024-04-27T07:33:36.409 INFO:tasks.workunit.client.1.smithi100.stdout:1/626: rename d0/d23/f8a to d0/d1f/d6d/db4/d4e/d7b/fcf 0 2024-04-27T07:33:36.412 INFO:tasks.workunit.client.1.smithi100.stdout:6/559: unlink de/d58/d28/f2f 0 2024-04-27T07:33:36.417 INFO:tasks.workunit.client.1.smithi100.stdout:2/517: dwrite d0/da/d29/d47/da1/da3/f63 [0,4194304] 0 2024-04-27T07:33:36.418 INFO:tasks.workunit.client.1.smithi100.stdout:0/515: getdents d1/d8/d20/d61 0 2024-04-27T07:33:36.422 INFO:tasks.workunit.client.1.smithi100.stdout:8/497: dread d6/f8 [0,4194304] 0 2024-04-27T07:33:36.423 INFO:tasks.workunit.client.1.smithi100.stdout:7/523: unlink d1/dd/d16/d2b/d7f/c88 0 2024-04-27T07:33:36.425 INFO:tasks.workunit.client.1.smithi100.stdout:6/560: dwrite de/f17 [4194304,4194304] 0 2024-04-27T07:33:36.430 INFO:tasks.workunit.client.1.smithi100.stdout:1/627: rename d0/f16 to d0/d1b/d20/d2d/d35/d4d/d60/da4/fd0 0 2024-04-27T07:33:36.431 INFO:tasks.workunit.client.0.smithi082.stdout:9/884: dread d9/da/dc/d35/d4b/f74 [0,4194304] 0 2024-04-27T07:33:36.432 INFO:tasks.workunit.client.1.smithi100.stdout:0/516: mkdir d1/d38/d3a/d54/db1 0 2024-04-27T07:33:36.432 INFO:tasks.workunit.client.0.smithi082.stdout:9/885: rename d9/da/dc/d33/f37 to d9/da/dc/d33/d5e/f129 0 2024-04-27T07:33:36.433 INFO:tasks.workunit.client.1.smithi100.stdout:2/518: mknod d0/da/d29/d47/d87/caf 0 2024-04-27T07:33:36.434 INFO:tasks.workunit.client.1.smithi100.stdout:2/519: readlink d0/d1e/l55 0 2024-04-27T07:33:36.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/909: dread d4/d15/d49/dab/dc3/d3e/f7c [0,4194304] 0 2024-04-27T07:33:36.436 INFO:tasks.workunit.client.0.smithi082.stdout:9/886: symlink d9/d2d/d2b/d46/db6/l12a 0 2024-04-27T07:33:36.436 INFO:tasks.workunit.client.0.smithi082.stdout:1/910: mknod d4/d15/d49/dab/dc3/d3e/d57/d101/d97/dd1/c139 0 2024-04-27T07:33:36.438 INFO:tasks.workunit.client.1.smithi100.stdout:6/561: creat de/fc3 x:0 0 0 2024-04-27T07:33:36.440 INFO:tasks.workunit.client.1.smithi100.stdout:3/641: dwrite d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:36.441 INFO:tasks.workunit.client.1.smithi100.stdout:1/628: rmdir d0/d1b/d20/d2d/d35/dac 39 2024-04-27T07:33:36.442 INFO:tasks.workunit.client.0.smithi082.stdout:9/887: link d9/d2d/d2b/c111 d9/d2d/d2b/d46/d5d/d6f/d118/c12b 0 2024-04-27T07:33:36.444 INFO:tasks.workunit.client.0.smithi082.stdout:1/911: dwrite d4/d15/d49/d99/f134 [0,4194304] 0 2024-04-27T07:33:36.448 INFO:tasks.workunit.client.0.smithi082.stdout:1/912: symlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/l13a 0 2024-04-27T07:33:36.450 INFO:tasks.workunit.client.1.smithi100.stdout:1/629: creat d0/d1f/d6d/dc7/fd1 x:0 0 0 2024-04-27T07:33:36.451 INFO:tasks.workunit.client.0.smithi082.stdout:9/888: link d9/da/dc/d35/d38/da5/fc6 d9/da/dc/d121/f12c 0 2024-04-27T07:33:36.452 INFO:tasks.workunit.client.1.smithi100.stdout:2/520: symlink d0/da/lb0 0 2024-04-27T07:33:36.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/889: write d9/d2d/f68 [1194962,39987] 0 2024-04-27T07:33:36.454 INFO:tasks.workunit.client.0.smithi082.stdout:9/890: readlink d9/da/l1c 0 2024-04-27T07:33:36.456 INFO:tasks.workunit.client.1.smithi100.stdout:8/498: rename d6/d4c/f95 to d6/d1b/d1d/f9c 0 2024-04-27T07:33:36.459 INFO:tasks.workunit.client.1.smithi100.stdout:7/524: link d1/l98 d1/dd/d16/d3e/d8b/l9b 0 2024-04-27T07:33:36.459 INFO:tasks.workunit.client.1.smithi100.stdout:1/630: write d0/d1b/d20/d2d/d35/dac/fb2 [663746,116877] 0 2024-04-27T07:33:36.460 INFO:tasks.workunit.client.0.smithi082.stdout:1/913: link d4/d15/d49/dab/dc3/d3e/d57/d101/d97/ffb d4/d15/d49/dab/dc3/d3e/d57/da5/f13b 0 2024-04-27T07:33:36.460 INFO:tasks.workunit.client.1.smithi100.stdout:1/631: fsync d0/d1b/d20/d2d/d35/f89 0 2024-04-27T07:33:36.461 INFO:tasks.workunit.client.0.smithi082.stdout:1/914: write d4/d15/d49/d99/d9a/dc7/df9/f137 [692526,89214] 0 2024-04-27T07:33:36.462 INFO:tasks.workunit.client.1.smithi100.stdout:8/499: mknod d6/d20/d50/c9d 0 2024-04-27T07:33:36.464 INFO:tasks.workunit.client.0.smithi082.stdout:1/915: mknod d4/d15/d49/d4e/c13c 0 2024-04-27T07:33:36.465 INFO:tasks.workunit.client.1.smithi100.stdout:2/521: rename d0/da/d3a to d0/da/d29/d47/d5a/d8d/d3e/d98/db1 0 2024-04-27T07:33:36.467 INFO:tasks.workunit.client.1.smithi100.stdout:8/500: rmdir d6/d20/d2a 39 2024-04-27T07:33:36.468 INFO:tasks.workunit.client.1.smithi100.stdout:0/517: dread d1/d38/f4a [0,4194304] 0 2024-04-27T07:33:36.469 INFO:tasks.workunit.client.1.smithi100.stdout:1/632: dwrite d0/d1f/d6d/db4/d4e/fc5 [0,4194304] 0 2024-04-27T07:33:36.471 INFO:tasks.workunit.client.0.smithi082.stdout:1/916: dwrite d4/d15/d49/da0/f138 [0,4194304] 0 2024-04-27T07:33:36.472 INFO:tasks.workunit.client.1.smithi100.stdout:7/525: rename d1/dd/d16/f2d to d1/dd/d16/d2b/f9c 0 2024-04-27T07:33:36.472 INFO:tasks.workunit.client.1.smithi100.stdout:3/642: link d7/d9/l4b d7/d9/lc7 0 2024-04-27T07:33:36.473 INFO:tasks.workunit.client.0.smithi082.stdout:9/891: dread d9/d2d/d2b/f34 [0,4194304] 0 2024-04-27T07:33:36.474 INFO:tasks.workunit.client.1.smithi100.stdout:7/526: dread - d1/dd/d16/d31/d4c/d4d/d3b/d40/f74 zero size 2024-04-27T07:33:36.475 INFO:tasks.workunit.client.1.smithi100.stdout:7/527: stat d1/dd/d16/d70/d51/f65 0 2024-04-27T07:33:36.476 INFO:tasks.workunit.client.0.smithi082.stdout:9/892: creat d9/d48/dd6/f12d x:0 0 0 2024-04-27T07:33:36.477 INFO:tasks.workunit.client.0.smithi082.stdout:1/917: getdents d4/d15/d49/dab/dc3/d4c/d7a/d8c/d112 0 2024-04-27T07:33:36.477 INFO:tasks.workunit.client.1.smithi100.stdout:0/518: creat d1/d8/d20/d61/fb2 x:0 0 0 2024-04-27T07:33:36.478 INFO:tasks.workunit.client.1.smithi100.stdout:6/562: truncate de/d2e/d3f/d80/f9e 4038597 0 2024-04-27T07:33:36.479 INFO:tasks.workunit.client.0.smithi082.stdout:1/918: fdatasync d4/d15/d49/dab/dc3/d3e/d57/d101/ffe 0 2024-04-27T07:33:36.481 INFO:tasks.workunit.client.1.smithi100.stdout:6/563: write de/d58/d21/d24/f46 [628854,104621] 0 2024-04-27T07:33:36.481 INFO:tasks.workunit.client.1.smithi100.stdout:1/633: creat d0/da0/fd2 x:0 0 0 2024-04-27T07:33:36.482 INFO:tasks.workunit.client.1.smithi100.stdout:2/522: dread d0/da/d29/d47/d5a/d8d/d3e/d98/db1/f48 [0,4194304] 0 2024-04-27T07:33:36.482 INFO:tasks.workunit.client.0.smithi082.stdout:9/893: truncate d9/da/dc/d35/d38/da5/fc6 598139 0 2024-04-27T07:33:36.484 INFO:tasks.workunit.client.0.smithi082.stdout:9/894: dread - d9/da/d85/fc4 zero size 2024-04-27T07:33:36.489 INFO:tasks.workunit.client.1.smithi100.stdout:2/523: dread d0/da/d29/d47/d5a/d8d/d3e/f85 [0,4194304] 0 2024-04-27T07:33:36.490 INFO:tasks.workunit.client.1.smithi100.stdout:2/524: stat d0/da/d29/d47/d87/d88 0 2024-04-27T07:33:36.491 INFO:tasks.workunit.client.1.smithi100.stdout:3/643: creat d7/d9/d10/fc8 x:0 0 0 2024-04-27T07:33:36.491 INFO:tasks.workunit.client.1.smithi100.stdout:3/644: readlink d7/d9/lb 0 2024-04-27T07:33:36.491 INFO:tasks.workunit.client.1.smithi100.stdout:6/564: mkdir de/d2e/dc0/dc4 0 2024-04-27T07:33:36.493 INFO:tasks.workunit.client.1.smithi100.stdout:0/519: unlink d1/d38/d3a/d54/l58 0 2024-04-27T07:33:36.494 INFO:tasks.workunit.client.1.smithi100.stdout:5/420: sync 2024-04-27T07:33:36.495 INFO:tasks.workunit.client.1.smithi100.stdout:2/525: creat d0/da/d75/fb2 x:0 0 0 2024-04-27T07:33:36.497 INFO:tasks.workunit.client.1.smithi100.stdout:3/645: creat d7/d9/d10/d22/fc9 x:0 0 0 2024-04-27T07:33:36.499 INFO:tasks.workunit.client.1.smithi100.stdout:3/646: chown d7/d9/d10/d3e/d74/db1/d9d/l95 12876 1 2024-04-27T07:33:36.499 INFO:tasks.workunit.client.1.smithi100.stdout:3/647: chown d7/f1f 293078 1 2024-04-27T07:33:36.500 INFO:tasks.workunit.client.1.smithi100.stdout:5/421: symlink d0/d58/d60/l88 0 2024-04-27T07:33:36.501 INFO:tasks.workunit.client.1.smithi100.stdout:1/634: getdents d0/d1b/d20 0 2024-04-27T07:33:36.502 INFO:tasks.workunit.client.1.smithi100.stdout:5/422: fsync d0/d4/d21/d24/d2f/f79 0 2024-04-27T07:33:36.503 INFO:tasks.workunit.client.0.smithi082.stdout:1/919: dwrite d4/d15/d49/dab/dc3/d4c/f92 [0,4194304] 0 2024-04-27T07:33:36.504 INFO:tasks.workunit.client.1.smithi100.stdout:2/526: mknod d0/da/d29/d47/da1/da3/cb3 0 2024-04-27T07:33:36.504 INFO:tasks.workunit.client.0.smithi082.stdout:9/895: dwrite d9/da/dc/f17 [0,4194304] 0 2024-04-27T07:33:36.506 INFO:tasks.workunit.client.0.smithi082.stdout:9/896: chown d9/da/dc/d35/d4a/d50/l92 689163 1 2024-04-27T07:33:36.506 INFO:tasks.workunit.client.1.smithi100.stdout:6/565: rename de/d2e/d3f/c88 to de/d58/d90/cc5 0 2024-04-27T07:33:36.507 INFO:tasks.workunit.client.0.smithi082.stdout:1/920: stat d4/d15/d49/dab/dc3/d4c/d7a/fc8 0 2024-04-27T07:33:36.510 INFO:tasks.workunit.client.0.smithi082.stdout:1/921: symlink d4/d15/d49/d99/de8/d102/l13d 0 2024-04-27T07:33:36.512 INFO:tasks.workunit.client.1.smithi100.stdout:5/423: read d0/f2a [315694,45421] 0 2024-04-27T07:33:36.514 INFO:tasks.workunit.client.0.smithi082.stdout:1/922: creat d4/d15/d49/d4e/f13e x:0 0 0 2024-04-27T07:33:36.515 INFO:tasks.workunit.client.0.smithi082.stdout:1/923: write d4/d15/d49/dab/dc3/d4c/f92 [1332787,91124] 0 2024-04-27T07:33:36.515 INFO:tasks.workunit.client.1.smithi100.stdout:7/528: dwrite d1/f6 [0,4194304] 0 2024-04-27T07:33:36.520 INFO:tasks.workunit.client.1.smithi100.stdout:6/566: mknod de/d58/d90/cc6 0 2024-04-27T07:33:36.524 INFO:tasks.workunit.client.1.smithi100.stdout:3/648: dread d7/d9/d10/d3e/d74/db1/f89 [0,4194304] 0 2024-04-27T07:33:36.526 INFO:tasks.workunit.client.1.smithi100.stdout:7/529: fdatasync d1/dd/d16/d70/f36 0 2024-04-27T07:33:36.528 INFO:tasks.workunit.client.1.smithi100.stdout:7/530: truncate d1/dd/f1e 4132168 0 2024-04-27T07:33:36.529 INFO:tasks.workunit.client.1.smithi100.stdout:5/424: rename d0/d4/d21/d24/d46/f66 to d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 0 2024-04-27T07:33:36.530 INFO:tasks.workunit.client.1.smithi100.stdout:5/425: fsync d0/d4/f19 0 2024-04-27T07:33:36.531 INFO:tasks.workunit.client.1.smithi100.stdout:5/426: stat d0/d4/d21/d24/d2f/d57/d37/d1a/f4e 0 2024-04-27T07:33:36.536 INFO:tasks.workunit.client.1.smithi100.stdout:7/531: chown d1/d54 16 1 2024-04-27T07:33:36.537 INFO:tasks.workunit.client.1.smithi100.stdout:6/567: mknod de/d58/d21/d24/d9f/daa/cc7 0 2024-04-27T07:33:36.540 INFO:tasks.workunit.client.1.smithi100.stdout:6/568: truncate de/d58/d21/d23/f82 607168 0 2024-04-27T07:33:36.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/924: write d4/d15/f18 [1042806,12834] 0 2024-04-27T07:33:36.543 INFO:tasks.workunit.client.1.smithi100.stdout:6/569: mkdir de/dc8 0 2024-04-27T07:33:36.544 INFO:tasks.workunit.client.1.smithi100.stdout:6/570: stat de/d58/d90/cc6 0 2024-04-27T07:33:36.544 INFO:tasks.workunit.client.0.smithi082.stdout:1/925: creat d4/d15/d49/dab/dc3/d3e/d46/f13f x:0 0 0 2024-04-27T07:33:36.546 INFO:tasks.workunit.client.1.smithi100.stdout:2/527: write d0/f11 [3193990,9705] 0 2024-04-27T07:33:36.546 INFO:tasks.workunit.client.1.smithi100.stdout:7/532: dwrite d1/dd/d16/d31/d4c/f81 [0,4194304] 0 2024-04-27T07:33:36.546 INFO:tasks.workunit.client.0.smithi082.stdout:9/897: dread d9/da/dc/f1b [0,4194304] 0 2024-04-27T07:33:36.546 INFO:tasks.workunit.client.0.smithi082.stdout:1/926: chown d4/f1e 94 1 2024-04-27T07:33:36.546 INFO:tasks.workunit.client.0.smithi082.stdout:1/927: readlink d4/d15/d49/da0/l89 0 2024-04-27T07:33:36.551 INFO:tasks.workunit.client.1.smithi100.stdout:1/635: dwrite d0/d1b/da1/fa2 [0,4194304] 0 2024-04-27T07:33:36.553 INFO:tasks.workunit.client.0.smithi082.stdout:1/928: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/ffe [0,4194304] 0 2024-04-27T07:33:36.555 INFO:tasks.workunit.client.0.smithi082.stdout:9/898: dwrite d9/da/f31 [0,4194304] 0 2024-04-27T07:33:36.556 INFO:tasks.workunit.client.1.smithi100.stdout:5/427: truncate d0/d4/f19 487888 0 2024-04-27T07:33:36.557 INFO:tasks.workunit.client.0.smithi082.stdout:9/899: write d9/d48/ffb [394082,64284] 0 2024-04-27T07:33:36.558 INFO:tasks.workunit.client.0.smithi082.stdout:1/929: unlink d4/d15/d49/da0/f43 0 2024-04-27T07:33:36.559 INFO:tasks.workunit.client.1.smithi100.stdout:1/636: stat d0/d1f/d6d/db4/d4e/lbf 0 2024-04-27T07:33:36.559 INFO:tasks.workunit.client.0.smithi082.stdout:9/900: dread - d9/da/dc/d35/d38/da5/d66/d97/f128 zero size 2024-04-27T07:33:36.559 INFO:tasks.workunit.client.1.smithi100.stdout:3/649: truncate d7/d9/d10/d33/d90/f81 3094569 0 2024-04-27T07:33:36.561 INFO:tasks.workunit.client.1.smithi100.stdout:2/528: mknod d0/da/cb4 0 2024-04-27T07:33:36.561 INFO:tasks.workunit.client.0.smithi082.stdout:1/930: write d4/d15/d49/dab/dc3/d4c/f9d [1097184,11874] 0 2024-04-27T07:33:36.563 INFO:tasks.workunit.client.1.smithi100.stdout:7/533: mkdir d1/dd/d16/d70/d51/d9d 0 2024-04-27T07:33:36.565 INFO:tasks.workunit.client.0.smithi082.stdout:9/901: dwrite d9/da/dc/d33/d5e/faa [0,4194304] 0 2024-04-27T07:33:36.568 INFO:tasks.workunit.client.1.smithi100.stdout:5/428: read d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [2506317,77177] 0 2024-04-27T07:33:36.569 INFO:tasks.workunit.client.1.smithi100.stdout:3/650: unlink d7/d9/d10/d22/l40 0 2024-04-27T07:33:36.571 INFO:tasks.workunit.client.1.smithi100.stdout:2/529: truncate d0/da/d29/d47/d5a/d8d/d3e/d98/db1/f48 1440578 0 2024-04-27T07:33:36.572 INFO:tasks.workunit.client.0.smithi082.stdout:9/902: dwrite d9/da/dc/db1/fbc [0,4194304] 0 2024-04-27T07:33:36.574 INFO:tasks.workunit.client.1.smithi100.stdout:7/534: mknod d1/dd/d16/d70/d51/d9d/c9e 0 2024-04-27T07:33:36.577 INFO:tasks.workunit.client.1.smithi100.stdout:3/651: creat d7/d9/d10/d28/fca x:0 0 0 2024-04-27T07:33:36.578 INFO:tasks.workunit.client.1.smithi100.stdout:7/535: rmdir d1/dd/d16/d70/d51/d6f 39 2024-04-27T07:33:36.578 INFO:tasks.workunit.client.1.smithi100.stdout:2/530: write d0/d1e/f57 [1206372,37935] 0 2024-04-27T07:33:36.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/903: dwrite d9/da/dc/d35/d4a/d61/f11f [0,4194304] 0 2024-04-27T07:33:36.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/904: write d9/d2d/d72/fe8 [617655,6392] 0 2024-04-27T07:33:36.580 INFO:tasks.workunit.client.1.smithi100.stdout:5/429: creat d0/d4/d21/d24/d2f/f8a x:0 0 0 2024-04-27T07:33:36.581 INFO:tasks.workunit.client.0.smithi082.stdout:9/905: read d9/f4c [33261,79893] 0 2024-04-27T07:33:36.583 INFO:tasks.workunit.client.0.smithi082.stdout:9/906: dread d9/d2d/d2b/f34 [0,4194304] 0 2024-04-27T07:33:36.584 INFO:tasks.workunit.client.1.smithi100.stdout:5/430: dread - d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 zero size 2024-04-27T07:33:36.585 INFO:tasks.workunit.client.0.smithi082.stdout:9/907: truncate d9/da/dc/d35/d4a/ff5 238518 0 2024-04-27T07:33:36.585 INFO:tasks.workunit.client.0.smithi082.stdout:9/908: dread - d9/d48/dd6/f11c zero size 2024-04-27T07:33:36.585 INFO:tasks.workunit.client.1.smithi100.stdout:2/531: mknod d0/d79/da7/cb5 0 2024-04-27T07:33:36.586 INFO:tasks.workunit.client.1.smithi100.stdout:7/536: mkdir d1/dd/d2a/d2c/d9f 0 2024-04-27T07:33:36.587 INFO:tasks.workunit.client.1.smithi100.stdout:7/537: chown d1/d54 0 1 2024-04-27T07:33:36.588 INFO:tasks.workunit.client.0.smithi082.stdout:9/909: unlink d9/d2d/d2b/c111 0 2024-04-27T07:33:36.591 INFO:tasks.workunit.client.0.smithi082.stdout:9/910: mknod d9/d2d/d2b/d46/d5d/d6f/d118/c12e 0 2024-04-27T07:33:36.592 INFO:tasks.workunit.client.1.smithi100.stdout:2/532: truncate d0/da/d29/d47/f7e 639888 0 2024-04-27T07:33:36.592 INFO:tasks.workunit.client.1.smithi100.stdout:3/652: dwrite d7/d9/d26/d2a/db3/fc5 [0,4194304] 0 2024-04-27T07:33:36.593 INFO:tasks.workunit.client.1.smithi100.stdout:5/431: creat d0/d4/d21/d24/d46/f8b x:0 0 0 2024-04-27T07:33:36.594 INFO:tasks.workunit.client.0.smithi082.stdout:9/911: creat d9/da/dc/d35/d38/dc5/f12f x:0 0 0 2024-04-27T07:33:36.595 INFO:tasks.workunit.client.1.smithi100.stdout:6/571: dread de/d58/d28/f2c [0,4194304] 0 2024-04-27T07:33:36.595 INFO:tasks.workunit.client.1.smithi100.stdout:7/538: creat d1/dd/d16/d70/fa0 x:0 0 0 2024-04-27T07:33:36.596 INFO:tasks.workunit.client.0.smithi082.stdout:9/912: rmdir d9/da/dc/d35/d4a/d50 39 2024-04-27T07:33:36.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/913: write d9/d48/dd6/f114 [336700,104178] 0 2024-04-27T07:33:36.598 INFO:tasks.workunit.client.0.smithi082.stdout:9/914: write d9/d2d/d72/f8a [3096683,88673] 0 2024-04-27T07:33:36.600 INFO:tasks.workunit.client.0.smithi082.stdout:9/915: stat d9/da/dc/d73/c109 0 2024-04-27T07:33:36.606 INFO:tasks.workunit.client.1.smithi100.stdout:7/539: rename d1/dd/l85 to d1/dd/d16/d70/d51/la1 0 2024-04-27T07:33:36.606 INFO:tasks.workunit.client.1.smithi100.stdout:5/432: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 [0,4194304] 0 2024-04-27T07:33:36.608 INFO:tasks.workunit.client.1.smithi100.stdout:7/540: rmdir d1/dd/d16/d31/d4c/d4d 39 2024-04-27T07:33:36.610 INFO:tasks.workunit.client.1.smithi100.stdout:5/433: creat d0/d4/d21/d24/d46/f8c x:0 0 0 2024-04-27T07:33:36.614 INFO:tasks.workunit.client.1.smithi100.stdout:5/434: creat d0/d4/d21/d24/d2f/d57/d3e/f8d x:0 0 0 2024-04-27T07:33:36.615 INFO:tasks.workunit.client.0.smithi082.stdout:1/931: write d4/d15/d49/dab/dc3/d4c/d7a/fae [2172994,29191] 0 2024-04-27T07:33:36.616 INFO:tasks.workunit.client.0.smithi082.stdout:1/932: dread - d4/d15/d49/d99/d9a/f128 zero size 2024-04-27T07:33:36.616 INFO:tasks.workunit.client.0.smithi082.stdout:1/933: fsync d4/fa1 0 2024-04-27T07:33:36.617 INFO:tasks.workunit.client.0.smithi082.stdout:1/934: chown d4/d15/d49/dab/dc3/d3e/d57/da5/ffa 15 1 2024-04-27T07:33:36.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/653: dread d7/f9e [0,4194304] 0 2024-04-27T07:33:36.619 INFO:tasks.workunit.client.1.smithi100.stdout:4/521: sync 2024-04-27T07:33:36.620 INFO:tasks.workunit.client.1.smithi100.stdout:9/437: sync 2024-04-27T07:33:36.620 INFO:tasks.workunit.client.0.smithi082.stdout:1/935: truncate f2 4134847 0 2024-04-27T07:33:36.621 INFO:tasks.workunit.client.1.smithi100.stdout:9/438: dread - d1/d9/db/d2b/d4f/f78 zero size 2024-04-27T07:33:36.622 INFO:tasks.workunit.client.1.smithi100.stdout:7/541: dread d1/d54/f61 [0,4194304] 0 2024-04-27T07:33:36.623 INFO:tasks.workunit.client.0.smithi082.stdout:1/936: symlink d4/d15/d49/dab/dc3/l140 0 2024-04-27T07:33:36.623 INFO:tasks.workunit.client.0.smithi082.stdout:1/937: stat d4/d15/d49/d99/de8/f133 0 2024-04-27T07:33:36.624 INFO:tasks.workunit.client.1.smithi100.stdout:4/522: getdents d5/d1b/d2c/d3f/d96 0 2024-04-27T07:33:36.626 INFO:tasks.workunit.client.1.smithi100.stdout:3/654: getdents d7/d9/d10/d3e/d91 0 2024-04-27T07:33:36.633 INFO:tasks.workunit.client.1.smithi100.stdout:4/523: dwrite d5/d1b/f80 [0,4194304] 0 2024-04-27T07:33:36.633 INFO:tasks.workunit.client.1.smithi100.stdout:2/533: dread d0/f24 [0,4194304] 0 2024-04-27T07:33:36.637 INFO:tasks.workunit.client.0.smithi082.stdout:9/916: write d9/da/dc/d33/f89 [241074,125630] 0 2024-04-27T07:33:36.639 INFO:tasks.workunit.client.0.smithi082.stdout:9/917: chown d9/da/dc/d35/d38/dc5/db8/le2 13 1 2024-04-27T07:33:36.639 INFO:tasks.workunit.client.0.smithi082.stdout:1/938: truncate d4/f86 3802357 0 2024-04-27T07:33:36.640 INFO:tasks.workunit.client.0.smithi082.stdout:1/939: read d4/fd [8348500,99916] 0 2024-04-27T07:33:36.643 INFO:tasks.workunit.client.0.smithi082.stdout:9/918: link d9/d2d/d72/dae/cf6 d9/d2d/d2b/d46/db6/c130 0 2024-04-27T07:33:36.643 INFO:tasks.workunit.client.1.smithi100.stdout:4/524: rename d5/d16/c20 to d5/d1b/d2c/d7d/d8a/cb4 0 2024-04-27T07:33:36.644 INFO:tasks.workunit.client.0.smithi082.stdout:9/919: creat d9/da/dc/d35/d4a/d61/f131 x:0 0 0 2024-04-27T07:33:36.645 INFO:tasks.workunit.client.0.smithi082.stdout:9/920: dread - d9/da/dc/d33/ffe zero size 2024-04-27T07:33:36.648 INFO:tasks.workunit.client.1.smithi100.stdout:1/637: dwrite d0/d1f/d6d/db4/d4e/d7b/fcf [0,4194304] 0 2024-04-27T07:33:36.650 INFO:tasks.workunit.client.1.smithi100.stdout:2/534: rename d0/d1e/f31 to d0/da/d29/d47/d5a/fb6 0 2024-04-27T07:33:36.650 INFO:tasks.workunit.client.0.smithi082.stdout:9/921: dwrite d9/da/dc/d73/dbb/fcf [0,4194304] 0 2024-04-27T07:33:36.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/922: creat d9/da/db0/f132 x:0 0 0 2024-04-27T07:33:36.654 INFO:tasks.workunit.client.0.smithi082.stdout:9/923: write d9/da/dc/d35/d38/da5/d66/f91 [2192906,36592] 0 2024-04-27T07:33:36.656 INFO:tasks.workunit.client.1.smithi100.stdout:4/525: creat d5/d16/d19/d46/d53/fb5 x:0 0 0 2024-04-27T07:33:36.663 INFO:tasks.workunit.client.1.smithi100.stdout:6/572: dwrite de/d58/f29 [0,4194304] 0 2024-04-27T07:33:36.663 INFO:tasks.workunit.client.1.smithi100.stdout:4/526: creat d5/d23/fb6 x:0 0 0 2024-04-27T07:33:36.667 INFO:tasks.workunit.client.1.smithi100.stdout:6/573: chown de/d2e/d86/f9a 193 1 2024-04-27T07:33:36.670 INFO:tasks.workunit.client.1.smithi100.stdout:7/542: dread d1/dd/f5d [0,4194304] 0 2024-04-27T07:33:36.671 INFO:tasks.workunit.client.1.smithi100.stdout:4/527: rmdir d5/d16/d19/d21/d77/d94 39 2024-04-27T07:33:36.676 INFO:tasks.workunit.client.1.smithi100.stdout:5/435: dwrite d0/d4/f22 [4194304,4194304] 0 2024-04-27T07:33:36.676 INFO:tasks.workunit.client.0.smithi082.stdout:9/924: creat d9/d48/f133 x:0 0 0 2024-04-27T07:33:36.677 INFO:tasks.workunit.client.1.smithi100.stdout:4/528: rename d5/d16/d2e/fa4 to d5/fb7 0 2024-04-27T07:33:36.678 INFO:tasks.workunit.client.1.smithi100.stdout:7/543: creat d1/dd/d2a/fa2 x:0 0 0 2024-04-27T07:33:36.679 INFO:tasks.workunit.client.1.smithi100.stdout:5/436: read - d0/d4/d21/d24/d46/f8b zero size 2024-04-27T07:33:36.683 INFO:tasks.workunit.client.1.smithi100.stdout:4/529: symlink d5/d16/d19/d21/d6d/dad/lb8 0 2024-04-27T07:33:36.684 INFO:tasks.workunit.client.1.smithi100.stdout:7/544: write d1/dd/d16/d70/d51/f65 [826880,19969] 0 2024-04-27T07:33:36.686 INFO:tasks.workunit.client.1.smithi100.stdout:5/437: unlink d0/d4/d21/f2e 0 2024-04-27T07:33:36.690 INFO:tasks.workunit.client.1.smithi100.stdout:3/655: dwrite d7/d9/d10/d28/f7d [0,4194304] 0 2024-04-27T07:33:36.694 INFO:tasks.workunit.client.1.smithi100.stdout:4/530: rename d5/d1b/d65/fa8 to d5/d1b/d2c/d3f/fb9 0 2024-04-27T07:33:36.698 INFO:tasks.workunit.client.1.smithi100.stdout:5/438: dwrite d0/d42/f81 [0,4194304] 0 2024-04-27T07:33:36.699 INFO:tasks.workunit.client.1.smithi100.stdout:1/638: dread d0/f14 [0,4194304] 0 2024-04-27T07:33:36.699 INFO:tasks.workunit.client.1.smithi100.stdout:4/531: write d5/d16/d4c/f7f [737582,119926] 0 2024-04-27T07:33:36.700 INFO:tasks.workunit.client.1.smithi100.stdout:2/535: truncate d0/f11 2668420 0 2024-04-27T07:33:36.702 INFO:tasks.workunit.client.1.smithi100.stdout:1/639: write d0/d1b/da1/fa2 [914822,127975] 0 2024-04-27T07:33:36.703 INFO:tasks.workunit.client.1.smithi100.stdout:6/574: truncate de/d58/d28/f30 3860629 0 2024-04-27T07:33:36.704 INFO:tasks.workunit.client.0.smithi082.stdout:9/925: dwrite d9/d48/dd6/ff9 [0,4194304] 0 2024-04-27T07:33:36.706 INFO:tasks.workunit.client.1.smithi100.stdout:2/536: chown d0/da/d29/d47/d5a/d8d/fa9 51 1 2024-04-27T07:33:36.707 INFO:tasks.workunit.client.1.smithi100.stdout:5/439: fsync d0/d4/d21/f50 0 2024-04-27T07:33:36.708 INFO:tasks.workunit.client.1.smithi100.stdout:4/532: truncate d5/d16/d19/d21/fb3 811254 0 2024-04-27T07:33:36.711 INFO:tasks.workunit.client.1.smithi100.stdout:6/575: write de/d58/d21/f49 [2861224,95472] 0 2024-04-27T07:33:36.713 INFO:tasks.workunit.client.1.smithi100.stdout:1/640: creat d0/d1f/d6d/fd3 x:0 0 0 2024-04-27T07:33:36.713 INFO:tasks.workunit.client.1.smithi100.stdout:6/576: read de/d2e/f77 [78631,89883] 0 2024-04-27T07:33:36.720 INFO:tasks.workunit.client.1.smithi100.stdout:4/533: mkdir d5/d16/d19/d46/d53/dba 0 2024-04-27T07:33:36.722 INFO:tasks.workunit.client.1.smithi100.stdout:5/440: truncate d0/d4/d21/f4b 2057495 0 2024-04-27T07:33:36.726 INFO:tasks.workunit.client.1.smithi100.stdout:7/545: getdents d1/dd/d16/d70/d51/d6f 0 2024-04-27T07:33:36.728 INFO:tasks.workunit.client.1.smithi100.stdout:2/537: unlink d0/da/d29/d47/c76 0 2024-04-27T07:33:36.729 INFO:tasks.workunit.client.1.smithi100.stdout:3/656: link d7/d9/d26/d2a/c66 d7/d9/d10/d22/ccb 0 2024-04-27T07:33:36.729 INFO:tasks.workunit.client.1.smithi100.stdout:2/538: fsync d0/da/d29/d47/da1/da3/f65 0 2024-04-27T07:33:36.730 INFO:tasks.workunit.client.1.smithi100.stdout:3/657: chown d7/d9/d10/d22/f5b 1702378569 1 2024-04-27T07:33:36.731 INFO:tasks.workunit.client.1.smithi100.stdout:4/534: mknod d5/d16/d19/d46/d53/d7e/cbb 0 2024-04-27T07:33:36.731 INFO:tasks.workunit.client.1.smithi100.stdout:7/546: dread d1/dd/d16/d31/d4c/f81 [0,4194304] 0 2024-04-27T07:33:36.732 INFO:tasks.workunit.client.1.smithi100.stdout:2/539: read d0/da/fd [1968284,62242] 0 2024-04-27T07:33:36.733 INFO:tasks.workunit.client.1.smithi100.stdout:3/658: write d7/d9/d10/d33/f41 [588568,84858] 0 2024-04-27T07:33:36.733 INFO:tasks.workunit.client.1.smithi100.stdout:1/641: mknod d0/d1b/d20/d2d/d35/d4d/d60/dcd/cd4 0 2024-04-27T07:33:36.735 INFO:tasks.workunit.client.1.smithi100.stdout:3/659: read d7/d9/fa7 [263944,17705] 0 2024-04-27T07:33:36.742 INFO:tasks.workunit.client.1.smithi100.stdout:7/547: write d1/dd/d16/d31/d4c/d4d/f6b [1188776,49764] 0 2024-04-27T07:33:36.744 INFO:tasks.workunit.client.0.smithi082.stdout:9/926: dwrite d9/d2d/d2b/d46/d5d/d6f/d118/f11b [0,4194304] 0 2024-04-27T07:33:36.752 INFO:tasks.workunit.client.1.smithi100.stdout:5/441: creat d0/d4/d21/d24/d2f/d57/d37/d1a/f8e x:0 0 0 2024-04-27T07:33:36.753 INFO:tasks.workunit.client.0.smithi082.stdout:9/927: truncate d9/da/dc/d35/d38/d65/fc7 4959291 0 2024-04-27T07:33:36.754 INFO:tasks.workunit.client.0.smithi082.stdout:9/928: chown d9/da/dc/d35/d38/da5 128554065 1 2024-04-27T07:33:36.755 INFO:tasks.workunit.client.0.smithi082.stdout:9/929: chown d9/da/dc/d35/d38/dc5/f41 0 1 2024-04-27T07:33:36.756 INFO:tasks.workunit.client.1.smithi100.stdout:7/548: mknod d1/dd/d16/d31/ca3 0 2024-04-27T07:33:36.757 INFO:tasks.workunit.client.1.smithi100.stdout:7/549: chown d1/dd/d16/d70/d6e 11 1 2024-04-27T07:33:36.758 INFO:tasks.workunit.client.1.smithi100.stdout:7/550: write d1/dd/d16/d70/f59 [446263,119054] 0 2024-04-27T07:33:36.758 INFO:tasks.workunit.client.1.smithi100.stdout:1/642: symlink d0/d1b/d20/d2d/ld5 0 2024-04-27T07:33:36.761 INFO:tasks.workunit.client.1.smithi100.stdout:1/643: write d0/d1f/d6d/db4/d4e/d7b/fc0 [253522,56445] 0 2024-04-27T07:33:36.762 INFO:tasks.workunit.client.1.smithi100.stdout:5/442: unlink d0/d4/fc 0 2024-04-27T07:33:36.762 INFO:tasks.workunit.client.1.smithi100.stdout:2/540: dread d0/da/f28 [0,4194304] 0 2024-04-27T07:33:36.763 INFO:tasks.workunit.client.1.smithi100.stdout:4/535: creat d5/d1b/fbc x:0 0 0 2024-04-27T07:33:36.766 INFO:tasks.workunit.client.1.smithi100.stdout:5/443: readlink d0/l13 0 2024-04-27T07:33:36.767 INFO:tasks.workunit.client.1.smithi100.stdout:5/444: chown d0/l13 2528445 1 2024-04-27T07:33:36.782 INFO:tasks.workunit.client.1.smithi100.stdout:8/501: sync 2024-04-27T07:33:36.856 INFO:tasks.workunit.client.1.smithi100.stdout:1/644: rename d0/cc1 to d0/d23/d3a/dae/cd6 0 2024-04-27T07:33:36.856 INFO:tasks.workunit.client.1.smithi100.stdout:2/541: creat d0/da/d39/fb7 x:0 0 0 2024-04-27T07:33:36.857 INFO:tasks.workunit.client.1.smithi100.stdout:3/660: truncate d7/d9/d10/f7b 284534 0 2024-04-27T07:33:36.857 INFO:tasks.workunit.client.1.smithi100.stdout:6/577: read de/d58/d28/f30 [914782,106111] 0 2024-04-27T07:33:36.858 INFO:tasks.workunit.client.1.smithi100.stdout:4/536: dwrite d5/d1b/d2c/f64 [0,4194304] 0 2024-04-27T07:33:36.858 INFO:tasks.workunit.client.1.smithi100.stdout:8/502: chown d6/d1b/d1d/d59/d4f/l7b 790 1 2024-04-27T07:33:36.863 INFO:tasks.workunit.client.1.smithi100.stdout:5/445: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/c8f 0 2024-04-27T07:33:36.865 INFO:tasks.workunit.client.1.smithi100.stdout:2/542: dwrite d0/da/d75/f9b [0,4194304] 0 2024-04-27T07:33:36.869 INFO:tasks.workunit.client.1.smithi100.stdout:6/578: rename de/d58/d21/f26 to de/d58/d21/d24/fc9 0 2024-04-27T07:33:36.872 INFO:tasks.workunit.client.1.smithi100.stdout:8/503: mkdir d6/d20/d54/d91/d9e 0 2024-04-27T07:33:36.873 INFO:tasks.workunit.client.1.smithi100.stdout:2/543: creat d0/da/d29/d47/d5a/d8d/d3e/d98/db1/fb8 x:0 0 0 2024-04-27T07:33:36.873 INFO:tasks.workunit.client.1.smithi100.stdout:1/645: dwrite d0/d1b/f33 [0,4194304] 0 2024-04-27T07:33:36.876 INFO:tasks.workunit.client.1.smithi100.stdout:3/661: rename d7/d9/d10/d33/d90/dbb/fbc to d7/d9/d10/d3e/d74/db1/fcc 0 2024-04-27T07:33:36.879 INFO:tasks.workunit.client.1.smithi100.stdout:3/662: truncate d7/d9/d10/d22/fc9 447031 0 2024-04-27T07:33:36.879 INFO:tasks.workunit.client.1.smithi100.stdout:1/646: read d0/d1b/d20/d2d/d35/d4d/d60/da4/fd0 [1719868,39784] 0 2024-04-27T07:33:36.885 INFO:tasks.workunit.client.1.smithi100.stdout:6/579: rmdir de/d2e/dc0/dc4 0 2024-04-27T07:33:36.888 INFO:tasks.workunit.client.1.smithi100.stdout:6/580: readlink de/d58/d21/d24/d9f/la3 0 2024-04-27T07:33:36.890 INFO:tasks.workunit.client.1.smithi100.stdout:1/647: link d0/l1c d0/d23/d3a/ld7 0 2024-04-27T07:33:36.891 INFO:tasks.workunit.client.1.smithi100.stdout:3/663: getdents d7 0 2024-04-27T07:33:36.891 INFO:tasks.workunit.client.1.smithi100.stdout:4/537: write d5/f10 [3702022,29178] 0 2024-04-27T07:33:36.893 INFO:tasks.workunit.client.1.smithi100.stdout:4/538: dread - d5/d23/d33/f9d zero size 2024-04-27T07:33:36.894 INFO:tasks.workunit.client.1.smithi100.stdout:1/648: mknod d0/d1f/d6d/db4/cd8 0 2024-04-27T07:33:36.898 INFO:tasks.workunit.client.1.smithi100.stdout:6/581: rename de/d58/d21/d5b/f6f to de/d58/d21/fca 0 2024-04-27T07:33:36.898 INFO:tasks.workunit.client.1.smithi100.stdout:6/582: fsync de/d58/d21/f83 0 2024-04-27T07:33:36.900 INFO:tasks.workunit.client.1.smithi100.stdout:4/539: unlink d5/d16/d19/d21/d2b/f58 0 2024-04-27T07:33:36.903 INFO:tasks.workunit.client.1.smithi100.stdout:6/583: dread de/d58/d28/f67 [4194304,4194304] 0 2024-04-27T07:33:36.904 INFO:tasks.workunit.client.1.smithi100.stdout:6/584: chown de/d2e/d3f/d80/cb1 1 1 2024-04-27T07:33:36.906 INFO:tasks.workunit.client.1.smithi100.stdout:4/540: fsync d5/d16/d19/d21/d77/fa5 0 2024-04-27T07:33:36.906 INFO:tasks.workunit.client.1.smithi100.stdout:2/544: write d0/da/f28 [2853941,79377] 0 2024-04-27T07:33:36.906 INFO:tasks.workunit.client.1.smithi100.stdout:6/585: fsync de/d58/d28/f59 0 2024-04-27T07:33:36.907 INFO:tasks.workunit.client.1.smithi100.stdout:1/649: dwrite d0/d1b/d20/d2d/d35/d4d/d60/fad [0,4194304] 0 2024-04-27T07:33:36.908 INFO:tasks.workunit.client.1.smithi100.stdout:1/650: chown d0/d1f/d6d/db4/f39 746915876 1 2024-04-27T07:33:36.912 INFO:tasks.workunit.client.1.smithi100.stdout:2/545: read d0/da/d29/d47/f91 [583809,104771] 0 2024-04-27T07:33:36.916 INFO:tasks.workunit.client.1.smithi100.stdout:6/586: rmdir de/d2e/d86 39 2024-04-27T07:33:36.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:36 smithi100 ceph-mon[34183]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 117 MiB/s rd, 330 MiB/s wr, 646 op/s 2024-04-27T07:33:36.917 INFO:tasks.workunit.client.1.smithi100.stdout:1/651: dread d0/d23/f54 [0,4194304] 0 2024-04-27T07:33:36.918 INFO:tasks.workunit.client.1.smithi100.stdout:4/541: mkdir d5/d1b/d2c/dbd 0 2024-04-27T07:33:36.919 INFO:tasks.workunit.client.1.smithi100.stdout:3/664: rmdir d7/d9/d10/d33/d90/dbb 0 2024-04-27T07:33:36.920 INFO:tasks.workunit.client.1.smithi100.stdout:8/504: dwrite d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:36.923 INFO:tasks.workunit.client.1.smithi100.stdout:1/652: truncate d0/d1f/d6d/db4/d4e/d7b/fc0 1031000 0 2024-04-27T07:33:36.928 INFO:tasks.workunit.client.1.smithi100.stdout:4/542: rename d5/d16/l9a to d5/d1b/d2c/d7d/lbe 0 2024-04-27T07:33:36.932 INFO:tasks.workunit.client.1.smithi100.stdout:3/665: mknod d7/d9/da5/ccd 0 2024-04-27T07:33:36.933 INFO:tasks.workunit.client.1.smithi100.stdout:4/543: mkdir d5/d1b/d2c/d50/dbf 0 2024-04-27T07:33:36.937 INFO:tasks.workunit.client.1.smithi100.stdout:2/546: rename d0/da/d29/d47/d5a/d8d/l92 to d0/da/d29/d47/d5a/d8d/lb9 0 2024-04-27T07:33:36.938 INFO:tasks.workunit.client.1.smithi100.stdout:6/587: dread de/d58/d21/d24/f25 [0,4194304] 0 2024-04-27T07:33:36.938 INFO:tasks.workunit.client.1.smithi100.stdout:2/547: stat d0/d1e/l55 0 2024-04-27T07:33:36.938 INFO:tasks.workunit.client.1.smithi100.stdout:1/653: symlink d0/d1f/d6d/db4/d4e/ld9 0 2024-04-27T07:33:36.939 INFO:tasks.workunit.client.1.smithi100.stdout:3/666: rmdir d7/d9/d10/d33 39 2024-04-27T07:33:36.941 INFO:tasks.workunit.client.1.smithi100.stdout:8/505: rmdir d6/d1b/d75/d9a 0 2024-04-27T07:33:36.942 INFO:tasks.workunit.client.1.smithi100.stdout:4/544: dwrite d5/d16/d4c/f7c [4194304,4194304] 0 2024-04-27T07:33:36.942 INFO:tasks.workunit.client.1.smithi100.stdout:3/667: write d7/f1f [928356,82102] 0 2024-04-27T07:33:36.944 INFO:tasks.workunit.client.1.smithi100.stdout:6/588: creat de/d2e/d3f/d80/fcb x:0 0 0 2024-04-27T07:33:36.945 INFO:tasks.workunit.client.1.smithi100.stdout:8/506: chown d6/d20/d8b/d8c 264659 1 2024-04-27T07:33:36.951 INFO:tasks.workunit.client.1.smithi100.stdout:2/548: rename d0/d1e/l55 to d0/da/d29/d47/d87/d88/lba 0 2024-04-27T07:33:36.951 INFO:tasks.workunit.client.1.smithi100.stdout:1/654: dwrite d0/d1b/d20/d2d/d35/dac/fb2 [0,4194304] 0 2024-04-27T07:33:36.953 INFO:tasks.workunit.client.1.smithi100.stdout:6/589: creat de/d2e/d3f/d80/fcc x:0 0 0 2024-04-27T07:33:36.954 INFO:tasks.workunit.client.1.smithi100.stdout:6/590: read de/d58/d21/d5b/f7f [467097,65521] 0 2024-04-27T07:33:36.955 INFO:tasks.workunit.client.1.smithi100.stdout:8/507: unlink d6/d20/d50/f98 0 2024-04-27T07:33:36.956 INFO:tasks.workunit.client.1.smithi100.stdout:4/545: symlink d5/d16/lc0 0 2024-04-27T07:33:36.958 INFO:tasks.workunit.client.1.smithi100.stdout:2/549: dwrite d0/d79/fad [0,4194304] 0 2024-04-27T07:33:36.961 INFO:tasks.workunit.client.1.smithi100.stdout:6/591: fdatasync de/d58/f71 0 2024-04-27T07:33:36.961 INFO:tasks.workunit.client.1.smithi100.stdout:4/546: creat d5/d1b/d65/fc1 x:0 0 0 2024-04-27T07:33:36.964 INFO:tasks.workunit.client.1.smithi100.stdout:4/547: write d5/d16/d4c/f7c [3955095,109461] 0 2024-04-27T07:33:36.964 INFO:tasks.workunit.client.1.smithi100.stdout:6/592: creat de/d58/d90/fcd x:0 0 0 2024-04-27T07:33:36.966 INFO:tasks.workunit.client.1.smithi100.stdout:1/655: getdents d0/d1b/d20/d2d/d35 0 2024-04-27T07:33:36.967 INFO:tasks.workunit.client.1.smithi100.stdout:2/550: read d0/f12 [947186,42128] 0 2024-04-27T07:33:36.968 INFO:tasks.workunit.client.1.smithi100.stdout:6/593: mknod de/d58/d90/cce 0 2024-04-27T07:33:36.977 INFO:tasks.workunit.client.1.smithi100.stdout:6/594: dwrite de/d2e/d86/f93 [0,4194304] 0 2024-04-27T07:33:36.982 INFO:tasks.workunit.client.0.smithi082.stdout:1/940: sync 2024-04-27T07:33:36.982 INFO:tasks.workunit.client.0.smithi082.stdout:9/930: sync 2024-04-27T07:33:36.984 INFO:tasks.workunit.client.0.smithi082.stdout:9/931: creat d9/da/dc/d88/d93/f134 x:0 0 0 2024-04-27T07:33:36.986 INFO:tasks.workunit.client.1.smithi100.stdout:6/595: unlink de/d58/d21/f32 0 2024-04-27T07:33:36.987 INFO:tasks.workunit.client.0.smithi082.stdout:9/932: write d9/da/dc/d33/f89 [1408811,22523] 0 2024-04-27T07:33:36.987 INFO:tasks.workunit.client.1.smithi100.stdout:4/548: dread d5/d23/f3c [0,4194304] 0 2024-04-27T07:33:36.988 INFO:tasks.workunit.client.1.smithi100.stdout:2/551: write d0/f11 [1269769,100425] 0 2024-04-27T07:33:36.989 INFO:tasks.workunit.client.0.smithi082.stdout:9/933: dread - d9/d2d/d2b/d46/db6/fcc zero size 2024-04-27T07:33:36.990 INFO:tasks.workunit.client.0.smithi082.stdout:1/941: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/d93/fe6 [4194304,4194304] 0 2024-04-27T07:33:36.991 INFO:tasks.workunit.client.0.smithi082.stdout:1/942: chown d4/d15/da7/cc4 1056682262 1 2024-04-27T07:33:36.993 INFO:tasks.workunit.client.1.smithi100.stdout:4/549: write d5/d16/fa1 [4318203,10864] 0 2024-04-27T07:33:36.994 INFO:tasks.workunit.client.1.smithi100.stdout:2/552: creat d0/da/d29/d47/dae/fbb x:0 0 0 2024-04-27T07:33:36.995 INFO:tasks.workunit.client.0.smithi082.stdout:1/943: mkdir d4/d15/d49/d99/d9a/da9/d141 0 2024-04-27T07:33:36.996 INFO:tasks.workunit.client.0.smithi082.stdout:9/934: link d9/da/d85/fc4 d9/da/dc/d121/f135 0 2024-04-27T07:33:36.996 INFO:tasks.workunit.client.1.smithi100.stdout:9/439: sync 2024-04-27T07:33:36.996 INFO:tasks.workunit.client.1.smithi100.stdout:0/520: sync 2024-04-27T07:33:36.996 INFO:tasks.workunit.client.1.smithi100.stdout:4/550: rmdir d5/d16/d19/d21/d77/d94/d9f 39 2024-04-27T07:33:36.999 INFO:tasks.workunit.client.1.smithi100.stdout:4/551: write d5/d1b/d2c/f8d [1013896,74312] 0 2024-04-27T07:33:37.001 INFO:tasks.workunit.client.1.smithi100.stdout:6/596: getdents de/d58/d21 0 2024-04-27T07:33:37.002 INFO:tasks.workunit.client.1.smithi100.stdout:4/552: dread - d5/d16/d19/d46/d53/f98 zero size 2024-04-27T07:33:37.005 INFO:tasks.workunit.client.1.smithi100.stdout:9/440: truncate d1/d9/db/d2b/f86 1617873 0 2024-04-27T07:33:37.006 INFO:tasks.workunit.client.0.smithi082.stdout:9/935: mkdir d9/da/dc/d33/d5e/d136 0 2024-04-27T07:33:37.006 INFO:tasks.workunit.client.1.smithi100.stdout:9/441: write d1/d9/db/d2b/f7f [331218,38061] 0 2024-04-27T07:33:37.007 INFO:tasks.workunit.client.1.smithi100.stdout:9/442: read - d1/d9/d1f/f8b zero size 2024-04-27T07:33:37.008 INFO:tasks.workunit.client.1.smithi100.stdout:6/597: symlink de/d2e/d86/lcf 0 2024-04-27T07:33:37.008 INFO:tasks.workunit.client.0.smithi082.stdout:1/944: rmdir d4/d15 39 2024-04-27T07:33:37.010 INFO:tasks.workunit.client.0.smithi082.stdout:1/945: dread - d4/d15/d49/d99/d9a/f128 zero size 2024-04-27T07:33:37.010 INFO:tasks.workunit.client.0.smithi082.stdout:9/936: dread d9/da/dc/d35/d38/fab [0,4194304] 0 2024-04-27T07:33:37.013 INFO:tasks.workunit.client.0.smithi082.stdout:9/937: fdatasync d9/da/dc/d35/d38/da5/fc6 0 2024-04-27T07:33:37.014 INFO:tasks.workunit.client.1.smithi100.stdout:0/521: creat d1/d8/d20/d72/d96/fb3 x:0 0 0 2024-04-27T07:33:37.016 INFO:tasks.workunit.client.0.smithi082.stdout:9/938: creat d9/d2d/d2b/d46/d5d/f137 x:0 0 0 2024-04-27T07:33:37.017 INFO:tasks.workunit.client.0.smithi082.stdout:9/939: write d9/d2d/d72/f8a [3621958,47162] 0 2024-04-27T07:33:37.019 INFO:tasks.workunit.client.1.smithi100.stdout:9/443: rename d1/d9/d1f/d52 to d1/d9/db/d2b/d31/d9f 0 2024-04-27T07:33:37.019 INFO:tasks.workunit.client.0.smithi082.stdout:1/946: dwrite d4/f28 [4194304,4194304] 0 2024-04-27T07:33:37.020 INFO:tasks.workunit.client.1.smithi100.stdout:9/444: stat d1/d9/l43 0 2024-04-27T07:33:37.021 INFO:tasks.workunit.client.0.smithi082.stdout:1/947: fsync d4/d15/d49/d99/fb6 0 2024-04-27T07:33:37.021 INFO:tasks.workunit.client.0.smithi082.stdout:9/940: creat d9/da/dc/d121/f138 x:0 0 0 2024-04-27T07:33:37.022 INFO:tasks.workunit.client.1.smithi100.stdout:4/553: dread d5/f6 [0,4194304] 0 2024-04-27T07:33:37.023 INFO:tasks.workunit.client.0.smithi082.stdout:9/941: fsync d9/da/dc/d88/d93/fc1 0 2024-04-27T07:33:37.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/948: symlink d4/d15/d49/dab/dc3/d3e/d57/d130/l142 0 2024-04-27T07:33:37.026 INFO:tasks.workunit.client.0.smithi082.stdout:9/942: stat d9/da/dc/d35/d38/d65/fc7 0 2024-04-27T07:33:37.028 INFO:tasks.workunit.client.1.smithi100.stdout:9/445: mkdir d1/d9/db/d2b/d4f/d91/da0 0 2024-04-27T07:33:37.028 INFO:tasks.workunit.client.1.smithi100.stdout:2/553: truncate d0/da/d29/d47/d5a/d8d/d5d/f96 1784689 0 2024-04-27T07:33:37.029 INFO:tasks.workunit.client.0.smithi082.stdout:9/943: write d9/da/dc/d35/d38/d65/f77 [5059709,35390] 0 2024-04-27T07:33:37.030 INFO:tasks.workunit.client.1.smithi100.stdout:4/554: rename d5/d23/f42 to d5/d16/d4c/fc2 0 2024-04-27T07:33:37.032 INFO:tasks.workunit.client.0.smithi082.stdout:1/949: getdents d4/d15/d49/dab/dc3/d3e/d57/d101/d6d 0 2024-04-27T07:33:37.033 INFO:tasks.workunit.client.0.smithi082.stdout:9/944: creat d9/da/dc/d35/d38/dc5/db8/d10f/f139 x:0 0 0 2024-04-27T07:33:37.034 INFO:tasks.workunit.client.0.smithi082.stdout:1/950: creat d4/d15/d49/dab/dc3/d4c/d7a/d8c/f143 x:0 0 0 2024-04-27T07:33:37.036 INFO:tasks.workunit.client.1.smithi100.stdout:0/522: rmdir d1/d8 39 2024-04-27T07:33:37.036 INFO:tasks.workunit.client.0.smithi082.stdout:1/951: mknod d4/d15/d29/c144 0 2024-04-27T07:33:37.036 INFO:tasks.workunit.client.0.smithi082.stdout:9/945: read d9/da/dc/f2a [3504867,19033] 0 2024-04-27T07:33:37.038 INFO:tasks.workunit.client.1.smithi100.stdout:2/554: rename d0/da/d29/d47/d5a/d8d/d3e to d0/d79/d94/dbc 0 2024-04-27T07:33:37.038 INFO:tasks.workunit.client.1.smithi100.stdout:9/446: dread d1/d9/db/f1e [0,4194304] 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.1.smithi100.stdout:9/447: write d1/d9/d1f/f7b [429095,107645] 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.1.smithi100.stdout:4/555: creat d5/d1b/d2c/fc3 x:0 0 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/952: rename d4/d15/d49/dab/dc3/l8f to d4/d15/d49/dab/dc3/d3e/d53/l145 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/953: readlink d4/d15/d49/d99/de8/lf1 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/954: readlink d4/d15/d49/dab/dc3/l126 0 2024-04-27T07:33:37.043 INFO:tasks.workunit.client.0.smithi082.stdout:9/946: write d9/da/dc/d35/d38/da5/faf [880950,14924] 0 2024-04-27T07:33:37.044 INFO:tasks.workunit.client.0.smithi082.stdout:1/955: creat d4/d15/d49/dab/dc3/d3e/d53/d72/d114/f146 x:0 0 0 2024-04-27T07:33:37.044 INFO:tasks.workunit.client.0.smithi082.stdout:9/947: stat d9/d2d/d2b/d46/d76/dcb/ff4 0 2024-04-27T07:33:37.045 INFO:tasks.workunit.client.0.smithi082.stdout:1/956: fsync d4/d15/d1c/f8e 0 2024-04-27T07:33:37.046 INFO:tasks.workunit.client.1.smithi100.stdout:2/555: dwrite d0/da/d29/d47/d5a/d8d/f2a [0,4194304] 0 2024-04-27T07:33:37.048 INFO:tasks.workunit.client.0.smithi082.stdout:1/957: mknod d4/d15/d49/dab/dc3/d3e/d57/d101/d97/dd1/c147 0 2024-04-27T07:33:37.049 INFO:tasks.workunit.client.0.smithi082.stdout:1/958: stat d4/d15/d49/dab/dc3/f6b 0 2024-04-27T07:33:37.051 INFO:tasks.workunit.client.0.smithi082.stdout:1/959: creat d4/d15/d49/dab/dc3/f148 x:0 0 0 2024-04-27T07:33:37.052 INFO:tasks.workunit.client.1.smithi100.stdout:4/556: dwrite d5/d16/f7b [0,4194304] 0 2024-04-27T07:33:37.056 INFO:tasks.workunit.client.1.smithi100.stdout:6/598: symlink de/d58/d21/d24/ld0 0 2024-04-27T07:33:37.056 INFO:tasks.workunit.client.0.smithi082.stdout:1/960: rename d4/f86 to d4/d15/d49/dab/dc3/d3e/d53/d72/d114/d129/f149 0 2024-04-27T07:33:37.058 INFO:tasks.workunit.client.1.smithi100.stdout:2/556: read d0/d79/d94/dbc/d98/db1/f48 [1314382,51038] 0 2024-04-27T07:33:37.058 INFO:tasks.workunit.client.1.smithi100.stdout:0/523: creat d1/d8/d20/d72/d96/fb4 x:0 0 0 2024-04-27T07:33:37.059 INFO:tasks.workunit.client.0.smithi082.stdout:1/961: symlink d4/d15/d49/da0/l14a 0 2024-04-27T07:33:37.062 INFO:tasks.workunit.client.1.smithi100.stdout:2/557: dread d0/da/d29/d47/d5a/d8d/d5d/f5f [0,4194304] 0 2024-04-27T07:33:37.062 INFO:tasks.workunit.client.0.smithi082.stdout:1/962: rename d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/l13a to d4/d15/d49/d99/de8/l14b 0 2024-04-27T07:33:37.063 INFO:tasks.workunit.client.1.smithi100.stdout:0/524: creat d1/d8/d14/d59/fb5 x:0 0 0 2024-04-27T07:33:37.063 INFO:tasks.workunit.client.1.smithi100.stdout:9/448: getdents d1/d9/d1f/d4a/d67 0 2024-04-27T07:33:37.063 INFO:tasks.workunit.client.0.smithi082.stdout:1/963: fdatasync d4/d15/d49/dab/dc3/d3e/f87 0 2024-04-27T07:33:37.064 INFO:tasks.workunit.client.1.smithi100.stdout:0/525: fdatasync d1/d38/f94 0 2024-04-27T07:33:37.065 INFO:tasks.workunit.client.0.smithi082.stdout:1/964: truncate d4/d15/d49/d4e/f13e 112910 0 2024-04-27T07:33:37.067 INFO:tasks.workunit.client.0.smithi082.stdout:1/965: write d4/d15/d49/dab/dc3/fcd [2989531,80499] 0 2024-04-27T07:33:37.067 INFO:tasks.workunit.client.1.smithi100.stdout:9/449: getdents d1/d9/db/d2b/d4f/d91 0 2024-04-27T07:33:37.067 INFO:tasks.workunit.client.1.smithi100.stdout:0/526: creat d1/d8/d20/d72/fb6 x:0 0 0 2024-04-27T07:33:37.069 INFO:tasks.workunit.client.1.smithi100.stdout:2/558: dread d0/da/d29/d47/da1/da3/f59 [0,4194304] 0 2024-04-27T07:33:37.071 INFO:tasks.workunit.client.1.smithi100.stdout:0/527: mknod d1/d8/d14/d59/cb7 0 2024-04-27T07:33:37.071 INFO:tasks.workunit.client.1.smithi100.stdout:9/450: mkdir d1/d9/db/da1 0 2024-04-27T07:33:37.072 INFO:tasks.workunit.client.1.smithi100.stdout:0/528: write d1/d8/d14/d59/fb5 [658799,124738] 0 2024-04-27T07:33:37.074 INFO:tasks.workunit.client.1.smithi100.stdout:0/529: chown d1/d8/d14/d59/f8f 7 1 2024-04-27T07:33:37.074 INFO:tasks.workunit.client.1.smithi100.stdout:2/559: symlink d0/da/d39/lbd 0 2024-04-27T07:33:37.075 INFO:tasks.workunit.client.0.smithi082.stdout:1/966: stat d4/d15/d49/d99/de8/l14b 0 2024-04-27T07:33:37.075 INFO:tasks.workunit.client.1.smithi100.stdout:9/451: fsync d1/d9/db/d2b/d31/d9f/f7c 0 2024-04-27T07:33:37.076 INFO:tasks.workunit.client.0.smithi082.stdout:1/967: chown d4/d15/d49/dab/dc3/d4c/d7a/d8c/c10a 32987 1 2024-04-27T07:33:37.076 INFO:tasks.workunit.client.1.smithi100.stdout:0/530: fsync d1/d38/d3a/d54/f93 0 2024-04-27T07:33:37.077 INFO:tasks.workunit.client.1.smithi100.stdout:4/557: dread d5/d16/d19/d21/f41 [4194304,4194304] 0 2024-04-27T07:33:37.077 INFO:tasks.workunit.client.1.smithi100.stdout:6/599: chown de/d58/d21/d24/d9f 2710354 1 2024-04-27T07:33:37.078 INFO:tasks.workunit.client.0.smithi082.stdout:1/968: read d4/d15/d49/dab/dc3/d4c/d7a/f80 [1077689,66631] 0 2024-04-27T07:33:37.078 INFO:tasks.workunit.client.1.smithi100.stdout:6/600: chown de/d58/d28/l3a 2140970 1 2024-04-27T07:33:37.079 INFO:tasks.workunit.client.1.smithi100.stdout:6/601: readlink de/d2e/l45 0 2024-04-27T07:33:37.079 INFO:tasks.workunit.client.1.smithi100.stdout:0/531: fdatasync d1/d8/d20/d61/d6a/f70 0 2024-04-27T07:33:37.080 INFO:tasks.workunit.client.0.smithi082.stdout:1/969: symlink d4/d15/d49/dab/dc3/d3e/d57/d101/d6d/db7/l14c 0 2024-04-27T07:33:37.082 INFO:tasks.workunit.client.0.smithi082.stdout:1/970: mkdir d4/d15/d29/d14d 0 2024-04-27T07:33:37.083 INFO:tasks.workunit.client.1.smithi100.stdout:6/602: dread de/d58/f7c [0,4194304] 0 2024-04-27T07:33:37.083 INFO:tasks.workunit.client.1.smithi100.stdout:9/452: symlink d1/d9/db/d2b/d31/d9f/d54/d61/d9b/d92/la2 0 2024-04-27T07:33:37.084 INFO:tasks.workunit.client.1.smithi100.stdout:4/558: creat d5/d23/fc4 x:0 0 0 2024-04-27T07:33:37.086 INFO:tasks.workunit.client.1.smithi100.stdout:0/532: creat d1/d8/d14/d59/d99/fb8 x:0 0 0 2024-04-27T07:33:37.087 INFO:tasks.workunit.client.0.smithi082.stdout:1/971: dwrite d4/d15/d49/d99/de8/f133 [0,4194304] 0 2024-04-27T07:33:37.088 INFO:tasks.workunit.client.1.smithi100.stdout:0/533: truncate d1/d38/d3a/d54/f93 458564 0 2024-04-27T07:33:37.088 INFO:tasks.workunit.client.1.smithi100.stdout:6/603: creat de/d58/d21/d91/fd1 x:0 0 0 2024-04-27T07:33:37.089 INFO:tasks.workunit.client.1.smithi100.stdout:6/604: stat de/d58/d21/d23 0 2024-04-27T07:33:37.089 INFO:tasks.workunit.client.0.smithi082.stdout:1/972: dread d4/d15/d49/dab/dc3/d4c/d7a/fc8 [0,4194304] 0 2024-04-27T07:33:37.090 INFO:tasks.workunit.client.1.smithi100.stdout:0/534: fsync d1/d8/d14/d59/fb5 0 2024-04-27T07:33:37.090 INFO:tasks.workunit.client.1.smithi100.stdout:4/559: write d5/d16/d19/d46/f81 [2953067,318] 0 2024-04-27T07:33:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:36 smithi082 ceph-mon[26613]: pgmap v24: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 117 MiB/s rd, 330 MiB/s wr, 646 op/s 2024-04-27T07:33:37.093 INFO:tasks.workunit.client.1.smithi100.stdout:9/453: getdents d1/d9/db 0 2024-04-27T07:33:37.093 INFO:tasks.workunit.client.1.smithi100.stdout:6/605: fdatasync de/d2e/d86/f9a 0 2024-04-27T07:33:37.094 INFO:tasks.workunit.client.1.smithi100.stdout:9/454: dread - d1/f26 zero size 2024-04-27T07:33:37.095 INFO:tasks.workunit.client.1.smithi100.stdout:6/606: dread - de/d2e/d86/f9a zero size 2024-04-27T07:33:37.096 INFO:tasks.workunit.client.1.smithi100.stdout:0/535: symlink d1/d38/dae/lb9 0 2024-04-27T07:33:37.100 INFO:tasks.workunit.client.1.smithi100.stdout:6/607: unlink de/f17 0 2024-04-27T07:33:37.101 INFO:tasks.workunit.client.0.smithi082.stdout:1/973: dwrite d4/d15/d49/dab/dc3/d3e/d57/d101/d97/ffb [0,4194304] 0 2024-04-27T07:33:37.102 INFO:tasks.workunit.client.0.smithi082.stdout:1/974: chown d4/d15/d49/dab/dc3/d3e/d57/da5/lb1 1 1 2024-04-27T07:33:37.104 INFO:tasks.workunit.client.0.smithi082.stdout:1/975: dread - d4/d15/d1c/fa2 zero size 2024-04-27T07:33:37.105 INFO:tasks.workunit.client.1.smithi100.stdout:0/536: dwrite d1/d8/d14/d59/fb5 [0,4194304] 0 2024-04-27T07:33:37.105 INFO:tasks.workunit.client.0.smithi082.stdout:1/976: dread - d4/d15/d49/d99/de8/d102/f120 zero size 2024-04-27T07:33:37.105 INFO:tasks.workunit.client.1.smithi100.stdout:6/608: dread de/d58/d21/d23/f82 [0,4194304] 0 2024-04-27T07:33:37.106 INFO:tasks.workunit.client.1.smithi100.stdout:0/537: stat d1/d38/fa7 0 2024-04-27T07:33:37.107 INFO:tasks.workunit.client.0.smithi082.stdout:1/977: creat d4/d15/d49/dab/dc3/d4c/d7a/d8c/f14e x:0 0 0 2024-04-27T07:33:37.108 INFO:tasks.workunit.client.0.smithi082.stdout:1/978: write d4/d15/d49/dab/dc3/d3e/d57/d101/d97/ffb [476815,52713] 0 2024-04-27T07:33:37.112 INFO:tasks.workunit.client.1.smithi100.stdout:6/609: mknod de/d2e/d86/cd2 0 2024-04-27T07:33:37.114 INFO:tasks.workunit.client.1.smithi100.stdout:0/538: fdatasync d1/d8/d14/d59/d99/fad 0 2024-04-27T07:33:37.115 INFO:tasks.workunit.client.1.smithi100.stdout:6/610: read de/d58/d28/f30 [151263,14225] 0 2024-04-27T07:33:37.115 INFO:tasks.workunit.client.1.smithi100.stdout:9/455: write d1/d9/d1f/f3c [1988463,62007] 0 2024-04-27T07:33:37.116 INFO:tasks.workunit.client.1.smithi100.stdout:0/539: chown d1/d8/d20/f4b 138 1 2024-04-27T07:33:37.117 INFO:tasks.workunit.client.1.smithi100.stdout:9/456: chown d1/d9/db/d2b/l2f 6049738 1 2024-04-27T07:33:37.118 INFO:tasks.workunit.client.1.smithi100.stdout:6/611: symlink de/d58/d21/ld3 0 2024-04-27T07:33:37.118 INFO:tasks.workunit.client.1.smithi100.stdout:0/540: write d1/d8/d20/f37 [2389955,72138] 0 2024-04-27T07:33:37.119 INFO:tasks.workunit.client.1.smithi100.stdout:0/541: fsync d1/d8/d20/f74 0 2024-04-27T07:33:37.121 INFO:tasks.workunit.client.1.smithi100.stdout:6/612: readlink de/d58/d21/d5b/l5f 0 2024-04-27T07:33:37.124 INFO:tasks.workunit.client.1.smithi100.stdout:6/613: read - de/d2e/d3f/d80/fcb zero size 2024-04-27T07:33:37.126 INFO:tasks.workunit.client.1.smithi100.stdout:4/560: dread d5/d16/d4c/f7c [0,4194304] 0 2024-04-27T07:33:37.128 INFO:tasks.workunit.client.1.smithi100.stdout:9/457: dwrite d1/d9/db/d2b/f7d [0,4194304] 0 2024-04-27T07:33:37.130 INFO:tasks.workunit.client.1.smithi100.stdout:0/542: dwrite d1/d8/d20/f3b [0,4194304] 0 2024-04-27T07:33:37.133 INFO:tasks.workunit.client.1.smithi100.stdout:4/561: creat d5/d1b/d2c/d7d/fc5 x:0 0 0 2024-04-27T07:33:37.134 INFO:tasks.workunit.client.1.smithi100.stdout:9/458: truncate d1/d9/db/d2b/d31/d9f/d54/d61/d9b/f90 616593 0 2024-04-27T07:33:37.135 INFO:tasks.workunit.client.1.smithi100.stdout:4/562: stat d5/d16/d19/d46/d53/f92 0 2024-04-27T07:33:37.136 INFO:tasks.workunit.client.1.smithi100.stdout:6/614: creat de/d58/d21/d24/fd4 x:0 0 0 2024-04-27T07:33:37.138 INFO:tasks.workunit.client.1.smithi100.stdout:9/459: chown d1/d9/db/d2b/d31/d9f/d54/d61/d9b/f90 2 1 2024-04-27T07:33:37.140 INFO:tasks.workunit.client.1.smithi100.stdout:4/563: mkdir d5/d1b/d65/dc6 0 2024-04-27T07:33:37.141 INFO:tasks.workunit.client.1.smithi100.stdout:6/615: creat de/d2e/fd5 x:0 0 0 2024-04-27T07:33:37.142 INFO:tasks.workunit.client.1.smithi100.stdout:4/564: read d5/d16/d19/d46/f81 [1075297,103567] 0 2024-04-27T07:33:37.144 INFO:tasks.workunit.client.1.smithi100.stdout:9/460: mkdir d1/d9/db/d2b/d4f/da3 0 2024-04-27T07:33:37.145 INFO:tasks.workunit.client.1.smithi100.stdout:6/616: mknod de/d9b/cd6 0 2024-04-27T07:33:37.146 INFO:tasks.workunit.client.0.smithi082.stdout:1/979: dread d4/d15/d49/dab/dc3/d3e/d53/d72/d114/d129/f149 [0,4194304] 0 2024-04-27T07:33:37.147 INFO:tasks.workunit.client.1.smithi100.stdout:4/565: rmdir d5/d1b/d2c/d3f 39 2024-04-27T07:33:37.148 INFO:tasks.workunit.client.0.smithi082.stdout:1/980: rmdir d4/d15/d49/d99/d9a 39 2024-04-27T07:33:37.149 INFO:tasks.workunit.client.0.smithi082.stdout:1/981: truncate d4/d15/d49/d99/de8/f135 243470 0 2024-04-27T07:33:37.150 INFO:tasks.workunit.client.1.smithi100.stdout:6/617: mknod de/d58/d21/d23/cd7 0 2024-04-27T07:33:37.151 INFO:tasks.workunit.client.1.smithi100.stdout:4/566: mknod d5/d16/d19/d46/d53/d7e/cc7 0 2024-04-27T07:33:37.151 INFO:tasks.workunit.client.1.smithi100.stdout:9/461: dwrite d1/d9/db/d2b/d31/f63 [0,4194304] 0 2024-04-27T07:33:37.152 INFO:tasks.workunit.client.0.smithi082.stdout:1/982: fdatasync d4/d15/d49/d99/d9a/dc7/df9/f100 0 2024-04-27T07:33:37.154 INFO:tasks.workunit.client.0.smithi082.stdout:1/983: write d4/d15/d49/dab/dc3/d3e/d57/d101/ffe [2361897,97816] 0 2024-04-27T07:33:37.155 INFO:tasks.workunit.client.0.smithi082.stdout:9/948: sync 2024-04-27T07:33:37.156 INFO:tasks.workunit.client.1.smithi100.stdout:4/567: chown d5/d1b/d2c/d7d/c24 20 1 2024-04-27T07:33:37.156 INFO:tasks.workunit.client.0.smithi082.stdout:1/984: rmdir d4/d15/d49/dab/dc3/d3e/d53/d72/d114/d129 39 2024-04-27T07:33:37.156 INFO:tasks.workunit.client.1.smithi100.stdout:0/543: dwrite d1/d30/f9d [0,4194304] 0 2024-04-27T07:33:37.158 INFO:tasks.workunit.client.1.smithi100.stdout:4/568: readlink d5/d16/d2e/l55 0 2024-04-27T07:33:37.158 INFO:tasks.workunit.client.0.smithi082.stdout:9/949: stat d9/da/dc/d33/d5e/l11a 0 2024-04-27T07:33:37.159 INFO:tasks.workunit.client.1.smithi100.stdout:9/462: symlink d1/d9/db/d2b/la4 0 2024-04-27T07:33:37.160 INFO:tasks.workunit.client.0.smithi082.stdout:1/985: mkdir d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/d14f 0 2024-04-27T07:33:37.161 INFO:tasks.workunit.client.0.smithi082.stdout:9/950: creat d9/d2d/d2b/d46/d5d/f13a x:0 0 0 2024-04-27T07:33:37.164 INFO:tasks.workunit.client.0.smithi082.stdout:1/986: mkdir d4/d15/d49/dab/dc3/d3e/d57/d101/d97/dd1/d150 0 2024-04-27T07:33:37.164 INFO:tasks.workunit.client.1.smithi100.stdout:4/569: dread d5/d16/d4c/f7c [4194304,4194304] 0 2024-04-27T07:33:37.165 INFO:tasks.workunit.client.1.smithi100.stdout:0/544: symlink d1/d38/d3a/lba 0 2024-04-27T07:33:37.166 INFO:tasks.workunit.client.0.smithi082.stdout:9/951: mknod d9/da/dc/d35/d38/c13b 0 2024-04-27T07:33:37.167 INFO:tasks.workunit.client.0.smithi082.stdout:9/952: truncate d9/d48/ffb 523567 0 2024-04-27T07:33:37.167 INFO:tasks.workunit.client.1.smithi100.stdout:0/545: write d1/d8/d20/f37 [2541615,124113] 0 2024-04-27T07:33:37.168 INFO:tasks.workunit.client.1.smithi100.stdout:4/570: rmdir d5/d1b/d2c/d50 39 2024-04-27T07:33:37.169 INFO:tasks.workunit.client.1.smithi100.stdout:6/618: dwrite de/d58/d21/d24/d9f/fc1 [0,4194304] 0 2024-04-27T07:33:37.170 INFO:tasks.workunit.client.0.smithi082.stdout:9/953: creat d9/da/dc/d33/d5e/d136/f13c x:0 0 0 2024-04-27T07:33:37.171 INFO:tasks.workunit.client.0.smithi082.stdout:9/954: fsync d9/da/d85/fc8 0 2024-04-27T07:33:37.173 INFO:tasks.workunit.client.0.smithi082.stdout:9/955: creat d9/d2d/d2b/d46/d5d/f13d x:0 0 0 2024-04-27T07:33:37.176 INFO:tasks.workunit.client.0.smithi082.stdout:9/956: rename d9/d2d/fec to d9/d2d/d2b/d46/d76/f13e 0 2024-04-27T07:33:37.178 INFO:tasks.workunit.client.0.smithi082.stdout:9/957: mkdir d9/da/d13f 0 2024-04-27T07:33:37.178 INFO:tasks.workunit.client.1.smithi100.stdout:4/571: dwrite d5/f10 [4194304,4194304] 0 2024-04-27T07:33:37.180 INFO:tasks.workunit.client.1.smithi100.stdout:4/572: truncate d5/d16/d19/d46/d53/d7e/fa9 776913 0 2024-04-27T07:33:37.192 INFO:tasks.workunit.client.1.smithi100.stdout:9/463: dread d1/d9/f25 [4194304,4194304] 0 2024-04-27T07:33:37.196 INFO:tasks.workunit.client.1.smithi100.stdout:9/464: dwrite d1/d9/d1f/f68 [0,4194304] 0 2024-04-27T07:33:37.206 INFO:tasks.workunit.client.1.smithi100.stdout:7/551: sync 2024-04-27T07:33:37.211 INFO:tasks.workunit.client.1.smithi100.stdout:9/465: mkdir d1/da5 0 2024-04-27T07:33:37.216 INFO:tasks.workunit.client.1.smithi100.stdout:7/552: truncate d1/dd/d2a/f68 1610117 0 2024-04-27T07:33:37.243 INFO:tasks.workunit.client.1.smithi100.stdout:0/546: truncate d1/d8/d20/d61/d6a/f97 7307099 0 2024-04-27T07:33:37.244 INFO:tasks.workunit.client.1.smithi100.stdout:6/619: truncate de/d58/d75/f8d 3079187 0 2024-04-27T07:33:37.244 INFO:tasks.workunit.client.1.smithi100.stdout:0/547: chown d1/d8/d14/d59/c5e 1 1 2024-04-27T07:33:37.245 INFO:tasks.workunit.client.0.smithi082.stdout:9/958: truncate d9/da/dc/d35/d38/fc9 1083961 0 2024-04-27T07:33:37.246 INFO:tasks.workunit.client.1.smithi100.stdout:9/466: write d1/f26 [936987,118100] 0 2024-04-27T07:33:37.247 INFO:tasks.workunit.client.1.smithi100.stdout:7/553: write d1/dd/d16/d70/f79 [509075,27338] 0 2024-04-27T07:33:37.248 INFO:tasks.workunit.client.1.smithi100.stdout:6/620: truncate de/d58/d21/f83 34458 0 2024-04-27T07:33:37.249 INFO:tasks.workunit.client.0.smithi082.stdout:9/959: getdents d9/da/dc 0 2024-04-27T07:33:37.251 INFO:tasks.workunit.client.1.smithi100.stdout:4/573: dwrite d5/f6 [0,4194304] 0 2024-04-27T07:33:37.252 INFO:tasks.workunit.client.0.smithi082.stdout:9/960: symlink d9/da/dc/d35/d38/dd8/l140 0 2024-04-27T07:33:37.253 INFO:tasks.workunit.client.1.smithi100.stdout:9/467: mknod d1/d9/db/d2b/d4f/d91/ca6 0 2024-04-27T07:33:37.253 INFO:tasks.workunit.client.0.smithi082.stdout:9/961: creat d9/da/dc/d88/da8/f141 x:0 0 0 2024-04-27T07:33:37.254 INFO:tasks.workunit.client.1.smithi100.stdout:9/468: readlink d1/d9/db/d2b/d31/l45 0 2024-04-27T07:33:37.254 INFO:tasks.workunit.client.1.smithi100.stdout:7/554: mkdir d1/dd/d16/d3e/d8b/da4 0 2024-04-27T07:33:37.254 INFO:tasks.workunit.client.0.smithi082.stdout:9/962: dread - d9/da/dc/d35/d38/dc5/f12f zero size 2024-04-27T07:33:37.255 INFO:tasks.workunit.client.1.smithi100.stdout:9/469: readlink d1/d9/d1f/d4a/d67/l8d 0 2024-04-27T07:33:37.256 INFO:tasks.workunit.client.0.smithi082.stdout:9/963: creat d9/d2d/d2b/d46/d76/dcb/f142 x:0 0 0 2024-04-27T07:33:37.256 INFO:tasks.workunit.client.1.smithi100.stdout:4/574: mknod d5/d16/d2e/d5a/cc8 0 2024-04-27T07:33:37.257 INFO:tasks.workunit.client.1.smithi100.stdout:6/621: rename de/d58/d21/d23/d73/lb5 to de/d58/d21/d24/d9f/ld8 0 2024-04-27T07:33:37.260 INFO:tasks.workunit.client.1.smithi100.stdout:9/470: creat d1/d9/db/d2b/d31/d9f/fa7 x:0 0 0 2024-04-27T07:33:37.261 INFO:tasks.workunit.client.1.smithi100.stdout:6/622: fsync de/d58/d21/f49 0 2024-04-27T07:33:37.262 INFO:tasks.workunit.client.0.smithi082.stdout:9/964: write d9/da/d85/f122 [1023061,84908] 0 2024-04-27T07:33:37.263 INFO:tasks.workunit.client.1.smithi100.stdout:7/555: unlink d1/fc 0 2024-04-27T07:33:37.264 INFO:tasks.workunit.client.1.smithi100.stdout:9/471: fsync d1/d9/db/d2b/d31/d9f/d54/f95 0 2024-04-27T07:33:37.264 INFO:tasks.workunit.client.0.smithi082.stdout:9/965: fsync d9/da/dc/f1b 0 2024-04-27T07:33:37.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/966: write d9/d2d/f68 [4101815,58602] 0 2024-04-27T07:33:37.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/967: stat d9/da/dc/d35/d4a/d7e/ce5 0 2024-04-27T07:33:37.266 INFO:tasks.workunit.client.0.smithi082.stdout:9/968: read - d9/da/db0/f132 zero size 2024-04-27T07:33:37.268 INFO:tasks.workunit.client.0.smithi082.stdout:9/969: creat d9/d2d/d2b/d46/d5d/da7/f143 x:0 0 0 2024-04-27T07:33:37.268 INFO:tasks.workunit.client.1.smithi100.stdout:6/623: unlink de/d58/d21/l40 0 2024-04-27T07:33:37.270 INFO:tasks.workunit.client.0.smithi082.stdout:9/970: mknod d9/da/dc/d35/d4a/d50/c144 0 2024-04-27T07:33:37.271 INFO:tasks.workunit.client.1.smithi100.stdout:9/472: rename d1/d9/db/d2b/l3b to d1/d9/db/d2b/d31/d9f/d54/d61/d9b/d92/la8 0 2024-04-27T07:33:37.273 INFO:tasks.workunit.client.1.smithi100.stdout:7/556: dwrite d1/dd/d16/d31/f60 [0,4194304] 0 2024-04-27T07:33:37.275 INFO:tasks.workunit.client.1.smithi100.stdout:9/473: symlink d1/d76/la9 0 2024-04-27T07:33:37.277 INFO:tasks.workunit.client.0.smithi082.stdout:9/971: dread f5 [0,4194304] 0 2024-04-27T07:33:37.280 INFO:tasks.workunit.client.0.smithi082.stdout:9/972: mknod d9/da/dc/d33/d5e/d136/c145 0 2024-04-27T07:33:37.281 INFO:tasks.workunit.client.1.smithi100.stdout:6/624: link de/d58/d21/f61 de/d58/d21/d24/d9f/db9/fd9 0 2024-04-27T07:33:37.283 INFO:tasks.workunit.client.1.smithi100.stdout:6/625: read de/d58/f71 [346630,21880] 0 2024-04-27T07:33:37.284 INFO:tasks.workunit.client.1.smithi100.stdout:4/575: write d5/d16/d19/f30 [836641,85584] 0 2024-04-27T07:33:37.286 INFO:tasks.workunit.client.0.smithi082.stdout:9/973: dwrite d9/da/dc/d33/f89 [0,4194304] 0 2024-04-27T07:33:37.287 INFO:tasks.workunit.client.1.smithi100.stdout:6/626: creat de/d58/d21/d5b/fda x:0 0 0 2024-04-27T07:33:37.288 INFO:tasks.workunit.client.1.smithi100.stdout:7/557: link d1/l69 d1/dd/d16/d2b/la5 0 2024-04-27T07:33:37.290 INFO:tasks.workunit.client.1.smithi100.stdout:6/627: mknod de/d58/d21/d23/cdb 0 2024-04-27T07:33:37.291 INFO:tasks.workunit.client.0.smithi082.stdout:9/974: rename d9/d2d/d72/fe8 to d9/da/db0/f146 0 2024-04-27T07:33:37.292 INFO:tasks.workunit.client.0.smithi082.stdout:9/975: dread - d9/da/dc/d35/d38/dc5/fe4 zero size 2024-04-27T07:33:37.294 INFO:tasks.workunit.client.0.smithi082.stdout:1/987: sync 2024-04-27T07:33:37.294 INFO:tasks.workunit.client.1.smithi100.stdout:7/558: write d1/dd/d2a/f93 [877716,56486] 0 2024-04-27T07:33:37.295 INFO:tasks.workunit.client.0.smithi082.stdout:9/976: unlink d9/da/dc/d35/d4a/f84 0 2024-04-27T07:33:37.295 INFO:tasks.workunit.client.1.smithi100.stdout:6/628: symlink de/d58/d21/d24/d9f/ldc 0 2024-04-27T07:33:37.295 INFO:tasks.workunit.client.1.smithi100.stdout:7/559: chown d1/dd/d16/d70/d51/d6f 292466098 1 2024-04-27T07:33:37.296 INFO:tasks.workunit.client.1.smithi100.stdout:6/629: fsync de/d2e/fd5 0 2024-04-27T07:33:37.296 INFO:tasks.workunit.client.0.smithi082.stdout:1/988: mkdir d4/d15/d49/d99/d9a/dc7/d151 0 2024-04-27T07:33:37.297 INFO:tasks.workunit.client.0.smithi082.stdout:1/989: stat d4/d15/d49/dab/dc3/d3e/d57/f77 0 2024-04-27T07:33:37.298 INFO:tasks.workunit.client.1.smithi100.stdout:4/576: getdents d5/d1b/d65 0 2024-04-27T07:33:37.298 INFO:tasks.workunit.client.1.smithi100.stdout:4/577: chown d5/f82 14 1 2024-04-27T07:33:37.299 INFO:tasks.workunit.client.0.smithi082.stdout:9/977: rename d9/da/dc/d88 to d9/da/dc/db1/d147 0 2024-04-27T07:33:37.300 INFO:tasks.workunit.client.1.smithi100.stdout:7/560: rmdir d1/dd/d16/d31/d4c 39 2024-04-27T07:33:37.300 INFO:tasks.workunit.client.0.smithi082.stdout:1/990: getdents d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/d14f 0 2024-04-27T07:33:37.300 INFO:tasks.workunit.client.1.smithi100.stdout:7/561: chown d1/dd/d2a/c63 2146 1 2024-04-27T07:33:37.301 INFO:tasks.workunit.client.1.smithi100.stdout:7/562: write d1/dd/f47 [8110197,35875] 0 2024-04-27T07:33:37.302 INFO:tasks.workunit.client.0.smithi082.stdout:1/991: rmdir d4/d15/d49/dab/dc3/d3e/d53/d72/d114 39 2024-04-27T07:33:37.303 INFO:tasks.workunit.client.1.smithi100.stdout:4/578: symlink d5/d16/d2e/lc9 0 2024-04-27T07:33:37.304 INFO:tasks.workunit.client.1.smithi100.stdout:9/474: truncate d1/d9/db/d2b/f36 4230209 0 2024-04-27T07:33:37.307 INFO:tasks.workunit.client.1.smithi100.stdout:7/563: read d1/d54/f61 [821772,34110] 0 2024-04-27T07:33:37.308 INFO:tasks.workunit.client.1.smithi100.stdout:7/564: write d1/dd/d16/f66 [4660903,40662] 0 2024-04-27T07:33:37.309 INFO:tasks.workunit.client.1.smithi100.stdout:7/565: chown d1/dd/d16/d3e/f7c 22974 1 2024-04-27T07:33:37.309 INFO:tasks.workunit.client.1.smithi100.stdout:9/475: rename d1/d9/db/d2b/d4f/d91/da0 to d1/d9/d1f/d4a/daa 0 2024-04-27T07:33:37.310 INFO:tasks.workunit.client.1.smithi100.stdout:7/566: fdatasync d1/dd/f47 0 2024-04-27T07:33:37.310 INFO:tasks.workunit.client.1.smithi100.stdout:9/476: stat d1/d9/db/d56/f83 0 2024-04-27T07:33:37.311 INFO:tasks.workunit.client.1.smithi100.stdout:7/567: stat d1/dd/d2a/d2c/f43 0 2024-04-27T07:33:37.311 INFO:tasks.workunit.client.1.smithi100.stdout:4/579: mkdir d5/d16/d19/dca 0 2024-04-27T07:33:37.314 INFO:tasks.workunit.client.1.smithi100.stdout:9/477: chown d1/f22 297795203 1 2024-04-27T07:33:37.314 INFO:tasks.workunit.client.0.smithi082.stdout:9/978: mkdir d9/da/dc/d35/d38/dd8/d148 0 2024-04-27T07:33:37.315 INFO:tasks.workunit.client.1.smithi100.stdout:4/580: rename d5/d16/d4c/l78 to d5/d1b/d65/lcb 0 2024-04-27T07:33:37.315 INFO:tasks.workunit.client.1.smithi100.stdout:9/478: rmdir d1/d9/d1f/d4a/d67/d8a 39 2024-04-27T07:33:37.316 INFO:tasks.workunit.client.1.smithi100.stdout:4/581: write d5/d23/d33/fa7 [2119958,34382] 0 2024-04-27T07:33:37.316 INFO:tasks.workunit.client.0.smithi082.stdout:9/979: mknod d9/da/dc/d73/c149 0 2024-04-27T07:33:37.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/980: dread - d9/da/dc/f10d zero size 2024-04-27T07:33:37.318 INFO:tasks.workunit.client.1.smithi100.stdout:4/582: truncate d5/d16/d19/d46/d53/f98 200220 0 2024-04-27T07:33:37.319 INFO:tasks.workunit.client.1.smithi100.stdout:9/479: creat d1/d9/db/d2b/fab x:0 0 0 2024-04-27T07:33:37.320 INFO:tasks.workunit.client.1.smithi100.stdout:4/583: stat d5/d23/l36 0 2024-04-27T07:33:37.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/981: truncate d9/da/dc/d35/d38/fc9 9645 0 2024-04-27T07:33:37.322 INFO:tasks.workunit.client.0.smithi082.stdout:1/992: dread d4/d15/d49/dab/dc3/d3e/d57/d101/f67 [0,4194304] 0 2024-04-27T07:33:37.323 INFO:tasks.workunit.client.0.smithi082.stdout:1/993: write d4/d15/d49/d99/de8/f133 [3341142,49481] 0 2024-04-27T07:33:37.326 INFO:tasks.workunit.client.0.smithi082.stdout:1/994: mkdir d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/d152 0 2024-04-27T07:33:37.327 INFO:tasks.workunit.client.0.smithi082.stdout:1/995: chown d4/d15/d29/l64 122049 1 2024-04-27T07:33:37.330 INFO:tasks.workunit.client.0.smithi082.stdout:1/996: mkdir d4/d15/d49/d99/de8/d102/d12b/d153 0 2024-04-27T07:33:37.334 INFO:tasks.workunit.client.0.smithi082.stdout:1/997: creat d4/d15/d49/dab/dc3/d3e/d53/d72/f154 x:0 0 0 2024-04-27T07:33:37.337 INFO:tasks.workunit.client.1.smithi100.stdout:9/480: dwrite d1/f29 [0,4194304] 0 2024-04-27T07:33:37.337 INFO:tasks.workunit.client.1.smithi100.stdout:4/584: dwrite d5/d1b/d2c/d3f/f57 [0,4194304] 0 2024-04-27T07:33:37.343 INFO:tasks.workunit.client.1.smithi100.stdout:4/585: mknod d5/d16/d19/d46/d53/d7e/ccc 0 2024-04-27T07:33:37.346 INFO:tasks.workunit.client.0.smithi082.stdout:1/998: dread d4/f11 [0,4194304] 0 2024-04-27T07:33:37.347 INFO:tasks.workunit.client.1.smithi100.stdout:9/481: rename d1/d9/db/d2b/d31/d9f to d1/d9/db/d2b/d4f/dac 0 2024-04-27T07:33:37.348 INFO:tasks.workunit.client.1.smithi100.stdout:9/482: chown d1/d76/l82 7132 1 2024-04-27T07:33:37.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/982: dread d9/da/dc/f2a [0,4194304] 0 2024-04-27T07:33:37.349 INFO:tasks.workunit.client.1.smithi100.stdout:4/586: creat d5/d16/fcd x:0 0 0 2024-04-27T07:33:37.350 INFO:tasks.workunit.client.1.smithi100.stdout:4/587: chown d5/d1b/d2c/d3f 39379227 1 2024-04-27T07:33:37.350 INFO:tasks.workunit.client.0.smithi082.stdout:1/999: symlink d4/d15/d49/dab/dc3/d4c/d7a/d8c/d117/d14f/l155 0 2024-04-27T07:33:37.351 INFO:tasks.workunit.client.1.smithi100.stdout:9/483: creat d1/d9/db/fad x:0 0 0 2024-04-27T07:33:37.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/983: mkdir d9/da/dc/d73/dbb/d14a 0 2024-04-27T07:33:37.354 INFO:tasks.workunit.client.1.smithi100.stdout:4/588: creat d5/d1b/d65/dc6/fce x:0 0 0 2024-04-27T07:33:37.355 INFO:tasks.workunit.client.1.smithi100.stdout:4/589: chown d5/d1b/d65/dc6 20269576 1 2024-04-27T07:33:37.355 INFO:tasks.workunit.client.1.smithi100.stdout:4/590: readlink d5/d16/d4c/l9e 0 2024-04-27T07:33:37.356 INFO:tasks.workunit.client.0.smithi082.stdout:9/984: creat d9/da/dc/d35/d38/f14b x:0 0 0 2024-04-27T07:33:37.357 INFO:tasks.workunit.client.0.smithi082.stdout:9/985: chown d9/da/dc/d35/d38/d65/f7f 62913 1 2024-04-27T07:33:37.359 INFO:tasks.workunit.client.1.smithi100.stdout:4/591: creat d5/d1b/d2c/d50/db0/fcf x:0 0 0 2024-04-27T07:33:37.360 INFO:tasks.workunit.client.0.smithi082.stdout:9/986: unlink d9/da/dc/lcd 0 2024-04-27T07:33:37.363 INFO:tasks.workunit.client.1.smithi100.stdout:9/484: dwrite d1/f30 [0,4194304] 0 2024-04-27T07:33:37.367 INFO:tasks.workunit.client.1.smithi100.stdout:5/446: sync 2024-04-27T07:33:37.367 INFO:tasks.workunit.client.1.smithi100.stdout:9/485: chown d1/d9/db/f93 15 1 2024-04-27T07:33:37.371 INFO:tasks.workunit.client.1.smithi100.stdout:9/486: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/fae x:0 0 0 2024-04-27T07:33:37.372 INFO:tasks.workunit.client.0.smithi082.stdout:9/987: dwrite d9/da/dc/d35/d4a/d50/fc2 [0,4194304] 0 2024-04-27T07:33:37.373 INFO:tasks.workunit.client.1.smithi100.stdout:9/487: readlink d1/d9/db/d2b/l2f 0 2024-04-27T07:33:37.374 INFO:tasks.workunit.client.1.smithi100.stdout:5/447: dwrite d0/d4/d21/d24/d2f/d39/d56/f64 [0,4194304] 0 2024-04-27T07:33:37.379 INFO:tasks.workunit.client.1.smithi100.stdout:9/488: creat d1/d9/db/d2b/d4f/da3/faf x:0 0 0 2024-04-27T07:33:37.380 INFO:tasks.workunit.client.1.smithi100.stdout:9/489: fdatasync d1/d9/db/d2b/d4f/dac/f81 0 2024-04-27T07:33:37.386 INFO:tasks.workunit.client.1.smithi100.stdout:9/490: dwrite d1/d9/db/f4e [0,4194304] 0 2024-04-27T07:33:37.388 INFO:tasks.workunit.client.1.smithi100.stdout:9/491: dread - d1/d9/db/f51 zero size 2024-04-27T07:33:37.397 INFO:tasks.workunit.client.1.smithi100.stdout:9/492: dwrite d1/d9/db/d2b/fab [0,4194304] 0 2024-04-27T07:33:37.403 INFO:tasks.workunit.client.1.smithi100.stdout:9/493: getdents d1/d9/db/d2b/d4f/dac/d54/d61/d9b 0 2024-04-27T07:33:37.403 INFO:tasks.workunit.client.0.smithi082.stdout:9/988: dwrite d9/da/dc/f1b [4194304,4194304] 0 2024-04-27T07:33:37.405 INFO:tasks.workunit.client.1.smithi100.stdout:9/494: mknod d1/d9/cb0 0 2024-04-27T07:33:37.408 INFO:tasks.workunit.client.1.smithi100.stdout:9/495: mkdir d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1 0 2024-04-27T07:33:37.408 INFO:tasks.workunit.client.0.smithi082.stdout:9/989: symlink d9/da/dc/d35/d38/da5/l14c 0 2024-04-27T07:33:37.409 INFO:tasks.workunit.client.0.smithi082.stdout:9/990: dread - d9/d48/dd6/f12d zero size 2024-04-27T07:33:37.411 INFO:tasks.workunit.client.0.smithi082.stdout:9/991: chown d9/da/dc/db1/d147/c10a 21648 1 2024-04-27T07:33:37.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/992: write f4 [2427435,117243] 0 2024-04-27T07:33:37.470 INFO:tasks.workunit.client.1.smithi100.stdout:5/448: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:37.471 INFO:tasks.workunit.client.1.smithi100.stdout:5/449: readlink d0/d4/d21/d24/d2f/l4a 0 2024-04-27T07:33:37.473 INFO:tasks.workunit.client.1.smithi100.stdout:5/450: chown d0/d4/d21/d24/d2f/d57/d37/d1a 21787 1 2024-04-27T07:33:37.478 INFO:tasks.workunit.client.1.smithi100.stdout:9/496: dwrite d1/d9/db/d2b/d31/f5b [0,4194304] 0 2024-04-27T07:33:37.479 INFO:tasks.workunit.client.1.smithi100.stdout:9/497: stat d1/d9/db/d2b/l4b 0 2024-04-27T07:33:37.489 INFO:tasks.workunit.client.1.smithi100.stdout:9/498: creat d1/d9/db/fb2 x:0 0 0 2024-04-27T07:33:37.494 INFO:tasks.workunit.client.1.smithi100.stdout:9/499: dread d1/d9/db/d2b/d31/f63 [0,4194304] 0 2024-04-27T07:33:37.543 INFO:tasks.workunit.client.1.smithi100.stdout:3/668: sync 2024-04-27T07:33:37.557 INFO:tasks.workunit.client.1.smithi100.stdout:9/500: creat d1/d9/d1f/d4a/d67/d8a/fb3 x:0 0 0 2024-04-27T07:33:37.563 INFO:tasks.workunit.client.1.smithi100.stdout:9/501: mkdir d1/d9/db/da1/db4 0 2024-04-27T07:33:37.574 INFO:tasks.workunit.client.1.smithi100.stdout:3/669: creat d7/d9/d26/d2a/fce x:0 0 0 2024-04-27T07:33:37.575 INFO:tasks.workunit.client.1.smithi100.stdout:3/670: dread - d7/dad/fbf zero size 2024-04-27T07:33:37.575 INFO:tasks.workunit.client.1.smithi100.stdout:3/671: stat d7/d9/d26/d2a/cab 0 2024-04-27T07:33:37.575 INFO:tasks.workunit.client.1.smithi100.stdout:3/672: chown d7/d9/d10/c8e 1734587463 1 2024-04-27T07:33:37.578 INFO:tasks.workunit.client.0.smithi082.stdout:9/993: sync 2024-04-27T07:33:37.579 INFO:tasks.workunit.client.0.smithi082.stdout:9/994: chown d9/da/dc/d73/f95 2 1 2024-04-27T07:33:37.580 INFO:tasks.workunit.client.0.smithi082.stdout:9/995: read d9/d2d/d2b/f34 [1106685,16510] 0 2024-04-27T07:33:37.581 INFO:tasks.workunit.client.0.smithi082.stdout:9/996: fsync d9/da/dc/d33/d103/f123 0 2024-04-27T07:33:37.583 INFO:tasks.workunit.client.0.smithi082.stdout:9/997: mknod d9/da/d13f/c14d 0 2024-04-27T07:33:37.583 INFO:tasks.workunit.client.1.smithi100.stdout:5/451: write d0/d4/d21/f4b [568120,102991] 0 2024-04-27T07:33:37.584 INFO:tasks.workunit.client.0.smithi082.stdout:9/998: mkdir d9/d48/dd6/d14e 0 2024-04-27T07:33:37.587 INFO:tasks.workunit.client.1.smithi100.stdout:5/452: symlink d0/d4/d21/d24/d2f/d57/d37/d48/l90 0 2024-04-27T07:33:37.588 INFO:tasks.workunit.client.1.smithi100.stdout:5/453: dread - d0/d4/d21/d24/d2f/d39/d56/f85 zero size 2024-04-27T07:33:37.589 INFO:tasks.workunit.client.0.smithi082.stdout:9/999: link d9/da/d85/fc4 d9/da/dc/d33/d5e/d127/f14f 0 2024-04-27T07:33:37.592 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm -rf -- ./tmp.10xfbqYoF6 2024-04-27T07:33:37.593 INFO:tasks.workunit.client.1.smithi100.stdout:5/454: dread d0/d4/d21/d24/d2f/d39/d56/d67/f68 [0,4194304] 0 2024-04-27T07:33:37.596 INFO:tasks.workunit.client.1.smithi100.stdout:3/673: write d7/d9/d10/d3e/d74/db1/f92 [972101,40821] 0 2024-04-27T07:33:37.597 INFO:tasks.workunit.client.1.smithi100.stdout:3/674: read - d7/dad/daf/fc6 zero size 2024-04-27T07:33:37.598 INFO:tasks.workunit.client.1.smithi100.stdout:9/502: rename d1/da5 to d1/d9/db/d2b/d4f/dac/d54/d61/d9b/db5 0 2024-04-27T07:33:37.598 INFO:tasks.workunit.client.1.smithi100.stdout:5/455: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:37.599 INFO:tasks.workunit.client.1.smithi100.stdout:9/503: read - d1/d9/db/d2b/d4f/da3/faf zero size 2024-04-27T07:33:37.601 INFO:tasks.workunit.client.1.smithi100.stdout:9/504: dread - d1/d9/db/f6c zero size 2024-04-27T07:33:37.603 INFO:tasks.workunit.client.1.smithi100.stdout:5/456: unlink d0/d4/d21/d24/d2f/d57/d37/d1a/d30/c3b 0 2024-04-27T07:33:37.605 INFO:tasks.workunit.client.1.smithi100.stdout:9/505: symlink d1/d9/db/d2b/d4f/dac/d54/d61/lb6 0 2024-04-27T07:33:37.605 INFO:tasks.workunit.client.1.smithi100.stdout:5/457: write d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 [431298,70403] 0 2024-04-27T07:33:37.606 INFO:tasks.workunit.client.1.smithi100.stdout:5/458: read d0/d4/f11 [2318404,44921] 0 2024-04-27T07:33:37.608 INFO:tasks.workunit.client.1.smithi100.stdout:9/506: creat d1/d9/db/da1/db4/fb7 x:0 0 0 2024-04-27T07:33:37.609 INFO:tasks.workunit.client.1.smithi100.stdout:5/459: dread d0/d4/d21/d24/d2f/d57/f55 [0,4194304] 0 2024-04-27T07:33:37.610 INFO:tasks.workunit.client.1.smithi100.stdout:9/507: write d1/f85 [1034638,57492] 0 2024-04-27T07:33:37.612 INFO:tasks.workunit.client.1.smithi100.stdout:3/675: dwrite d7/d9/d26/f38 [0,4194304] 0 2024-04-27T07:33:37.617 INFO:tasks.workunit.client.1.smithi100.stdout:3/676: unlink d7/d9/da5/ccd 0 2024-04-27T07:33:37.620 INFO:tasks.workunit.client.1.smithi100.stdout:5/460: dwrite d0/d4/d21/d24/d2f/d39/d56/f85 [0,4194304] 0 2024-04-27T07:33:37.623 INFO:tasks.workunit.client.1.smithi100.stdout:3/677: mknod d7/d9/d10/d33/ccf 0 2024-04-27T07:33:37.625 INFO:tasks.workunit.client.1.smithi100.stdout:3/678: write d7/d9/d26/d2a/f82 [294712,113858] 0 2024-04-27T07:33:37.628 INFO:tasks.workunit.client.1.smithi100.stdout:3/679: dread d7/d9/d10/d3e/d74/fb4 [0,4194304] 0 2024-04-27T07:33:37.629 INFO:tasks.workunit.client.1.smithi100.stdout:3/680: chown d7/d9/d10/d3e/d74/db1/d9d/c85 221442 1 2024-04-27T07:33:37.631 INFO:tasks.workunit.client.1.smithi100.stdout:3/681: truncate d7/f1f 2004870 0 2024-04-27T07:33:37.631 INFO:tasks.workunit.client.1.smithi100.stdout:9/508: dread d1/f46 [0,4194304] 0 2024-04-27T07:33:37.631 INFO:tasks.workunit.client.1.smithi100.stdout:5/461: getdents d0/d4/d21/d24/d2f/d39/d56/d67 0 2024-04-27T07:33:37.634 INFO:tasks.workunit.client.1.smithi100.stdout:5/462: creat d0/d4/d21/d24/d2f/d57/f91 x:0 0 0 2024-04-27T07:33:37.639 INFO:tasks.workunit.client.1.smithi100.stdout:9/509: truncate d1/f30 1473692 0 2024-04-27T07:33:37.641 INFO:tasks.workunit.client.1.smithi100.stdout:9/510: creat d1/d9/db/da1/db4/fb8 x:0 0 0 2024-04-27T07:33:37.643 INFO:tasks.workunit.client.1.smithi100.stdout:9/511: unlink d1/d9/db/d2b/d4f/d91/ca6 0 2024-04-27T07:33:37.646 INFO:tasks.workunit.client.1.smithi100.stdout:9/512: link d1/d9/db/d2b/fab d1/fb9 0 2024-04-27T07:33:37.648 INFO:tasks.workunit.client.1.smithi100.stdout:9/513: getdents d1/d9/db/d56/d5c 0 2024-04-27T07:33:37.649 INFO:tasks.workunit.client.1.smithi100.stdout:5/463: dread d0/d4/d21/d24/d2f/f79 [0,4194304] 0 2024-04-27T07:33:37.649 INFO:tasks.workunit.client.1.smithi100.stdout:9/514: fdatasync d1/d9/d1f/f3c 0 2024-04-27T07:33:37.651 INFO:tasks.workunit.client.1.smithi100.stdout:5/464: mkdir d0/d4/d21/d24/d2f/d39/d7c/d92 0 2024-04-27T07:33:37.653 INFO:tasks.workunit.client.1.smithi100.stdout:5/465: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 0 2024-04-27T07:33:37.657 INFO:tasks.workunit.client.1.smithi100.stdout:9/515: dwrite d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f8f [0,4194304] 0 2024-04-27T07:33:37.664 INFO:tasks.workunit.client.1.smithi100.stdout:9/516: write d1/d9/f25 [153289,4019] 0 2024-04-27T07:33:37.664 INFO:tasks.workunit.client.1.smithi100.stdout:9/517: write d1/d9/db/d2b/d4f/f78 [636306,118305] 0 2024-04-27T07:33:37.664 INFO:tasks.workunit.client.1.smithi100.stdout:5/466: rename d0/ce to d0/d4/d21/d24/d2f/d57/d37/d1a/c93 0 2024-04-27T07:33:37.668 INFO:tasks.workunit.client.1.smithi100.stdout:5/467: write d0/d4/d21/d24/d2f/d39/d56/d67/d84/f7a [781134,68913] 0 2024-04-27T07:33:37.673 INFO:tasks.workunit.client.1.smithi100.stdout:5/468: truncate d0/d4/d21/f50 3751613 0 2024-04-27T07:33:37.675 INFO:tasks.workunit.client.1.smithi100.stdout:5/469: unlink d0/f2a 0 2024-04-27T07:33:37.683 INFO:tasks.workunit.client.1.smithi100.stdout:9/518: dread d1/d9/d1f/d4a/f4d [0,4194304] 0 2024-04-27T07:33:37.685 INFO:tasks.workunit.client.1.smithi100.stdout:9/519: dread - d1/d9/db/f51 zero size 2024-04-27T07:33:37.685 INFO:tasks.workunit.client.1.smithi100.stdout:9/520: chown d1/d9/db/d2b/d9c 51108 1 2024-04-27T07:33:37.689 INFO:tasks.workunit.client.1.smithi100.stdout:9/521: link d1/d9/d1f/f68 d1/d9/db/fba 0 2024-04-27T07:33:37.689 INFO:tasks.workunit.client.1.smithi100.stdout:5/470: dread d0/d4/d21/d24/d2f/d57/d37/f1b [0,4194304] 0 2024-04-27T07:33:37.691 INFO:tasks.workunit.client.1.smithi100.stdout:9/522: mknod d1/d9/db/d2b/d31/cbb 0 2024-04-27T07:33:37.693 INFO:tasks.workunit.client.1.smithi100.stdout:5/471: dread d0/d4/d21/d24/d2f/f79 [0,4194304] 0 2024-04-27T07:33:37.695 INFO:tasks.workunit.client.1.smithi100.stdout:5/472: write d0/d4/d21/d24/d2f/f79 [1284777,56449] 0 2024-04-27T07:33:37.697 INFO:tasks.workunit.client.1.smithi100.stdout:5/473: mkdir d0/d42/d94 0 2024-04-27T07:33:37.698 INFO:tasks.workunit.client.1.smithi100.stdout:9/523: dwrite d1/d9/db/d2b/d4f/dac/fa7 [0,4194304] 0 2024-04-27T07:33:37.698 INFO:tasks.workunit.client.1.smithi100.stdout:5/474: stat d0/d42/f81 0 2024-04-27T07:33:37.706 INFO:tasks.workunit.client.1.smithi100.stdout:9/524: creat d1/fbc x:0 0 0 2024-04-27T07:33:37.707 INFO:tasks.workunit.client.1.smithi100.stdout:5/475: write d0/d4/f19 [682968,93040] 0 2024-04-27T07:33:37.716 INFO:tasks.workunit.client.1.smithi100.stdout:5/476: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 [1148421,67910] 0 2024-04-27T07:33:37.717 INFO:tasks.workunit.client.1.smithi100.stdout:5/477: chown d0/d42/d94 40 1 2024-04-27T07:33:37.726 INFO:tasks.workunit.client.1.smithi100.stdout:5/478: symlink d0/d4/d21/d24/d2f/d57/d37/d1a/d31/l95 0 2024-04-27T07:33:37.727 INFO:tasks.workunit.client.1.smithi100.stdout:5/479: write d0/f1d [4552549,87338] 0 2024-04-27T07:33:37.729 INFO:tasks.workunit.client.1.smithi100.stdout:9/525: dread d1/d9/db/d2b/d4f/dac/d54/f95 [0,4194304] 0 2024-04-27T07:33:37.730 INFO:tasks.workunit.client.1.smithi100.stdout:5/480: write d0/d4/d21/d24/d2f/d57/d37/f1b [4688400,69483] 0 2024-04-27T07:33:37.732 INFO:tasks.workunit.client.1.smithi100.stdout:5/481: fsync d0/d4/d21/d24/d2f/d57/f91 0 2024-04-27T07:33:37.733 INFO:tasks.workunit.client.1.smithi100.stdout:9/526: rename d1/d9/db/d2b/d31/f63 to d1/d9/db/d56/fbd 0 2024-04-27T07:33:37.734 INFO:tasks.workunit.client.1.smithi100.stdout:8/508: sync 2024-04-27T07:33:37.735 INFO:tasks.workunit.client.1.smithi100.stdout:9/527: read - d1/d9/d1f/d4a/d67/d8a/fb3 zero size 2024-04-27T07:33:37.736 INFO:tasks.workunit.client.1.smithi100.stdout:8/509: creat d6/d20/d54/f9f x:0 0 0 2024-04-27T07:33:37.736 INFO:tasks.workunit.client.1.smithi100.stdout:9/528: stat d1/d9/db/d2b/d4f/f78 0 2024-04-27T07:33:37.737 INFO:tasks.workunit.client.1.smithi100.stdout:8/510: mknod d6/d20/d2a/ca0 0 2024-04-27T07:33:37.754 INFO:tasks.workunit.client.1.smithi100.stdout:8/511: symlink d6/d1b/d1d/la1 0 2024-04-27T07:33:37.758 INFO:tasks.workunit.client.1.smithi100.stdout:8/512: mkdir d6/d20/da2 0 2024-04-27T07:33:37.758 INFO:tasks.workunit.client.1.smithi100.stdout:5/482: truncate d0/f14 920147 0 2024-04-27T07:33:37.760 INFO:tasks.workunit.client.1.smithi100.stdout:5/483: write d0/d42/f81 [1984338,126445] 0 2024-04-27T07:33:37.767 INFO:tasks.workunit.client.1.smithi100.stdout:9/529: dwrite d1/d9/db/f1e [0,4194304] 0 2024-04-27T07:33:37.770 INFO:tasks.workunit.client.1.smithi100.stdout:8/513: getdents d6/d20/d46 0 2024-04-27T07:33:37.771 INFO:tasks.workunit.client.1.smithi100.stdout:9/530: stat d1/d9/db/d2b/f34 0 2024-04-27T07:33:37.775 INFO:tasks.workunit.client.1.smithi100.stdout:9/531: mkdir d1/d9/db/d2b/d4f/d57/dbe 0 2024-04-27T07:33:37.779 INFO:tasks.workunit.client.1.smithi100.stdout:9/532: fsync d1/d9/db/d2b/f86 0 2024-04-27T07:33:37.780 INFO:tasks.workunit.client.1.smithi100.stdout:5/484: dread d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:37.781 INFO:tasks.workunit.client.1.smithi100.stdout:9/533: write d1/d9/db/d2b/d4f/dac/d54/f95 [3583784,102558] 0 2024-04-27T07:33:37.783 INFO:tasks.workunit.client.1.smithi100.stdout:5/485: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d 39 2024-04-27T07:33:37.785 INFO:tasks.workunit.client.1.smithi100.stdout:9/534: creat d1/d9/d1f/d4a/fbf x:0 0 0 2024-04-27T07:33:37.788 INFO:tasks.workunit.client.1.smithi100.stdout:9/535: creat d1/d9/db/d56/fc0 x:0 0 0 2024-04-27T07:33:37.791 INFO:tasks.workunit.client.1.smithi100.stdout:5/486: dwrite d0/d4/d21/d24/d46/f8b [0,4194304] 0 2024-04-27T07:33:37.792 INFO:tasks.workunit.client.1.smithi100.stdout:5/487: dread - d0/d4/d21/d24/d2f/d57/f91 zero size 2024-04-27T07:33:37.796 INFO:tasks.workunit.client.1.smithi100.stdout:9/536: write d1/f46 [3156858,83306] 0 2024-04-27T07:33:37.798 INFO:tasks.workunit.client.1.smithi100.stdout:5/488: dwrite d0/d4/f22 [4194304,4194304] 0 2024-04-27T07:33:37.800 INFO:tasks.workunit.client.1.smithi100.stdout:9/537: creat d1/d9/d1f/d4a/d67/fc1 x:0 0 0 2024-04-27T07:33:37.801 INFO:tasks.workunit.client.1.smithi100.stdout:5/489: truncate d0/d4/d21/d24/d2f/d39/d56/f5d 173052 0 2024-04-27T07:33:37.804 INFO:tasks.workunit.client.1.smithi100.stdout:5/490: creat d0/d58/d60/f96 x:0 0 0 2024-04-27T07:33:37.804 INFO:tasks.workunit.client.1.smithi100.stdout:5/491: write d0/d42/f7d [71859,7236] 0 2024-04-27T07:33:37.806 INFO:tasks.workunit.client.1.smithi100.stdout:9/538: read d1/d9/db/f2e [2934127,78467] 0 2024-04-27T07:33:37.809 INFO:tasks.workunit.client.1.smithi100.stdout:9/539: mkdir d1/d9/dc2 0 2024-04-27T07:33:37.810 INFO:tasks.workunit.client.1.smithi100.stdout:9/540: stat d1/d9/db/d2b/d4f/dac/d54/d61 0 2024-04-27T07:33:37.812 INFO:tasks.workunit.client.1.smithi100.stdout:9/541: chown d1/d9/db/d2b/d31/f35 3253 1 2024-04-27T07:33:37.812 INFO:tasks.workunit.client.1.smithi100.stdout:8/514: dread d6/f7 [0,4194304] 0 2024-04-27T07:33:37.813 INFO:tasks.workunit.client.1.smithi100.stdout:5/492: rename d0/d58 to d0/d42/d94/d97 0 2024-04-27T07:33:37.813 INFO:tasks.workunit.client.1.smithi100.stdout:9/542: chown d1/d9/db/d2b/d4f/d57/f87 8488349 1 2024-04-27T07:33:37.813 INFO:tasks.workunit.client.1.smithi100.stdout:8/515: read - d6/d1b/d1d/d59/f58 zero size 2024-04-27T07:33:37.815 INFO:tasks.workunit.client.1.smithi100.stdout:8/516: read - d6/d1b/d1d/d59/f58 zero size 2024-04-27T07:33:37.815 INFO:tasks.workunit.client.1.smithi100.stdout:5/493: dread - d0/d4/d21/d24/d2f/d39/d56/f6b zero size 2024-04-27T07:33:37.815 INFO:tasks.workunit.client.1.smithi100.stdout:9/543: mknod d1/d9/d1f/d4a/cc3 0 2024-04-27T07:33:37.816 INFO:tasks.workunit.client.1.smithi100.stdout:5/494: dread - d0/d4/d21/d24/d2f/f5c zero size 2024-04-27T07:33:37.816 INFO:tasks.workunit.client.1.smithi100.stdout:8/517: chown d6/d1b/d1d/d59/f58 20759229 1 2024-04-27T07:33:37.817 INFO:tasks.workunit.client.1.smithi100.stdout:9/544: symlink d1/d9/db/d2b/d31/lc4 0 2024-04-27T07:33:37.818 INFO:tasks.workunit.client.1.smithi100.stdout:8/518: rmdir d6/d20/d8b 39 2024-04-27T07:33:37.821 INFO:tasks.workunit.client.1.smithi100.stdout:5/495: rename d0/d4/d21/d24/d2f/d57/d37/d1a/c93 to d0/d4/d21/d24/d2f/d57/d3e/c98 0 2024-04-27T07:33:37.822 INFO:tasks.workunit.client.1.smithi100.stdout:8/519: unlink d6/fb 0 2024-04-27T07:33:37.822 INFO:tasks.workunit.client.1.smithi100.stdout:9/545: truncate d1/d9/db/d2b/fab 2250087 0 2024-04-27T07:33:37.824 INFO:tasks.workunit.client.1.smithi100.stdout:5/496: unlink d0/d4/d21/f26 0 2024-04-27T07:33:37.825 INFO:tasks.workunit.client.1.smithi100.stdout:5/497: dread - d0/d4/d21/d24/d2f/d57/f91 zero size 2024-04-27T07:33:37.826 INFO:tasks.workunit.client.1.smithi100.stdout:8/520: mkdir d6/d20/d99/da3 0 2024-04-27T07:33:37.830 INFO:tasks.workunit.client.1.smithi100.stdout:9/546: link d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/fae d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/fc5 0 2024-04-27T07:33:37.832 INFO:tasks.workunit.client.1.smithi100.stdout:5/498: dwrite d0/d4/d21/d24/d2f/d39/d56/f85 [0,4194304] 0 2024-04-27T07:33:37.833 INFO:tasks.workunit.client.1.smithi100.stdout:9/547: mknod d1/d9/dc2/cc6 0 2024-04-27T07:33:37.837 INFO:tasks.workunit.client.1.smithi100.stdout:9/548: mkdir d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7 0 2024-04-27T07:33:37.842 INFO:tasks.workunit.client.1.smithi100.stdout:9/549: mknod d1/d9/cc8 0 2024-04-27T07:33:37.845 INFO:tasks.workunit.client.1.smithi100.stdout:8/521: rename d6/d20/d99 to d6/d20/d50/d72/da4 0 2024-04-27T07:33:37.846 INFO:tasks.workunit.client.1.smithi100.stdout:9/550: creat d1/d9/db/d2b/d4f/da3/fc9 x:0 0 0 2024-04-27T07:33:37.853 INFO:tasks.workunit.client.1.smithi100.stdout:9/551: dwrite d1/f29 [0,4194304] 0 2024-04-27T07:33:37.855 INFO:tasks.workunit.client.1.smithi100.stdout:5/499: truncate d0/d4/d21/d24/f69 656536 0 2024-04-27T07:33:37.860 INFO:tasks.workunit.client.1.smithi100.stdout:1/656: sync 2024-04-27T07:33:37.860 INFO:tasks.workunit.client.1.smithi100.stdout:2/560: sync 2024-04-27T07:33:37.861 INFO:tasks.workunit.client.1.smithi100.stdout:9/552: creat d1/d9/d1f/fca x:0 0 0 2024-04-27T07:33:37.867 INFO:tasks.workunit.client.1.smithi100.stdout:9/553: dread d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f8f [0,4194304] 0 2024-04-27T07:33:37.868 INFO:tasks.workunit.client.1.smithi100.stdout:8/522: write d6/f10 [763574,12142] 0 2024-04-27T07:33:37.870 INFO:tasks.workunit.client.1.smithi100.stdout:5/500: getdents d0/d4/d21/d24/d2f/d39 0 2024-04-27T07:33:37.874 INFO:tasks.workunit.client.1.smithi100.stdout:9/554: creat d1/d9/db/d2b/d4f/d91/fcb x:0 0 0 2024-04-27T07:33:37.876 INFO:tasks.workunit.client.1.smithi100.stdout:5/501: mkdir d0/d4/d21/d24/d46/d99 0 2024-04-27T07:33:37.877 INFO:tasks.workunit.client.1.smithi100.stdout:5/502: stat d0/d4/d21/d24/d46/f80 0 2024-04-27T07:33:37.878 INFO:tasks.workunit.client.1.smithi100.stdout:2/561: write d0/da/d29/f23 [3300816,49291] 0 2024-04-27T07:33:37.879 INFO:tasks.workunit.client.1.smithi100.stdout:1/657: dread d0/d1f/d6d/db4/d4e/fc5 [0,4194304] 0 2024-04-27T07:33:37.879 INFO:tasks.workunit.client.1.smithi100.stdout:5/503: mkdir d0/d42/d94/d9a 0 2024-04-27T07:33:37.882 INFO:tasks.workunit.client.1.smithi100.stdout:9/555: link d1/d9/db/d56/fc0 d1/d9/db/d56/d5c/fcc 0 2024-04-27T07:33:37.883 INFO:tasks.workunit.client.1.smithi100.stdout:2/562: mknod d0/da/d29/d47/d87/d8b/cbe 0 2024-04-27T07:33:37.884 INFO:tasks.workunit.client.1.smithi100.stdout:2/563: chown d0/da/d29/d47/f91 759906 1 2024-04-27T07:33:37.889 INFO:tasks.workunit.client.1.smithi100.stdout:2/564: creat d0/d79/d94/fbf x:0 0 0 2024-04-27T07:33:37.891 INFO:tasks.workunit.client.1.smithi100.stdout:9/556: write d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f8f [4123960,52194] 0 2024-04-27T07:33:37.894 INFO:tasks.workunit.client.1.smithi100.stdout:5/504: dwrite d0/d42/d94/d97/d60/f61 [0,4194304] 0 2024-04-27T07:33:37.894 INFO:tasks.workunit.client.1.smithi100.stdout:1/658: dwrite d0/da0/f91 [0,4194304] 0 2024-04-27T07:33:37.895 INFO:tasks.workunit.client.1.smithi100.stdout:2/565: creat d0/da/d29/d47/d87/fc0 x:0 0 0 2024-04-27T07:33:37.896 INFO:tasks.workunit.client.1.smithi100.stdout:6/630: sync 2024-04-27T07:33:37.896 INFO:tasks.workunit.client.1.smithi100.stdout:7/568: sync 2024-04-27T07:33:37.896 INFO:tasks.workunit.client.1.smithi100.stdout:0/548: sync 2024-04-27T07:33:37.896 INFO:tasks.workunit.client.1.smithi100.stdout:4/592: sync 2024-04-27T07:33:37.897 INFO:tasks.workunit.client.1.smithi100.stdout:3/682: sync 2024-04-27T07:33:37.903 INFO:tasks.workunit.client.1.smithi100.stdout:8/523: dwrite d6/f45 [0,4194304] 0 2024-04-27T07:33:37.903 INFO:tasks.workunit.client.1.smithi100.stdout:0/549: fdatasync d1/d8/d14/d59/fb5 0 2024-04-27T07:33:37.903 INFO:tasks.workunit.client.1.smithi100.stdout:4/593: stat d5/d16/d19/l4f 0 2024-04-27T07:33:37.907 INFO:tasks.workunit.client.1.smithi100.stdout:9/557: creat d1/d9/db/d2b/d4f/dac/d54/d61/fcd x:0 0 0 2024-04-27T07:33:37.907 INFO:tasks.workunit.client.1.smithi100.stdout:0/550: truncate d1/d8/d20/faa 720673 0 2024-04-27T07:33:37.908 INFO:tasks.workunit.client.1.smithi100.stdout:7/569: fdatasync d1/dd/d16/d4a/d56/f86 0 2024-04-27T07:33:37.909 INFO:tasks.workunit.client.1.smithi100.stdout:0/551: dread - d1/d8/fa1 zero size 2024-04-27T07:33:37.910 INFO:tasks.workunit.client.1.smithi100.stdout:7/570: stat d1/dd/d16/d31/l53 0 2024-04-27T07:33:37.914 INFO:tasks.workunit.client.1.smithi100.stdout:3/683: creat d7/dad/daf/fd0 x:0 0 0 2024-04-27T07:33:37.914 INFO:tasks.workunit.client.1.smithi100.stdout:8/524: chown d6/d20/d50/f74 587738444 1 2024-04-27T07:33:37.915 INFO:tasks.workunit.client.1.smithi100.stdout:5/505: rename d0/d4/d21/d24/d2f/d39/d56/d67/f68 to d0/d42/f9b 0 2024-04-27T07:33:37.915 INFO:tasks.workunit.client.1.smithi100.stdout:8/525: write d6/d20/d2a/f65 [3313461,95662] 0 2024-04-27T07:33:37.916 INFO:tasks.workunit.client.1.smithi100.stdout:1/659: getdents d0/d1b/da1 0 2024-04-27T07:33:37.917 INFO:tasks.workunit.client.1.smithi100.stdout:9/558: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/fce x:0 0 0 2024-04-27T07:33:37.918 INFO:tasks.workunit.client.1.smithi100.stdout:1/660: write d0/d1b/da1/fb0 [264755,41637] 0 2024-04-27T07:33:37.918 INFO:tasks.workunit.client.1.smithi100.stdout:0/552: dread - d1/d8/d20/f77 zero size 2024-04-27T07:33:37.920 INFO:tasks.workunit.client.1.smithi100.stdout:6/631: link de/d58/d21/d24/f25 de/d58/d21/d24/d9f/daa/fdd 0 2024-04-27T07:33:37.923 INFO:tasks.workunit.client.1.smithi100.stdout:7/571: mknod d1/dd/d16/d70/d51/ca6 0 2024-04-27T07:33:37.925 INFO:tasks.workunit.client.1.smithi100.stdout:0/553: write d1/d8/d20/d1e/f6e [4413650,1280] 0 2024-04-27T07:33:37.927 INFO:tasks.workunit.client.1.smithi100.stdout:3/684: unlink d7/d9/lc7 0 2024-04-27T07:33:37.930 INFO:tasks.workunit.client.1.smithi100.stdout:6/632: mkdir de/d58/d21/d24/d9f/daa/dde 0 2024-04-27T07:33:37.931 INFO:tasks.workunit.client.1.smithi100.stdout:2/566: write d0/da/d29/d47/d5a/d8d/d5d/f5f [1028937,33684] 0 2024-04-27T07:33:37.935 INFO:tasks.workunit.client.1.smithi100.stdout:0/554: symlink d1/d30/lbb 0 2024-04-27T07:33:37.936 INFO:tasks.workunit.client.1.smithi100.stdout:4/594: getdents d5/d16/d2e 0 2024-04-27T07:33:37.936 INFO:tasks.workunit.client.1.smithi100.stdout:3/685: dwrite d7/d9/d10/f29 [4194304,4194304] 0 2024-04-27T07:33:37.938 INFO:tasks.workunit.client.1.smithi100.stdout:5/506: write d0/d4/d21/d24/d2f/d57/d37/d1a/f4d [301525,7334] 0 2024-04-27T07:33:37.940 INFO:tasks.workunit.client.1.smithi100.stdout:5/507: stat d0/d4/d21/d24/d46 0 2024-04-27T07:33:37.943 INFO:tasks.workunit.client.1.smithi100.stdout:1/661: creat d0/fda x:0 0 0 2024-04-27T07:33:37.947 INFO:tasks.workunit.client.1.smithi100.stdout:3/686: rename d7/dad/daf/fc6 to d7/d9/d10/d33/d90/fd1 0 2024-04-27T07:33:37.948 INFO:tasks.workunit.client.1.smithi100.stdout:2/567: mknod d0/da/d29/cc1 0 2024-04-27T07:33:37.951 INFO:tasks.workunit.client.1.smithi100.stdout:5/508: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f9c x:0 0 0 2024-04-27T07:33:37.952 INFO:tasks.workunit.client.1.smithi100.stdout:9/559: dwrite d1/d9/d1f/f98 [0,4194304] 0 2024-04-27T07:33:37.952 INFO:tasks.workunit.client.1.smithi100.stdout:8/526: dwrite d6/d1b/f22 [0,4194304] 0 2024-04-27T07:33:37.953 INFO:tasks.workunit.client.1.smithi100.stdout:4/595: mkdir d5/d16/d19/d46/d53/dba/dd0 0 2024-04-27T07:33:37.957 INFO:tasks.workunit.client.1.smithi100.stdout:3/687: stat d7/d9/d10/d33/d47/cc2 0 2024-04-27T07:33:37.959 INFO:tasks.workunit.client.1.smithi100.stdout:7/572: link d1/l98 d1/dd/d16/d2b/d7f/la7 0 2024-04-27T07:33:37.961 INFO:tasks.workunit.client.1.smithi100.stdout:1/662: dwrite d0/d1f/d6d/db4/f39 [0,4194304] 0 2024-04-27T07:33:37.961 INFO:tasks.workunit.client.1.smithi100.stdout:6/633: getdents de/d2e/d3f/d80 0 2024-04-27T07:33:37.962 INFO:tasks.workunit.client.1.smithi100.stdout:5/509: mkdir d0/d4/d21/d24/d46/d9d 0 2024-04-27T07:33:37.963 INFO:tasks.workunit.client.1.smithi100.stdout:1/663: stat d0/d1f/d6d/db4/d4e/l6a 0 2024-04-27T07:33:37.965 INFO:tasks.workunit.client.1.smithi100.stdout:9/560: creat d1/d9/db/d56/d5c/fcf x:0 0 0 2024-04-27T07:33:37.968 INFO:tasks.workunit.client.1.smithi100.stdout:3/688: symlink d7/d9/d10/d33/d90/d3a/ld2 0 2024-04-27T07:33:37.969 INFO:tasks.workunit.client.1.smithi100.stdout:5/510: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/c76 1125 1 2024-04-27T07:33:37.970 INFO:tasks.workunit.client.1.smithi100.stdout:8/527: creat d6/d20/fa5 x:0 0 0 2024-04-27T07:33:37.972 INFO:tasks.workunit.client.1.smithi100.stdout:0/555: dread d1/d8/d20/f7b [0,4194304] 0 2024-04-27T07:33:37.973 INFO:tasks.workunit.client.1.smithi100.stdout:6/634: creat de/d2e/d3f/d80/fdf x:0 0 0 2024-04-27T07:33:37.974 INFO:tasks.workunit.client.1.smithi100.stdout:9/561: mkdir d1/d9/db/d2b/d4f/dac/d54/d61/d9b/db5/dd0 0 2024-04-27T07:33:37.974 INFO:tasks.workunit.client.1.smithi100.stdout:6/635: chown de/d9b/ca6 197490 1 2024-04-27T07:33:37.975 INFO:tasks.workunit.client.1.smithi100.stdout:8/528: write d6/d20/d50/d72/f87 [530839,67674] 0 2024-04-27T07:33:37.976 INFO:tasks.workunit.client.1.smithi100.stdout:3/689: creat d7/d9/d10/d3e/d55/fd3 x:0 0 0 2024-04-27T07:33:37.977 INFO:tasks.workunit.client.1.smithi100.stdout:5/511: symlink d0/d4/d21/d24/d2f/d57/d3e/l9e 0 2024-04-27T07:33:37.980 INFO:tasks.workunit.client.1.smithi100.stdout:0/556: rename d1/d8/d14/c90 to d1/d8/d14/d59/d64/d80/cbc 0 2024-04-27T07:33:37.983 INFO:tasks.workunit.client.1.smithi100.stdout:5/512: mknod d0/d42/d94/c9f 0 2024-04-27T07:33:37.983 INFO:tasks.workunit.client.1.smithi100.stdout:6/636: write de/d58/d21/d24/f27 [3946537,70754] 0 2024-04-27T07:33:37.984 INFO:tasks.workunit.client.1.smithi100.stdout:8/529: dwrite d6/d20/d50/f74 [0,4194304] 0 2024-04-27T07:33:37.986 INFO:tasks.workunit.client.1.smithi100.stdout:6/637: read de/f11 [87637,87693] 0 2024-04-27T07:33:37.991 INFO:tasks.workunit.client.1.smithi100.stdout:0/557: creat d1/d8/d14/d59/d64/d80/fbd x:0 0 0 2024-04-27T07:33:37.995 INFO:tasks.workunit.client.1.smithi100.stdout:4/596: write d5/d16/d19/d46/f81 [2916678,21288] 0 2024-04-27T07:33:38.001 INFO:tasks.workunit.client.1.smithi100.stdout:7/573: dwrite d1/d54/f61 [0,4194304] 0 2024-04-27T07:33:38.006 INFO:tasks.workunit.client.1.smithi100.stdout:1/664: truncate d0/d1f/f2b 393658 0 2024-04-27T07:33:38.007 INFO:tasks.workunit.client.1.smithi100.stdout:1/665: readlink d0/d1f/d6d/db4/d6c/l9c 0 2024-04-27T07:33:38.018 INFO:tasks.workunit.client.1.smithi100.stdout:9/562: rename d1/d9/db/d2b/d4f/dac/d54/d61/d9b/db5 to d1/d9/db/d2b/d4f/dd1 0 2024-04-27T07:33:38.020 INFO:tasks.workunit.client.1.smithi100.stdout:8/530: dread d6/f31 [0,4194304] 0 2024-04-27T07:33:38.025 INFO:tasks.workunit.client.1.smithi100.stdout:3/690: rename d7/d9/d26/c58 to d7/d9/d10/d33/d90/d3a/cd4 0 2024-04-27T07:33:38.026 INFO:tasks.workunit.client.1.smithi100.stdout:4/597: dwrite d5/d1b/d2c/d50/f5c [0,4194304] 0 2024-04-27T07:33:38.027 INFO:tasks.workunit.client.1.smithi100.stdout:1/666: dread d0/d1b/d20/d2d/d35/f8b [0,4194304] 0 2024-04-27T07:33:38.028 INFO:tasks.workunit.client.1.smithi100.stdout:9/563: unlink d1/d9/d1f/f68 0 2024-04-27T07:33:38.029 INFO:tasks.workunit.client.1.smithi100.stdout:5/513: mkdir d0/d4/d21/d24/d46/d99/da0 0 2024-04-27T07:33:38.031 INFO:tasks.workunit.client.1.smithi100.stdout:5/514: write d0/d42/d94/d97/d60/f96 [149578,99235] 0 2024-04-27T07:33:38.033 INFO:tasks.workunit.client.1.smithi100.stdout:8/531: read d6/d1b/d1d/f39 [326427,23463] 0 2024-04-27T07:33:38.038 INFO:tasks.workunit.client.1.smithi100.stdout:3/691: creat d7/d9/d10/d22/fd5 x:0 0 0 2024-04-27T07:33:38.038 INFO:tasks.workunit.client.1.smithi100.stdout:9/564: dwrite d1/d9/db/d2b/d4f/dac/fa7 [4194304,4194304] 0 2024-04-27T07:33:38.040 INFO:tasks.workunit.client.1.smithi100.stdout:3/692: dread - d7/dad/daf/fd0 zero size 2024-04-27T07:33:38.044 INFO:tasks.workunit.client.1.smithi100.stdout:3/693: write d7/d9/d26/f59 [2535485,18614] 0 2024-04-27T07:33:38.047 INFO:tasks.workunit.client.1.smithi100.stdout:6/638: getdents de/d58/d21/d23/da0 0 2024-04-27T07:33:38.050 INFO:tasks.workunit.client.1.smithi100.stdout:1/667: dwrite d0/d1b/d20/d2d/d35/d65/fc6 [0,4194304] 0 2024-04-27T07:33:38.052 INFO:tasks.workunit.client.1.smithi100.stdout:8/532: mkdir d6/d20/da2/da6 0 2024-04-27T07:33:38.053 INFO:tasks.workunit.client.1.smithi100.stdout:6/639: write de/d2e/d3f/d80/fa1 [601643,109931] 0 2024-04-27T07:33:38.057 INFO:tasks.workunit.client.1.smithi100.stdout:0/558: dwrite d1/f55 [0,4194304] 0 2024-04-27T07:33:38.057 INFO:tasks.workunit.client.1.smithi100.stdout:5/515: creat d0/fa1 x:0 0 0 2024-04-27T07:33:38.060 INFO:tasks.workunit.client.1.smithi100.stdout:8/533: fsync d6/d1b/d1d/f9c 0 2024-04-27T07:33:38.062 INFO:tasks.workunit.client.1.smithi100.stdout:6/640: mknod de/d2e/d86/ce0 0 2024-04-27T07:33:38.063 INFO:tasks.workunit.client.1.smithi100.stdout:7/574: truncate d1/dd/d16/d2b/d7f/f83 2782845 0 2024-04-27T07:33:38.066 INFO:tasks.workunit.client.1.smithi100.stdout:7/575: chown d1/dd/d16/d31/c7d 595282 1 2024-04-27T07:33:38.066 INFO:tasks.workunit.client.1.smithi100.stdout:6/641: truncate de/d58/d28/f4d 1598181 0 2024-04-27T07:33:38.071 INFO:tasks.workunit.client.1.smithi100.stdout:9/565: getdents d1/d9/db/d2b/d4f 0 2024-04-27T07:33:38.072 INFO:tasks.workunit.client.1.smithi100.stdout:7/576: symlink d1/dd/d2a/d2c/la8 0 2024-04-27T07:33:38.073 INFO:tasks.workunit.client.1.smithi100.stdout:0/559: truncate d1/d8/d20/d61/d6a/f97 3920560 0 2024-04-27T07:33:38.074 INFO:tasks.workunit.client.1.smithi100.stdout:6/642: mknod de/d58/d21/d24/d9f/ce1 0 2024-04-27T07:33:38.075 INFO:tasks.workunit.client.1.smithi100.stdout:6/643: readlink de/d58/d21/d23/l8e 0 2024-04-27T07:33:38.078 INFO:tasks.workunit.client.1.smithi100.stdout:7/577: unlink d1/dd/d16/f26 0 2024-04-27T07:33:38.080 INFO:tasks.workunit.client.1.smithi100.stdout:6/644: creat de/d2e/dc0/fe2 x:0 0 0 2024-04-27T07:33:38.081 INFO:tasks.workunit.client.1.smithi100.stdout:6/645: stat de/d58/d21/d24/f27 0 2024-04-27T07:33:38.081 INFO:tasks.workunit.client.1.smithi100.stdout:0/560: creat d1/d8/d20/d88/fbe x:0 0 0 2024-04-27T07:33:38.082 INFO:tasks.workunit.client.1.smithi100.stdout:7/578: fsync d1/d54/f5f 0 2024-04-27T07:33:38.082 INFO:tasks.workunit.client.1.smithi100.stdout:0/561: chown d1/d8/d20/d61/l84 1883 1 2024-04-27T07:33:38.087 INFO:tasks.workunit.client.1.smithi100.stdout:3/694: dread d7/d9/d10/d3e/d74/db1/d9d/f80 [0,4194304] 0 2024-04-27T07:33:38.090 INFO:tasks.workunit.client.1.smithi100.stdout:6/646: dwrite de/d2e/d3f/d80/fdf [0,4194304] 0 2024-04-27T07:33:38.091 INFO:tasks.workunit.client.1.smithi100.stdout:8/534: truncate d6/d1b/d1d/f2c 2008059 0 2024-04-27T07:33:38.095 INFO:tasks.workunit.client.1.smithi100.stdout:0/562: dwrite d1/d30/f3d [0,4194304] 0 2024-04-27T07:33:38.095 INFO:tasks.workunit.client.1.smithi100.stdout:3/695: fsync d7/d9/d10/d3e/d74/db1/f89 0 2024-04-27T07:33:38.097 INFO:tasks.workunit.client.1.smithi100.stdout:3/696: dread - d7/d9/d26/d2a/fce zero size 2024-04-27T07:33:38.098 INFO:tasks.workunit.client.1.smithi100.stdout:3/697: chown d7/d9/d26/d2a/l25 119 1 2024-04-27T07:33:38.103 INFO:tasks.workunit.client.1.smithi100.stdout:0/563: rmdir d1/d8/d14/d59/d99 39 2024-04-27T07:33:38.104 INFO:tasks.workunit.client.1.smithi100.stdout:0/564: stat d1/d8/d20/l1a 0 2024-04-27T07:33:38.109 INFO:tasks.workunit.client.1.smithi100.stdout:3/698: mkdir d7/d9/d10/d33/d90/d3a/dd6 0 2024-04-27T07:33:38.110 INFO:tasks.workunit.client.1.smithi100.stdout:6/647: write de/d58/d21/d23/f39 [1643026,5341] 0 2024-04-27T07:33:38.112 INFO:tasks.workunit.client.1.smithi100.stdout:0/565: rmdir d1/d38/d3a/d54 39 2024-04-27T07:33:38.114 INFO:tasks.workunit.client.1.smithi100.stdout:8/535: truncate d6/d1b/d75/f83 2639231 0 2024-04-27T07:33:38.116 INFO:tasks.workunit.client.1.smithi100.stdout:6/648: creat de/d58/d21/d23/da0/fe3 x:0 0 0 2024-04-27T07:33:38.116 INFO:tasks.workunit.client.1.smithi100.stdout:8/536: read d6/d20/d2a/f3c [1972666,102095] 0 2024-04-27T07:33:38.122 INFO:tasks.workunit.client.1.smithi100.stdout:3/699: mknod d7/d9/d10/d3e/d74/da8/cd7 0 2024-04-27T07:33:38.126 INFO:tasks.workunit.client.1.smithi100.stdout:8/537: symlink d6/d20/d54/la7 0 2024-04-27T07:33:38.128 INFO:tasks.workunit.client.1.smithi100.stdout:0/566: creat d1/d8/d14/d59/d99/fbf x:0 0 0 2024-04-27T07:33:38.130 INFO:tasks.workunit.client.1.smithi100.stdout:6/649: dread de/f10 [0,4194304] 0 2024-04-27T07:33:38.131 INFO:tasks.workunit.client.1.smithi100.stdout:6/650: write de/d58/f29 [4498024,9330] 0 2024-04-27T07:33:38.131 INFO:tasks.workunit.client.1.smithi100.stdout:3/700: creat d7/d9/d10/d3e/d74/db1/d9d/fd8 x:0 0 0 2024-04-27T07:33:38.135 INFO:tasks.workunit.client.1.smithi100.stdout:8/538: rename d6/d4c to d6/d20/d50/da8 0 2024-04-27T07:33:38.137 INFO:tasks.workunit.client.1.smithi100.stdout:0/567: creat d1/d8/d20/fc0 x:0 0 0 2024-04-27T07:33:38.137 INFO:tasks.workunit.client.1.smithi100.stdout:3/701: mknod d7/d9/d26/d2a/cd9 0 2024-04-27T07:33:38.138 INFO:tasks.workunit.client.1.smithi100.stdout:8/539: dread - d6/d1b/d1d/f68 zero size 2024-04-27T07:33:38.138 INFO:tasks.workunit.client.1.smithi100.stdout:0/568: write d1/d8/d20/d1e/f85 [945825,123803] 0 2024-04-27T07:33:38.156 INFO:tasks.workunit.client.1.smithi100.stdout:3/702: creat d7/d9/d2f/fda x:0 0 0 2024-04-27T07:33:38.156 INFO:tasks.workunit.client.1.smithi100.stdout:0/569: read - d1/d8/d20/f77 zero size 2024-04-27T07:33:38.159 INFO:tasks.workunit.client.1.smithi100.stdout:3/703: unlink d7/d9/d10/d33/d90/lb7 0 2024-04-27T07:33:38.160 INFO:tasks.workunit.client.1.smithi100.stdout:8/540: dread d6/ff [0,4194304] 0 2024-04-27T07:33:38.162 INFO:tasks.workunit.client.1.smithi100.stdout:8/541: truncate d6/d20/d46/f57 5080951 0 2024-04-27T07:33:38.162 INFO:tasks.workunit.client.1.smithi100.stdout:0/570: link d1/d30/f3d d1/d8/d20/d61/d66/fc1 0 2024-04-27T07:33:38.163 INFO:tasks.workunit.client.1.smithi100.stdout:3/704: chown d7/d9/c1a 1282251 1 2024-04-27T07:33:38.165 INFO:tasks.workunit.client.1.smithi100.stdout:0/571: dread d1/d38/d3a/d54/f93 [0,4194304] 0 2024-04-27T07:33:38.165 INFO:tasks.workunit.client.1.smithi100.stdout:8/542: mkdir d6/d1b/d1d/d59/d94/da9 0 2024-04-27T07:33:38.167 INFO:tasks.workunit.client.1.smithi100.stdout:0/572: truncate d1/d8/d14/d59/d64/d80/fa6 18130 0 2024-04-27T07:33:38.168 INFO:tasks.workunit.client.1.smithi100.stdout:0/573: write d1/d8/f7f [854913,44964] 0 2024-04-27T07:33:38.168 INFO:tasks.workunit.client.1.smithi100.stdout:3/705: mkdir d7/d9/d10/d3e/ddb 0 2024-04-27T07:33:38.170 INFO:tasks.workunit.client.1.smithi100.stdout:8/543: creat d6/d1b/d75/faa x:0 0 0 2024-04-27T07:33:38.171 INFO:tasks.workunit.client.1.smithi100.stdout:3/706: creat d7/d9/d10/d3e/d74/fdc x:0 0 0 2024-04-27T07:33:38.172 INFO:tasks.workunit.client.1.smithi100.stdout:3/707: chown d7/d9/d26/d2a/l25 60 1 2024-04-27T07:33:38.176 INFO:tasks.workunit.client.1.smithi100.stdout:0/574: rename d1/d8/d14/d59/f9b to d1/fc2 0 2024-04-27T07:33:38.176 INFO:tasks.workunit.client.1.smithi100.stdout:3/708: dread d7/d9/d10/d28/fa4 [4194304,4194304] 0 2024-04-27T07:33:38.177 INFO:tasks.workunit.client.1.smithi100.stdout:3/709: fsync d7/d9/d10/d28/db0/fba 0 2024-04-27T07:33:38.179 INFO:tasks.workunit.client.1.smithi100.stdout:3/710: read d7/d9/d10/f86 [906673,52344] 0 2024-04-27T07:33:38.180 INFO:tasks.workunit.client.1.smithi100.stdout:8/544: getdents d6/d20/d50 0 2024-04-27T07:33:38.184 INFO:tasks.workunit.client.1.smithi100.stdout:8/545: mknod d6/d20/d50/da8/cab 0 2024-04-27T07:33:38.188 INFO:tasks.workunit.client.1.smithi100.stdout:3/711: dwrite d7/d9/d10/f86 [0,4194304] 0 2024-04-27T07:33:38.190 INFO:tasks.workunit.client.1.smithi100.stdout:3/712: fdatasync d7/d9/d26/d2a/d5e/fa6 0 2024-04-27T07:33:38.191 INFO:tasks.workunit.client.1.smithi100.stdout:8/546: rmdir d6/d20/d50/d72/da4/da3 0 2024-04-27T07:33:38.195 INFO:tasks.workunit.client.1.smithi100.stdout:3/713: mkdir d7/d9/d10/d33/d90/d3a/ddd 0 2024-04-27T07:33:38.195 INFO:tasks.workunit.client.1.smithi100.stdout:3/714: fsync d7/f1f 0 2024-04-27T07:33:38.198 INFO:tasks.workunit.client.1.smithi100.stdout:8/547: rmdir d6/d1b/d1d/d59/d94/da9 0 2024-04-27T07:33:38.199 INFO:tasks.workunit.client.1.smithi100.stdout:3/715: fdatasync d7/d9/d10/f7b 0 2024-04-27T07:33:38.200 INFO:tasks.workunit.client.1.smithi100.stdout:8/548: rmdir d6/d1b/d1d 39 2024-04-27T07:33:38.201 INFO:tasks.workunit.client.1.smithi100.stdout:3/716: mknod d7/d9/da5/cde 0 2024-04-27T07:33:38.202 INFO:tasks.workunit.client.1.smithi100.stdout:8/549: write d6/f3b [1450565,1491] 0 2024-04-27T07:33:38.203 INFO:tasks.workunit.client.1.smithi100.stdout:3/717: rmdir d7/d9/d10/d3e/d55 39 2024-04-27T07:33:38.204 INFO:tasks.workunit.client.1.smithi100.stdout:3/718: chown d7/d9 147284 1 2024-04-27T07:33:38.205 INFO:tasks.workunit.client.1.smithi100.stdout:8/550: symlink d6/d20/d50/lac 0 2024-04-27T07:33:38.207 INFO:tasks.workunit.client.1.smithi100.stdout:3/719: symlink d7/d9/d10/d3e/d55/ldf 0 2024-04-27T07:33:38.209 INFO:tasks.workunit.client.1.smithi100.stdout:8/551: write d6/d1b/d1d/f32 [5116357,16588] 0 2024-04-27T07:33:38.210 INFO:tasks.workunit.client.1.smithi100.stdout:3/720: unlink d7/d9/d10/d3e/d55/c63 0 2024-04-27T07:33:38.212 INFO:tasks.workunit.client.1.smithi100.stdout:8/552: creat d6/d1b/d75/fad x:0 0 0 2024-04-27T07:33:38.213 INFO:tasks.workunit.client.1.smithi100.stdout:3/721: symlink d7/dad/daf/le0 0 2024-04-27T07:33:38.214 INFO:tasks.workunit.client.1.smithi100.stdout:3/722: write d7/d9/d10/f29 [6434793,83938] 0 2024-04-27T07:33:38.215 INFO:tasks.workunit.client.1.smithi100.stdout:3/723: chown d7/dad/daf 10680760 1 2024-04-27T07:33:38.221 INFO:tasks.workunit.client.1.smithi100.stdout:3/724: write d7/d9/d10/d33/d90/f81 [3026471,17850] 0 2024-04-27T07:33:38.225 INFO:tasks.workunit.client.1.smithi100.stdout:8/553: dwrite f1 [0,4194304] 0 2024-04-27T07:33:38.228 INFO:tasks.workunit.client.1.smithi100.stdout:8/554: truncate d6/d20/d2a/f55 4271142 0 2024-04-27T07:33:38.229 INFO:tasks.workunit.client.1.smithi100.stdout:8/555: stat d6/d20 0 2024-04-27T07:33:38.231 INFO:tasks.workunit.client.1.smithi100.stdout:3/725: dwrite d7/d9/d26/d2a/f87 [0,4194304] 0 2024-04-27T07:33:38.232 INFO:tasks.workunit.client.1.smithi100.stdout:3/726: dread - d7/d9/fac zero size 2024-04-27T07:33:38.236 INFO:tasks.workunit.client.1.smithi100.stdout:8/556: rename d6/d20/d46 to d6/d20/d54/d91/dae 0 2024-04-27T07:33:38.242 INFO:tasks.workunit.client.1.smithi100.stdout:8/557: dwrite d6/d20/d50/f52 [0,4194304] 0 2024-04-27T07:33:38.244 INFO:tasks.workunit.client.1.smithi100.stdout:3/727: write d7/d9/d10/d33/d90/d3a/f65 [631391,23257] 0 2024-04-27T07:33:38.248 INFO:tasks.workunit.client.1.smithi100.stdout:3/728: write d7/d9/d2f/f5d [2159862,31509] 0 2024-04-27T07:33:38.252 INFO:tasks.workunit.client.1.smithi100.stdout:8/558: dwrite d6/d20/d50/d72/f86 [0,4194304] 0 2024-04-27T07:33:38.252 INFO:tasks.workunit.client.1.smithi100.stdout:3/729: creat d7/d9/d10/d28/fe1 x:0 0 0 2024-04-27T07:33:38.256 INFO:tasks.workunit.client.1.smithi100.stdout:8/559: mkdir d6/d20/d50/d72/daf 0 2024-04-27T07:33:38.259 INFO:tasks.workunit.client.1.smithi100.stdout:3/730: unlink d7/d9/d10/d33/d90/f99 0 2024-04-27T07:33:38.260 INFO:tasks.workunit.client.1.smithi100.stdout:8/560: unlink d6/d20/d54/d91/dae/f57 0 2024-04-27T07:33:38.261 INFO:tasks.workunit.client.1.smithi100.stdout:8/561: write d6/d20/d50/f52 [413561,109081] 0 2024-04-27T07:33:38.264 INFO:tasks.workunit.client.1.smithi100.stdout:8/562: rmdir d6/d1b/d1d/d59/d4f 39 2024-04-27T07:33:38.266 INFO:tasks.workunit.client.1.smithi100.stdout:8/563: rename d6/d1b/d1d/d59/d4f to d6/d20/da2/db0 0 2024-04-27T07:33:38.280 INFO:tasks.workunit.client.1.smithi100.stdout:8/564: dread d6/f10 [0,4194304] 0 2024-04-27T07:33:38.310 INFO:tasks.workunit.client.1.smithi100.stdout:3/731: write d7/d9/d10/d3e/d74/fb4 [1600518,50099] 0 2024-04-27T07:33:38.311 INFO:tasks.workunit.client.1.smithi100.stdout:2/568: sync 2024-04-27T07:33:38.312 INFO:tasks.workunit.client.1.smithi100.stdout:8/565: mknod d6/d1b/d1d/cb1 0 2024-04-27T07:33:38.319 INFO:tasks.workunit.client.1.smithi100.stdout:3/732: dwrite d7/d9/d10/d3e/d74/db1/d9d/f80 [4194304,4194304] 0 2024-04-27T07:33:38.319 INFO:tasks.workunit.client.1.smithi100.stdout:8/566: dwrite d6/f31 [4194304,4194304] 0 2024-04-27T07:33:38.326 INFO:tasks.workunit.client.1.smithi100.stdout:8/567: creat d6/d1b/fb2 x:0 0 0 2024-04-27T07:33:38.327 INFO:tasks.workunit.client.1.smithi100.stdout:8/568: fsync d6/d20/d50/f89 0 2024-04-27T07:33:38.329 INFO:tasks.workunit.client.1.smithi100.stdout:3/733: rename d7/d9/d10/d22/l54 to d7/d9/d10/d3e/le2 0 2024-04-27T07:33:38.333 INFO:tasks.workunit.client.1.smithi100.stdout:3/734: getdents d7/d9/d10/d3e/d74 0 2024-04-27T07:33:38.337 INFO:tasks.workunit.client.1.smithi100.stdout:3/735: rename d7/d9/d26/d2a/c66 to d7/d9/ce3 0 2024-04-27T07:33:38.339 INFO:tasks.workunit.client.1.smithi100.stdout:3/736: write d7/d9/d2f/f69 [2496817,72398] 0 2024-04-27T07:33:38.341 INFO:tasks.workunit.client.1.smithi100.stdout:3/737: creat d7/d9/d10/d3e/d74/fe4 x:0 0 0 2024-04-27T07:33:38.349 INFO:tasks.workunit.client.1.smithi100.stdout:8/569: dwrite d6/d1b/d1d/f39 [0,4194304] 0 2024-04-27T07:33:38.351 INFO:tasks.workunit.client.1.smithi100.stdout:3/738: dwrite d7/d9/fc [0,4194304] 0 2024-04-27T07:33:38.355 INFO:tasks.workunit.client.1.smithi100.stdout:8/570: truncate d6/d1b/d1d/f2c 1813520 0 2024-04-27T07:33:38.358 INFO:tasks.workunit.client.1.smithi100.stdout:8/571: creat d6/d20/d50/fb3 x:0 0 0 2024-04-27T07:33:38.358 INFO:tasks.workunit.client.1.smithi100.stdout:3/739: link d7/d9/l84 d7/d9/d10/d33/d90/d3a/dd6/le5 0 2024-04-27T07:33:38.359 INFO:tasks.workunit.client.1.smithi100.stdout:8/572: dread d6/ff [0,4194304] 0 2024-04-27T07:33:38.360 INFO:tasks.workunit.client.1.smithi100.stdout:3/740: truncate d7/d9/d10/d28/f75 888715 0 2024-04-27T07:33:38.361 INFO:tasks.workunit.client.1.smithi100.stdout:3/741: readlink d7/d9/d26/d2a/l1d 0 2024-04-27T07:33:38.361 INFO:tasks.workunit.client.1.smithi100.stdout:3/742: readlink d7/d9/d10/d33/l36 0 2024-04-27T07:33:38.363 INFO:tasks.workunit.client.1.smithi100.stdout:8/573: creat d6/d1b/d1d/d59/fb4 x:0 0 0 2024-04-27T07:33:38.364 INFO:tasks.workunit.client.1.smithi100.stdout:3/743: rmdir d7/d9/d10/d3e/d74/db1 39 2024-04-27T07:33:38.365 INFO:tasks.workunit.client.1.smithi100.stdout:3/744: truncate d7/dad/daf/fd0 486886 0 2024-04-27T07:33:38.368 INFO:tasks.workunit.client.1.smithi100.stdout:3/745: fdatasync d7/d9/d10/d33/d90/d3a/fa2 0 2024-04-27T07:33:38.368 INFO:tasks.workunit.client.1.smithi100.stdout:8/574: dread d6/d20/d50/d72/f87 [0,4194304] 0 2024-04-27T07:33:38.369 INFO:tasks.workunit.client.1.smithi100.stdout:8/575: chown d6/d1b/d1d/d59/c92 5426 1 2024-04-27T07:33:38.370 INFO:tasks.workunit.client.1.smithi100.stdout:3/746: creat d7/dad/fe6 x:0 0 0 2024-04-27T07:33:38.373 INFO:tasks.workunit.client.1.smithi100.stdout:3/747: creat d7/d9/d26/d2a/d5e/d98/fe7 x:0 0 0 2024-04-27T07:33:38.374 INFO:tasks.workunit.client.1.smithi100.stdout:8/576: getdents d6/d1b/d1d/d59/d94 0 2024-04-27T07:33:38.376 INFO:tasks.workunit.client.1.smithi100.stdout:3/748: creat d7/d9/d10/d22/fe8 x:0 0 0 2024-04-27T07:33:38.377 INFO:tasks.workunit.client.1.smithi100.stdout:3/749: readlink d7/d9/d10/d3e/l68 0 2024-04-27T07:33:38.379 INFO:tasks.workunit.client.1.smithi100.stdout:3/750: dread d7/d9/d10/d28/f75 [0,4194304] 0 2024-04-27T07:33:38.380 INFO:tasks.workunit.client.1.smithi100.stdout:3/751: chown d7/d9/fa7 63 1 2024-04-27T07:33:38.386 INFO:tasks.workunit.client.1.smithi100.stdout:3/752: dread d7/d9/d10/d28/db0/fba [0,4194304] 0 2024-04-27T07:33:38.387 INFO:tasks.workunit.client.1.smithi100.stdout:8/577: dwrite d6/ff [0,4194304] 0 2024-04-27T07:33:38.391 INFO:tasks.workunit.client.1.smithi100.stdout:8/578: symlink d6/d20/d50/d72/lb5 0 2024-04-27T07:33:38.394 INFO:tasks.workunit.client.1.smithi100.stdout:8/579: creat d6/d1b/fb6 x:0 0 0 2024-04-27T07:33:38.395 INFO:tasks.workunit.client.1.smithi100.stdout:8/580: dread - d6/d1b/d1d/f9c zero size 2024-04-27T07:33:38.396 INFO:tasks.workunit.client.1.smithi100.stdout:3/753: truncate d7/d9/fc 1600086 0 2024-04-27T07:33:38.396 INFO:tasks.workunit.client.1.smithi100.stdout:8/581: readlink d6/l4b 0 2024-04-27T07:33:38.397 INFO:tasks.workunit.client.1.smithi100.stdout:8/582: stat d6/d1b/d1d/d59 0 2024-04-27T07:33:38.399 INFO:tasks.workunit.client.1.smithi100.stdout:3/754: unlink d7/d9/l84 0 2024-04-27T07:33:38.404 INFO:tasks.workunit.client.1.smithi100.stdout:8/583: dwrite d6/d1b/d1d/f32 [0,4194304] 0 2024-04-27T07:33:38.408 INFO:tasks.workunit.client.1.smithi100.stdout:3/755: rename d7/d9/d10/d33/d90/l4c to d7/d9/d26/d2a/le9 0 2024-04-27T07:33:38.408 INFO:tasks.workunit.client.1.smithi100.stdout:8/584: rename d6/d20/d50 to d6/d20/d50/db7 22 2024-04-27T07:33:38.413 INFO:tasks.workunit.client.1.smithi100.stdout:3/756: symlink d7/da9/lea 0 2024-04-27T07:33:38.414 INFO:tasks.workunit.client.1.smithi100.stdout:8/585: mknod d6/d20/d54/d91/d9e/cb8 0 2024-04-27T07:33:38.419 INFO:tasks.workunit.client.1.smithi100.stdout:8/586: rename d6/d20/d54/d91/dae/c88 to d6/d20/d50/cb9 0 2024-04-27T07:33:38.427 INFO:tasks.workunit.client.1.smithi100.stdout:3/757: write d7/d9/d10/d33/d90/f57 [885213,55650] 0 2024-04-27T07:33:38.428 INFO:tasks.workunit.client.1.smithi100.stdout:8/587: truncate d6/d20/d2a/f55 2023905 0 2024-04-27T07:33:38.428 INFO:tasks.workunit.client.1.smithi100.stdout:8/588: chown f1 60761 1 2024-04-27T07:33:38.429 INFO:tasks.workunit.client.1.smithi100.stdout:8/589: chown d6/d20/d2a/c28 3 1 2024-04-27T07:33:38.430 INFO:tasks.workunit.client.1.smithi100.stdout:3/758: getdents d7/d9/d10/d3e 0 2024-04-27T07:33:38.433 INFO:tasks.workunit.client.1.smithi100.stdout:3/759: creat d7/d9/d10/d33/d90/d3a/feb x:0 0 0 2024-04-27T07:33:38.436 INFO:tasks.workunit.client.1.smithi100.stdout:8/590: dwrite d6/d1b/d75/faa [0,4194304] 0 2024-04-27T07:33:38.441 INFO:tasks.workunit.client.1.smithi100.stdout:8/591: creat d6/d1b/d75/fba x:0 0 0 2024-04-27T07:33:38.443 INFO:tasks.workunit.client.1.smithi100.stdout:8/592: chown d6/d1b/d1d/d59/l5f 513 1 2024-04-27T07:33:38.443 INFO:tasks.workunit.client.1.smithi100.stdout:3/760: dwrite d7/d9/d10/d28/f77 [0,4194304] 0 2024-04-27T07:33:38.444 INFO:tasks.workunit.client.1.smithi100.stdout:8/593: chown d6/f8 572 1 2024-04-27T07:33:38.447 INFO:tasks.workunit.client.1.smithi100.stdout:3/761: creat d7/d9/d10/d3e/d74/da8/fec x:0 0 0 2024-04-27T07:33:38.450 INFO:tasks.workunit.client.1.smithi100.stdout:8/594: rename d6/d20/d50/da8/c6e to d6/d20/d54/cbb 0 2024-04-27T07:33:38.450 INFO:tasks.workunit.client.1.smithi100.stdout:3/762: mknod d7/d9/d10/d28/db0/ced 0 2024-04-27T07:33:38.452 INFO:tasks.workunit.client.1.smithi100.stdout:8/595: mknod d6/d1b/d1d/d77/cbc 0 2024-04-27T07:33:38.452 INFO:tasks.workunit.client.1.smithi100.stdout:3/763: truncate d7/d9/d10/d22/fc9 1289389 0 2024-04-27T07:33:38.455 INFO:tasks.workunit.client.1.smithi100.stdout:3/764: mkdir d7/d9/d10/d33/d90/d3a/dd6/dee 0 2024-04-27T07:33:38.461 INFO:tasks.workunit.client.1.smithi100.stdout:3/765: dwrite d7/d9/d26/d2a/f82 [0,4194304] 0 2024-04-27T07:33:38.467 INFO:tasks.workunit.client.1.smithi100.stdout:3/766: getdents d7/d9/d26/d2a 0 2024-04-27T07:33:38.469 INFO:tasks.workunit.client.1.smithi100.stdout:3/767: mknod d7/d9/d26/cef 0 2024-04-27T07:33:38.475 INFO:tasks.workunit.client.1.smithi100.stdout:3/768: dwrite d7/d9/d10/f15 [4194304,4194304] 0 2024-04-27T07:33:38.475 INFO:tasks.workunit.client.1.smithi100.stdout:3/769: chown d7/d9/d10/d33/l36 41048 1 2024-04-27T07:33:38.477 INFO:tasks.workunit.client.1.smithi100.stdout:4/598: sync 2024-04-27T07:33:38.477 INFO:tasks.workunit.client.1.smithi100.stdout:1/668: sync 2024-04-27T07:33:38.477 INFO:tasks.workunit.client.1.smithi100.stdout:5/516: sync 2024-04-27T07:33:38.479 INFO:tasks.workunit.client.1.smithi100.stdout:5/517: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 [642949,82733] 0 2024-04-27T07:33:38.481 INFO:tasks.workunit.client.1.smithi100.stdout:4/599: rename d5/d1b/d2c/dbd to d5/d16/d19/d46/dd1 0 2024-04-27T07:33:38.482 INFO:tasks.workunit.client.1.smithi100.stdout:5/518: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fa2 x:0 0 0 2024-04-27T07:33:38.509 INFO:tasks.workunit.client.1.smithi100.stdout:1/669: write d0/d1b/d20/d2d/d35/f80 [756550,123088] 0 2024-04-27T07:33:38.509 INFO:tasks.workunit.client.1.smithi100.stdout:5/519: dread d0/fa [0,4194304] 0 2024-04-27T07:33:38.511 INFO:tasks.workunit.client.1.smithi100.stdout:1/670: dread - d0/d1b/d20/d2d/d35/d4d/d60/fbd zero size 2024-04-27T07:33:38.512 INFO:tasks.workunit.client.1.smithi100.stdout:5/520: creat d0/d42/d94/d97/fa3 x:0 0 0 2024-04-27T07:33:38.513 INFO:tasks.workunit.client.1.smithi100.stdout:4/600: dwrite d5/d23/fb6 [0,4194304] 0 2024-04-27T07:33:38.515 INFO:tasks.workunit.client.1.smithi100.stdout:4/601: read d5/d1b/f80 [3957315,119881] 0 2024-04-27T07:33:38.516 INFO:tasks.workunit.client.1.smithi100.stdout:4/602: chown d5/d1b/d65/c66 543135 1 2024-04-27T07:33:38.517 INFO:tasks.workunit.client.1.smithi100.stdout:4/603: stat d5/d1b/d2c/d50/db0/fcf 0 2024-04-27T07:33:38.518 INFO:tasks.workunit.client.1.smithi100.stdout:5/521: rmdir d0/d4/d21 39 2024-04-27T07:33:38.524 INFO:tasks.workunit.client.1.smithi100.stdout:4/604: dwrite d5/d23/fc4 [0,4194304] 0 2024-04-27T07:33:38.525 INFO:tasks.workunit.client.1.smithi100.stdout:1/671: link d0/d1f/l5a d0/d23/d3a/ldb 0 2024-04-27T07:33:38.525 INFO:tasks.workunit.client.1.smithi100.stdout:5/522: chown d0/d4/d21/d24/f47 282506 1 2024-04-27T07:33:38.526 INFO:tasks.workunit.client.1.smithi100.stdout:1/672: write d0/d1f/fc2 [1982436,63924] 0 2024-04-27T07:33:38.529 INFO:tasks.workunit.client.1.smithi100.stdout:1/673: write d0/f18 [1362500,69630] 0 2024-04-27T07:33:38.530 INFO:tasks.workunit.client.1.smithi100.stdout:4/605: write d5/fc [2037802,112032] 0 2024-04-27T07:33:38.533 INFO:tasks.workunit.client.1.smithi100.stdout:4/606: mkdir d5/d16/d19/d46/dd1/dd2 0 2024-04-27T07:33:38.535 INFO:tasks.workunit.client.1.smithi100.stdout:5/523: truncate d0/d4/d21/d24/d2f/d57/d37/f3f 3390758 0 2024-04-27T07:33:38.537 INFO:tasks.workunit.client.1.smithi100.stdout:4/607: mkdir d5/d1b/d65/dc6/dd3 0 2024-04-27T07:33:38.537 INFO:tasks.workunit.client.1.smithi100.stdout:5/524: chown d0/d4/d21/d24/d2f/f8a 468 1 2024-04-27T07:33:38.537 INFO:tasks.workunit.client.1.smithi100.stdout:1/674: dwrite d0/d1b/d20/d2d/d35/d65/f76 [0,4194304] 0 2024-04-27T07:33:38.540 INFO:tasks.workunit.client.1.smithi100.stdout:4/608: mknod d5/d16/cd4 0 2024-04-27T07:33:38.540 INFO:tasks.workunit.client.1.smithi100.stdout:5/525: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 0 2024-04-27T07:33:38.541 INFO:tasks.workunit.client.1.smithi100.stdout:1/675: truncate d0/d1b/d20/d2d/d35/d65/fb9 275176 0 2024-04-27T07:33:38.542 INFO:tasks.workunit.client.1.smithi100.stdout:4/609: dread d5/d16/d19/d46/d53/f98 [0,4194304] 0 2024-04-27T07:33:38.543 INFO:tasks.workunit.client.1.smithi100.stdout:1/676: creat d0/d1b/d20/fdc x:0 0 0 2024-04-27T07:33:38.547 INFO:tasks.workunit.client.1.smithi100.stdout:4/610: symlink d5/d16/d19/d21/d77/d94/d9f/ld5 0 2024-04-27T07:33:38.551 INFO:tasks.workunit.client.1.smithi100.stdout:4/611: mkdir d5/d16/d19/d21/d77/d94/d9f/dd6 0 2024-04-27T07:33:38.552 INFO:tasks.workunit.client.1.smithi100.stdout:4/612: rmdir d5/d1b/d65 39 2024-04-27T07:33:38.555 INFO:tasks.workunit.client.1.smithi100.stdout:5/526: write d0/d4/d21/d24/d2f/d57/f55 [350538,62187] 0 2024-04-27T07:33:38.556 INFO:tasks.workunit.client.1.smithi100.stdout:4/613: mkdir d5/d1b/d2c/dd7 0 2024-04-27T07:33:38.557 INFO:tasks.workunit.client.1.smithi100.stdout:5/527: symlink d0/d4/d21/d24/la4 0 2024-04-27T07:33:38.561 INFO:tasks.workunit.client.1.smithi100.stdout:5/528: rename d0/d4/d21/d24/d46/f8c to d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fa5 0 2024-04-27T07:33:38.563 INFO:tasks.workunit.client.1.smithi100.stdout:5/529: truncate d0/d42/d94/d97/fa3 598191 0 2024-04-27T07:33:38.564 INFO:tasks.workunit.client.1.smithi100.stdout:5/530: dread - d0/d4/d21/d24/d2f/d57/f91 zero size 2024-04-27T07:33:38.565 INFO:tasks.workunit.client.1.smithi100.stdout:5/531: fsync d0/d4/d21/d24/d2f/d39/d56/f85 0 2024-04-27T07:33:38.566 INFO:tasks.workunit.client.1.smithi100.stdout:5/532: read d0/d42/f9b [1188998,77985] 0 2024-04-27T07:33:38.569 INFO:tasks.workunit.client.1.smithi100.stdout:5/533: creat d0/d4/d21/d24/d2f/d39/d56/fa6 x:0 0 0 2024-04-27T07:33:38.570 INFO:tasks.workunit.client.1.smithi100.stdout:5/534: stat d0/d4/d21/d24/d2f/c62 0 2024-04-27T07:33:38.570 INFO:tasks.workunit.client.1.smithi100.stdout:4/614: dread d5/f15 [0,4194304] 0 2024-04-27T07:33:38.574 INFO:tasks.workunit.client.1.smithi100.stdout:4/615: unlink d5/d16/d19/d21/fac 0 2024-04-27T07:33:38.575 INFO:tasks.workunit.client.1.smithi100.stdout:5/535: getdents d0/d42/d94/d97/d60 0 2024-04-27T07:33:38.577 INFO:tasks.workunit.client.1.smithi100.stdout:4/616: creat d5/d16/d19/d46/dd1/dd2/fd8 x:0 0 0 2024-04-27T07:33:38.580 INFO:tasks.workunit.client.1.smithi100.stdout:4/617: symlink d5/d16/d19/d46/d53/dba/dd0/ld9 0 2024-04-27T07:33:38.581 INFO:tasks.workunit.client.1.smithi100.stdout:4/618: symlink d5/d16/d19/d21/d6d/lda 0 2024-04-27T07:33:38.582 INFO:tasks.workunit.client.1.smithi100.stdout:4/619: chown d5/f9 16 1 2024-04-27T07:33:38.592 INFO:tasks.workunit.client.1.smithi100.stdout:4/620: dread d5/f6 [0,4194304] 0 2024-04-27T07:33:38.594 INFO:tasks.workunit.client.1.smithi100.stdout:4/621: mknod d5/d16/d19/d46/d53/d7e/cdb 0 2024-04-27T07:33:38.596 INFO:tasks.workunit.client.1.smithi100.stdout:4/622: write d5/d16/d19/d46/d53/f98 [692871,96835] 0 2024-04-27T07:33:38.605 INFO:tasks.workunit.client.1.smithi100.stdout:4/623: truncate d5/d23/f3c 2125799 0 2024-04-27T07:33:38.607 INFO:tasks.workunit.client.1.smithi100.stdout:4/624: mknod d5/d16/d19/d21/d77/d94/d9f/dd6/cdc 0 2024-04-27T07:33:38.608 INFO:tasks.workunit.client.1.smithi100.stdout:4/625: creat d5/d1b/d2c/d7d/fdd x:0 0 0 2024-04-27T07:33:38.609 INFO:tasks.workunit.client.1.smithi100.stdout:4/626: truncate d5/d16/d19/d21/d2b/fab 393888 0 2024-04-27T07:33:38.615 INFO:tasks.workunit.client.1.smithi100.stdout:4/627: dwrite d5/d23/fb6 [0,4194304] 0 2024-04-27T07:33:38.622 INFO:tasks.workunit.client.1.smithi100.stdout:4/628: dwrite d5/d1b/d2c/f8d [0,4194304] 0 2024-04-27T07:33:38.626 INFO:tasks.workunit.client.1.smithi100.stdout:4/629: creat d5/d16/d19/d21/d77/d94/d9f/dd6/fde x:0 0 0 2024-04-27T07:33:38.626 INFO:tasks.workunit.client.1.smithi100.stdout:4/630: truncate d5/d16/fa1 4474678 0 2024-04-27T07:33:38.630 INFO:tasks.workunit.client.1.smithi100.stdout:4/631: rename d5/d16/d19/d21/d77/d94/d9f/dd6/cdc to d5/d16/d19/d21/d6d/dad/cdf 0 2024-04-27T07:33:38.632 INFO:tasks.workunit.client.1.smithi100.stdout:4/632: mkdir d5/d16/d19/dca/de0 0 2024-04-27T07:33:38.635 INFO:tasks.workunit.client.1.smithi100.stdout:4/633: symlink d5/d1b/d65/dc6/dd3/le1 0 2024-04-27T07:33:38.636 INFO:tasks.workunit.client.1.smithi100.stdout:4/634: chown d5/d16/d19/d21/d77/d94/d9f 256856968 1 2024-04-27T07:33:38.641 INFO:tasks.workunit.client.1.smithi100.stdout:4/635: dwrite d5/d1b/d65/fc1 [0,4194304] 0 2024-04-27T07:33:38.646 INFO:tasks.workunit.client.1.smithi100.stdout:4/636: dwrite d5/d16/d19/d21/f41 [4194304,4194304] 0 2024-04-27T07:33:38.648 INFO:tasks.workunit.client.1.smithi100.stdout:4/637: write d5/d16/d19/d46/dd1/dd2/fd8 [497027,39170] 0 2024-04-27T07:33:38.685 INFO:tasks.workunit.client.1.smithi100.stdout:9/566: sync 2024-04-27T07:33:38.686 INFO:tasks.workunit.client.1.smithi100.stdout:4/638: write d5/d16/d19/d21/d2b/fab [713194,124666] 0 2024-04-27T07:33:38.688 INFO:tasks.workunit.client.1.smithi100.stdout:4/639: mkdir d5/d16/d19/d46/dd1/de2 0 2024-04-27T07:33:38.691 INFO:tasks.workunit.client.1.smithi100.stdout:4/640: rename d5/d1b/d2c/d7d/fdd to d5/fe3 0 2024-04-27T07:33:38.764 INFO:tasks.workunit.client.1.smithi100.stdout:9/567: getdents d1/d9/db/d2b/d4f/da3 0 2024-04-27T07:33:38.765 INFO:tasks.workunit.client.1.smithi100.stdout:4/641: read d5/d16/d19/f73 [2513334,89078] 0 2024-04-27T07:33:38.765 INFO:tasks.workunit.client.1.smithi100.stdout:4/642: read - d5/d1b/fbc zero size 2024-04-27T07:33:38.768 INFO:tasks.workunit.client.1.smithi100.stdout:4/643: write d5/d16/d4c/f7c [8380300,114687] 0 2024-04-27T07:33:38.768 INFO:tasks.workunit.client.1.smithi100.stdout:9/568: mknod d1/d9/db/d56/d5c/cd2 0 2024-04-27T07:33:38.769 INFO:tasks.workunit.client.1.smithi100.stdout:4/644: chown d5/d23/d33/fa7 111283527 1 2024-04-27T07:33:38.773 INFO:tasks.workunit.client.1.smithi100.stdout:9/569: unlink d1/d9/d1f/d4a/d67/l8d 0 2024-04-27T07:33:38.776 INFO:tasks.workunit.client.1.smithi100.stdout:9/570: write d1/d9/db/d2b/d4f/f72 [831702,70297] 0 2024-04-27T07:33:38.777 INFO:tasks.workunit.client.1.smithi100.stdout:4/645: dwrite d5/d1b/d2c/d3f/f57 [0,4194304] 0 2024-04-27T07:33:38.783 INFO:tasks.workunit.client.1.smithi100.stdout:9/571: unlink d1/d9/d1f/d4a/d67/c80 0 2024-04-27T07:33:38.786 INFO:tasks.workunit.client.1.smithi100.stdout:4/646: dwrite d5/d1b/d2c/d50/db0/fcf [0,4194304] 0 2024-04-27T07:33:38.789 INFO:tasks.workunit.client.1.smithi100.stdout:9/572: creat d1/d9/d1f/fd3 x:0 0 0 2024-04-27T07:33:38.792 INFO:tasks.workunit.client.1.smithi100.stdout:9/573: symlink d1/d76/ld4 0 2024-04-27T07:33:38.795 INFO:tasks.workunit.client.1.smithi100.stdout:9/574: creat d1/d9/db/da1/db4/fd5 x:0 0 0 2024-04-27T07:33:38.796 INFO:tasks.workunit.client.1.smithi100.stdout:9/575: readlink d1/d9/db/d2b/l4b 0 2024-04-27T07:33:38.798 INFO:tasks.workunit.client.1.smithi100.stdout:9/576: mkdir d1/d76/dd6 0 2024-04-27T07:33:38.798 INFO:tasks.workunit.client.1.smithi100.stdout:2/569: sync 2024-04-27T07:33:38.798 INFO:tasks.workunit.client.1.smithi100.stdout:7/579: sync 2024-04-27T07:33:38.799 INFO:tasks.workunit.client.1.smithi100.stdout:7/580: write d1/dd/d16/d70/f59 [699695,53449] 0 2024-04-27T07:33:38.807 INFO:tasks.workunit.client.1.smithi100.stdout:4/647: write d5/d23/f3c [1535095,103657] 0 2024-04-27T07:33:38.808 INFO:tasks.workunit.client.1.smithi100.stdout:9/577: dwrite d1/d9/d1f/f8e [0,4194304] 0 2024-04-27T07:33:38.810 INFO:tasks.workunit.client.1.smithi100.stdout:2/570: getdents d0/d79/d94/dbc/d98/db1 0 2024-04-27T07:33:38.811 INFO:tasks.workunit.client.1.smithi100.stdout:7/581: dread d1/dd/d2a/f93 [0,4194304] 0 2024-04-27T07:33:38.812 INFO:tasks.workunit.client.1.smithi100.stdout:4/648: unlink d5/d1b/d2c/d7d/c1d 0 2024-04-27T07:33:38.815 INFO:tasks.workunit.client.1.smithi100.stdout:2/571: fdatasync d0/da/d29/f3c 0 2024-04-27T07:33:38.816 INFO:tasks.workunit.client.1.smithi100.stdout:7/582: creat d1/dd/d16/d3e/fa9 x:0 0 0 2024-04-27T07:33:38.818 INFO:tasks.workunit.client.1.smithi100.stdout:7/583: symlink d1/dd/d16/d70/d51/d9d/laa 0 2024-04-27T07:33:38.822 INFO:tasks.workunit.client.1.smithi100.stdout:2/572: rename d0/da/d39/l4d to d0/da/d29/d47/d5a/lc2 0 2024-04-27T07:33:38.824 INFO:tasks.workunit.client.1.smithi100.stdout:4/649: getdents d5/d1b/d2c/d50/db0 0 2024-04-27T07:33:38.827 INFO:tasks.workunit.client.1.smithi100.stdout:2/573: mkdir d0/da/d29/d47/da1/dc3 0 2024-04-27T07:33:38.830 INFO:tasks.workunit.client.1.smithi100.stdout:4/650: unlink d5/d16/d19/d46/c71 0 2024-04-27T07:33:38.837 INFO:tasks.workunit.client.1.smithi100.stdout:7/584: write d1/dd/d16/d2b/d7f/f83 [1272589,100761] 0 2024-04-27T07:33:38.838 INFO:tasks.workunit.client.1.smithi100.stdout:4/651: dwrite d5/d16/d4c/f7c [4194304,4194304] 0 2024-04-27T07:33:38.839 INFO:tasks.workunit.client.1.smithi100.stdout:9/578: dread d1/d9/db/d2b/f7d [0,4194304] 0 2024-04-27T07:33:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:38 smithi082 ceph-mon[26613]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 82 MiB/s rd, 253 MiB/s wr, 480 op/s 2024-04-27T07:33:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:38 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:38.843 INFO:tasks.workunit.client.1.smithi100.stdout:4/652: symlink d5/d23/d33/le4 0 2024-04-27T07:33:38.845 INFO:tasks.workunit.client.1.smithi100.stdout:4/653: read d5/d16/d4c/fc2 [691389,94807] 0 2024-04-27T07:33:38.846 INFO:tasks.workunit.client.1.smithi100.stdout:9/579: write d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f90 [598415,114004] 0 2024-04-27T07:33:38.846 INFO:tasks.workunit.client.1.smithi100.stdout:2/574: dread d0/d79/fad [0,4194304] 0 2024-04-27T07:33:38.848 INFO:tasks.workunit.client.1.smithi100.stdout:9/580: write d1/d9/d1f/f7b [29965,43879] 0 2024-04-27T07:33:38.849 INFO:tasks.workunit.client.1.smithi100.stdout:2/575: stat d0/da/d29/d47/d5a/d8d/fa9 0 2024-04-27T07:33:38.849 INFO:tasks.workunit.client.1.smithi100.stdout:7/585: rename d1/f6 to d1/dd/d16/d4a/fab 0 2024-04-27T07:33:38.854 INFO:tasks.workunit.client.1.smithi100.stdout:9/581: unlink d1/d9/d1f/f3c 0 2024-04-27T07:33:38.857 INFO:tasks.workunit.client.1.smithi100.stdout:2/576: rename d0/d79/d94/dbc/d98/c9d to d0/da/d29/d47/d5a/d82/cc4 0 2024-04-27T07:33:38.860 INFO:tasks.workunit.client.1.smithi100.stdout:7/586: link d1/dd/f5d d1/dd/d16/d70/d51/d6f/fac 0 2024-04-27T07:33:38.862 INFO:tasks.workunit.client.1.smithi100.stdout:2/577: mknod d0/da/d29/d47/d87/d8b/cc5 0 2024-04-27T07:33:38.862 INFO:tasks.workunit.client.1.smithi100.stdout:9/582: getdents d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7 0 2024-04-27T07:33:38.865 INFO:tasks.workunit.client.1.smithi100.stdout:4/654: dwrite d5/f32 [0,4194304] 0 2024-04-27T07:33:38.868 INFO:tasks.workunit.client.1.smithi100.stdout:9/583: unlink d1/d9/db/f51 0 2024-04-27T07:33:38.869 INFO:tasks.workunit.client.1.smithi100.stdout:2/578: rename d0/da/d29/f3c to d0/da/d29/d47/d87/d88/fc6 0 2024-04-27T07:33:38.869 INFO:tasks.workunit.client.1.smithi100.stdout:7/587: link d1/dd/d16/d2b/c37 d1/dd/d2a/d2c/cad 0 2024-04-27T07:33:38.871 INFO:tasks.workunit.client.1.smithi100.stdout:9/584: creat d1/d9/d1f/d4a/d67/d8a/fd7 x:0 0 0 2024-04-27T07:33:38.872 INFO:tasks.workunit.client.1.smithi100.stdout:9/585: readlink d1/d9/db/d2b/d4f/dac/d54/d61/lb6 0 2024-04-27T07:33:38.873 INFO:tasks.workunit.client.1.smithi100.stdout:4/655: rename d5/d16/d2e/l35 to d5/d1b/d2c/d3f/le5 0 2024-04-27T07:33:38.873 INFO:tasks.workunit.client.1.smithi100.stdout:2/579: fsync d0/f24 0 2024-04-27T07:33:38.875 INFO:tasks.workunit.client.1.smithi100.stdout:9/586: creat d1/d76/dd6/fd8 x:0 0 0 2024-04-27T07:33:38.877 INFO:tasks.workunit.client.1.smithi100.stdout:4/656: symlink d5/d16/d2e/le6 0 2024-04-27T07:33:38.881 INFO:tasks.workunit.client.1.smithi100.stdout:4/657: creat d5/d1b/d2c/d7d/d8a/fe7 x:0 0 0 2024-04-27T07:33:38.882 INFO:tasks.workunit.client.1.smithi100.stdout:2/580: getdents d0/da/d29/d47/d87 0 2024-04-27T07:33:38.882 INFO:tasks.workunit.client.1.smithi100.stdout:4/658: truncate d5/fc 3459362 0 2024-04-27T07:33:38.885 INFO:tasks.workunit.client.1.smithi100.stdout:4/659: chown d5/d1b/d2c/d7d/l6b 99492753 1 2024-04-27T07:33:38.887 INFO:tasks.workunit.client.1.smithi100.stdout:7/588: dread d1/dd/d16/d70/f79 [0,4194304] 0 2024-04-27T07:33:38.887 INFO:tasks.workunit.client.1.smithi100.stdout:9/587: dwrite d1/d9/d1f/fca [0,4194304] 0 2024-04-27T07:33:38.889 INFO:tasks.workunit.client.1.smithi100.stdout:4/660: mknod d5/d16/d19/d46/d53/d7e/ce8 0 2024-04-27T07:33:38.890 INFO:tasks.workunit.client.1.smithi100.stdout:9/588: rmdir d1/d9/db/d2b/d4f 39 2024-04-27T07:33:38.892 INFO:tasks.workunit.client.1.smithi100.stdout:4/661: fdatasync d5/d16/d19/d21/d77/d94/d9f/dd6/fde 0 2024-04-27T07:33:38.896 INFO:tasks.workunit.client.1.smithi100.stdout:4/662: mkdir d5/d1b/d65/de9 0 2024-04-27T07:33:38.897 INFO:tasks.workunit.client.1.smithi100.stdout:6/651: sync 2024-04-27T07:33:38.897 INFO:tasks.workunit.client.1.smithi100.stdout:7/589: dwrite d1/f15 [0,4194304] 0 2024-04-27T07:33:38.899 INFO:tasks.workunit.client.1.smithi100.stdout:6/652: readlink de/l6c 0 2024-04-27T07:33:38.900 INFO:tasks.workunit.client.1.smithi100.stdout:4/663: symlink d5/d1b/d2c/d7d/lea 0 2024-04-27T07:33:38.900 INFO:tasks.workunit.client.1.smithi100.stdout:9/589: dwrite d1/d9/d1f/f98 [0,4194304] 0 2024-04-27T07:33:38.906 INFO:tasks.workunit.client.1.smithi100.stdout:6/653: rename de/d58/d75/cb4 to de/d2e/d3f/ce4 0 2024-04-27T07:33:38.909 INFO:tasks.workunit.client.1.smithi100.stdout:9/590: getdents d1/d9/db/d2b/d9c 0 2024-04-27T07:33:38.911 INFO:tasks.workunit.client.1.smithi100.stdout:7/590: read d1/dd/d16/d31/d4c/f81 [251123,113157] 0 2024-04-27T07:33:38.911 INFO:tasks.workunit.client.1.smithi100.stdout:4/664: rename d5/d16/c69 to d5/d16/d2e/ceb 0 2024-04-27T07:33:38.913 INFO:tasks.workunit.client.1.smithi100.stdout:2/581: write d0/f12 [411373,4724] 0 2024-04-27T07:33:38.914 INFO:tasks.workunit.client.1.smithi100.stdout:9/591: chown d1/d9/db/d2b/d4f/dac/d54/d61/d9b 2547 1 2024-04-27T07:33:38.915 INFO:tasks.workunit.client.1.smithi100.stdout:4/665: mkdir d5/d1b/d2c/d3f/dec 0 2024-04-27T07:33:38.915 INFO:tasks.workunit.client.1.smithi100.stdout:2/582: dread - d0/d79/d94/dbc/d98/db1/fb8 zero size 2024-04-27T07:33:38.916 INFO:tasks.workunit.client.1.smithi100.stdout:9/592: write d1/d9/db/da1/db4/fb8 [1013071,14787] 0 2024-04-27T07:33:38.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:38 smithi100 ceph-mon[34183]: pgmap v25: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 82 MiB/s rd, 253 MiB/s wr, 480 op/s 2024-04-27T07:33:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:38 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:38.917 INFO:tasks.workunit.client.1.smithi100.stdout:4/666: fsync d5/d16/d4c/f7f 0 2024-04-27T07:33:38.918 INFO:tasks.workunit.client.1.smithi100.stdout:4/667: dread - d5/d16/fcd zero size 2024-04-27T07:33:38.918 INFO:tasks.workunit.client.1.smithi100.stdout:6/654: creat de/d58/d21/fe5 x:0 0 0 2024-04-27T07:33:38.919 INFO:tasks.workunit.client.1.smithi100.stdout:7/591: getdents d1/dd/d16/d3e/d8b/da4 0 2024-04-27T07:33:38.921 INFO:tasks.workunit.client.1.smithi100.stdout:4/668: write d5/d16/d4c/f7f [3327891,29989] 0 2024-04-27T07:33:38.923 INFO:tasks.workunit.client.1.smithi100.stdout:7/592: fdatasync d1/dd/d16/d70/f79 0 2024-04-27T07:33:38.923 INFO:tasks.workunit.client.1.smithi100.stdout:9/593: chown d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/la8 4772791 1 2024-04-27T07:33:38.925 INFO:tasks.workunit.client.1.smithi100.stdout:4/669: mknod d5/d1b/d2c/d50/ced 0 2024-04-27T07:33:38.926 INFO:tasks.workunit.client.1.smithi100.stdout:7/593: write d1/dd/d2a/d2c/f43 [1059379,57430] 0 2024-04-27T07:33:38.927 INFO:tasks.workunit.client.1.smithi100.stdout:2/583: dwrite d0/da/d29/f13 [0,4194304] 0 2024-04-27T07:33:38.928 INFO:tasks.workunit.client.1.smithi100.stdout:4/670: chown d5/d1b/d2c/f8d 819641 1 2024-04-27T07:33:38.933 INFO:tasks.workunit.client.1.smithi100.stdout:7/594: symlink d1/dd/d16/d2b/d7f/lae 0 2024-04-27T07:33:38.934 INFO:tasks.workunit.client.1.smithi100.stdout:9/594: dwrite d1/d9/db/d56/f83 [0,4194304] 0 2024-04-27T07:33:38.938 INFO:tasks.workunit.client.1.smithi100.stdout:9/595: read - d1/d9/db/d2b/d4f/dac/d54/f99 zero size 2024-04-27T07:33:38.938 INFO:tasks.workunit.client.1.smithi100.stdout:4/671: dread d5/d16/d19/d21/f41 [4194304,4194304] 0 2024-04-27T07:33:38.940 INFO:tasks.workunit.client.1.smithi100.stdout:6/655: truncate de/d2e/f55 5568684 0 2024-04-27T07:33:38.944 INFO:tasks.workunit.client.1.smithi100.stdout:4/672: creat d5/d1b/fee x:0 0 0 2024-04-27T07:33:38.945 INFO:tasks.workunit.client.1.smithi100.stdout:9/596: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/fd9 x:0 0 0 2024-04-27T07:33:38.946 INFO:tasks.workunit.client.1.smithi100.stdout:7/595: dwrite d1/d75/f8e [0,4194304] 0 2024-04-27T07:33:38.949 INFO:tasks.workunit.client.1.smithi100.stdout:6/656: rmdir de/d58/d21/d91 39 2024-04-27T07:33:38.954 INFO:tasks.workunit.client.1.smithi100.stdout:3/770: sync 2024-04-27T07:33:38.954 INFO:tasks.workunit.client.1.smithi100.stdout:0/575: sync 2024-04-27T07:33:38.954 INFO:tasks.workunit.client.1.smithi100.stdout:8/596: sync 2024-04-27T07:33:38.955 INFO:tasks.workunit.client.1.smithi100.stdout:5/536: sync 2024-04-27T07:33:38.955 INFO:tasks.workunit.client.1.smithi100.stdout:1/677: sync 2024-04-27T07:33:38.965 INFO:tasks.workunit.client.1.smithi100.stdout:4/673: dwrite d5/d16/d19/f3d [4194304,4194304] 0 2024-04-27T07:33:38.966 INFO:tasks.workunit.client.1.smithi100.stdout:8/597: symlink d6/d20/d54/d91/dae/lbd 0 2024-04-27T07:33:38.968 INFO:tasks.workunit.client.1.smithi100.stdout:3/771: rename d7/d9/d10/d33/l36 to d7/d9/d10/d33/d47/lf0 0 2024-04-27T07:33:38.969 INFO:tasks.workunit.client.1.smithi100.stdout:9/597: getdents d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1 0 2024-04-27T07:33:38.970 INFO:tasks.workunit.client.1.smithi100.stdout:6/657: dwrite de/d58/d21/f83 [0,4194304] 0 2024-04-27T07:33:38.970 INFO:tasks.workunit.client.1.smithi100.stdout:1/678: write d0/d1b/d20/d2d/d35/d65/fc6 [3912544,98737] 0 2024-04-27T07:33:38.971 INFO:tasks.workunit.client.1.smithi100.stdout:5/537: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 [1449262,82412] 0 2024-04-27T07:33:38.971 INFO:tasks.workunit.client.1.smithi100.stdout:0/576: creat d1/d8/d20/d72/fc3 x:0 0 0 2024-04-27T07:33:38.972 INFO:tasks.workunit.client.1.smithi100.stdout:2/584: dread d0/da/d29/d47/d5a/d8d/f4b [0,4194304] 0 2024-04-27T07:33:38.975 INFO:tasks.workunit.client.1.smithi100.stdout:4/674: mkdir d5/d16/d19/d46/def 0 2024-04-27T07:33:38.977 INFO:tasks.workunit.client.1.smithi100.stdout:8/598: read d6/d20/d2a/f49 [2503884,118047] 0 2024-04-27T07:33:38.982 INFO:tasks.workunit.client.1.smithi100.stdout:7/596: dread d1/dd/f47 [0,4194304] 0 2024-04-27T07:33:38.986 INFO:tasks.workunit.client.1.smithi100.stdout:1/679: mkdir d0/d1f/d6d/db4/d4e/d7b/ddd 0 2024-04-27T07:33:38.991 INFO:tasks.workunit.client.1.smithi100.stdout:6/658: fsync de/d58/f1b 0 2024-04-27T07:33:38.991 INFO:tasks.workunit.client.1.smithi100.stdout:4/675: mkdir d5/d1b/d2c/dd7/df0 0 2024-04-27T07:33:38.998 INFO:tasks.workunit.client.1.smithi100.stdout:8/599: symlink d6/lbe 0 2024-04-27T07:33:38.999 INFO:tasks.workunit.client.1.smithi100.stdout:9/598: dwrite d1/d9/db/d2b/d31/f5b [0,4194304] 0 2024-04-27T07:33:39.001 INFO:tasks.workunit.client.1.smithi100.stdout:0/577: dwrite d1/d8/d20/f37 [4194304,4194304] 0 2024-04-27T07:33:39.009 INFO:tasks.workunit.client.1.smithi100.stdout:1/680: dwrite d0/d1b/d20/d2d/d35/f89 [0,4194304] 0 2024-04-27T07:33:39.013 INFO:tasks.workunit.client.1.smithi100.stdout:8/600: dread d6/d1b/d75/faa [0,4194304] 0 2024-04-27T07:33:39.013 INFO:tasks.workunit.client.1.smithi100.stdout:2/585: dwrite d0/da/f6b [0,4194304] 0 2024-04-27T07:33:39.014 INFO:tasks.workunit.client.1.smithi100.stdout:5/538: link d0/d4/d21/d24/d2f/d39/l49 d0/d4/d21/d51/la7 0 2024-04-27T07:33:39.021 INFO:tasks.workunit.client.1.smithi100.stdout:0/578: creat d1/d8/d20/d72/d96/fc4 x:0 0 0 2024-04-27T07:33:39.024 INFO:tasks.workunit.client.1.smithi100.stdout:1/681: chown d0/d1f/d6d/db4/d4e/d7b/l7c 56630 1 2024-04-27T07:33:39.025 INFO:tasks.workunit.client.1.smithi100.stdout:5/539: readlink d0/d4/l2c 0 2024-04-27T07:33:39.026 INFO:tasks.workunit.client.1.smithi100.stdout:8/601: rename d6/d20/l21 to d6/d20/d50/d72/lbf 0 2024-04-27T07:33:39.027 INFO:tasks.workunit.client.1.smithi100.stdout:8/602: chown d6 7657 1 2024-04-27T07:33:39.027 INFO:tasks.workunit.client.1.smithi100.stdout:5/540: stat d0/d4/d21/d24/d2f/d57/d37/d1a/d34/l4c 0 2024-04-27T07:33:39.029 INFO:tasks.workunit.client.1.smithi100.stdout:3/772: dread d7/d9/d10/d33/d90/f2e [0,4194304] 0 2024-04-27T07:33:39.029 INFO:tasks.workunit.client.1.smithi100.stdout:0/579: fdatasync d1/d8/d20/f28 0 2024-04-27T07:33:39.031 INFO:tasks.workunit.client.1.smithi100.stdout:2/586: symlink d0/d1e/lc7 0 2024-04-27T07:33:39.031 INFO:tasks.workunit.client.1.smithi100.stdout:3/773: dread - d7/d9/d10/d3e/d74/da8/fec zero size 2024-04-27T07:33:39.032 INFO:tasks.workunit.client.1.smithi100.stdout:1/682: creat d0/d1f/d6d/fde x:0 0 0 2024-04-27T07:33:39.032 INFO:tasks.workunit.client.1.smithi100.stdout:6/659: dread de/d58/d21/d24/f54 [0,4194304] 0 2024-04-27T07:33:39.033 INFO:tasks.workunit.client.1.smithi100.stdout:8/603: stat d6/d20/l70 0 2024-04-27T07:33:39.034 INFO:tasks.workunit.client.1.smithi100.stdout:5/541: unlink d0/d4/d21/d24/d2f/d39/d7c/c86 0 2024-04-27T07:33:39.034 INFO:tasks.workunit.client.1.smithi100.stdout:1/683: chown d0/d1f/d6d/db4/d4e/d7b/fcf 1884 1 2024-04-27T07:33:39.036 INFO:tasks.workunit.client.1.smithi100.stdout:8/604: chown d6/d20/d54/la7 37006073 1 2024-04-27T07:33:39.041 INFO:tasks.workunit.client.1.smithi100.stdout:3/774: getdents d7/d9/d10/d3e/d74/da8 0 2024-04-27T07:33:39.042 INFO:tasks.workunit.client.1.smithi100.stdout:1/684: creat d0/d1f/d6d/db4/d4e/d7b/ddd/fdf x:0 0 0 2024-04-27T07:33:39.043 INFO:tasks.workunit.client.1.smithi100.stdout:0/580: getdents d1/d8/d20/d61/d6a 0 2024-04-27T07:33:39.045 INFO:tasks.workunit.client.1.smithi100.stdout:8/605: dread d6/d1b/d1d/f32 [0,4194304] 0 2024-04-27T07:33:39.048 INFO:tasks.workunit.client.1.smithi100.stdout:5/542: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 [0,4194304] 0 2024-04-27T07:33:39.049 INFO:tasks.workunit.client.1.smithi100.stdout:1/685: symlink d0/d23/d3a/dae/le0 0 2024-04-27T07:33:39.050 INFO:tasks.workunit.client.1.smithi100.stdout:3/775: fdatasync d7/d9/d10/d3e/d74/db1/fcc 0 2024-04-27T07:33:39.051 INFO:tasks.workunit.client.1.smithi100.stdout:4/676: dread d5/d1b/d2c/d3f/f63 [0,4194304] 0 2024-04-27T07:33:39.052 INFO:tasks.workunit.client.1.smithi100.stdout:1/686: write d0/f85 [6758671,112535] 0 2024-04-27T07:33:39.052 INFO:tasks.workunit.client.1.smithi100.stdout:0/581: rename d1/d30/f73 to d1/d8/d14/d59/d99/fc5 0 2024-04-27T07:33:39.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/677: read d5/f88 [4074281,21337] 0 2024-04-27T07:33:39.055 INFO:tasks.workunit.client.1.smithi100.stdout:8/606: mkdir d6/d20/d8b/dc0 0 2024-04-27T07:33:39.060 INFO:tasks.workunit.client.1.smithi100.stdout:6/660: dread de/d2e/d3f/f60 [0,4194304] 0 2024-04-27T07:33:39.060 INFO:tasks.workunit.client.1.smithi100.stdout:3/776: unlink d7/d9/d10/d3e/lb5 0 2024-04-27T07:33:39.061 INFO:tasks.workunit.client.1.smithi100.stdout:3/777: readlink d7/d9/d10/d33/d90/d3a/ld2 0 2024-04-27T07:33:39.062 INFO:tasks.workunit.client.1.smithi100.stdout:1/687: mkdir d0/d1f/d6d/dc7/de1 0 2024-04-27T07:33:39.063 INFO:tasks.workunit.client.1.smithi100.stdout:5/543: mknod d0/ca8 0 2024-04-27T07:33:39.064 INFO:tasks.workunit.client.1.smithi100.stdout:0/582: mknod d1/d8/d14/cc6 0 2024-04-27T07:33:39.065 INFO:tasks.workunit.client.1.smithi100.stdout:0/583: write d1/d38/f9c [4992627,6498] 0 2024-04-27T07:33:39.066 INFO:tasks.workunit.client.1.smithi100.stdout:0/584: chown d1/d8/d20/f28 4 1 2024-04-27T07:33:39.070 INFO:tasks.workunit.client.1.smithi100.stdout:6/661: rename de/l6c to de/d2e/dc0/le6 0 2024-04-27T07:33:39.071 INFO:tasks.workunit.client.1.smithi100.stdout:6/662: chown de/d58/d21/d23/d73/c81 107 1 2024-04-27T07:33:39.072 INFO:tasks.workunit.client.1.smithi100.stdout:3/778: mknod d7/d9/d26/d2a/d5e/d98/cf1 0 2024-04-27T07:33:39.073 INFO:tasks.workunit.client.1.smithi100.stdout:6/663: write de/d58/d28/f59 [2188493,39316] 0 2024-04-27T07:33:39.074 INFO:tasks.workunit.client.1.smithi100.stdout:3/779: write d7/d9/d10/d33/d90/f57 [102408,55658] 0 2024-04-27T07:33:39.078 INFO:tasks.workunit.client.1.smithi100.stdout:3/780: read d7/d9/d10/d28/f7d [1285526,49322] 0 2024-04-27T07:33:39.080 INFO:tasks.workunit.client.1.smithi100.stdout:5/544: getdents d0/d42/d94/d97/d60 0 2024-04-27T07:33:39.084 INFO:tasks.workunit.client.1.smithi100.stdout:0/585: dread d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:39.084 INFO:tasks.workunit.client.1.smithi100.stdout:7/597: truncate d1/dd/d16/d70/d51/d6f/f92 928974 0 2024-04-27T07:33:39.085 INFO:tasks.workunit.client.1.smithi100.stdout:0/586: chown d1/d8/d20/f37 240427 1 2024-04-27T07:33:39.087 INFO:tasks.workunit.client.1.smithi100.stdout:3/781: rmdir d7/d9/d10/d33/d90 39 2024-04-27T07:33:39.087 INFO:tasks.workunit.client.1.smithi100.stdout:0/587: stat d1/d8/d14/d59/c8c 0 2024-04-27T07:33:39.087 INFO:tasks.workunit.client.1.smithi100.stdout:7/598: dread d1/dd/d2a/f93 [0,4194304] 0 2024-04-27T07:33:39.088 INFO:tasks.workunit.client.1.smithi100.stdout:5/545: fdatasync d0/d4/f19 0 2024-04-27T07:33:39.090 INFO:tasks.workunit.client.1.smithi100.stdout:5/546: chown d0/d4/d21/d24/d2f/d57 6 1 2024-04-27T07:33:39.090 INFO:tasks.workunit.client.1.smithi100.stdout:1/688: getdents d0/d1f/d97 0 2024-04-27T07:33:39.092 INFO:tasks.workunit.client.1.smithi100.stdout:3/782: mkdir d7/d9/d26/d2a/d5e/df2 0 2024-04-27T07:33:39.092 INFO:tasks.workunit.client.1.smithi100.stdout:5/547: dread d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:39.094 INFO:tasks.workunit.client.1.smithi100.stdout:7/599: unlink d1/dd/d16/l24 0 2024-04-27T07:33:39.096 INFO:tasks.workunit.client.1.smithi100.stdout:0/588: rename d1/d30/lbb to d1/d8/d20/d61/d6a/lc7 0 2024-04-27T07:33:39.096 INFO:tasks.workunit.client.1.smithi100.stdout:6/664: dread de/d58/f22 [0,4194304] 0 2024-04-27T07:33:39.098 INFO:tasks.workunit.client.1.smithi100.stdout:0/589: write d1/d30/f9d [4842911,83938] 0 2024-04-27T07:33:39.098 INFO:tasks.workunit.client.1.smithi100.stdout:9/599: truncate d1/d9/d1f/f3a 4207595 0 2024-04-27T07:33:39.104 INFO:tasks.workunit.client.1.smithi100.stdout:9/600: mkdir d1/d76/dd6/dda 0 2024-04-27T07:33:39.109 INFO:tasks.workunit.client.1.smithi100.stdout:7/600: getdents d1/dd/d2a/d2c 0 2024-04-27T07:33:39.112 INFO:tasks.workunit.client.1.smithi100.stdout:9/601: dwrite d1/d9/db/da1/db4/fb8 [0,4194304] 0 2024-04-27T07:33:39.113 INFO:tasks.workunit.client.1.smithi100.stdout:9/602: fdatasync d1/fbc 0 2024-04-27T07:33:39.117 INFO:tasks.workunit.client.1.smithi100.stdout:4/678: write d5/d1b/d2c/d3f/f63 [2924790,86932] 0 2024-04-27T07:33:39.118 INFO:tasks.workunit.client.1.smithi100.stdout:9/603: fsync d1/d9/db/d2b/d4f/f62 0 2024-04-27T07:33:39.119 INFO:tasks.workunit.client.1.smithi100.stdout:3/783: mkdir d7/d9/d10/d3e/df3 0 2024-04-27T07:33:39.122 INFO:tasks.workunit.client.1.smithi100.stdout:3/784: readlink d7/d9/d26/d2a/d5e/l4d 0 2024-04-27T07:33:39.122 INFO:tasks.workunit.client.1.smithi100.stdout:8/607: write d6/f27 [653386,70703] 0 2024-04-27T07:33:39.123 INFO:tasks.workunit.client.1.smithi100.stdout:6/665: dread de/d2e/f55 [0,4194304] 0 2024-04-27T07:33:39.126 INFO:tasks.workunit.client.1.smithi100.stdout:9/604: dwrite d1/f85 [0,4194304] 0 2024-04-27T07:33:39.129 INFO:tasks.workunit.client.1.smithi100.stdout:4/679: link d5/d16/d19/l1a d5/d23/d33/lf1 0 2024-04-27T07:33:39.130 INFO:tasks.workunit.client.1.smithi100.stdout:3/785: chown d7/d9/d10/d3e/d74/fa3 4993878 1 2024-04-27T07:33:39.132 INFO:tasks.workunit.client.1.smithi100.stdout:3/786: chown d7/d9/d10/d28 3281530 1 2024-04-27T07:33:39.135 INFO:tasks.workunit.client.1.smithi100.stdout:9/605: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/ldb 0 2024-04-27T07:33:39.135 INFO:tasks.workunit.client.1.smithi100.stdout:8/608: dwrite d6/f10 [0,4194304] 0 2024-04-27T07:33:39.139 INFO:tasks.workunit.client.1.smithi100.stdout:1/689: write d0/f26 [3482022,104192] 0 2024-04-27T07:33:39.140 INFO:tasks.workunit.client.1.smithi100.stdout:1/690: readlink d0/d1b/l9d 0 2024-04-27T07:33:39.143 INFO:tasks.workunit.client.1.smithi100.stdout:4/680: mknod d5/d16/cf2 0 2024-04-27T07:33:39.146 INFO:tasks.workunit.client.1.smithi100.stdout:9/606: symlink d1/ldc 0 2024-04-27T07:33:39.147 INFO:tasks.workunit.client.1.smithi100.stdout:7/601: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:39.148 INFO:tasks.workunit.client.1.smithi100.stdout:4/681: write d5/d16/d19/f30 [314480,97875] 0 2024-04-27T07:33:39.149 INFO:tasks.workunit.client.1.smithi100.stdout:6/666: dwrite de/d58/d21/d24/fc9 [0,4194304] 0 2024-04-27T07:33:39.159 INFO:tasks.workunit.client.1.smithi100.stdout:1/691: dwrite d0/d1b/d20/d2d/d35/d65/fc6 [0,4194304] 0 2024-04-27T07:33:39.160 INFO:tasks.workunit.client.1.smithi100.stdout:8/609: dwrite d6/f41 [0,4194304] 0 2024-04-27T07:33:39.161 INFO:tasks.workunit.client.1.smithi100.stdout:7/602: creat d1/dd/d16/d31/d4c/d4d/d3b/faf x:0 0 0 2024-04-27T07:33:39.162 INFO:tasks.workunit.client.1.smithi100.stdout:3/787: dread d7/d9/d26/f59 [0,4194304] 0 2024-04-27T07:33:39.166 INFO:tasks.workunit.client.1.smithi100.stdout:4/682: mkdir d5/d16/d19/df3 0 2024-04-27T07:33:39.168 INFO:tasks.workunit.client.1.smithi100.stdout:1/692: write d0/d1b/d20/fce [657156,26951] 0 2024-04-27T07:33:39.168 INFO:tasks.workunit.client.1.smithi100.stdout:4/683: chown d5/d16/d2e/lc9 108912 1 2024-04-27T07:33:39.169 INFO:tasks.workunit.client.1.smithi100.stdout:6/667: dread de/d58/f7c [0,4194304] 0 2024-04-27T07:33:39.169 INFO:tasks.workunit.client.1.smithi100.stdout:9/607: creat d1/d9/d1f/d4a/d67/fdd x:0 0 0 2024-04-27T07:33:39.171 INFO:tasks.workunit.client.1.smithi100.stdout:7/603: mkdir d1/dd/d2a/db0 0 2024-04-27T07:33:39.171 INFO:tasks.workunit.client.1.smithi100.stdout:4/684: write d5/fe3 [812533,2642] 0 2024-04-27T07:33:39.176 INFO:tasks.workunit.client.1.smithi100.stdout:6/668: rmdir de 39 2024-04-27T07:33:39.179 INFO:tasks.workunit.client.1.smithi100.stdout:3/788: dwrite d7/d9/d10/d33/d90/f81 [0,4194304] 0 2024-04-27T07:33:39.181 INFO:tasks.workunit.client.1.smithi100.stdout:1/693: mkdir d0/d1b/d20/d2d/d35/d4d/de2 0 2024-04-27T07:33:39.181 INFO:tasks.workunit.client.1.smithi100.stdout:4/685: dwrite d5/d16/d19/d46/dd1/dd2/fd8 [0,4194304] 0 2024-04-27T07:33:39.182 INFO:tasks.workunit.client.1.smithi100.stdout:3/789: dread - d7/d9/d10/d28/db0/fbd zero size 2024-04-27T07:33:39.185 INFO:tasks.workunit.client.1.smithi100.stdout:4/686: chown d5/d16/d2e/f38 223 1 2024-04-27T07:33:39.185 INFO:tasks.workunit.client.1.smithi100.stdout:6/669: write de/d58/d21/f83 [4471369,104645] 0 2024-04-27T07:33:39.188 INFO:tasks.workunit.client.1.smithi100.stdout:4/687: dread d5/d16/d19/d46/d53/d7e/fa9 [0,4194304] 0 2024-04-27T07:33:39.188 INFO:tasks.workunit.client.1.smithi100.stdout:1/694: read d0/d1b/d20/d2d/f83 [3207228,50898] 0 2024-04-27T07:33:39.192 INFO:tasks.workunit.client.1.smithi100.stdout:4/688: read d5/f88 [4114926,52901] 0 2024-04-27T07:33:39.194 INFO:tasks.workunit.client.1.smithi100.stdout:6/670: dwrite de/d58/d21/d24/d9f/fc1 [4194304,4194304] 0 2024-04-27T07:33:39.197 INFO:tasks.workunit.client.1.smithi100.stdout:1/695: link d0/d23/f29 d0/d1f/d6d/db4/d40/fe3 0 2024-04-27T07:33:39.200 INFO:tasks.workunit.client.1.smithi100.stdout:4/689: creat d5/d1b/d65/dc6/ff4 x:0 0 0 2024-04-27T07:33:39.201 INFO:tasks.workunit.client.1.smithi100.stdout:6/671: rmdir de/d58/d21/d5b 39 2024-04-27T07:33:39.202 INFO:tasks.workunit.client.1.smithi100.stdout:1/696: write d0/d1f/d6d/db4/f28 [1065066,2066] 0 2024-04-27T07:33:39.205 INFO:tasks.workunit.client.1.smithi100.stdout:6/672: unlink de/d58/d28/f2c 0 2024-04-27T07:33:39.206 INFO:tasks.workunit.client.1.smithi100.stdout:6/673: truncate de/d2e/f96 526639 0 2024-04-27T07:33:39.207 INFO:tasks.workunit.client.1.smithi100.stdout:1/697: rmdir d0/d1f/d6d/db4 39 2024-04-27T07:33:39.209 INFO:tasks.workunit.client.1.smithi100.stdout:1/698: fdatasync d0/da0/fc4 0 2024-04-27T07:33:39.211 INFO:tasks.workunit.client.1.smithi100.stdout:3/790: dread d7/d9/d10/f9c [0,4194304] 0 2024-04-27T07:33:39.212 INFO:tasks.workunit.client.1.smithi100.stdout:9/608: dwrite d1/f22 [0,4194304] 0 2024-04-27T07:33:39.213 INFO:tasks.workunit.client.1.smithi100.stdout:3/791: readlink d7/d9/d26/d2a/le9 0 2024-04-27T07:33:39.215 INFO:tasks.workunit.client.1.smithi100.stdout:9/609: creat d1/d76/dd6/fde x:0 0 0 2024-04-27T07:33:39.216 INFO:tasks.workunit.client.1.smithi100.stdout:9/610: chown d1/d9/db/d2b/l6e 106167 1 2024-04-27T07:33:39.219 INFO:tasks.workunit.client.1.smithi100.stdout:1/699: dread d0/d1f/d6d/db4/d4e/d7b/fc0 [0,4194304] 0 2024-04-27T07:33:39.220 INFO:tasks.workunit.client.1.smithi100.stdout:3/792: read d7/dad/daf/f49 [5744649,129636] 0 2024-04-27T07:33:39.221 INFO:tasks.workunit.client.1.smithi100.stdout:9/611: symlink d1/d9/db/d2b/d4f/dd1/dd0/ldf 0 2024-04-27T07:33:39.225 INFO:tasks.workunit.client.1.smithi100.stdout:6/674: write de/d58/d21/d24/d9f/fbc [4955987,21282] 0 2024-04-27T07:33:39.227 INFO:tasks.workunit.client.1.smithi100.stdout:9/612: unlink d1/d9/db/d2b/f7f 0 2024-04-27T07:33:39.227 INFO:tasks.workunit.client.1.smithi100.stdout:6/675: stat de/d58/d28 0 2024-04-27T07:33:39.228 INFO:tasks.workunit.client.1.smithi100.stdout:3/793: dwrite d7/dad/daf/fd0 [0,4194304] 0 2024-04-27T07:33:39.230 INFO:tasks.workunit.client.1.smithi100.stdout:9/613: write d1/d9/d1f/f8b [729144,89302] 0 2024-04-27T07:33:39.230 INFO:tasks.workunit.client.1.smithi100.stdout:6/676: chown de/d58/f7c 2372379 1 2024-04-27T07:33:39.231 INFO:tasks.workunit.client.1.smithi100.stdout:6/677: stat de/d58/d21/d23/d73/c81 0 2024-04-27T07:33:39.233 INFO:tasks.workunit.client.1.smithi100.stdout:1/700: truncate d0/f26 1670042 0 2024-04-27T07:33:39.236 INFO:tasks.workunit.client.1.smithi100.stdout:9/614: creat d1/d76/fe0 x:0 0 0 2024-04-27T07:33:39.236 INFO:tasks.workunit.client.1.smithi100.stdout:6/678: truncate de/d58/f1b 2129057 0 2024-04-27T07:33:39.239 INFO:tasks.workunit.client.1.smithi100.stdout:3/794: rmdir d7/d9/d26/d2a/d5e/df2 0 2024-04-27T07:33:39.240 INFO:tasks.workunit.client.1.smithi100.stdout:3/795: write d7/dad/fbf [538705,119036] 0 2024-04-27T07:33:39.241 INFO:tasks.workunit.client.1.smithi100.stdout:9/615: unlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/la2 0 2024-04-27T07:33:39.242 INFO:tasks.workunit.client.1.smithi100.stdout:3/796: chown d7/d9/d10/d33/d90/d3a/fa2 1 1 2024-04-27T07:33:39.243 INFO:tasks.workunit.client.1.smithi100.stdout:9/616: write d1/d9/d1f/d4a/d67/fc1 [192659,19240] 0 2024-04-27T07:33:39.243 INFO:tasks.workunit.client.1.smithi100.stdout:3/797: chown d7/d9/d26/f59 6432869 1 2024-04-27T07:33:39.244 INFO:tasks.workunit.client.1.smithi100.stdout:1/701: rename d0/d1f/d6d/db4/d4e/d7b/ddd/fdf to d0/fe4 0 2024-04-27T07:33:39.246 INFO:tasks.workunit.client.1.smithi100.stdout:1/702: dread - d0/fe4 zero size 2024-04-27T07:33:39.246 INFO:tasks.workunit.client.1.smithi100.stdout:9/617: fdatasync d1/d9/db/d2b/f7d 0 2024-04-27T07:33:39.248 INFO:tasks.workunit.client.1.smithi100.stdout:9/618: dread - d1/d9/db/d2b/d4f/da3/fc9 zero size 2024-04-27T07:33:39.249 INFO:tasks.workunit.client.1.smithi100.stdout:1/703: symlink d0/d1f/d6d/db4/d40/le5 0 2024-04-27T07:33:39.253 INFO:tasks.workunit.client.1.smithi100.stdout:3/798: dwrite d7/d9/d26/f59 [0,4194304] 0 2024-04-27T07:33:39.253 INFO:tasks.workunit.client.1.smithi100.stdout:9/619: symlink d1/d9/db/d2b/d4f/d57/dbe/le1 0 2024-04-27T07:33:39.255 INFO:tasks.workunit.client.1.smithi100.stdout:9/620: chown d1/d9/db/d2b/d4f/da3/fc9 0 1 2024-04-27T07:33:39.257 INFO:tasks.workunit.client.1.smithi100.stdout:6/679: dread de/f1e [0,4194304] 0 2024-04-27T07:33:39.263 INFO:tasks.workunit.client.1.smithi100.stdout:9/621: dwrite d1/d9/db/d56/d5c/fcf [0,4194304] 0 2024-04-27T07:33:39.269 INFO:tasks.workunit.client.1.smithi100.stdout:1/704: write d0/d1b/d20/d2d/d35/f4c [785881,32173] 0 2024-04-27T07:33:39.269 INFO:tasks.workunit.client.1.smithi100.stdout:9/622: mknod d1/d9/db/d2b/d4f/dac/d54/ce2 0 2024-04-27T07:33:39.270 INFO:tasks.workunit.client.1.smithi100.stdout:9/623: fsync d1/f30 0 2024-04-27T07:33:39.271 INFO:tasks.workunit.client.1.smithi100.stdout:1/705: creat d0/d1f/d6d/db4/fe6 x:0 0 0 2024-04-27T07:33:39.277 INFO:tasks.workunit.client.1.smithi100.stdout:9/624: rename d1/d9/d1f to d1/d9/db/d56/d5c/de3 0 2024-04-27T07:33:39.279 INFO:tasks.workunit.client.1.smithi100.stdout:1/706: dwrite d0/d23/d3a/dae/fcb [0,4194304] 0 2024-04-27T07:33:39.282 INFO:tasks.workunit.client.1.smithi100.stdout:1/707: readlink d0/d23/d3a/ldb 0 2024-04-27T07:33:39.287 INFO:tasks.workunit.client.1.smithi100.stdout:9/625: dwrite d1/d9/db/d56/d5c/de3/d4a/d67/fc1 [0,4194304] 0 2024-04-27T07:33:39.291 INFO:tasks.workunit.client.1.smithi100.stdout:1/708: dwrite d0/f18 [0,4194304] 0 2024-04-27T07:33:39.295 INFO:tasks.workunit.client.1.smithi100.stdout:1/709: mkdir d0/d1b/d20/d2d/d35/d4d/d60/da4/de7 0 2024-04-27T07:33:39.296 INFO:tasks.workunit.client.1.smithi100.stdout:9/626: dwrite d1/d9/db/d2b/d4f/da3/faf [0,4194304] 0 2024-04-27T07:33:39.298 INFO:tasks.workunit.client.1.smithi100.stdout:9/627: chown d1/d9/db/d56/d5c/cd2 224255567 1 2024-04-27T07:33:39.301 INFO:tasks.workunit.client.1.smithi100.stdout:9/628: chown d1/d9/db/d56/d5c/de3/d4a/d67/d8a/fb3 219 1 2024-04-27T07:33:39.304 INFO:tasks.workunit.client.1.smithi100.stdout:1/710: getdents d0/d1b/d20/d2d/d35/dac 0 2024-04-27T07:33:39.307 INFO:tasks.workunit.client.1.smithi100.stdout:1/711: creat d0/d1f/d6d/dc7/fe8 x:0 0 0 2024-04-27T07:33:39.307 INFO:tasks.workunit.client.1.smithi100.stdout:1/712: write d0/fda [703770,105999] 0 2024-04-27T07:33:39.309 INFO:tasks.workunit.client.1.smithi100.stdout:1/713: creat d0/d1f/d6d/dc7/fe9 x:0 0 0 2024-04-27T07:33:39.310 INFO:tasks.workunit.client.1.smithi100.stdout:9/629: rename d1/d9/db/d56/d5c/de3/l58 to d1/d9/db/d2b/d4f/dac/d54/d61/le4 0 2024-04-27T07:33:39.311 INFO:tasks.workunit.client.1.smithi100.stdout:1/714: creat d0/d1b/fea x:0 0 0 2024-04-27T07:33:39.312 INFO:tasks.workunit.client.1.smithi100.stdout:1/715: chown d0/d23/d3a/dae/cb5 8653 1 2024-04-27T07:33:39.312 INFO:tasks.workunit.client.1.smithi100.stdout:9/630: creat d1/d9/db/d2b/d4f/da3/fe5 x:0 0 0 2024-04-27T07:33:39.313 INFO:tasks.workunit.client.1.smithi100.stdout:9/631: dread - d1/d9/db/d2b/d4f/f62 zero size 2024-04-27T07:33:39.314 INFO:tasks.workunit.client.1.smithi100.stdout:9/632: chown d1/d9/db/d2b/d4f/dac/f5d 5476468 1 2024-04-27T07:33:39.315 INFO:tasks.workunit.client.1.smithi100.stdout:1/716: creat d0/d1b/d20/feb x:0 0 0 2024-04-27T07:33:39.315 INFO:tasks.workunit.client.1.smithi100.stdout:9/633: write d1/f26 [1690518,96580] 0 2024-04-27T07:33:39.319 INFO:tasks.workunit.client.1.smithi100.stdout:1/717: getdents d0/d23/d3a/dae 0 2024-04-27T07:33:39.320 INFO:tasks.workunit.client.1.smithi100.stdout:1/718: write d0/d1f/fc2 [4933953,25127] 0 2024-04-27T07:33:39.320 INFO:tasks.workunit.client.1.smithi100.stdout:9/634: link d1/d9/f75 d1/d9/db/d2b/d4f/dd1/fe6 0 2024-04-27T07:33:39.322 INFO:tasks.workunit.client.1.smithi100.stdout:9/635: chown d1/d9/db/d2b/d31/lc4 1402212 1 2024-04-27T07:33:39.323 INFO:tasks.workunit.client.1.smithi100.stdout:1/719: truncate d0/d1f/f8f 1084723 0 2024-04-27T07:33:39.325 INFO:tasks.workunit.client.1.smithi100.stdout:1/720: mknod d0/d1f/d6d/dc7/de1/cec 0 2024-04-27T07:33:39.327 INFO:tasks.workunit.client.1.smithi100.stdout:1/721: mknod d0/d1f/d6d/db4/d4e/ced 0 2024-04-27T07:33:39.328 INFO:tasks.workunit.client.1.smithi100.stdout:1/722: write d0/f18 [863612,32853] 0 2024-04-27T07:33:39.329 INFO:tasks.workunit.client.1.smithi100.stdout:1/723: dread - d0/d1f/d97/fbe zero size 2024-04-27T07:33:39.339 INFO:tasks.workunit.client.1.smithi100.stdout:1/724: dwrite d0/d23/f54 [0,4194304] 0 2024-04-27T07:33:39.342 INFO:tasks.workunit.client.1.smithi100.stdout:1/725: mknod d0/d1f/cee 0 2024-04-27T07:33:39.342 INFO:tasks.workunit.client.1.smithi100.stdout:1/726: chown d0/d1f/d6d/db4/d6c/c73 519021 1 2024-04-27T07:33:39.344 INFO:tasks.workunit.client.1.smithi100.stdout:1/727: chown d0/d1f/d6d/db4/c36 368421 1 2024-04-27T07:33:39.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.416+0000 7f781096e700 1 -- 172.21.15.82:0/1858639354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0ffee0 msgr2=0x7f780c102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.416+0000 7f781096e700 1 --2- 172.21.15.82:0/1858639354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0ffee0 0x7f780c102300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7800004940 tx=0x7f7800009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:39.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 -- 172.21.15.82:0/1858639354 shutdown_connections 2024-04-27T07:33:39.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 --2- 172.21.15.82:0/1858639354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0ffee0 0x7f780c102300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 --2- 172.21.15.82:0/1858639354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0662c0 0x7f780c0ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 -- 172.21.15.82:0/1858639354 >> 172.21.15.82:0/1858639354 conn(0x7f780c0f7430 msgr2=0x7f780c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:39.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 -- 172.21.15.82:0/1858639354 shutdown_connections 2024-04-27T07:33:39.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 -- 172.21.15.82:0/1858639354 wait complete. 2024-04-27T07:33:39.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.417+0000 7f781096e700 1 Processor -- start 2024-04-27T07:33:39.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f781096e700 1 -- start start 2024-04-27T07:33:39.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f781096e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f781096e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 0x7f780c10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f781096e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c10e4f0 con 0x7f780c0662c0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f781096e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c10ed40 con 0x7f780c0ffee0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48674/0 (socket says 172.21.15.82:48674) 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 -- 172.21.15.82:0/2888502750 learned_addr learned my addr 172.21.15.82:0/2888502750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f7809d9b700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 0x7f780c10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 -- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 msgr2=0x7f780c10def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 0x7f780c10def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f780a59c700 1 -- 172.21.15.82:0/2888502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc005040 con 0x7f780c0662c0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.418+0000 7f7809d9b700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 0x7f780c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f780a59c700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009700 tx=0x7f77fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77fc00e7e0 con 0x7f780c0662c0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7800005040 con 0x7f780c0662c0 2024-04-27T07:33:39.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77fc00f040 con 0x7f780c0662c0 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77fc013e90 con 0x7f780c0662c0 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.419+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c10f370 con 0x7f780c0662c0 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.420+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c05f5c0 con 0x7f780c0662c0 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.421+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f77fc00e940 con 0x7f780c0662c0 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.421+0000 7f77faffd700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 0x7f77f406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.421+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f77fc08b430 con 0x7f780c0662c0 2024-04-27T07:33:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.422+0000 7f7809d9b700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 0x7f77f406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.423+0000 7f7809d9b700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 0x7f77f406e1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f780000b0d0 tx=0x7f7800009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:39.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.428+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f77fc0584d0 con 0x7f780c0662c0 2024-04-27T07:33:39.493 INFO:tasks.workunit.client.1.smithi100.stdout:2/587: sync 2024-04-27T07:33:39.496 INFO:tasks.workunit.client.1.smithi100.stdout:2/588: truncate d0/f24 540142 0 2024-04-27T07:33:39.498 INFO:tasks.workunit.client.1.smithi100.stdout:2/589: truncate d0/d1e/f3b 897825 0 2024-04-27T07:33:39.513 INFO:tasks.workunit.client.1.smithi100.stdout:2/590: dread d0/da/d29/d47/d5a/d8d/f2a [4194304,4194304] 0 2024-04-27T07:33:39.568 INFO:tasks.workunit.client.1.smithi100.stdout:2/591: dwrite d0/d1e/f33 [0,4194304] 0 2024-04-27T07:33:39.576 INFO:tasks.workunit.client.1.smithi100.stdout:2/592: dread d0/da/d75/f78 [0,4194304] 0 2024-04-27T07:33:39.576 INFO:tasks.workunit.client.1.smithi100.stdout:2/593: readlink d0/da/l36 0 2024-04-27T07:33:39.581 INFO:tasks.workunit.client.1.smithi100.stdout:2/594: dwrite d0/f12 [0,4194304] 0 2024-04-27T07:33:39.584 INFO:tasks.workunit.client.1.smithi100.stdout:2/595: unlink d0/da/l1a 0 2024-04-27T07:33:39.587 INFO:tasks.workunit.client.1.smithi100.stdout:2/596: symlink d0/da/d29/d47/lc8 0 2024-04-27T07:33:39.589 INFO:tasks.workunit.client.1.smithi100.stdout:2/597: mknod d0/da/d29/d47/d5a/d8d/d5d/cc9 0 2024-04-27T07:33:39.590 INFO:tasks.workunit.client.1.smithi100.stdout:2/598: chown d0/da/d29/f23 19600385 1 2024-04-27T07:33:39.592 INFO:tasks.workunit.client.1.smithi100.stdout:2/599: mknod d0/da/d29/d47/da1/da3/cca 0 2024-04-27T07:33:39.595 INFO:tasks.workunit.client.1.smithi100.stdout:2/600: creat d0/da/d29/d47/d5a/d8d/fcb x:0 0 0 2024-04-27T07:33:39.596 INFO:tasks.workunit.client.1.smithi100.stdout:2/601: chown d0/f11 170738647 1 2024-04-27T07:33:39.598 INFO:tasks.workunit.client.1.smithi100.stdout:2/602: rename d0/da/d29/f13 to d0/da/d29/d47/d87/fcc 0 2024-04-27T07:33:39.604 INFO:tasks.workunit.client.1.smithi100.stdout:2/603: write d0/da/d29/d47/da1/da3/f52 [2814876,59808] 0 2024-04-27T07:33:39.605 INFO:tasks.workunit.client.1.smithi100.stdout:2/604: dread - d0/d79/d94/dbc/d98/fab zero size 2024-04-27T07:33:39.605 INFO:tasks.workunit.client.1.smithi100.stdout:5/548: sync 2024-04-27T07:33:39.605 INFO:tasks.workunit.client.1.smithi100.stdout:7/604: sync 2024-04-27T07:33:39.605 INFO:tasks.workunit.client.1.smithi100.stdout:0/590: sync 2024-04-27T07:33:39.608 INFO:tasks.workunit.client.1.smithi100.stdout:0/591: mknod d1/d38/d3a/d54/cc8 0 2024-04-27T07:33:39.609 INFO:tasks.workunit.client.1.smithi100.stdout:0/592: read d1/d38/d3a/f3c [3190660,54827] 0 2024-04-27T07:33:39.610 INFO:tasks.workunit.client.1.smithi100.stdout:2/605: symlink d0/d79/d94/dbc/d74/lcd 0 2024-04-27T07:33:39.610 INFO:tasks.workunit.client.1.smithi100.stdout:0/593: chown d1/d8/d14/d65 23926573 1 2024-04-27T07:33:39.611 INFO:tasks.workunit.client.1.smithi100.stdout:2/606: stat d0/d79/d94/dbc/d98/db1/ca6 0 2024-04-27T07:33:39.612 INFO:tasks.workunit.client.1.smithi100.stdout:5/549: creat d0/d4/fa9 x:0 0 0 2024-04-27T07:33:39.612 INFO:tasks.workunit.client.1.smithi100.stdout:0/594: stat d1/d8/d20/d61/d66/fc1 0 2024-04-27T07:33:39.614 INFO:tasks.workunit.client.1.smithi100.stdout:2/607: mkdir d0/da/d29/d47/da1/dce 0 2024-04-27T07:33:39.614 INFO:tasks.workunit.client.1.smithi100.stdout:7/605: write d1/dd/d16/d31/d4c/f81 [812764,32354] 0 2024-04-27T07:33:39.615 INFO:tasks.workunit.client.1.smithi100.stdout:2/608: write d0/d79/d94/fbf [914074,10118] 0 2024-04-27T07:33:39.617 INFO:tasks.workunit.client.1.smithi100.stdout:0/595: rename d1/d8/l5d to d1/d38/d3a/d54/lc9 0 2024-04-27T07:33:39.620 INFO:tasks.workunit.client.1.smithi100.stdout:2/609: creat d0/da/d29/d47/d5a/d8d/d5d/fcf x:0 0 0 2024-04-27T07:33:39.621 INFO:tasks.workunit.client.1.smithi100.stdout:7/606: mknod d1/dd/d16/d31/cb1 0 2024-04-27T07:33:39.622 INFO:tasks.workunit.client.1.smithi100.stdout:5/550: dwrite d0/d4/d21/d24/d46/f71 [0,4194304] 0 2024-04-27T07:33:39.622 INFO:tasks.workunit.client.1.smithi100.stdout:2/610: read - d0/da/d29/d47/d87/fc0 zero size 2024-04-27T07:33:39.623 INFO:tasks.workunit.client.1.smithi100.stdout:5/551: read - d0/d4/fa9 zero size 2024-04-27T07:33:39.623 INFO:tasks.workunit.client.1.smithi100.stdout:0/596: fdatasync d1/d8/d20/f42 0 2024-04-27T07:33:39.624 INFO:tasks.workunit.client.1.smithi100.stdout:2/611: chown d0/da/d75/f9b 650890905 1 2024-04-27T07:33:39.628 INFO:tasks.workunit.client.1.smithi100.stdout:2/612: chown d0/d1e/f57 73 1 2024-04-27T07:33:39.629 INFO:tasks.workunit.client.1.smithi100.stdout:0/597: mknod d1/d38/cca 0 2024-04-27T07:33:39.636 INFO:tasks.workunit.client.1.smithi100.stdout:7/607: truncate d1/dd/d16/d70/f79 2217849 0 2024-04-27T07:33:39.638 INFO:tasks.workunit.client.1.smithi100.stdout:2/613: link d0/da/d29/d47/d5a/d8d/d5d/fcf d0/da/d29/d47/da1/dc3/fd0 0 2024-04-27T07:33:39.639 INFO:tasks.workunit.client.1.smithi100.stdout:7/608: link d1/dd/d16/d4a/f89 d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/fb2 0 2024-04-27T07:33:39.644 INFO:tasks.workunit.client.1.smithi100.stdout:7/609: rename d1/dd/d2a/d2c/cad to d1/dd/cb3 0 2024-04-27T07:33:39.646 INFO:tasks.workunit.client.1.smithi100.stdout:5/552: truncate d0/d4/d21/d24/d2f/f79 1836607 0 2024-04-27T07:33:39.648 INFO:tasks.workunit.client.1.smithi100.stdout:7/610: creat d1/dd/d16/d70/d6e/fb4 x:0 0 0 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:8/610: sync 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:4/690: sync 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:9/636: sync 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:6/680: sync 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:1/728: sync 2024-04-27T07:33:39.650 INFO:tasks.workunit.client.1.smithi100.stdout:3/799: sync 2024-04-27T07:33:39.651 INFO:tasks.workunit.client.1.smithi100.stdout:7/611: chown d1/dd/d16/d31/d4c/f81 118480 1 2024-04-27T07:33:39.653 INFO:tasks.workunit.client.1.smithi100.stdout:5/553: getdents d0/d4/d21/d24/d2f/d57/d37/d1a/d31 0 2024-04-27T07:33:39.653 INFO:tasks.workunit.client.1.smithi100.stdout:0/598: dread d1/d30/f9d [0,4194304] 0 2024-04-27T07:33:39.657 INFO:tasks.workunit.client.1.smithi100.stdout:1/729: creat d0/d1f/d6d/db4/d40/fef x:0 0 0 2024-04-27T07:33:39.657 INFO:tasks.workunit.client.1.smithi100.stdout:7/612: readlink d1/dd/d16/d70/d51/d6f/l80 0 2024-04-27T07:33:39.658 INFO:tasks.workunit.client.1.smithi100.stdout:8/611: mknod d6/d20/d8b/d8c/cc1 0 2024-04-27T07:33:39.660 INFO:tasks.workunit.client.1.smithi100.stdout:8/612: dread - d6/d1b/d1d/d59/f58 zero size 2024-04-27T07:33:39.660 INFO:tasks.workunit.client.1.smithi100.stdout:2/614: dread d0/da/d29/d47/d87/f9a [0,4194304] 0 2024-04-27T07:33:39.661 INFO:tasks.workunit.client.1.smithi100.stdout:3/800: rename d7/d9/d10/f15 to d7/ff4 0 2024-04-27T07:33:39.662 INFO:tasks.workunit.client.1.smithi100.stdout:6/681: dread de/d58/d21/d24/fc9 [0,4194304] 0 2024-04-27T07:33:39.662 INFO:tasks.workunit.client.1.smithi100.stdout:4/691: symlink d5/d1b/d2c/dd7/df0/lf5 0 2024-04-27T07:33:39.664 INFO:tasks.workunit.client.1.smithi100.stdout:8/613: write d6/d20/d2a/f85 [920572,100006] 0 2024-04-27T07:33:39.664 INFO:tasks.workunit.client.1.smithi100.stdout:8/614: readlink d6/d20/l70 0 2024-04-27T07:33:39.666 INFO:tasks.workunit.client.1.smithi100.stdout:8/615: stat d6/f3b 0 2024-04-27T07:33:39.667 INFO:tasks.workunit.client.1.smithi100.stdout:8/616: truncate d6/d1b/d1d/d59/f58 934808 0 2024-04-27T07:33:39.668 INFO:tasks.workunit.client.1.smithi100.stdout:1/730: mkdir d0/d23/d3a/df0 0 2024-04-27T07:33:39.671 INFO:tasks.workunit.client.1.smithi100.stdout:2/615: rename d0/da/d29/d47/d5a/d8d/d5d/c9f to d0/d79/d94/dbc/cd1 0 2024-04-27T07:33:39.671 INFO:tasks.workunit.client.1.smithi100.stdout:2/616: chown d0/d79/ca2 10845 1 2024-04-27T07:33:39.673 INFO:tasks.workunit.client.1.smithi100.stdout:4/692: fsync d5/d23/f25 0 2024-04-27T07:33:39.678 INFO:tasks.workunit.client.1.smithi100.stdout:2/617: dread d0/da/d29/d47/da1/da3/f59 [0,4194304] 0 2024-04-27T07:33:39.678 INFO:tasks.workunit.client.1.smithi100.stdout:6/682: truncate de/d58/d21/f85 1988530 0 2024-04-27T07:33:39.679 INFO:tasks.workunit.client.1.smithi100.stdout:1/731: dread d0/d1f/d6d/db4/d4e/d7b/fc0 [0,4194304] 0 2024-04-27T07:33:39.681 INFO:tasks.workunit.client.1.smithi100.stdout:9/637: dread d1/d9/db/f93 [0,4194304] 0 2024-04-27T07:33:39.682 INFO:tasks.workunit.client.1.smithi100.stdout:5/554: dread d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:39.683 INFO:tasks.workunit.client.1.smithi100.stdout:0/599: creat d1/d8/d20/d72/fcb x:0 0 0 2024-04-27T07:33:39.684 INFO:tasks.workunit.client.1.smithi100.stdout:7/613: creat d1/dd/fb5 x:0 0 0 2024-04-27T07:33:39.685 INFO:tasks.workunit.client.1.smithi100.stdout:4/693: symlink d5/d16/d19/d46/dd1/lf6 0 2024-04-27T07:33:39.685 INFO:tasks.workunit.client.1.smithi100.stdout:5/555: dread - d0/d4/d21/d24/d2f/d57/d3e/f8d zero size 2024-04-27T07:33:39.685 INFO:tasks.workunit.client.1.smithi100.stdout:6/683: dread de/d2e/d3f/d80/fa1 [0,4194304] 0 2024-04-27T07:33:39.686 INFO:tasks.workunit.client.1.smithi100.stdout:3/801: chown d7/d9/d10/d33/cb8 6452395 1 2024-04-27T07:33:39.687 INFO:tasks.workunit.client.1.smithi100.stdout:2/618: unlink d0/da/d29/f80 0 2024-04-27T07:33:39.687 INFO:tasks.workunit.client.1.smithi100.stdout:3/802: fsync d7/d9/d26/d2a/f82 0 2024-04-27T07:33:39.688 INFO:tasks.workunit.client.1.smithi100.stdout:1/732: symlink d0/d1f/d6d/db4/d40/lf1 0 2024-04-27T07:33:39.689 INFO:tasks.workunit.client.1.smithi100.stdout:1/733: chown d0/f85 871103 1 2024-04-27T07:33:39.690 INFO:tasks.workunit.client.1.smithi100.stdout:8/617: creat d6/d1b/d1d/d59/fc2 x:0 0 0 2024-04-27T07:33:39.694 INFO:tasks.workunit.client.1.smithi100.stdout:1/734: dwrite d0/d1f/d6d/db4/f39 [0,4194304] 0 2024-04-27T07:33:39.695 INFO:tasks.workunit.client.1.smithi100.stdout:1/735: chown d0/f19 3726562 1 2024-04-27T07:33:39.704 INFO:tasks.workunit.client.1.smithi100.stdout:7/614: mknod d1/dd/d16/d70/d51/d9d/cb6 0 2024-04-27T07:33:39.705 INFO:tasks.workunit.client.1.smithi100.stdout:5/556: unlink d0/d4/d21/d24/d2f/l4a 0 2024-04-27T07:33:39.721 INFO:tasks.workunit.client.1.smithi100.stdout:7/615: dread d1/dd/d16/d31/d4c/d4d/f6b [0,4194304] 0 2024-04-27T07:33:39.722 INFO:tasks.workunit.client.1.smithi100.stdout:7/616: dread - d1/dd/d16/d70/d6e/fb4 zero size 2024-04-27T07:33:39.728 INFO:tasks.workunit.client.1.smithi100.stdout:7/617: dwrite d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a [0,4194304] 0 2024-04-27T07:33:39.763 INFO:tasks.workunit.client.1.smithi100.stdout:4/694: creat d5/d1b/d65/dc6/dd3/ff7 x:0 0 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:4/695: stat d5/c97 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:4/696: write d5/fe [1233039,31178] 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:8/618: symlink d6/d20/d50/d72/da4/lc3 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:1/736: rmdir d0/d1f/d6d/dc7/de1 39 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:7/618: write d1/dd/d2a/fa2 [282884,11939] 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:9/638: dwrite d1/d9/db/d2b/d4f/dac/f7e [0,4194304] 0 2024-04-27T07:33:39.764 INFO:tasks.workunit.client.1.smithi100.stdout:9/639: stat d1/d9/db/d2b/d4f/dac/d54/f95 0 2024-04-27T07:33:39.766 INFO:tasks.workunit.client.1.smithi100.stdout:2/619: rename d0/da/d29/d47/f4a to d0/d79/d94/dbc/d74/fd2 0 2024-04-27T07:33:39.767 INFO:tasks.workunit.client.1.smithi100.stdout:2/620: chown d0/d79/d94/fbf 2084799 1 2024-04-27T07:33:39.768 INFO:tasks.workunit.client.1.smithi100.stdout:0/600: creat d1/d38/fcc x:0 0 0 2024-04-27T07:33:39.768 INFO:tasks.workunit.client.1.smithi100.stdout:0/601: chown d1/d8/d20/d88/f92 10635 1 2024-04-27T07:33:39.769 INFO:tasks.workunit.client.1.smithi100.stdout:0/602: chown d1/d8/d14/d59/d99/fbf 116728408 1 2024-04-27T07:33:39.770 INFO:tasks.workunit.client.1.smithi100.stdout:8/619: symlink d6/d20/d54/d91/lc4 0 2024-04-27T07:33:39.776 INFO:tasks.workunit.client.1.smithi100.stdout:5/557: creat d0/d4/d21/d24/d46/d99/da0/faa x:0 0 0 2024-04-27T07:33:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.775+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f780c10f6a0 con 0x7f77f406bd40 2024-04-27T07:33:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:39 smithi082 ceph-mon[26613]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 271 MiB/s wr, 507 op/s 2024-04-27T07:33:39.779 INFO:tasks.workunit.client.1.smithi100.stdout:3/803: creat d7/d9/d10/d3e/d74/ff5 x:0 0 0 2024-04-27T07:33:39.779 INFO:tasks.workunit.client.1.smithi100.stdout:1/737: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:39.779 INFO:tasks.workunit.client.1.smithi100.stdout:9/640: chown d1/d9/db/d2b/fab 4 1 2024-04-27T07:33:39.780 INFO:tasks.workunit.client.1.smithi100.stdout:7/619: read d1/f32 [3381026,38866] 0 2024-04-27T07:33:39.781 INFO:tasks.workunit.client.1.smithi100.stdout:2/621: mknod d0/d79/d94/dbc/d98/cd3 0 2024-04-27T07:33:39.781 INFO:tasks.workunit.client.1.smithi100.stdout:7/620: chown d1/dd/d2a/d2c 4 1 2024-04-27T07:33:39.784 INFO:tasks.workunit.client.1.smithi100.stdout:7/621: dread - d1/dd/d16/d31/d4c/f8f zero size 2024-04-27T07:33:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.778+0000 7f77faffd700 1 -- 172.21.15.82:0/2888502750 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f780c10f6a0 con 0x7f77f406bd40 2024-04-27T07:33:39.785 INFO:tasks.workunit.client.1.smithi100.stdout:9/641: dread d1/d9/db/d56/d5c/fcf [0,4194304] 0 2024-04-27T07:33:39.786 INFO:tasks.workunit.client.1.smithi100.stdout:8/620: creat d6/d20/d50/d72/da4/fc5 x:0 0 0 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 msgr2=0x7f77f406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 0x7f77f406e1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f780000b0d0 tx=0x7f7800009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 msgr2=0x7f780c10d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009700 tx=0x7f77fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 shutdown_connections 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f77f406bd40 0x7f77f406e1f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f780c0662c0 0x7f780c10d9b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 --2- 172.21.15.82:0/2888502750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f780c0ffee0 0x7f780c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 >> 172.21.15.82:0/2888502750 conn(0x7f780c0f7430 msgr2=0x7f780c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 shutdown_connections 2024-04-27T07:33:39.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.782+0000 7f781096e700 1 -- 172.21.15.82:0/2888502750 wait complete. 2024-04-27T07:33:39.793 INFO:tasks.workunit.client.1.smithi100.stdout:4/697: rename d5/d1b/d2c to d5/d1b/df8 0 2024-04-27T07:33:39.793 INFO:tasks.workunit.client.1.smithi100.stdout:4/698: stat d5/d16/cd4 0 2024-04-27T07:33:39.794 INFO:tasks.workunit.client.1.smithi100.stdout:2/622: dwrite d0/d79/d94/dbc/d98/db1/fb8 [0,4194304] 0 2024-04-27T07:33:39.795 INFO:tasks.workunit.client.1.smithi100.stdout:3/804: chown d7/f9e 11828673 1 2024-04-27T07:33:39.796 INFO:tasks.workunit.client.1.smithi100.stdout:5/558: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/cab 0 2024-04-27T07:33:39.797 INFO:tasks.workunit.client.1.smithi100.stdout:5/559: chown d0/fa1 1 1 2024-04-27T07:33:39.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/622: symlink d1/dd/d16/d3e/lb7 0 2024-04-27T07:33:39.798 INFO:tasks.workunit.client.1.smithi100.stdout:4/699: dwrite d5/d1b/df8/d7d/fc5 [0,4194304] 0 2024-04-27T07:33:39.799 INFO:tasks.workunit.client.1.smithi100.stdout:5/560: write d0/d4/d21/d24/d2f/d39/d56/f6b [55093,35629] 0 2024-04-27T07:33:39.800 INFO:tasks.workunit.client.1.smithi100.stdout:4/700: fsync d5/f32 0 2024-04-27T07:33:39.801 INFO:tasks.workunit.client.1.smithi100.stdout:9/642: dread d1/d9/f6f [0,4194304] 0 2024-04-27T07:33:39.803 INFO:tasks.workunit.client.1.smithi100.stdout:0/603: creat d1/d8/fcd x:0 0 0 2024-04-27T07:33:39.804 INFO:tasks.workunit.client.1.smithi100.stdout:7/623: rmdir d1/dd/d16/d70 39 2024-04-27T07:33:39.806 INFO:tasks.workunit.client.1.smithi100.stdout:8/621: rename d6/cd to d6/d20/d50/cc6 0 2024-04-27T07:33:39.808 INFO:tasks.workunit.client.1.smithi100.stdout:1/738: creat d0/d1f/ff2 x:0 0 0 2024-04-27T07:33:39.809 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:33:39.809 INFO:tasks.workunit.client.1.smithi100.stdout:4/701: mknod d5/d1b/d65/dc6/cf9 0 2024-04-27T07:33:39.811 INFO:tasks.workunit.client.1.smithi100.stdout:9/643: unlink d1/ldc 0 2024-04-27T07:33:39.812 INFO:tasks.workunit.client.1.smithi100.stdout:0/604: mkdir d1/d8/d14/dce 0 2024-04-27T07:33:39.814 INFO:tasks.workunit.client.1.smithi100.stdout:2/623: rename d0/da/d29/l68 to d0/da/d29/ld4 0 2024-04-27T07:33:39.816 INFO:tasks.workunit.client.1.smithi100.stdout:2/624: chown d0/da/lb0 17242451 1 2024-04-27T07:33:39.820 INFO:tasks.workunit.client.1.smithi100.stdout:0/605: dwrite d1/d8/d20/d72/d96/fb4 [0,4194304] 0 2024-04-27T07:33:39.821 INFO:tasks.workunit.client.1.smithi100.stdout:0/606: write d1/d8/d14/d59/d64/d80/fbd [558413,101899] 0 2024-04-27T07:33:39.825 INFO:tasks.workunit.client.1.smithi100.stdout:9/644: mkdir d1/d9/db/d2b/de7 0 2024-04-27T07:33:39.826 INFO:tasks.workunit.client.1.smithi100.stdout:7/624: link d1/dd/d2a/d2c/la8 d1/dd/d16/d31/d4c/d4d/d3b/lb8 0 2024-04-27T07:33:39.826 INFO:tasks.workunit.client.1.smithi100.stdout:9/645: fsync d1/d9/db/d2b/d4f/dac/f5d 0 2024-04-27T07:33:39.828 INFO:tasks.workunit.client.1.smithi100.stdout:3/805: rename d7/d9/c1a to d7/cf6 0 2024-04-27T07:33:39.828 INFO:tasks.workunit.client.1.smithi100.stdout:1/739: write d0/da0/f8c [101520,46539] 0 2024-04-27T07:33:39.829 INFO:tasks.workunit.client.1.smithi100.stdout:5/561: truncate d0/d4/d21/f3a 1097861 0 2024-04-27T07:33:39.833 INFO:tasks.workunit.client.1.smithi100.stdout:4/702: getdents d5/d1b/d65 0 2024-04-27T07:33:39.835 INFO:tasks.workunit.client.1.smithi100.stdout:3/806: write d7/d9/d10/d33/d90/d3a/f94 [4776646,27580] 0 2024-04-27T07:33:39.836 INFO:tasks.workunit.client.1.smithi100.stdout:3/807: fsync d7/d9/d2f/fda 0 2024-04-27T07:33:39.836 INFO:tasks.workunit.client.1.smithi100.stdout:8/622: rename d6/d1b/fb2 to d6/d20/d54/d91/fc7 0 2024-04-27T07:33:39.837 INFO:tasks.workunit.client.1.smithi100.stdout:1/740: rmdir d0/d23/d3a 39 2024-04-27T07:33:39.838 INFO:tasks.workunit.client.1.smithi100.stdout:6/684: sync 2024-04-27T07:33:39.841 INFO:tasks.workunit.client.1.smithi100.stdout:7/625: link d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a d1/dd/d16/d31/d4c/d4d/d3b/fb9 0 2024-04-27T07:33:39.845 INFO:tasks.workunit.client.1.smithi100.stdout:7/626: truncate d1/dd/d16/d4a/d56/f94 1297374 0 2024-04-27T07:33:39.845 INFO:tasks.workunit.client.1.smithi100.stdout:6/685: dwrite de/d2e/d86/f93 [0,4194304] 0 2024-04-27T07:33:39.848 INFO:tasks.workunit.client.1.smithi100.stdout:9/646: write d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/fae [989627,123066] 0 2024-04-27T07:33:39.849 INFO:tasks.workunit.client.1.smithi100.stdout:8/623: truncate d6/d20/f40 78186 0 2024-04-27T07:33:39.850 INFO:tasks.workunit.client.1.smithi100.stdout:0/607: truncate d1/d8/d20/d1e/f85 619535 0 2024-04-27T07:33:39.854 INFO:tasks.workunit.client.1.smithi100.stdout:4/703: write d5/d16/d19/d46/d53/d7e/fa9 [1560134,72206] 0 2024-04-27T07:33:39.856 INFO:tasks.workunit.client.1.smithi100.stdout:7/627: truncate d1/dd/d16/d70/d6e/fb4 621706 0 2024-04-27T07:33:39.857 INFO:tasks.workunit.client.1.smithi100.stdout:6/686: creat de/d58/d90/fe7 x:0 0 0 2024-04-27T07:33:39.861 INFO:tasks.workunit.client.1.smithi100.stdout:1/741: creat d0/d1f/d6d/dc7/de1/ff3 x:0 0 0 2024-04-27T07:33:39.861 INFO:tasks.workunit.client.1.smithi100.stdout:7/628: write d1/dd/d16/d31/d4c/f81 [3328780,82489] 0 2024-04-27T07:33:39.863 INFO:tasks.workunit.client.1.smithi100.stdout:5/562: creat d0/d4/d21/fac x:0 0 0 2024-04-27T07:33:39.863 INFO:tasks.workunit.client.1.smithi100.stdout:6/687: dread de/d58/f71 [0,4194304] 0 2024-04-27T07:33:39.867 INFO:tasks.workunit.client.1.smithi100.stdout:4/704: dwrite d5/d23/f25 [4194304,4194304] 0 2024-04-27T07:33:39.868 INFO:tasks.workunit.client.1.smithi100.stdout:2/625: rename d0/da/d29/d47/dae/fbb to d0/d1e/fd5 0 2024-04-27T07:33:39.870 INFO:tasks.workunit.client.1.smithi100.stdout:8/624: mknod d6/d20/d8b/dc0/cc8 0 2024-04-27T07:33:39.873 INFO:tasks.workunit.client.1.smithi100.stdout:1/742: dread d0/d23/f54 [0,4194304] 0 2024-04-27T07:33:39.874 INFO:tasks.workunit.client.1.smithi100.stdout:8/625: write d6/f10 [1076835,30355] 0 2024-04-27T07:33:39.875 INFO:tasks.workunit.client.1.smithi100.stdout:0/608: mkdir d1/d8/d20/d61/d66/dcf 0 2024-04-27T07:33:39.877 INFO:tasks.workunit.client.1.smithi100.stdout:7/629: readlink d1/l4 0 2024-04-27T07:33:39.877 INFO:tasks.workunit.client.1.smithi100.stdout:4/705: dwrite d5/fe3 [0,4194304] 0 2024-04-27T07:33:39.878 INFO:tasks.workunit.client.1.smithi100.stdout:0/609: write d1/d38/fcc [629817,72176] 0 2024-04-27T07:33:39.880 INFO:tasks.workunit.client.1.smithi100.stdout:4/706: readlink d5/d16/l91 0 2024-04-27T07:33:39.882 INFO:tasks.workunit.client.1.smithi100.stdout:4/707: fdatasync d5/d16/fa1 0 2024-04-27T07:33:39.884 INFO:tasks.workunit.client.1.smithi100.stdout:6/688: creat de/d58/d21/d24/d9f/daa/fe8 x:0 0 0 2024-04-27T07:33:39.885 INFO:tasks.workunit.client.1.smithi100.stdout:4/708: write d5/d16/fcd [400120,56711] 0 2024-04-27T07:33:39.887 INFO:tasks.workunit.client.1.smithi100.stdout:9/647: dwrite d1/d9/db/d56/fc0 [0,4194304] 0 2024-04-27T07:33:39.890 INFO:tasks.workunit.client.1.smithi100.stdout:2/626: unlink d0/l2b 0 2024-04-27T07:33:39.899 INFO:tasks.workunit.client.1.smithi100.stdout:5/563: fdatasync d0/d4/d21/f3a 0 2024-04-27T07:33:39.901 INFO:tasks.workunit.client.1.smithi100.stdout:6/689: rmdir de/d58/d21/d24/d9f 39 2024-04-27T07:33:39.902 INFO:tasks.workunit.client.1.smithi100.stdout:4/709: truncate d5/d16/d19/f73 3363208 0 2024-04-27T07:33:39.903 INFO:tasks.workunit.client.1.smithi100.stdout:2/627: unlink d0/da/d29/d47/d5a/d8d/d5d/f67 0 2024-04-27T07:33:39.906 INFO:tasks.workunit.client.1.smithi100.stdout:1/743: truncate d0/d1b/d20/d2d/d35/f8b 452500 0 2024-04-27T07:33:39.907 INFO:tasks.workunit.client.1.smithi100.stdout:7/630: symlink d1/dd/d16/d31/lba 0 2024-04-27T07:33:39.910 INFO:tasks.workunit.client.1.smithi100.stdout:7/631: chown d1/dd/d16/d4a/l90 2045 1 2024-04-27T07:33:39.911 INFO:tasks.workunit.client.1.smithi100.stdout:9/648: mkdir d1/d9/db/d2b/de7/de8 0 2024-04-27T07:33:39.912 INFO:tasks.workunit.client.1.smithi100.stdout:4/710: dwrite d5/d16/d19/d46/dd1/dd2/fd8 [0,4194304] 0 2024-04-27T07:33:39.914 INFO:tasks.workunit.client.1.smithi100.stdout:5/564: creat d0/d4/d21/d24/d2f/d39/d7c/fad x:0 0 0 2024-04-27T07:33:39.914 INFO:tasks.workunit.client.1.smithi100.stdout:7/632: readlink d1/dd/d16/d70/d51/d6f/l77 0 2024-04-27T07:33:39.916 INFO:tasks.workunit.client.1.smithi100.stdout:4/711: read d5/d23/fb6 [3134143,12167] 0 2024-04-27T07:33:39.916 INFO:tasks.workunit.client.1.smithi100.stdout:5/565: fsync d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 0 2024-04-27T07:33:39.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:39 smithi100 ceph-mon[34183]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 271 MiB/s wr, 507 op/s 2024-04-27T07:33:39.920 INFO:tasks.workunit.client.1.smithi100.stdout:2/628: truncate d0/da/d29/d47/da1/da3/f59 884416 0 2024-04-27T07:33:39.920 INFO:tasks.workunit.client.1.smithi100.stdout:0/610: creat d1/d8/fd0 x:0 0 0 2024-04-27T07:33:39.920 INFO:tasks.workunit.client.1.smithi100.stdout:9/649: truncate d1/d9/f21 6252908 0 2024-04-27T07:33:39.921 INFO:tasks.workunit.client.1.smithi100.stdout:8/626: getdents d6/d1b/d1d 0 2024-04-27T07:33:39.926 INFO:tasks.workunit.client.1.smithi100.stdout:7/633: rename d1/dd/d16/d70/d51/d9d/cb6 to d1/dd/d16/d3e/d8b/da4/cbb 0 2024-04-27T07:33:39.932 INFO:tasks.workunit.client.1.smithi100.stdout:8/627: symlink d6/d20/d54/d91/dae/lc9 0 2024-04-27T07:33:39.933 INFO:tasks.workunit.client.1.smithi100.stdout:7/634: dread d1/dd/d2a/d2c/f2e [0,4194304] 0 2024-04-27T07:33:39.933 INFO:tasks.workunit.client.1.smithi100.stdout:5/566: symlink d0/d4/lae 0 2024-04-27T07:33:39.934 INFO:tasks.workunit.client.1.smithi100.stdout:8/628: stat d6/d1b/d1d/d59/l5f 0 2024-04-27T07:33:39.935 INFO:tasks.workunit.client.1.smithi100.stdout:2/629: truncate d0/da/d29/d47/da1/da3/f97 711203 0 2024-04-27T07:33:39.935 INFO:tasks.workunit.client.1.smithi100.stdout:6/690: dread de/fbd [0,4194304] 0 2024-04-27T07:33:39.935 INFO:tasks.workunit.client.1.smithi100.stdout:9/650: dread d1/d9/db/d2b/d4f/dd1/fe6 [0,4194304] 0 2024-04-27T07:33:39.937 INFO:tasks.workunit.client.1.smithi100.stdout:0/611: creat d1/d38/d3a/d54/db1/fd1 x:0 0 0 2024-04-27T07:33:39.938 INFO:tasks.workunit.client.1.smithi100.stdout:4/712: dread d5/d16/d4c/fc2 [0,4194304] 0 2024-04-27T07:33:39.939 INFO:tasks.workunit.client.1.smithi100.stdout:9/651: chown d1/d9/db/da1/db4/fd5 555 1 2024-04-27T07:33:39.939 INFO:tasks.workunit.client.1.smithi100.stdout:7/635: readlink d1/dd/d2a/d2c/la8 0 2024-04-27T07:33:39.951 INFO:tasks.workunit.client.1.smithi100.stdout:4/713: dread - d5/d1b/d65/dc6/ff4 zero size 2024-04-27T07:33:39.951 INFO:tasks.workunit.client.1.smithi100.stdout:9/652: stat d1/d9/db/d2b/d4f/dd1/dd0 0 2024-04-27T07:33:39.951 INFO:tasks.workunit.client.1.smithi100.stdout:5/567: read - d0/d4/d21/d24/f5a zero size 2024-04-27T07:33:39.952 INFO:tasks.workunit.client.1.smithi100.stdout:7/636: chown d1/dd/d16/d3e/lb7 32705 1 2024-04-27T07:33:39.959 INFO:tasks.workunit.client.1.smithi100.stdout:1/744: dwrite d0/d23/f54 [0,4194304] 0 2024-04-27T07:33:39.960 INFO:tasks.workunit.client.1.smithi100.stdout:2/630: creat d0/d79/d94/dbc/d98/db1/fd6 x:0 0 0 2024-04-27T07:33:39.960 INFO:tasks.workunit.client.1.smithi100.stdout:0/612: symlink d1/d8/d20/d72/d96/ld2 0 2024-04-27T07:33:39.960 INFO:tasks.workunit.client.1.smithi100.stdout:0/613: chown d1/d8/d20/f26 72 1 2024-04-27T07:33:39.960 INFO:tasks.workunit.client.1.smithi100.stdout:4/714: dwrite d5/d1b/fee [0,4194304] 0 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 -- 172.21.15.82:0/2619028082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 msgr2=0x7fe7280fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 --2- 172.21.15.82:0/2619028082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe7280fc0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe720009ce0 tx=0x7fe720004d10 comp rx=0 tx=0).stop 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 -- 172.21.15.82:0/2619028082 shutdown_connections 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 --2- 172.21.15.82:0/2619028082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 0x7fe7280fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 --2- 172.21.15.82:0/2619028082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe7280fc0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 -- 172.21.15.82:0/2619028082 >> 172.21.15.82:0/2619028082 conn(0x7fe7280f7430 msgr2=0x7fe7280f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:39.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 -- 172.21.15.82:0/2619028082 shutdown_connections 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.942+0000 7fe72f751700 1 -- 172.21.15.82:0/2619028082 wait complete. 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.943+0000 7fe72f751700 1 Processor -- start 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.943+0000 7fe72f751700 1 -- start start 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72f751700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72f751700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 0x7fe72810cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72f751700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72810d680 con 0x7fe7280fbcb0 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72f751700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72810de20 con 0x7fe7280fcf60 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48688/0 (socket says 172.21.15.82:48688) 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 -- 172.21.15.82:0/341397056 learned_addr learned my addr 172.21.15.82:0/341397056 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72ccec700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 0x7fe72810cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 -- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 msgr2=0x7fe72810cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 0x7fe72810cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:39.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 -- 172.21.15.82:0/341397056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720009940 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.944+0000 7fe72d4ed700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe720004740 tx=0x7fe720004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.945+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72000e040 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.945+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7200128e0 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.945+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72001c9a0 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.945+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72810e0a0 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.945+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72810e660 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.946+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72805f5c0 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.947+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe720012a50 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.947+0000 7fe71dffb700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 0x7fe71406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.947+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe72008c680 con 0x7fe7280fbcb0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.948+0000 7fe72ccec700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 0x7fe71406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.949+0000 7fe72ccec700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 0x7fe71406e1a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe724009bf0 tx=0x7fe7240091a0 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:39.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:39.956+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe7200597c0 con 0x7fe7280fbcb0 2024-04-27T07:33:39.975 INFO:tasks.workunit.client.1.smithi100.stdout:7/637: write d1/dd/d2a/f93 [122395,32085] 0 2024-04-27T07:33:39.976 INFO:tasks.workunit.client.1.smithi100.stdout:9/653: mkdir d1/d9/db/d56/d5c/de3/d4a/daa/de9 0 2024-04-27T07:33:39.977 INFO:tasks.workunit.client.1.smithi100.stdout:8/629: write d6/d1b/f2d [4843497,77200] 0 2024-04-27T07:33:39.977 INFO:tasks.workunit.client.1.smithi100.stdout:5/568: mknod d0/d4/d21/caf 0 2024-04-27T07:33:39.978 INFO:tasks.workunit.client.1.smithi100.stdout:1/745: creat d0/d1b/d20/d2d/d35/d4d/de2/ff4 x:0 0 0 2024-04-27T07:33:39.978 INFO:tasks.workunit.client.1.smithi100.stdout:8/630: rename d6/d1b/d1d to d6/d1b/d1d/d59/dca 22 2024-04-27T07:33:39.978 INFO:tasks.workunit.client.1.smithi100.stdout:0/614: symlink d1/d38/d3a/ld3 0 2024-04-27T07:33:39.983 INFO:tasks.workunit.client.1.smithi100.stdout:7/638: symlink d1/dd/d16/d70/d51/lbc 0 2024-04-27T07:33:39.985 INFO:tasks.workunit.client.1.smithi100.stdout:9/654: link d1/d76/dd6/fd8 d1/d9/db/d2b/d4f/d57/dbe/fea 0 2024-04-27T07:33:39.985 INFO:tasks.workunit.client.1.smithi100.stdout:5/569: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fb0 x:0 0 0 2024-04-27T07:33:39.988 INFO:tasks.workunit.client.1.smithi100.stdout:1/746: dwrite d0/d1b/d20/d2d/d35/dac/fb2 [0,4194304] 0 2024-04-27T07:33:39.988 INFO:tasks.workunit.client.1.smithi100.stdout:0/615: stat d1/d8/l1b 0 2024-04-27T07:33:39.988 INFO:tasks.workunit.client.1.smithi100.stdout:7/639: mknod d1/dd/d16/d4a/cbd 0 2024-04-27T07:33:39.988 INFO:tasks.workunit.client.1.smithi100.stdout:9/655: symlink d1/d9/db/d56/d5c/leb 0 2024-04-27T07:33:39.988 INFO:tasks.workunit.client.1.smithi100.stdout:6/691: truncate de/d58/d21/fca 6107998 0 2024-04-27T07:33:39.993 INFO:tasks.workunit.client.1.smithi100.stdout:8/631: creat d6/d20/d50/d72/daf/fcb x:0 0 0 2024-04-27T07:33:39.993 INFO:tasks.workunit.client.1.smithi100.stdout:5/570: rename d0/d4/d21/d24/d46/c5f to d0/d4/d21/d24/cb1 0 2024-04-27T07:33:40.014 INFO:tasks.workunit.client.1.smithi100.stdout:4/715: dread d5/d16/d19/f3d [0,4194304] 0 2024-04-27T07:33:40.016 INFO:tasks.workunit.client.1.smithi100.stdout:9/656: creat d1/d9/db/d56/d5c/de3/d4a/fec x:0 0 0 2024-04-27T07:33:40.016 INFO:tasks.workunit.client.1.smithi100.stdout:7/640: write d1/dd/d16/d4a/fab [3700304,101297] 0 2024-04-27T07:33:40.017 INFO:tasks.workunit.client.1.smithi100.stdout:6/692: dwrite de/d58/d28/f4d [0,4194304] 0 2024-04-27T07:33:40.019 INFO:tasks.workunit.client.1.smithi100.stdout:4/716: chown d5/d16/d19/dca 518 1 2024-04-27T07:33:40.019 INFO:tasks.workunit.client.1.smithi100.stdout:0/616: getdents d1/d8/d20/d61/d66/dcf 0 2024-04-27T07:33:40.019 INFO:tasks.workunit.client.1.smithi100.stdout:0/617: fsync d1/d8/d20/d1e/f6e 0 2024-04-27T07:33:40.025 INFO:tasks.workunit.client.1.smithi100.stdout:8/632: dwrite d6/d20/d50/f74 [4194304,4194304] 0 2024-04-27T07:33:40.027 INFO:tasks.workunit.client.1.smithi100.stdout:1/747: truncate d0/d1f/d6d/db4/d40/fe3 617708 0 2024-04-27T07:33:40.028 INFO:tasks.workunit.client.1.smithi100.stdout:4/717: write d5/d16/d19/d21/f41 [5835412,7202] 0 2024-04-27T07:33:40.028 INFO:tasks.workunit.client.1.smithi100.stdout:1/748: write d0/d1b/da1/fa2 [1444939,90842] 0 2024-04-27T07:33:40.029 INFO:tasks.workunit.client.1.smithi100.stdout:7/641: rename d1/dd/d16/d4a/d56/l82 to d1/dd/d2a/d2c/d9f/lbe 0 2024-04-27T07:33:40.030 INFO:tasks.workunit.client.1.smithi100.stdout:5/571: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:40.038 INFO:tasks.workunit.client.1.smithi100.stdout:8/633: creat d6/d1b/d1d/d77/fcc x:0 0 0 2024-04-27T07:33:40.041 INFO:tasks.workunit.client.1.smithi100.stdout:1/749: truncate d0/d1b/d20/d2d/d35/d4d/d60/fbd 417318 0 2024-04-27T07:33:40.041 INFO:tasks.workunit.client.1.smithi100.stdout:6/693: mknod de/d58/d21/ce9 0 2024-04-27T07:33:40.041 INFO:tasks.workunit.client.1.smithi100.stdout:5/572: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fa2 zero size 2024-04-27T07:33:40.043 INFO:tasks.workunit.client.1.smithi100.stdout:6/694: chown de/d2e/d86/f93 4880909 1 2024-04-27T07:33:40.043 INFO:tasks.workunit.client.1.smithi100.stdout:4/718: creat d5/d16/d19/d21/d87/ffa x:0 0 0 2024-04-27T07:33:40.044 INFO:tasks.workunit.client.1.smithi100.stdout:4/719: write d5/f10 [5268545,59235] 0 2024-04-27T07:33:40.047 INFO:tasks.workunit.client.1.smithi100.stdout:1/750: dwrite d0/d1f/d6d/db4/f28 [4194304,4194304] 0 2024-04-27T07:33:40.053 INFO:tasks.workunit.client.1.smithi100.stdout:4/720: write d5/d16/d19/d21/d77/d94/d9f/dd6/fde [238395,53454] 0 2024-04-27T07:33:40.055 INFO:tasks.workunit.client.1.smithi100.stdout:4/721: chown d5/d16/d19/d46/d53/l60 3 1 2024-04-27T07:33:40.056 INFO:tasks.workunit.client.1.smithi100.stdout:9/657: link d1/d9/db/d2b/d31/l45 d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/led 0 2024-04-27T07:33:40.061 INFO:tasks.workunit.client.1.smithi100.stdout:9/658: truncate d1/f13 4427250 0 2024-04-27T07:33:40.063 INFO:tasks.workunit.client.1.smithi100.stdout:5/573: unlink d0/d4/d21/d24/d2f/d39/d56/d67/d84/f7a 0 2024-04-27T07:33:40.065 INFO:tasks.workunit.client.1.smithi100.stdout:1/751: dwrite d0/f14 [0,4194304] 0 2024-04-27T07:33:40.068 INFO:tasks.workunit.client.1.smithi100.stdout:7/642: mkdir d1/dd/d16/d31/dbf 0 2024-04-27T07:33:40.068 INFO:tasks.workunit.client.1.smithi100.stdout:8/634: dwrite d6/d20/d50/d72/f87 [0,4194304] 0 2024-04-27T07:33:40.069 INFO:tasks.workunit.client.1.smithi100.stdout:0/618: write d1/d8/d14/f17 [4872035,6680] 0 2024-04-27T07:33:40.077 INFO:tasks.workunit.client.1.smithi100.stdout:7/643: write d1/dd/d16/d4a/fab [4457295,93334] 0 2024-04-27T07:33:40.077 INFO:tasks.workunit.client.1.smithi100.stdout:1/752: chown d0/d1b/d20/d2d/l3f 4954 1 2024-04-27T07:33:40.079 INFO:tasks.workunit.client.1.smithi100.stdout:4/722: link d5/d1b/f5f d5/d16/d19/d21/d2b/ffb 0 2024-04-27T07:33:40.080 INFO:tasks.workunit.client.1.smithi100.stdout:1/753: chown d0/d1b/da1/fb0 1680 1 2024-04-27T07:33:40.088 INFO:tasks.workunit.client.1.smithi100.stdout:7/644: stat d1/dd/d16/d31/d4c/d4d/d3b/f45 0 2024-04-27T07:33:40.089 INFO:tasks.workunit.client.1.smithi100.stdout:9/659: write d1/d9/db/f2e [1415661,107377] 0 2024-04-27T07:33:40.089 INFO:tasks.workunit.client.1.smithi100.stdout:8/635: dwrite d6/d20/d2a/f85 [0,4194304] 0 2024-04-27T07:33:40.093 INFO:tasks.workunit.client.1.smithi100.stdout:7/645: chown d1/dd/d16/d70/d6e/fb4 237 1 2024-04-27T07:33:40.093 INFO:tasks.workunit.client.1.smithi100.stdout:4/723: rename d5/d1b/d65/dc6 to d5/d1b/df8/d50/dfc 0 2024-04-27T07:33:40.095 INFO:tasks.workunit.client.1.smithi100.stdout:0/619: link d1/d38/f40 d1/d38/d3a/fd4 0 2024-04-27T07:33:40.096 INFO:tasks.workunit.client.1.smithi100.stdout:8/636: dread - d6/d20/d50/f89 zero size 2024-04-27T07:33:40.099 INFO:tasks.workunit.client.1.smithi100.stdout:4/724: fdatasync d5/d1b/f6c 0 2024-04-27T07:33:40.103 INFO:tasks.workunit.client.1.smithi100.stdout:5/574: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fa5 [0,4194304] 0 2024-04-27T07:33:40.103 INFO:tasks.workunit.client.1.smithi100.stdout:1/754: symlink d0/d1f/d6d/dc7/lf5 0 2024-04-27T07:33:40.107 INFO:tasks.workunit.client.1.smithi100.stdout:8/637: creat d6/d1b/d75/fcd x:0 0 0 2024-04-27T07:33:40.110 INFO:tasks.workunit.client.1.smithi100.stdout:9/660: dwrite d1/d9/db/d2b/d4f/dac/f7c [0,4194304] 0 2024-04-27T07:33:40.112 INFO:tasks.workunit.client.1.smithi100.stdout:8/638: truncate d6/d1b/d1d/d59/fb4 199456 0 2024-04-27T07:33:40.115 INFO:tasks.workunit.client.1.smithi100.stdout:0/620: rename d1/d8/d14/d59/d99/fad to d1/d8/d14/d59/d99/fd5 0 2024-04-27T07:33:40.116 INFO:tasks.workunit.client.1.smithi100.stdout:9/661: write d1/d9/db/d56/d5c/de3/d4a/fec [501591,74194] 0 2024-04-27T07:33:40.116 INFO:tasks.workunit.client.1.smithi100.stdout:6/695: truncate de/d58/d21/d24/d9f/fbc 2620822 0 2024-04-27T07:33:40.118 INFO:tasks.workunit.client.1.smithi100.stdout:0/621: truncate d1/d8/d20/d61/fb2 949203 0 2024-04-27T07:33:40.119 INFO:tasks.workunit.client.1.smithi100.stdout:4/725: symlink d5/d16/d19/d21/lfd 0 2024-04-27T07:33:40.119 INFO:tasks.workunit.client.1.smithi100.stdout:9/662: chown d1/d9/db/d2b/d4f/dac/d54/d61/l66 378127 1 2024-04-27T07:33:40.120 INFO:tasks.workunit.client.1.smithi100.stdout:4/726: stat d5/d16/d19/l4f 0 2024-04-27T07:33:40.120 INFO:tasks.workunit.client.1.smithi100.stdout:5/575: creat d0/d4/d21/d24/d2f/d39/d56/d67/d84/fb2 x:0 0 0 2024-04-27T07:33:40.121 INFO:tasks.workunit.client.1.smithi100.stdout:9/663: chown d1/d9/db/d56/d5c/de3/d4a/d67/d8a/fb3 1030084318 1 2024-04-27T07:33:40.122 INFO:tasks.workunit.client.1.smithi100.stdout:9/664: dread - d1/f94 zero size 2024-04-27T07:33:40.123 INFO:tasks.workunit.client.1.smithi100.stdout:8/639: rename d6/d1b/d1d/d77 to d6/d20/d8b/d8c/dce 0 2024-04-27T07:33:40.124 INFO:tasks.workunit.client.1.smithi100.stdout:1/755: rmdir d0/d1f/d6d 39 2024-04-27T07:33:40.127 INFO:tasks.workunit.client.1.smithi100.stdout:1/756: write d0/d1b/d20/d2d/d35/d4d/d60/fbd [493451,53696] 0 2024-04-27T07:33:40.127 INFO:tasks.workunit.client.1.smithi100.stdout:4/727: creat d5/ffe x:0 0 0 2024-04-27T07:33:40.128 INFO:tasks.workunit.client.1.smithi100.stdout:5/576: symlink d0/d4/d21/d24/d2f/d57/d37/d1a/d31/lb3 0 2024-04-27T07:33:40.130 INFO:tasks.workunit.client.1.smithi100.stdout:9/665: symlink d1/d76/dd6/lee 0 2024-04-27T07:33:40.131 INFO:tasks.workunit.client.1.smithi100.stdout:4/728: chown d5/d16/d19/d46/d53/d7e/cbb 2314 1 2024-04-27T07:33:40.134 INFO:tasks.workunit.client.1.smithi100.stdout:8/640: dwrite d6/d1b/d75/fba [0,4194304] 0 2024-04-27T07:33:40.135 INFO:tasks.workunit.client.1.smithi100.stdout:6/696: truncate de/d58/d21/f49 404408 0 2024-04-27T07:33:40.136 INFO:tasks.workunit.client.1.smithi100.stdout:8/641: readlink d6/d20/d50/l6c 0 2024-04-27T07:33:40.140 INFO:tasks.workunit.client.1.smithi100.stdout:0/622: write d1/d38/f47 [1364271,124826] 0 2024-04-27T07:33:40.142 INFO:tasks.workunit.client.1.smithi100.stdout:9/666: mknod d1/d9/db/d2b/d4f/d57/cef 0 2024-04-27T07:33:40.146 INFO:tasks.workunit.client.1.smithi100.stdout:5/577: mkdir d0/d4/d21/d24/d2f/d57/d37/db4 0 2024-04-27T07:33:40.148 INFO:tasks.workunit.client.1.smithi100.stdout:5/578: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fa2 zero size 2024-04-27T07:33:40.148 INFO:tasks.workunit.client.1.smithi100.stdout:9/667: creat d1/d9/db/d2b/d4f/d57/ff0 x:0 0 0 2024-04-27T07:33:40.151 INFO:tasks.workunit.client.1.smithi100.stdout:6/697: unlink de/d58/d21/d24/f25 0 2024-04-27T07:33:40.152 INFO:tasks.workunit.client.1.smithi100.stdout:4/729: write d5/f9 [3812288,114820] 0 2024-04-27T07:33:40.153 INFO:tasks.workunit.client.1.smithi100.stdout:4/730: readlink d5/d16/d2e/le6 0 2024-04-27T07:33:40.153 INFO:tasks.workunit.client.1.smithi100.stdout:8/642: rename d6/d20/f96 to d6/d20/d8b/dc0/fcf 0 2024-04-27T07:33:40.154 INFO:tasks.workunit.client.1.smithi100.stdout:8/643: chown d6/d20/d54/d91/lc4 986546 1 2024-04-27T07:33:40.155 INFO:tasks.workunit.client.1.smithi100.stdout:0/623: fsync d1/d8/d14/f50 0 2024-04-27T07:33:40.157 INFO:tasks.workunit.client.1.smithi100.stdout:5/579: rmdir d0/d4/d21/d24/d2f/d57/d3e 39 2024-04-27T07:33:40.159 INFO:tasks.workunit.client.1.smithi100.stdout:4/731: rmdir d5/d16/d19 39 2024-04-27T07:33:40.162 INFO:tasks.workunit.client.1.smithi100.stdout:9/668: creat d1/d76/dd6/dda/ff1 x:0 0 0 2024-04-27T07:33:40.165 INFO:tasks.workunit.client.1.smithi100.stdout:1/757: getdents d0/d23/d3a 0 2024-04-27T07:33:40.168 INFO:tasks.workunit.client.1.smithi100.stdout:9/669: creat d1/d9/db/d2b/d4f/d57/dbe/ff2 x:0 0 0 2024-04-27T07:33:40.169 INFO:tasks.workunit.client.1.smithi100.stdout:5/580: mkdir d0/d4/d21/d24/d2f/db5 0 2024-04-27T07:33:40.171 INFO:tasks.workunit.client.1.smithi100.stdout:0/624: rmdir d1/d8/d14/d65 0 2024-04-27T07:33:40.173 INFO:tasks.workunit.client.1.smithi100.stdout:8/644: dwrite d6/d1b/d1d/f9c [0,4194304] 0 2024-04-27T07:33:40.173 INFO:tasks.workunit.client.1.smithi100.stdout:6/698: rename de/d58/d21/d5b/f7f to de/d2e/fea 0 2024-04-27T07:33:40.175 INFO:tasks.workunit.client.1.smithi100.stdout:1/758: symlink d0/d1f/lf6 0 2024-04-27T07:33:40.178 INFO:tasks.workunit.client.1.smithi100.stdout:5/581: creat d0/d4/d21/d24/d2f/d39/d56/d67/fb6 x:0 0 0 2024-04-27T07:33:40.181 INFO:tasks.workunit.client.1.smithi100.stdout:9/670: rename d1/d76/dd6/lee to d1/d9/db/d56/d5c/de3/d4a/daa/de9/lf3 0 2024-04-27T07:33:40.182 INFO:tasks.workunit.client.1.smithi100.stdout:6/699: read de/d58/f35 [17211,85123] 0 2024-04-27T07:33:40.184 INFO:tasks.workunit.client.1.smithi100.stdout:6/700: write de/d2e/d3f/d80/fcc [229957,129351] 0 2024-04-27T07:33:40.184 INFO:tasks.workunit.client.1.smithi100.stdout:8/645: read d6/d1b/d1d/d59/fb4 [173788,126128] 0 2024-04-27T07:33:40.184 INFO:tasks.workunit.client.1.smithi100.stdout:4/732: rmdir d5/d16/d19/d46/def 0 2024-04-27T07:33:40.186 INFO:tasks.workunit.client.1.smithi100.stdout:8/646: dread d6/d1b/d1d/d59/f58 [0,4194304] 0 2024-04-27T07:33:40.187 INFO:tasks.workunit.client.1.smithi100.stdout:3/808: sync 2024-04-27T07:33:40.189 INFO:tasks.workunit.client.1.smithi100.stdout:5/582: fsync d0/d4/d21/d24/d46/f80 0 2024-04-27T07:33:40.190 INFO:tasks.workunit.client.1.smithi100.stdout:9/671: symlink d1/d9/db/d2b/de7/lf4 0 2024-04-27T07:33:40.191 INFO:tasks.workunit.client.1.smithi100.stdout:0/625: write d1/d8/d20/d61/d6a/f70 [1036801,30219] 0 2024-04-27T07:33:40.193 INFO:tasks.workunit.client.1.smithi100.stdout:6/701: chown de/d58/d21/d91 37 1 2024-04-27T07:33:40.194 INFO:tasks.workunit.client.1.smithi100.stdout:6/702: fdatasync de/d58/d28/f59 0 2024-04-27T07:33:40.194 INFO:tasks.workunit.client.1.smithi100.stdout:9/672: truncate d1/d9/db/da1/db4/fd5 765027 0 2024-04-27T07:33:40.194 INFO:tasks.workunit.client.1.smithi100.stdout:9/673: stat d1/d9/db/fad 0 2024-04-27T07:33:40.195 INFO:tasks.workunit.client.1.smithi100.stdout:9/674: stat d1/d9/db/d2b/f34 0 2024-04-27T07:33:40.196 INFO:tasks.workunit.client.1.smithi100.stdout:1/759: unlink d0/f26 0 2024-04-27T07:33:40.197 INFO:tasks.workunit.client.1.smithi100.stdout:5/583: dread d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:40.198 INFO:tasks.workunit.client.1.smithi100.stdout:3/809: unlink d7/d9/d10/d22/fd5 0 2024-04-27T07:33:40.198 INFO:tasks.workunit.client.1.smithi100.stdout:1/760: write d0/d1b/d20/d2d/d35/d4d/d60/fb6 [2057775,24356] 0 2024-04-27T07:33:40.199 INFO:tasks.workunit.client.1.smithi100.stdout:5/584: chown d0/d4/f11 4 1 2024-04-27T07:33:40.199 INFO:tasks.workunit.client.1.smithi100.stdout:8/647: creat d6/d20/d54/d91/fd0 x:0 0 0 2024-04-27T07:33:40.203 INFO:tasks.workunit.client.1.smithi100.stdout:4/733: link d5/d16/d19/d46/d53/f98 d5/d1b/df8/d50/dbf/fff 0 2024-04-27T07:33:40.204 INFO:tasks.workunit.client.1.smithi100.stdout:6/703: creat de/feb x:0 0 0 2024-04-27T07:33:40.206 INFO:tasks.workunit.client.1.smithi100.stdout:9/675: dread d1/f30 [0,4194304] 0 2024-04-27T07:33:40.209 INFO:tasks.workunit.client.1.smithi100.stdout:8/648: chown d6/d1b/d1d/c4a 237463 1 2024-04-27T07:33:40.213 INFO:tasks.workunit.client.1.smithi100.stdout:9/676: dwrite d1/d9/db/d56/d5c/de3/f8b [0,4194304] 0 2024-04-27T07:33:40.213 INFO:tasks.workunit.client.1.smithi100.stdout:4/734: unlink d5/d23/fb6 0 2024-04-27T07:33:40.215 INFO:tasks.workunit.client.1.smithi100.stdout:6/704: rmdir de/d58/d28 39 2024-04-27T07:33:40.216 INFO:tasks.workunit.client.1.smithi100.stdout:0/626: write d1/d38/d3a/d54/f93 [200879,48783] 0 2024-04-27T07:33:40.220 INFO:tasks.workunit.client.1.smithi100.stdout:8/649: chown d6/d20/d54/d91/dae/c6d 13038011 1 2024-04-27T07:33:40.223 INFO:tasks.workunit.client.1.smithi100.stdout:9/677: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/lf5 0 2024-04-27T07:33:40.224 INFO:tasks.workunit.client.1.smithi100.stdout:9/678: write d1/d9/db/d2b/d4f/da3/fc9 [733760,89368] 0 2024-04-27T07:33:40.227 INFO:tasks.workunit.client.1.smithi100.stdout:0/627: mkdir d1/d8/d20/d61/d6a/dd6 0 2024-04-27T07:33:40.228 INFO:tasks.workunit.client.1.smithi100.stdout:0/628: dread - d1/d8/d20/d72/d96/fb3 zero size 2024-04-27T07:33:40.229 INFO:tasks.workunit.client.1.smithi100.stdout:5/585: rename d0/d4/d21/d24/c87 to d0/d4/d21/d24/d2f/d57/cb7 0 2024-04-27T07:33:40.230 INFO:tasks.workunit.client.1.smithi100.stdout:6/705: rename de/d58/d21/d24/d9f to de/d58/d21/d24/d9f/dec 22 2024-04-27T07:33:40.231 INFO:tasks.workunit.client.1.smithi100.stdout:8/650: symlink d6/d20/d50/d72/daf/ld1 0 2024-04-27T07:33:40.232 INFO:tasks.workunit.client.1.smithi100.stdout:6/706: dread - de/d58/d90/fe7 zero size 2024-04-27T07:33:40.232 INFO:tasks.workunit.client.1.smithi100.stdout:9/679: dwrite d1/f85 [0,4194304] 0 2024-04-27T07:33:40.232 INFO:tasks.workunit.client.1.smithi100.stdout:8/651: fdatasync d6/d1b/d75/fcd 0 2024-04-27T07:33:40.233 INFO:tasks.workunit.client.1.smithi100.stdout:3/810: truncate d7/f9e 3433477 0 2024-04-27T07:33:40.236 INFO:tasks.workunit.client.1.smithi100.stdout:1/761: getdents d0/d23 0 2024-04-27T07:33:40.239 INFO:tasks.workunit.client.1.smithi100.stdout:4/735: truncate d5/d1b/fee 1302192 0 2024-04-27T07:33:40.240 INFO:tasks.workunit.client.1.smithi100.stdout:8/652: readlink d6/la 0 2024-04-27T07:33:40.243 INFO:tasks.workunit.client.1.smithi100.stdout:3/811: fsync d7/d9/d10/d33/d90/d3a/fa2 0 2024-04-27T07:33:40.244 INFO:tasks.workunit.client.1.smithi100.stdout:1/762: chown d0/d1f/d6d/db4/d4e/lbf 3 1 2024-04-27T07:33:40.245 INFO:tasks.workunit.client.1.smithi100.stdout:4/736: symlink d5/l100 0 2024-04-27T07:33:40.245 INFO:tasks.workunit.client.1.smithi100.stdout:1/763: readlink d0/d1f/d6d/db4/d4e/lbf 0 2024-04-27T07:33:40.247 INFO:tasks.workunit.client.1.smithi100.stdout:4/737: dread - d5/d16/d19/d21/d87/ffa zero size 2024-04-27T07:33:40.248 INFO:tasks.workunit.client.1.smithi100.stdout:3/812: write d7/d9/d10/f9c [3342458,10671] 0 2024-04-27T07:33:40.249 INFO:tasks.workunit.client.1.smithi100.stdout:0/629: creat d1/d8/d20/fd7 x:0 0 0 2024-04-27T07:33:40.296 INFO:tasks.workunit.client.1.smithi100.stdout:4/738: write d5/d1b/df8/d3f/f63 [4856735,109467] 0 2024-04-27T07:33:40.297 INFO:tasks.workunit.client.1.smithi100.stdout:1/764: dread d0/d23/d3a/f98 [0,4194304] 0 2024-04-27T07:33:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.295+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe72810ea90 con 0x7fe71406bcf0 2024-04-27T07:33:40.297 INFO:tasks.workunit.client.1.smithi100.stdout:9/680: dread d1/fb9 [0,4194304] 0 2024-04-27T07:33:40.299 INFO:tasks.workunit.client.1.smithi100.stdout:3/813: creat d7/ff7 x:0 0 0 2024-04-27T07:33:40.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.297+0000 7fe71dffb700 1 -- 172.21.15.82:0/341397056 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe72810ea90 con 0x7fe71406bcf0 2024-04-27T07:33:40.301 INFO:tasks.workunit.client.1.smithi100.stdout:4/739: fdatasync d5/d1b/df8/d50/dfc/dd3/ff7 0 2024-04-27T07:33:40.301 INFO:tasks.workunit.client.1.smithi100.stdout:1/765: dread - d0/d1f/ff2 zero size 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.300+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 msgr2=0x7fe71406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.300+0000 7fe72f751700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 0x7fe71406e1a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe724009bf0 tx=0x7fe7240091a0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 msgr2=0x7fe72810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe720004740 tx=0x7fe720004d10 comp rx=0 tx=0).stop 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 shutdown_connections 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe71406bcf0 0x7fe71406e1a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7280fbcb0 0x7fe72810cab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 --2- 172.21.15.82:0/341397056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7280fcf60 0x7fe72810cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 >> 172.21.15.82:0/341397056 conn(0x7fe7280f7430 msgr2=0x7fe7280f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 shutdown_connections 2024-04-27T07:33:40.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.301+0000 7fe72f751700 1 -- 172.21.15.82:0/341397056 wait complete. 2024-04-27T07:33:40.305 INFO:tasks.workunit.client.1.smithi100.stdout:0/630: rename d1/d8/d14/d59/f87 to d1/d8/d20/d61/d66/fd8 0 2024-04-27T07:33:40.306 INFO:tasks.workunit.client.1.smithi100.stdout:6/707: dwrite de/d58/d21/f8c [0,4194304] 0 2024-04-27T07:33:40.309 INFO:tasks.workunit.client.1.smithi100.stdout:5/586: dread d0/d4/f70 [0,4194304] 0 2024-04-27T07:33:40.311 INFO:tasks.workunit.client.1.smithi100.stdout:5/587: write d0/d4/d21/d24/d2f/d39/d56/f6b [357992,95854] 0 2024-04-27T07:33:40.311 INFO:tasks.workunit.client.1.smithi100.stdout:0/631: unlink d1/d8/d14/f17 0 2024-04-27T07:33:40.315 INFO:tasks.workunit.client.1.smithi100.stdout:3/814: rename d7/d9/d26/d2a/d5e/cae to d7/d9/d10/d3e/d91/cf8 0 2024-04-27T07:33:40.316 INFO:tasks.workunit.client.1.smithi100.stdout:1/766: creat d0/d1f/d6d/db4/ff7 x:0 0 0 2024-04-27T07:33:40.316 INFO:tasks.workunit.client.1.smithi100.stdout:6/708: symlink de/d58/d21/d24/led 0 2024-04-27T07:33:40.318 INFO:tasks.workunit.client.1.smithi100.stdout:5/588: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/f8e [0,4194304] 0 2024-04-27T07:33:40.318 INFO:tasks.workunit.client.1.smithi100.stdout:9/681: link d1/d9/db/d56/f83 d1/d9/db/d2b/ff6 0 2024-04-27T07:33:40.321 INFO:tasks.workunit.client.1.smithi100.stdout:0/632: mknod d1/d8/d20/d61/d6a/cd9 0 2024-04-27T07:33:40.322 INFO:tasks.workunit.client.1.smithi100.stdout:0/633: chown d1/d8/d20/d1e/c79 516738443 1 2024-04-27T07:33:40.325 INFO:tasks.workunit.client.1.smithi100.stdout:4/740: link d5/d16/d19/d21/d6d/dad/cdf d5/d1b/df8/d3f/d96/c101 0 2024-04-27T07:33:40.328 INFO:tasks.workunit.client.1.smithi100.stdout:1/767: dwrite d0/d1b/d20/d2d/d35/d4d/d60/da4/fb7 [0,4194304] 0 2024-04-27T07:33:40.329 INFO:tasks.workunit.client.1.smithi100.stdout:1/768: chown d0/d1b/fea 24320 1 2024-04-27T07:33:40.330 INFO:tasks.workunit.client.1.smithi100.stdout:5/589: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fb8 x:0 0 0 2024-04-27T07:33:40.331 INFO:tasks.workunit.client.1.smithi100.stdout:5/590: chown d0/d4/d21/fac 3 1 2024-04-27T07:33:40.334 INFO:tasks.workunit.client.1.smithi100.stdout:4/741: rmdir d5/d16/d19/d21/d77/d94 39 2024-04-27T07:33:40.335 INFO:tasks.workunit.client.1.smithi100.stdout:6/709: getdents de/d58/d75 0 2024-04-27T07:33:40.336 INFO:tasks.workunit.client.1.smithi100.stdout:9/682: getdents d1/d9/db/d2b/d4f/dd1/dd0 0 2024-04-27T07:33:40.340 INFO:tasks.workunit.client.1.smithi100.stdout:1/769: rename d0/d23/d3a/ldb to d0/d1f/d6d/dc7/de1/lf8 0 2024-04-27T07:33:40.341 INFO:tasks.workunit.client.1.smithi100.stdout:0/634: creat d1/d8/d20/d61/d6a/dd6/fda x:0 0 0 2024-04-27T07:33:40.342 INFO:tasks.workunit.client.1.smithi100.stdout:5/591: fdatasync d0/d4/d21/d24/f5a 0 2024-04-27T07:33:40.343 INFO:tasks.workunit.client.1.smithi100.stdout:5/592: dread - d0/d4/d21/d24/d2f/f5c zero size 2024-04-27T07:33:40.344 INFO:tasks.workunit.client.1.smithi100.stdout:4/742: chown d5/d23/d33/ca0 6804 1 2024-04-27T07:33:40.344 INFO:tasks.workunit.client.1.smithi100.stdout:6/710: rmdir de/d58/d21 39 2024-04-27T07:33:40.346 INFO:tasks.workunit.client.1.smithi100.stdout:9/683: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/lf7 0 2024-04-27T07:33:40.346 INFO:tasks.workunit.client.1.smithi100.stdout:5/593: dread d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:40.347 INFO:tasks.workunit.client.1.smithi100.stdout:0/635: write d1/d30/f9d [3476114,37958] 0 2024-04-27T07:33:40.350 INFO:tasks.workunit.client.1.smithi100.stdout:4/743: mkdir d5/d102 0 2024-04-27T07:33:40.357 INFO:tasks.workunit.client.1.smithi100.stdout:1/770: link d0/d1b/d20/d2d/d35/dac/fb2 d0/d1f/d6d/dba/ff9 0 2024-04-27T07:33:40.357 INFO:tasks.workunit.client.1.smithi100.stdout:9/684: creat d1/d9/db/d2b/d4f/dd1/ff8 x:0 0 0 2024-04-27T07:33:40.357 INFO:tasks.workunit.client.1.smithi100.stdout:9/685: write d1/fbc [861447,108523] 0 2024-04-27T07:33:40.358 INFO:tasks.workunit.client.1.smithi100.stdout:9/686: chown d1/f13 1314 1 2024-04-27T07:33:40.359 INFO:tasks.workunit.client.1.smithi100.stdout:1/771: chown d0/d23/d3a/f59 0 1 2024-04-27T07:33:40.359 INFO:tasks.workunit.client.1.smithi100.stdout:5/594: mknod d0/d4/d21/d24/d2f/d57/d37/db4/cb9 0 2024-04-27T07:33:40.361 INFO:tasks.workunit.client.1.smithi100.stdout:4/744: rename d5/d1b/df8/l85 to d5/d16/d19/d46/dd1/dd2/l103 0 2024-04-27T07:33:40.362 INFO:tasks.workunit.client.1.smithi100.stdout:4/745: dread - d5/ffe zero size 2024-04-27T07:33:40.362 INFO:tasks.workunit.client.1.smithi100.stdout:6/711: truncate de/d58/d28/f8b 1988592 0 2024-04-27T07:33:40.362 INFO:tasks.workunit.client.1.smithi100.stdout:4/746: chown d5/fc 7682595 1 2024-04-27T07:33:40.363 INFO:tasks.workunit.client.1.smithi100.stdout:9/687: mknod d1/d9/db/da1/db4/cf9 0 2024-04-27T07:33:40.365 INFO:tasks.workunit.client.1.smithi100.stdout:1/772: rename d0/da0/fd2 to d0/d1f/d6d/db4/d4e/d7b/ffa 0 2024-04-27T07:33:40.368 INFO:tasks.workunit.client.1.smithi100.stdout:4/747: chown d5/d16/d19/d21/d77/d94/d9f/dd6/fde 104909 1 2024-04-27T07:33:40.369 INFO:tasks.workunit.client.1.smithi100.stdout:4/748: dread - d5/d1b/df8/d50/dfc/fce zero size 2024-04-27T07:33:40.370 INFO:tasks.workunit.client.1.smithi100.stdout:9/688: rmdir d1/d9/db/d2b/d4f/d57 39 2024-04-27T07:33:40.372 INFO:tasks.workunit.client.1.smithi100.stdout:5/595: rename d0/d4/d21/d24/d2f/d57/d37/d1a/d31/lb3 to d0/d4/d21/d51/lba 0 2024-04-27T07:33:40.372 INFO:tasks.workunit.client.1.smithi100.stdout:0/636: link d1/d8/d14/d59/d64/ca9 d1/d38/d3a/d54/cdb 0 2024-04-27T07:33:40.373 INFO:tasks.workunit.client.1.smithi100.stdout:1/773: mknod d0/d1b/d20/d2d/d35/d4d/d60/da4/cfb 0 2024-04-27T07:33:40.377 INFO:tasks.workunit.client.1.smithi100.stdout:9/689: read d1/d9/db/fba [475073,8395] 0 2024-04-27T07:33:40.379 INFO:tasks.workunit.client.1.smithi100.stdout:9/690: dread - d1/d9/db/d2b/d4f/da3/fe5 zero size 2024-04-27T07:33:40.379 INFO:tasks.workunit.client.1.smithi100.stdout:9/691: write d1/f22 [2299381,50354] 0 2024-04-27T07:33:40.388 INFO:tasks.workunit.client.1.smithi100.stdout:6/712: write de/d58/d28/f30 [2111881,63921] 0 2024-04-27T07:33:40.391 INFO:tasks.workunit.client.1.smithi100.stdout:0/637: mknod d1/d38/cdc 0 2024-04-27T07:33:40.391 INFO:tasks.workunit.client.1.smithi100.stdout:5/596: rmdir d0/d4 39 2024-04-27T07:33:40.394 INFO:tasks.workunit.client.1.smithi100.stdout:4/749: link d5/d1b/df8/d7d/l6b d5/d1b/df8/d50/dbf/l104 0 2024-04-27T07:33:40.398 INFO:tasks.workunit.client.1.smithi100.stdout:5/597: creat d0/d42/d94/d97/d60/fbb x:0 0 0 2024-04-27T07:33:40.401 INFO:tasks.workunit.client.1.smithi100.stdout:4/750: mknod d5/d16/d19/d21/d6d/c105 0 2024-04-27T07:33:40.403 INFO:tasks.workunit.client.1.smithi100.stdout:5/598: symlink d0/d42/lbc 0 2024-04-27T07:33:40.403 INFO:tasks.workunit.client.1.smithi100.stdout:9/692: getdents d1/d9/db/d56/d5c/de3/d4a/daa/de9 0 2024-04-27T07:33:40.405 INFO:tasks.workunit.client.1.smithi100.stdout:4/751: fsync d5/d16/d19/d21/d87/f90 0 2024-04-27T07:33:40.405 INFO:tasks.workunit.client.1.smithi100.stdout:1/774: dwrite d0/d1b/d20/d2d/d35/f8b [0,4194304] 0 2024-04-27T07:33:40.408 INFO:tasks.workunit.client.1.smithi100.stdout:9/693: fdatasync d1/d9/db/d56/d5c/de3/f7b 0 2024-04-27T07:33:40.409 INFO:tasks.workunit.client.1.smithi100.stdout:0/638: truncate d1/d8/d20/faa 332415 0 2024-04-27T07:33:40.410 INFO:tasks.workunit.client.1.smithi100.stdout:9/694: write d1/d9/db/d2b/d4f/f78 [840122,124572] 0 2024-04-27T07:33:40.413 INFO:tasks.workunit.client.1.smithi100.stdout:9/695: read d1/d9/db/f2e [3106286,63460] 0 2024-04-27T07:33:40.415 INFO:tasks.workunit.client.1.smithi100.stdout:6/713: rename de/fbd to de/d58/d21/fee 0 2024-04-27T07:33:40.417 INFO:tasks.workunit.client.1.smithi100.stdout:0/639: dwrite d1/d38/fa7 [0,4194304] 0 2024-04-27T07:33:40.418 INFO:tasks.workunit.client.1.smithi100.stdout:6/714: chown de/d58/d21/d23/f39 1173101 1 2024-04-27T07:33:40.421 INFO:tasks.workunit.client.1.smithi100.stdout:1/775: dread d0/da0/f8c [0,4194304] 0 2024-04-27T07:33:40.423 INFO:tasks.workunit.client.1.smithi100.stdout:0/640: mknod d1/d8/d20/d61/cdd 0 2024-04-27T07:33:40.425 INFO:tasks.workunit.client.1.smithi100.stdout:1/776: dread - d0/d1b/d20/feb zero size 2024-04-27T07:33:40.425 INFO:tasks.workunit.client.1.smithi100.stdout:5/599: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fbd x:0 0 0 2024-04-27T07:33:40.432 INFO:tasks.workunit.client.1.smithi100.stdout:9/696: dwrite d1/d9/db/d2b/d4f/dac/d54/f95 [4194304,4194304] 0 2024-04-27T07:33:40.434 INFO:tasks.workunit.client.1.smithi100.stdout:5/600: symlink d0/d4/d21/d24/d2f/d57/d37/d1a/d30/lbe 0 2024-04-27T07:33:40.436 INFO:tasks.workunit.client.1.smithi100.stdout:6/715: dread de/d58/d28/f59 [0,4194304] 0 2024-04-27T07:33:40.436 INFO:tasks.workunit.client.1.smithi100.stdout:4/752: truncate d5/d1b/df8/d50/f5c 1780004 0 2024-04-27T07:33:40.437 INFO:tasks.workunit.client.1.smithi100.stdout:6/716: fdatasync de/f69 0 2024-04-27T07:33:40.438 INFO:tasks.workunit.client.1.smithi100.stdout:1/777: getdents d0/da0 0 2024-04-27T07:33:40.439 INFO:tasks.workunit.client.1.smithi100.stdout:5/601: write d0/d4/d21/d24/d46/d99/da0/faa [833600,60466] 0 2024-04-27T07:33:40.440 INFO:tasks.workunit.client.1.smithi100.stdout:9/697: unlink d1/d9/db/d2b/d4f/dac/c6d 0 2024-04-27T07:33:40.442 INFO:tasks.workunit.client.1.smithi100.stdout:4/753: dread d5/d16/d19/d46/d53/f92 [0,4194304] 0 2024-04-27T07:33:40.444 INFO:tasks.workunit.client.1.smithi100.stdout:4/754: chown d5/d16/d19/f3d 3 1 2024-04-27T07:33:40.445 INFO:tasks.workunit.client.1.smithi100.stdout:9/698: symlink d1/d9/db/da1/db4/lfa 0 2024-04-27T07:33:40.446 INFO:tasks.workunit.client.1.smithi100.stdout:1/778: creat d0/d1f/d6d/ffc x:0 0 0 2024-04-27T07:33:40.448 INFO:tasks.workunit.client.1.smithi100.stdout:5/602: mknod d0/d4/d21/d24/d2f/d39/d7c/d92/cbf 0 2024-04-27T07:33:40.450 INFO:tasks.workunit.client.1.smithi100.stdout:0/641: dread d1/d8/d20/d61/d6a/f97 [0,4194304] 0 2024-04-27T07:33:40.451 INFO:tasks.workunit.client.1.smithi100.stdout:1/779: rename d0/da0/f91 to d0/d1f/d6d/db4/d4e/ffd 0 2024-04-27T07:33:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 -- 172.21.15.82:0/3160387557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fcf60 msgr2=0x7f7d840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/3160387557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fcf60 0x7f7d840fd3d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7d74004940 tx=0x7f7d74009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 -- 172.21.15.82:0/3160387557 shutdown_connections 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/3160387557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fcf60 0x7f7d840fd3d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/3160387557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fbcb0 0x7f7d840fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 -- 172.21.15.82:0/3160387557 >> 172.21.15.82:0/3160387557 conn(0x7f7d840f7430 msgr2=0x7f7d840f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 -- 172.21.15.82:0/3160387557 shutdown_connections 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.450+0000 7f7d8c76b700 1 -- 172.21.15.82:0/3160387557 wait complete. 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.451+0000 7f7d8c76b700 1 Processor -- start 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.451+0000 7f7d8c76b700 1 -- start start 2024-04-27T07:33:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.451+0000 7f7d8c76b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.455 INFO:tasks.workunit.client.1.smithi100.stdout:5/603: creat d0/fc0 x:0 0 0 2024-04-27T07:33:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.452+0000 7f7d8c76b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fcf60 0x7f7d841100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.452+0000 7f7d8c76b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841106e0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.452+0000 7f7d8c76b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84110f30 con 0x7f7d840fcf60 2024-04-27T07:33:40.456 INFO:tasks.workunit.client.1.smithi100.stdout:1/780: unlink d0/d1f/d6d/db4/d4e/ced 0 2024-04-27T07:33:40.458 INFO:tasks.workunit.client.1.smithi100.stdout:5/604: creat d0/d4/d21/d24/d2f/d39/d7c/fc1 x:0 0 0 2024-04-27T07:33:40.463 INFO:tasks.workunit.client.1.smithi100.stdout:0/642: link d1/d8/d20/f5a d1/d30/fde 0 2024-04-27T07:33:40.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48696/0 (socket says 172.21.15.82:48696) 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 -- 172.21.15.82:0/383269541 learned_addr learned my addr 172.21.15.82:0/383269541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 -- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fcf60 msgr2=0x7f7d841100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fcf60 0x7f7d841100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.453+0000 7f7d8a507700 1 -- 172.21.15.82:0/383269541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74005040 con 0x7f7d840fbcb0 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.454+0000 7f7d8a507700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7d80004f20 tx=0x7f7d8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.454+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d80007ea0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.454+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d8000f040 con 0x7f7d840fbcb0 2024-04-27T07:33:40.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.454+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d8000c7f0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.455+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d841111b0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.472 INFO:tasks.workunit.client.1.smithi100.stdout:1/781: creat d0/d1b/d20/d2d/ffe x:0 0 0 2024-04-27T07:33:40.472 INFO:tasks.workunit.client.1.smithi100.stdout:0/643: read d1/d8/d14/d59/d99/fc5 [73854,32964] 0 2024-04-27T07:33:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.455+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d841116f0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.456+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8405f5c0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.459+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f7d800090d0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.459+0000 7f7d7affd700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 0x7f7d7006e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.460+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7d80092d90 con 0x7f7d840fbcb0 2024-04-27T07:33:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.460+0000 7f7d89d06700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 0x7f7d7006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.461+0000 7f7d89d06700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 0x7f7d7006e270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009b30 tx=0x7f7d74009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:40.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.467+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7d8005ffc0 con 0x7f7d840fbcb0 2024-04-27T07:33:40.475 INFO:tasks.workunit.client.1.smithi100.stdout:5/605: link d0/d4/d21/d24/d2f/d39/d56/f64 d0/fc2 0 2024-04-27T07:33:40.476 INFO:tasks.workunit.client.1.smithi100.stdout:5/606: chown d0/d4/d21/d24/d2f/d39/d56 1513 1 2024-04-27T07:33:40.478 INFO:tasks.workunit.client.1.smithi100.stdout:0/644: creat d1/d8/d14/d59/d99/fdf x:0 0 0 2024-04-27T07:33:40.481 INFO:tasks.workunit.client.1.smithi100.stdout:9/699: rename d1/d9/db/da1/db4 to d1/d9/db/da1/dfb 0 2024-04-27T07:33:40.482 INFO:tasks.workunit.client.1.smithi100.stdout:0/645: dread - d1/fb0 zero size 2024-04-27T07:33:40.482 INFO:tasks.workunit.client.1.smithi100.stdout:6/717: dwrite de/d2e/d3f/f87 [0,4194304] 0 2024-04-27T07:33:40.485 INFO:tasks.workunit.client.1.smithi100.stdout:1/782: creat d0/d23/d3a/df0/fff x:0 0 0 2024-04-27T07:33:40.486 INFO:tasks.workunit.client.1.smithi100.stdout:5/607: symlink d0/d42/d94/lc3 0 2024-04-27T07:33:40.487 INFO:tasks.workunit.client.1.smithi100.stdout:9/700: chown d1/d9/f21 51 1 2024-04-27T07:33:40.488 INFO:tasks.workunit.client.1.smithi100.stdout:0/646: dread - d1/fc2 zero size 2024-04-27T07:33:40.499 INFO:tasks.workunit.client.1.smithi100.stdout:9/701: dwrite d1/d9/db/d2b/d4f/da3/faf [0,4194304] 0 2024-04-27T07:33:40.502 INFO:tasks.workunit.client.1.smithi100.stdout:1/783: rename d0/d1f/d6d/db4/d4e/d7b/ffa to d0/d1f/d6d/db4/f100 0 2024-04-27T07:33:40.506 INFO:tasks.workunit.client.1.smithi100.stdout:5/608: rename d0/d4/d21/d24/d46 to d0/d42/d94/d97/d60/dc4 0 2024-04-27T07:33:40.509 INFO:tasks.workunit.client.1.smithi100.stdout:1/784: stat d0/d1b/d20/d2d/d35/l90 0 2024-04-27T07:33:40.510 INFO:tasks.workunit.client.1.smithi100.stdout:9/702: dwrite d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/fc5 [0,4194304] 0 2024-04-27T07:33:40.515 INFO:tasks.workunit.client.1.smithi100.stdout:0/647: rename d1/d8/d14/d59/d64/d80/fbd to d1/d8/d14/dce/fe0 0 2024-04-27T07:33:40.515 INFO:tasks.workunit.client.1.smithi100.stdout:5/609: readlink d0/d4/d21/d24/d2f/d57/d37/d1a/d30/lbe 0 2024-04-27T07:33:40.523 INFO:tasks.workunit.client.1.smithi100.stdout:6/718: dwrite de/d58/d21/d24/d9f/fbc [0,4194304] 0 2024-04-27T07:33:40.524 INFO:tasks.workunit.client.1.smithi100.stdout:1/785: truncate d0/d1b/d20/d2d/d35/f69 758423 0 2024-04-27T07:33:40.527 INFO:tasks.workunit.client.1.smithi100.stdout:6/719: mknod de/d58/d28/cef 0 2024-04-27T07:33:40.527 INFO:tasks.workunit.client.1.smithi100.stdout:5/610: symlink d0/d4/d21/d24/d2f/d57/d37/lc5 0 2024-04-27T07:33:40.527 INFO:tasks.workunit.client.1.smithi100.stdout:1/786: write d0/d1f/d6d/db4/d4e/d7b/fcf [2698702,123152] 0 2024-04-27T07:33:40.527 INFO:tasks.workunit.client.1.smithi100.stdout:9/703: link d1/d9/db/fb2 d1/d9/db/d56/d5c/de3/d4a/daa/de9/ffc 0 2024-04-27T07:33:40.528 INFO:tasks.workunit.client.1.smithi100.stdout:6/720: chown de/d58/d21/d24/f54 25205 1 2024-04-27T07:33:40.529 INFO:tasks.workunit.client.1.smithi100.stdout:5/611: dread d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:40.529 INFO:tasks.workunit.client.1.smithi100.stdout:1/787: truncate d0/da0/f74 1089045 0 2024-04-27T07:33:40.530 INFO:tasks.workunit.client.1.smithi100.stdout:6/721: read de/d58/d90/f97 [363769,22214] 0 2024-04-27T07:33:40.530 INFO:tasks.workunit.client.1.smithi100.stdout:2/631: sync 2024-04-27T07:33:40.545 INFO:tasks.workunit.client.1.smithi100.stdout:2/632: write d0/da/d75/f78 [1774592,30306] 0 2024-04-27T07:33:40.546 INFO:tasks.workunit.client.1.smithi100.stdout:6/722: mkdir de/d58/d21/d91/df0 0 2024-04-27T07:33:40.546 INFO:tasks.workunit.client.1.smithi100.stdout:5/612: creat d0/d4/d21/d24/d2f/d57/d37/d48/fc6 x:0 0 0 2024-04-27T07:33:40.546 INFO:tasks.workunit.client.1.smithi100.stdout:2/633: read d0/da/d29/d47/d5a/d8d/f2a [3028829,32966] 0 2024-04-27T07:33:40.546 INFO:tasks.workunit.client.1.smithi100.stdout:6/723: mknod de/d58/d28/cf1 0 2024-04-27T07:33:40.547 INFO:tasks.workunit.client.1.smithi100.stdout:6/724: write de/d58/d21/d24/d9f/daa/fe8 [415782,113700] 0 2024-04-27T07:33:40.547 INFO:tasks.workunit.client.1.smithi100.stdout:1/788: creat d0/d1f/d6d/f101 x:0 0 0 2024-04-27T07:33:40.547 INFO:tasks.workunit.client.1.smithi100.stdout:5/613: write d0/d4/f11 [536004,69084] 0 2024-04-27T07:33:40.548 INFO:tasks.workunit.client.1.smithi100.stdout:5/614: chown d0/fc2 11544163 1 2024-04-27T07:33:40.551 INFO:tasks.workunit.client.1.smithi100.stdout:1/789: readlink d0/d1b/l1e 0 2024-04-27T07:33:40.555 INFO:tasks.workunit.client.1.smithi100.stdout:0/648: dwrite d1/d8/d20/faa [0,4194304] 0 2024-04-27T07:33:40.557 INFO:tasks.workunit.client.1.smithi100.stdout:1/790: creat d0/d1b/d20/d2d/d35/d4d/d60/f102 x:0 0 0 2024-04-27T07:33:40.557 INFO:tasks.workunit.client.1.smithi100.stdout:5/615: truncate d0/d4/d21/d24/d2f/f79 1916324 0 2024-04-27T07:33:40.559 INFO:tasks.workunit.client.1.smithi100.stdout:1/791: write d0/d1f/d6d/dc7/fe9 [10819,6028] 0 2024-04-27T07:33:40.563 INFO:tasks.workunit.client.1.smithi100.stdout:5/616: write d0/d4/d21/d24/d2f/d39/d56/fa6 [850076,68734] 0 2024-04-27T07:33:40.567 INFO:tasks.workunit.client.1.smithi100.stdout:2/634: dread d0/da/f1c [0,4194304] 0 2024-04-27T07:33:40.573 INFO:tasks.workunit.client.1.smithi100.stdout:1/792: creat d0/d1f/d6d/db4/f103 x:0 0 0 2024-04-27T07:33:40.576 INFO:tasks.workunit.client.1.smithi100.stdout:2/635: dwrite d0/d79/d94/dbc/d98/fab [0,4194304] 0 2024-04-27T07:33:40.599 INFO:tasks.workunit.client.1.smithi100.stdout:2/636: dwrite d0/d1e/f33 [0,4194304] 0 2024-04-27T07:33:40.599 INFO:tasks.workunit.client.1.smithi100.stdout:6/725: dread de/d58/d21/d24/f7e [0,4194304] 0 2024-04-27T07:33:40.599 INFO:tasks.workunit.client.1.smithi100.stdout:5/617: dwrite d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:40.599 INFO:tasks.workunit.client.1.smithi100.stdout:2/637: write d0/da/d29/d47/d5a/fb6 [808596,101815] 0 2024-04-27T07:33:40.600 INFO:tasks.workunit.client.1.smithi100.stdout:6/726: rmdir de/d2e/dc0 39 2024-04-27T07:33:40.600 INFO:tasks.workunit.client.1.smithi100.stdout:1/793: dwrite d0/d1b/d20/f94 [0,4194304] 0 2024-04-27T07:33:40.601 INFO:tasks.workunit.client.1.smithi100.stdout:0/649: dread d1/d8/f2e [0,4194304] 0 2024-04-27T07:33:40.602 INFO:tasks.workunit.client.1.smithi100.stdout:6/727: chown de/l13 3020 1 2024-04-27T07:33:40.603 INFO:tasks.workunit.client.1.smithi100.stdout:2/638: symlink d0/da/d29/ld7 0 2024-04-27T07:33:40.607 INFO:tasks.workunit.client.1.smithi100.stdout:2/639: write d0/d79/d94/dbc/d98/db1/fb8 [3996671,123752] 0 2024-04-27T07:33:40.608 INFO:tasks.workunit.client.1.smithi100.stdout:6/728: rename de/d58/d21/fe5 to de/d2e/d3f/ff2 0 2024-04-27T07:33:40.609 INFO:tasks.workunit.client.1.smithi100.stdout:1/794: mknod d0/d1b/d20/c104 0 2024-04-27T07:33:40.611 INFO:tasks.workunit.client.1.smithi100.stdout:5/618: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 [0,4194304] 0 2024-04-27T07:33:40.612 INFO:tasks.workunit.client.1.smithi100.stdout:2/640: symlink d0/da/d29/d47/d87/d88/ld8 0 2024-04-27T07:33:40.614 INFO:tasks.workunit.client.1.smithi100.stdout:6/729: rename de/d2e/d86/lbb to de/d58/d21/d23/lf3 0 2024-04-27T07:33:40.617 INFO:tasks.workunit.client.1.smithi100.stdout:2/641: rename d0/d79/d94/dbc/d74 to d0/da/d29/d47/d5a/dd9 0 2024-04-27T07:33:40.619 INFO:tasks.workunit.client.1.smithi100.stdout:2/642: stat d0/d79/d94/dbc/d98/db1/c7f 0 2024-04-27T07:33:40.624 INFO:tasks.workunit.client.1.smithi100.stdout:2/643: unlink d0/c60 0 2024-04-27T07:33:40.625 INFO:tasks.workunit.client.1.smithi100.stdout:2/644: write d0/da/d29/d47/d87/fcc [2128616,35288] 0 2024-04-27T07:33:40.631 INFO:tasks.workunit.client.1.smithi100.stdout:2/645: dwrite d0/d1e/f57 [8388608,4194304] 0 2024-04-27T07:33:40.653 INFO:tasks.workunit.client.1.smithi100.stdout:0/650: write d1/d8/d20/d1e/f85 [438254,65766] 0 2024-04-27T07:33:40.654 INFO:tasks.workunit.client.1.smithi100.stdout:2/646: dread d0/da/d29/f23 [0,4194304] 0 2024-04-27T07:33:40.655 INFO:tasks.workunit.client.1.smithi100.stdout:5/619: truncate d0/d42/f81 3324481 0 2024-04-27T07:33:40.658 INFO:tasks.workunit.client.1.smithi100.stdout:2/647: creat d0/d79/fda x:0 0 0 2024-04-27T07:33:40.658 INFO:tasks.workunit.client.1.smithi100.stdout:6/730: write de/d58/d75/f8d [1357760,24249] 0 2024-04-27T07:33:40.659 INFO:tasks.workunit.client.1.smithi100.stdout:2/648: dread - d0/d1e/fd5 zero size 2024-04-27T07:33:40.661 INFO:tasks.workunit.client.1.smithi100.stdout:5/620: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fc7 x:0 0 0 2024-04-27T07:33:40.662 INFO:tasks.workunit.client.1.smithi100.stdout:2/649: chown d0/da/d29/d47/d87/d8b/cc5 29 1 2024-04-27T07:33:40.663 INFO:tasks.workunit.client.1.smithi100.stdout:0/651: getdents d1/d8/d20/d88 0 2024-04-27T07:33:40.665 INFO:tasks.workunit.client.1.smithi100.stdout:5/621: creat d0/d4/d21/d24/fc8 x:0 0 0 2024-04-27T07:33:40.670 INFO:tasks.workunit.client.1.smithi100.stdout:5/622: mkdir d0/d42/d94/d97/d60/dc4/d99/dc9 0 2024-04-27T07:33:40.672 INFO:tasks.workunit.client.1.smithi100.stdout:5/623: rmdir d0/d4 39 2024-04-27T07:33:40.675 INFO:tasks.workunit.client.1.smithi100.stdout:6/731: dread de/d58/d28/f8b [0,4194304] 0 2024-04-27T07:33:40.675 INFO:tasks.workunit.client.1.smithi100.stdout:5/624: mkdir d0/d42/d94/d97/d60/dc4/dca 0 2024-04-27T07:33:40.680 INFO:tasks.workunit.client.1.smithi100.stdout:0/652: dread d1/d8/d20/f29 [0,4194304] 0 2024-04-27T07:33:40.683 INFO:tasks.workunit.client.1.smithi100.stdout:2/650: dwrite d0/da/d29/d47/f91 [0,4194304] 0 2024-04-27T07:33:40.685 INFO:tasks.workunit.client.1.smithi100.stdout:5/625: creat d0/fcb x:0 0 0 2024-04-27T07:33:40.686 INFO:tasks.workunit.client.1.smithi100.stdout:0/653: creat d1/d38/dae/fe1 x:0 0 0 2024-04-27T07:33:40.688 INFO:tasks.workunit.client.1.smithi100.stdout:0/654: read - d1/d8/d20/d72/fcb zero size 2024-04-27T07:33:40.688 INFO:tasks.workunit.client.1.smithi100.stdout:2/651: rmdir d0/da/d29/d47/d5a/d8d 39 2024-04-27T07:33:40.689 INFO:tasks.workunit.client.1.smithi100.stdout:6/732: link de/d58/d75/ca8 de/d2e/d3f/d80/cf4 0 2024-04-27T07:33:40.690 INFO:tasks.workunit.client.1.smithi100.stdout:2/652: dread - d0/d79/d94/dbc/d98/db1/fd6 zero size 2024-04-27T07:33:40.691 INFO:tasks.workunit.client.1.smithi100.stdout:6/733: chown de/d58/d21/d24 53629311 1 2024-04-27T07:33:40.691 INFO:tasks.workunit.client.1.smithi100.stdout:5/626: fsync d0/d4/d21/fac 0 2024-04-27T07:33:40.691 INFO:tasks.workunit.client.1.smithi100.stdout:2/653: stat d0/da/c34 0 2024-04-27T07:33:40.693 INFO:tasks.workunit.client.1.smithi100.stdout:2/654: write d0/da/f28 [1938083,98755] 0 2024-04-27T07:33:40.693 INFO:tasks.workunit.client.1.smithi100.stdout:0/655: fdatasync d1/d38/f40 0 2024-04-27T07:33:40.695 INFO:tasks.workunit.client.1.smithi100.stdout:6/734: creat de/d58/d75/ff5 x:0 0 0 2024-04-27T07:33:40.701 INFO:tasks.workunit.client.1.smithi100.stdout:2/655: mknod d0/d79/da7/cdb 0 2024-04-27T07:33:40.701 INFO:tasks.workunit.client.1.smithi100.stdout:0/656: dwrite d1/d38/d3a/fa4 [0,4194304] 0 2024-04-27T07:33:40.706 INFO:tasks.workunit.client.1.smithi100.stdout:5/627: symlink d0/d4/d21/d24/d2f/lcc 0 2024-04-27T07:33:40.708 INFO:tasks.workunit.client.1.smithi100.stdout:6/735: creat de/d58/d21/d91/df0/ff6 x:0 0 0 2024-04-27T07:33:40.711 INFO:tasks.workunit.client.1.smithi100.stdout:5/628: creat d0/d42/d94/d97/fcd x:0 0 0 2024-04-27T07:33:40.711 INFO:tasks.workunit.client.1.smithi100.stdout:7/646: sync 2024-04-27T07:33:40.711 INFO:tasks.workunit.client.1.smithi100.stdout:8/653: sync 2024-04-27T07:33:40.713 INFO:tasks.workunit.client.1.smithi100.stdout:2/656: rename d0/d79/ca2 to d0/da/cdc 0 2024-04-27T07:33:40.747 INFO:tasks.workunit.client.1.smithi100.stdout:0/657: dwrite d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:40.748 INFO:tasks.workunit.client.1.smithi100.stdout:5/629: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fb8 26213 0 2024-04-27T07:33:40.750 INFO:tasks.workunit.client.1.smithi100.stdout:2/657: fsync d0/da/d29/d47/d5a/d82/f89 0 2024-04-27T07:33:40.750 INFO:tasks.workunit.client.1.smithi100.stdout:5/630: chown d0/d4/d21/d24/d2f/d39/d7c/d92/cbf 80278152 1 2024-04-27T07:33:40.753 INFO:tasks.workunit.client.1.smithi100.stdout:6/736: link de/d58/d28/f8b de/d58/d21/d24/ff7 0 2024-04-27T07:33:40.753 INFO:tasks.workunit.client.1.smithi100.stdout:7/647: creat d1/dd/d16/d31/d4c/d4d/fc0 x:0 0 0 2024-04-27T07:33:40.755 INFO:tasks.workunit.client.1.smithi100.stdout:0/658: creat d1/d8/d14/d59/d64/d80/fe2 x:0 0 0 2024-04-27T07:33:40.755 INFO:tasks.workunit.client.1.smithi100.stdout:2/658: dread d0/da/d29/f8e [0,4194304] 0 2024-04-27T07:33:40.756 INFO:tasks.workunit.client.1.smithi100.stdout:8/654: link d6/f18 d6/d20/d8b/d8c/fd2 0 2024-04-27T07:33:40.757 INFO:tasks.workunit.client.1.smithi100.stdout:7/648: write d1/dd/d16/d70/fa0 [550583,125971] 0 2024-04-27T07:33:40.759 INFO:tasks.workunit.client.1.smithi100.stdout:5/631: chown d0/d4/d21/d24/d2f/d57/c35 903546 1 2024-04-27T07:33:40.763 INFO:tasks.workunit.client.1.smithi100.stdout:6/737: dwrite de/d2e/d3f/d80/fdf [0,4194304] 0 2024-04-27T07:33:40.767 INFO:tasks.workunit.client.1.smithi100.stdout:2/659: rename d0/da/d29/d47/da1/dce to d0/da/d29/d47/d87/d88/ddd 0 2024-04-27T07:33:40.770 INFO:tasks.workunit.client.1.smithi100.stdout:0/659: mknod d1/d8/ce3 0 2024-04-27T07:33:40.771 INFO:tasks.workunit.client.1.smithi100.stdout:7/649: dwrite d1/dd/d2a/f62 [0,4194304] 0 2024-04-27T07:33:40.772 INFO:tasks.workunit.client.1.smithi100.stdout:5/632: symlink d0/d4/d21/d24/d2f/d39/d7c/lce 0 2024-04-27T07:33:40.776 INFO:tasks.workunit.client.1.smithi100.stdout:6/738: rename de/d2e/d3f/l72 to de/d58/d21/d24/d9f/db9/lf8 0 2024-04-27T07:33:40.779 INFO:tasks.workunit.client.1.smithi100.stdout:5/633: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d30/ccf 0 2024-04-27T07:33:40.780 INFO:tasks.workunit.client.1.smithi100.stdout:6/739: symlink de/d58/d21/d24/d9f/db9/lf9 0 2024-04-27T07:33:40.783 INFO:tasks.workunit.client.1.smithi100.stdout:8/655: getdents d6/d20/d50/da8 0 2024-04-27T07:33:40.787 INFO:tasks.workunit.client.1.smithi100.stdout:7/650: creat d1/dd/d16/d31/d4c/fc1 x:0 0 0 2024-04-27T07:33:40.787 INFO:tasks.workunit.client.1.smithi100.stdout:5/634: getdents d0/d42/d94/d97/d60/dc4/d99/dc9 0 2024-04-27T07:33:40.787 INFO:tasks.workunit.client.1.smithi100.stdout:7/651: fdatasync d1/f15 0 2024-04-27T07:33:40.788 INFO:tasks.workunit.client.1.smithi100.stdout:8/656: mknod d6/d20/d54/cd3 0 2024-04-27T07:33:40.789 INFO:tasks.workunit.client.1.smithi100.stdout:7/652: dread - d1/dd/d16/d3e/f7c zero size 2024-04-27T07:33:40.791 INFO:tasks.workunit.client.1.smithi100.stdout:2/660: rename d0/da/d29/d47/d5a/d8d/fcb to d0/da/d29/d47/fde 0 2024-04-27T07:33:40.792 INFO:tasks.workunit.client.1.smithi100.stdout:5/635: fdatasync d0/d4/d21/d24/d2f/d57/d3e/f8d 0 2024-04-27T07:33:40.795 INFO:tasks.workunit.client.1.smithi100.stdout:2/661: mknod d0/da/d29/d47/d5a/cdf 0 2024-04-27T07:33:40.797 INFO:tasks.workunit.client.1.smithi100.stdout:8/657: dread d6/d1b/f34 [0,4194304] 0 2024-04-27T07:33:40.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/653: read d1/f33 [492494,76374] 0 2024-04-27T07:33:40.798 INFO:tasks.workunit.client.1.smithi100.stdout:7/654: chown d1/dd/d16/d70 45135 1 2024-04-27T07:33:40.802 INFO:tasks.workunit.client.1.smithi100.stdout:2/662: dwrite d0/da/d29/d47/d5a/d8d/f4b [0,4194304] 0 2024-04-27T07:33:40.802 INFO:tasks.workunit.client.1.smithi100.stdout:8/658: getdents d6/d20/d54/d91/dae 0 2024-04-27T07:33:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.804+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d84111ad0 con 0x7f7d7006bdc0 2024-04-27T07:33:40.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:40 smithi082 ceph-mon[26613]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:40.807 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:40 smithi082 ceph-mon[26613]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:40.808 INFO:tasks.workunit.client.1.smithi100.stdout:8/659: symlink d6/d20/d50/d72/ld4 0 2024-04-27T07:33:40.812 INFO:tasks.workunit.client.1.smithi100.stdout:7/655: dwrite d1/dd/d16/d4a/d56/f94 [0,4194304] 0 2024-04-27T07:33:40.812 INFO:tasks.workunit.client.1.smithi100.stdout:2/663: creat d0/da/d29/d47/da1/da3/fe0 x:0 0 0 2024-04-27T07:33:40.812 INFO:tasks.workunit.client.1.smithi100.stdout:8/660: truncate d6/f10 4786477 0 2024-04-27T07:33:40.813 INFO:tasks.workunit.client.1.smithi100.stdout:2/664: write d0/da/d29/d47/d5a/fb6 [4307633,3781] 0 2024-04-27T07:33:40.814 INFO:tasks.workunit.client.1.smithi100.stdout:2/665: write d0/da/d75/f9b [3019781,115262] 0 2024-04-27T07:33:40.815 INFO:tasks.workunit.client.1.smithi100.stdout:7/656: creat d1/dd/d2a/d2c/fc2 x:0 0 0 2024-04-27T07:33:40.822 INFO:tasks.workunit.client.1.smithi100.stdout:2/666: creat d0/d79/d94/dbc/d98/db1/fe1 x:0 0 0 2024-04-27T07:33:40.824 INFO:tasks.workunit.client.1.smithi100.stdout:7/657: dwrite d1/dd/d16/d2b/d7f/f83 [0,4194304] 0 2024-04-27T07:33:40.825 INFO:tasks.workunit.client.1.smithi100.stdout:6/740: dread de/d58/f29 [0,4194304] 0 2024-04-27T07:33:40.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.823+0000 7f7d7affd700 1 -- 172.21.15.82:0/383269541 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f7d84111ad0 con 0x7f7d7006bdc0 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (7m) 26s ago 8m 24.4M - 0.25.0 c8568f914cd2 140fb28f83a3 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 26s ago 8m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (7m) 37s ago 7m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (7m) 26s ago 8m 87.7M - 9.4.7 954c08fa6188 866060be69ef 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (3m) 26s ago 3m 113M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (3m) 26s ago 3m 118M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (3m) 36s ago 3m 66.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (3m) 37s ago 3m 102M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (9m) 26s ago 9m 395M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (69s) 37s ago 7m 490M - 19.0.0-3227-gc37f63b3 d1033e293654 b143c0687007 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (9m) 26s ago 10m 49.4M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:33:40.826 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (7m) 37s ago 7m 39.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 starting - - - - 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 37s ago 7m 16.6M - 1.5.0 0da6a335fe13 b8cb0134ac9d 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 26s ago 6m 86.4M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 26s ago 6m 95.2M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 26s ago 5m 73.7M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (5m) 37s ago 5m 95.5M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (5m) 37s ago 5m 86.3M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (4m) 37s ago 4m 77.2M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:33:40.827 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 26s ago 8m 60.7M - 2.43.0 a07b618ecd1d 23c329618427 2024-04-27T07:33:40.828 INFO:tasks.workunit.client.1.smithi100.stdout:2/667: chown d0/da/d29/d47/d5a/d8d/d5d/c64 569469 1 2024-04-27T07:33:40.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 msgr2=0x7f7d7006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 0x7f7d7006e270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009b30 tx=0x7f7d74009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 msgr2=0x7f7d8410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7d80004f20 tx=0x7f7d8000b040 comp rx=0 tx=0).stop 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 shutdown_connections 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7d7006bdc0 0x7f7d7006e270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840fbcb0 0x7f7d8410fba0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 --2- 172.21.15.82:0/383269541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d840fcf60 0x7f7d841100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 >> 172.21.15.82:0/383269541 conn(0x7f7d840f7430 msgr2=0x7f7d840f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 shutdown_connections 2024-04-27T07:33:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.827+0000 7f7d8c76b700 1 -- 172.21.15.82:0/383269541 wait complete. 2024-04-27T07:33:40.832 INFO:tasks.workunit.client.1.smithi100.stdout:0/660: write d1/d8/f83 [953749,92039] 0 2024-04-27T07:33:40.834 INFO:tasks.workunit.client.1.smithi100.stdout:6/741: dwrite de/d58/d21/d24/d9f/fc1 [4194304,4194304] 0 2024-04-27T07:33:40.835 INFO:tasks.workunit.client.1.smithi100.stdout:0/661: truncate d1/d8/d14/d59/d99/fdf 691467 0 2024-04-27T07:33:40.836 INFO:tasks.workunit.client.1.smithi100.stdout:2/668: symlink d0/d79/d94/dbc/le2 0 2024-04-27T07:33:40.838 INFO:tasks.workunit.client.1.smithi100.stdout:6/742: mknod de/cfa 0 2024-04-27T07:33:40.838 INFO:tasks.workunit.client.1.smithi100.stdout:0/662: read d1/d8/d14/d59/d99/fd5 [178529,66689] 0 2024-04-27T07:33:40.845 INFO:tasks.workunit.client.1.smithi100.stdout:0/663: dwrite d1/d8/d20/d1e/f85 [0,4194304] 0 2024-04-27T07:33:40.846 INFO:tasks.workunit.client.1.smithi100.stdout:0/664: chown d1/d30/f36 1869173444 1 2024-04-27T07:33:40.847 INFO:tasks.workunit.client.1.smithi100.stdout:0/665: truncate d1/d8/d14/d59/d64/d80/fe2 515629 0 2024-04-27T07:33:40.848 INFO:tasks.workunit.client.1.smithi100.stdout:0/666: stat d1/d38/c6f 0 2024-04-27T07:33:40.854 INFO:tasks.workunit.client.1.smithi100.stdout:8/661: dread d6/d1b/d75/f8f [0,4194304] 0 2024-04-27T07:33:40.856 INFO:tasks.workunit.client.1.smithi100.stdout:8/662: creat d6/d20/fd5 x:0 0 0 2024-04-27T07:33:40.886 INFO:tasks.workunit.client.1.smithi100.stdout:3/815: sync 2024-04-27T07:33:40.892 INFO:tasks.workunit.client.1.smithi100.stdout:3/816: getdents d7/d9/d10 0 2024-04-27T07:33:40.897 INFO:tasks.workunit.client.1.smithi100.stdout:3/817: rename d7/d9/d10/d3e/d74/fe4 to d7/d9/d10/d33/d90/d3a/ddd/ff9 0 2024-04-27T07:33:40.898 INFO:tasks.workunit.client.1.smithi100.stdout:3/818: read - d7/d9/d10/d33/d90/d3a/feb zero size 2024-04-27T07:33:40.904 INFO:tasks.workunit.client.1.smithi100.stdout:3/819: dwrite d7/d9/d10/d33/f41 [4194304,4194304] 0 2024-04-27T07:33:40.910 INFO:tasks.workunit.client.1.smithi100.stdout:3/820: rename d7/d9/d26/d2a/d5e/l6a to d7/d9/d10/d33/d90/d3a/dd6/dee/lfa 0 2024-04-27T07:33:40.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:40 smithi100 ceph-mon[34183]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:40.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:40 smithi100 ceph-mon[34183]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:40.920 INFO:tasks.workunit.client.1.smithi100.stdout:2/669: getdents d0/da/d29/d47/d5a 0 2024-04-27T07:33:40.923 INFO:tasks.workunit.client.1.smithi100.stdout:2/670: dread d0/da/d29/d47/da1/da3/f97 [0,4194304] 0 2024-04-27T07:33:40.925 INFO:tasks.workunit.client.1.smithi100.stdout:2/671: creat d0/da/d29/d47/da1/fe3 x:0 0 0 2024-04-27T07:33:40.926 INFO:tasks.workunit.client.1.smithi100.stdout:2/672: write d0/d79/d94/fbf [1728867,44551] 0 2024-04-27T07:33:40.929 INFO:tasks.workunit.client.1.smithi100.stdout:2/673: fdatasync d0/d1e/f7c 0 2024-04-27T07:33:40.930 INFO:tasks.workunit.client.1.smithi100.stdout:6/743: write f6 [443319,56345] 0 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 -- 172.21.15.82:0/1261681871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 msgr2=0x7f9a880fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 --2- 172.21.15.82:0/1261681871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a880fc0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9a84004940 tx=0x7f9a84009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 -- 172.21.15.82:0/1261681871 shutdown_connections 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 --2- 172.21.15.82:0/1261681871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 0x7f9a880fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 --2- 172.21.15.82:0/1261681871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a880fc0c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 -- 172.21.15.82:0/1261681871 >> 172.21.15.82:0/1261681871 conn(0x7f9a880f7430 msgr2=0x7f9a880f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 -- 172.21.15.82:0/1261681871 shutdown_connections 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.978+0000 7f9a8f669700 1 -- 172.21.15.82:0/1261681871 wait complete. 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 Processor -- start 2024-04-27T07:33:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 -- start start 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 0x7f9a88112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88112cb0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8f669700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88112df0 con 0x7f9a880fcf60 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8d405700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8d405700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48712/0 (socket says 172.21.15.82:48712) 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8cc04700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 0x7f9a88112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.979+0000 7f9a8d405700 1 -- 172.21.15.82:0/2385758599 learned_addr learned my addr 172.21.15.82:0/2385758599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8d405700 1 -- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 msgr2=0x7f9a88112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8d405700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 0x7f9a88112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8d405700 1 -- 172.21.15.82:0/2385758599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84005040 con 0x7f9a880fbcb0 2024-04-27T07:33:40.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8d405700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009150 tx=0x7f9a84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:40.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8400e040 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a8400bbf0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a88112ff0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8401c630 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.980+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a881134d0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.981+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8804c710 con 0x7f9a880fbcb0 2024-04-27T07:33:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.982+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f9a8400bd60 con 0x7f9a880fbcb0 2024-04-27T07:33:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.983+0000 7f9a7dffb700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 0x7f9a7406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.983+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9a8408bdb0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.983+0000 7f9a8cc04700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 0x7f9a7406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.984+0000 7f9a8cc04700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 0x7f9a7406e1b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a78004f40 tx=0x7f9a7800b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:40.988+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f9a84058ed0 con 0x7f9a880fbcb0 2024-04-27T07:33:40.998 INFO:tasks.workunit.client.1.smithi100.stdout:0/667: write d1/d38/f7c [2132416,129460] 0 2024-04-27T07:33:40.998 INFO:tasks.workunit.client.1.smithi100.stdout:7/658: dwrite d1/dd/d2a/f68 [0,4194304] 0 2024-04-27T07:33:40.999 INFO:tasks.workunit.client.1.smithi100.stdout:2/674: write d0/da/f6b [2611544,115756] 0 2024-04-27T07:33:41.001 INFO:tasks.workunit.client.1.smithi100.stdout:2/675: readlink d0/da/d29/l22 0 2024-04-27T07:33:41.001 INFO:tasks.workunit.client.1.smithi100.stdout:0/668: write d1/d8/d20/f3b [926422,38101] 0 2024-04-27T07:33:41.002 INFO:tasks.workunit.client.1.smithi100.stdout:7/659: mkdir d1/dd/d16/d3e/dc3 0 2024-04-27T07:33:41.003 INFO:tasks.workunit.client.1.smithi100.stdout:6/744: fdatasync de/d58/d21/f85 0 2024-04-27T07:33:41.012 INFO:tasks.workunit.client.1.smithi100.stdout:2/676: unlink d0/da/d29/l22 0 2024-04-27T07:33:41.012 INFO:tasks.workunit.client.1.smithi100.stdout:7/660: rmdir d1/dd/d2a/d2c 39 2024-04-27T07:33:41.030 INFO:tasks.workunit.client.1.smithi100.stdout:0/669: symlink d1/le4 0 2024-04-27T07:33:41.031 INFO:tasks.workunit.client.1.smithi100.stdout:7/661: dread d1/d75/f8e [0,4194304] 0 2024-04-27T07:33:41.032 INFO:tasks.workunit.client.1.smithi100.stdout:2/677: unlink d0/da/d29/d47/da1/da3/f52 0 2024-04-27T07:33:41.034 INFO:tasks.workunit.client.1.smithi100.stdout:6/745: rename de/d9b/cd6 to de/d58/d21/d91/df0/cfb 0 2024-04-27T07:33:41.035 INFO:tasks.workunit.client.1.smithi100.stdout:0/670: mkdir d1/d38/d3a/d54/de5 0 2024-04-27T07:33:41.039 INFO:tasks.workunit.client.1.smithi100.stdout:0/671: mkdir d1/d38/d3a/d54/de6 0 2024-04-27T07:33:41.041 INFO:tasks.workunit.client.1.smithi100.stdout:6/746: dwrite de/d58/d21/d24/fd4 [0,4194304] 0 2024-04-27T07:33:41.041 INFO:tasks.workunit.client.1.smithi100.stdout:0/672: write d1/d8/d14/d59/d64/d80/fe2 [639739,130992] 0 2024-04-27T07:33:41.043 INFO:tasks.workunit.client.1.smithi100.stdout:2/678: rename d0/da/d29/d47/d5a/d8d/f2a to d0/da/fe4 0 2024-04-27T07:33:41.046 INFO:tasks.workunit.client.1.smithi100.stdout:7/662: getdents d1/d75 0 2024-04-27T07:33:41.050 INFO:tasks.workunit.client.1.smithi100.stdout:0/673: rename d1/d38/d3a/fa4 to d1/d8/d14/d59/d64/fe7 0 2024-04-27T07:33:41.056 INFO:tasks.workunit.client.1.smithi100.stdout:7/663: symlink d1/dd/d16/d31/lc4 0 2024-04-27T07:33:41.058 INFO:tasks.workunit.client.1.smithi100.stdout:6/747: getdents de/d2e/d3f/d80 0 2024-04-27T07:33:41.062 INFO:tasks.workunit.client.1.smithi100.stdout:7/664: creat d1/dd/d2a/fc5 x:0 0 0 2024-04-27T07:33:41.068 INFO:tasks.workunit.client.1.smithi100.stdout:0/674: dread d1/d30/f3d [0,4194304] 0 2024-04-27T07:33:41.068 INFO:tasks.workunit.client.1.smithi100.stdout:0/675: readlink d1/d8/d20/d72/d96/ld2 0 2024-04-27T07:33:41.069 INFO:tasks.workunit.client.1.smithi100.stdout:4/755: sync 2024-04-27T07:33:41.070 INFO:tasks.workunit.client.1.smithi100.stdout:6/748: rename de/d9b to de/dfc 0 2024-04-27T07:33:41.072 INFO:tasks.workunit.client.1.smithi100.stdout:0/676: dread d1/d8/d20/d61/d66/fc1 [0,4194304] 0 2024-04-27T07:33:41.073 INFO:tasks.workunit.client.1.smithi100.stdout:4/756: creat d5/d16/d19/d46/d53/f106 x:0 0 0 2024-04-27T07:33:41.074 INFO:tasks.workunit.client.1.smithi100.stdout:6/749: write de/f1e [2496058,99948] 0 2024-04-27T07:33:41.076 INFO:tasks.workunit.client.1.smithi100.stdout:0/677: fsync d1/d8/fa1 0 2024-04-27T07:33:41.076 INFO:tasks.workunit.client.1.smithi100.stdout:4/757: creat d5/d16/d4c/f107 x:0 0 0 2024-04-27T07:33:41.078 INFO:tasks.workunit.client.1.smithi100.stdout:2/679: write d0/da/d29/d47/d5a/d82/f89 [825943,41782] 0 2024-04-27T07:33:41.080 INFO:tasks.workunit.client.1.smithi100.stdout:2/680: dread - d0/da/d29/d47/da1/fe3 zero size 2024-04-27T07:33:41.081 INFO:tasks.workunit.client.1.smithi100.stdout:2/681: fsync d0/d1e/f33 0 2024-04-27T07:33:41.084 INFO:tasks.workunit.client.1.smithi100.stdout:4/758: rename d5/d16/c27 to d5/d1b/df8/d7d/c108 0 2024-04-27T07:33:41.085 INFO:tasks.workunit.client.1.smithi100.stdout:2/682: dread d0/d1e/f33 [0,4194304] 0 2024-04-27T07:33:41.087 INFO:tasks.workunit.client.1.smithi100.stdout:2/683: truncate d0/d79/d94/dbc/d98/db1/fd6 70223 0 2024-04-27T07:33:41.087 INFO:tasks.workunit.client.1.smithi100.stdout:4/759: truncate d5/d1b/df8/f8d 440433 0 2024-04-27T07:33:41.088 INFO:tasks.workunit.client.1.smithi100.stdout:2/684: chown d0/da/d29/d47/dae 3 1 2024-04-27T07:33:41.089 INFO:tasks.workunit.client.1.smithi100.stdout:6/750: write f8 [1355812,24938] 0 2024-04-27T07:33:41.090 INFO:tasks.workunit.client.1.smithi100.stdout:0/678: truncate d1/d8/d20/d1e/f85 1534604 0 2024-04-27T07:33:41.090 INFO:tasks.workunit.client.1.smithi100.stdout:6/751: chown de/d58/d21/d23/f39 41 1 2024-04-27T07:33:41.091 INFO:tasks.workunit.client.1.smithi100.stdout:4/760: rmdir d5/d1b/df8/dd7 39 2024-04-27T07:33:41.091 INFO:tasks.workunit.client.1.smithi100.stdout:4/761: chown d5/d16/f7b 103130 1 2024-04-27T07:33:41.091 INFO:tasks.workunit.client.1.smithi100.stdout:2/685: mknod d0/d79/d94/dbc/ce5 0 2024-04-27T07:33:41.093 INFO:tasks.workunit.client.1.smithi100.stdout:4/762: write d5/d16/d4c/f7f [4600985,106284] 0 2024-04-27T07:33:41.093 INFO:tasks.workunit.client.1.smithi100.stdout:2/686: rename d0/da/d39 to d0/da/d39/de6 22 2024-04-27T07:33:41.093 INFO:tasks.workunit.client.1.smithi100.stdout:6/752: chown de/d58/d21/d91/df0/cfb 12 1 2024-04-27T07:33:41.095 INFO:tasks.workunit.client.1.smithi100.stdout:6/753: stat de/d58/d90/f97 0 2024-04-27T07:33:41.095 INFO:tasks.workunit.client.1.smithi100.stdout:0/679: creat d1/d38/d3a/fe8 x:0 0 0 2024-04-27T07:33:41.097 INFO:tasks.workunit.client.1.smithi100.stdout:2/687: creat d0/da/d29/d47/d87/d88/ddd/fe7 x:0 0 0 2024-04-27T07:33:41.097 INFO:tasks.workunit.client.1.smithi100.stdout:4/763: read d5/d16/d19/f73 [455816,16677] 0 2024-04-27T07:33:41.098 INFO:tasks.workunit.client.1.smithi100.stdout:7/665: dread d1/dd/d16/d70/d51/d6f/f87 [0,4194304] 0 2024-04-27T07:33:41.098 INFO:tasks.workunit.client.1.smithi100.stdout:4/764: fsync d5/d16/fcd 0 2024-04-27T07:33:41.099 INFO:tasks.workunit.client.1.smithi100.stdout:6/754: mkdir de/d58/d21/dfd 0 2024-04-27T07:33:41.100 INFO:tasks.workunit.client.1.smithi100.stdout:0/680: creat d1/d8/da8/fe9 x:0 0 0 2024-04-27T07:33:41.101 INFO:tasks.workunit.client.1.smithi100.stdout:0/681: truncate d1/d38/d3a/fa5 1470265 0 2024-04-27T07:33:41.102 INFO:tasks.workunit.client.1.smithi100.stdout:7/666: write d1/dd/d2a/d2c/fc2 [217160,57658] 0 2024-04-27T07:33:41.103 INFO:tasks.workunit.client.1.smithi100.stdout:2/688: unlink d0/da/d29/d47/d5a/d8d/f45 0 2024-04-27T07:33:41.104 INFO:tasks.workunit.client.1.smithi100.stdout:4/765: fsync d5/d16/d19/d21/f41 0 2024-04-27T07:33:41.105 INFO:tasks.workunit.client.1.smithi100.stdout:4/766: fsync d5/d16/d4c/f107 0 2024-04-27T07:33:41.106 INFO:tasks.workunit.client.1.smithi100.stdout:6/755: mknod de/d58/d21/d23/da0/cfe 0 2024-04-27T07:33:41.107 INFO:tasks.workunit.client.1.smithi100.stdout:0/682: mknod d1/d8/da8/cea 0 2024-04-27T07:33:41.111 INFO:tasks.workunit.client.1.smithi100.stdout:4/767: creat d5/d16/d19/dca/f109 x:0 0 0 2024-04-27T07:33:41.113 INFO:tasks.workunit.client.1.smithi100.stdout:4/768: write d5/d16/d19/d46/dd1/dd2/fd8 [4826610,101194] 0 2024-04-27T07:33:41.113 INFO:tasks.workunit.client.1.smithi100.stdout:6/756: symlink de/d58/d21/d23/lff 0 2024-04-27T07:33:41.120 INFO:tasks.workunit.client.1.smithi100.stdout:4/769: rmdir d5/d1b/df8/d50/dbf 39 2024-04-27T07:33:41.121 INFO:tasks.workunit.client.1.smithi100.stdout:6/757: dread de/d58/d28/f8b [0,4194304] 0 2024-04-27T07:33:41.121 INFO:tasks.workunit.client.1.smithi100.stdout:0/683: link d1/d38/fa7 d1/d8/da8/feb 0 2024-04-27T07:33:41.122 INFO:tasks.workunit.client.1.smithi100.stdout:0/684: fdatasync d1/d8/d20/d61/fb2 0 2024-04-27T07:33:41.123 INFO:tasks.workunit.client.1.smithi100.stdout:0/685: dread - d1/d8/d20/d72/d96/fb3 zero size 2024-04-27T07:33:41.124 INFO:tasks.workunit.client.1.smithi100.stdout:4/770: creat d5/d16/d19/d46/d53/dba/dd0/f10a x:0 0 0 2024-04-27T07:33:41.126 INFO:tasks.workunit.client.1.smithi100.stdout:6/758: symlink de/d2e/d3f/d80/l100 0 2024-04-27T07:33:41.130 INFO:tasks.workunit.client.1.smithi100.stdout:0/686: mknod d1/d8/d20/d61/d66/cec 0 2024-04-27T07:33:41.131 INFO:tasks.workunit.client.1.smithi100.stdout:6/759: chown de/d58/d21/d24/d9f/ld8 399305 1 2024-04-27T07:33:41.133 INFO:tasks.workunit.client.1.smithi100.stdout:0/687: mkdir d1/d8/d14/ded 0 2024-04-27T07:33:41.135 INFO:tasks.workunit.client.1.smithi100.stdout:0/688: mknod d1/d8/d14/cee 0 2024-04-27T07:33:41.137 INFO:tasks.workunit.client.1.smithi100.stdout:7/667: dread d1/dd/d16/d4a/fab [0,4194304] 0 2024-04-27T07:33:41.140 INFO:tasks.workunit.client.1.smithi100.stdout:2/689: dwrite d0/da/d29/d47/f7e [0,4194304] 0 2024-04-27T07:33:41.141 INFO:tasks.workunit.client.1.smithi100.stdout:0/689: dread - d1/d8/d14/d59/d99/f9e zero size 2024-04-27T07:33:41.145 INFO:tasks.workunit.client.1.smithi100.stdout:2/690: creat d0/da/d29/d47/da1/da3/fe8 x:0 0 0 2024-04-27T07:33:41.146 INFO:tasks.workunit.client.1.smithi100.stdout:6/760: link de/d58/d21/d24/c4c de/d58/d21/d24/d9f/daa/dde/c101 0 2024-04-27T07:33:41.147 INFO:tasks.workunit.client.1.smithi100.stdout:4/771: write d5/d16/d2e/f38 [3812335,107687] 0 2024-04-27T07:33:41.148 INFO:tasks.workunit.client.1.smithi100.stdout:0/690: dread d1/d8/d14/f50 [0,4194304] 0 2024-04-27T07:33:41.149 INFO:tasks.workunit.client.1.smithi100.stdout:6/761: mknod de/d58/d90/c102 0 2024-04-27T07:33:41.150 INFO:tasks.workunit.client.1.smithi100.stdout:0/691: chown d1/d8/d20/d72/d96 683816839 1 2024-04-27T07:33:41.150 INFO:tasks.workunit.client.1.smithi100.stdout:7/668: dwrite d1/d75/f8e [0,4194304] 0 2024-04-27T07:33:41.151 INFO:tasks.workunit.client.1.smithi100.stdout:6/762: readlink de/d58/d21/ld3 0 2024-04-27T07:33:41.151 INFO:tasks.workunit.client.1.smithi100.stdout:4/772: rmdir d5/d23 39 2024-04-27T07:33:41.151 INFO:tasks.workunit.client.1.smithi100.stdout:6/763: stat de/d58/d21/d91/faf 0 2024-04-27T07:33:41.224 INFO:tasks.workunit.client.1.smithi100.stdout:0/692: rmdir d1/d8/d20/d61/d6a/dd6 39 2024-04-27T07:33:41.225 INFO:tasks.workunit.client.1.smithi100.stdout:6/764: read - de/d58/d21/d23/da0/fe3 zero size 2024-04-27T07:33:41.225 INFO:tasks.workunit.client.1.smithi100.stdout:4/773: symlink d5/d1b/df8/d7d/d8a/l10b 0 2024-04-27T07:33:41.227 INFO:tasks.workunit.client.1.smithi100.stdout:0/693: write d1/d8/d14/d59/d64/d80/fa6 [49074,12864] 0 2024-04-27T07:33:41.228 INFO:tasks.workunit.client.1.smithi100.stdout:4/774: rmdir d5/d16/d19/d46/d53/dba 39 2024-04-27T07:33:41.234 INFO:tasks.workunit.client.1.smithi100.stdout:7/669: dwrite d1/dd/d16/d70/f36 [0,4194304] 0 2024-04-27T07:33:41.237 INFO:tasks.workunit.client.1.smithi100.stdout:4/775: rename d5/d16/d4c/c72 to d5/d16/d19/c10c 0 2024-04-27T07:33:41.239 INFO:tasks.workunit.client.1.smithi100.stdout:0/694: dwrite d1/d8/d20/f37 [0,4194304] 0 2024-04-27T07:33:41.240 INFO:tasks.workunit.client.1.smithi100.stdout:6/765: dwrite fd [0,4194304] 0 2024-04-27T07:33:41.242 INFO:tasks.workunit.client.1.smithi100.stdout:0/695: stat d1/d8/l1b 0 2024-04-27T07:33:41.242 INFO:tasks.workunit.client.1.smithi100.stdout:0/696: readlink d1/d30/l6d 0 2024-04-27T07:33:41.242 INFO:tasks.workunit.client.1.smithi100.stdout:4/776: write d5/d1b/df8/d50/db0/fcf [4126134,25400] 0 2024-04-27T07:33:41.244 INFO:tasks.workunit.client.1.smithi100.stdout:7/670: creat d1/fc6 x:0 0 0 2024-04-27T07:33:41.247 INFO:tasks.workunit.client.1.smithi100.stdout:0/697: dread - d1/d8/d20/d72/fab zero size 2024-04-27T07:33:41.249 INFO:tasks.workunit.client.1.smithi100.stdout:4/777: mkdir d5/d16/d19/d21/d77/d94/d9f/d10d 0 2024-04-27T07:33:41.252 INFO:tasks.workunit.client.1.smithi100.stdout:7/671: unlink d1/dd/d16/d2b/d7f/la7 0 2024-04-27T07:33:41.252 INFO:tasks.workunit.client.1.smithi100.stdout:4/778: symlink d5/d16/d19/d46/d53/d7e/l10e 0 2024-04-27T07:33:41.254 INFO:tasks.workunit.client.1.smithi100.stdout:0/698: creat d1/d38/fef x:0 0 0 2024-04-27T07:33:41.256 INFO:tasks.workunit.client.1.smithi100.stdout:4/779: readlink d5/d23/l29 0 2024-04-27T07:33:41.259 INFO:tasks.workunit.client.1.smithi100.stdout:7/672: dwrite d1/d54/f5f [4194304,4194304] 0 2024-04-27T07:33:41.263 INFO:tasks.workunit.client.1.smithi100.stdout:7/673: creat d1/dd/d16/d4a/d56/fc7 x:0 0 0 2024-04-27T07:33:41.264 INFO:tasks.workunit.client.1.smithi100.stdout:0/699: rename d1/d8/d20/d61/d6a/cd9 to d1/d8/cf0 0 2024-04-27T07:33:41.266 INFO:tasks.workunit.client.1.smithi100.stdout:7/674: symlink d1/dd/d16/d31/lc8 0 2024-04-27T07:33:41.266 INFO:tasks.workunit.client.1.smithi100.stdout:0/700: creat d1/d8/da8/ff1 x:0 0 0 2024-04-27T07:33:41.268 INFO:tasks.workunit.client.1.smithi100.stdout:7/675: unlink d1/dd/d16/d70/d51/d9d/c9e 0 2024-04-27T07:33:41.270 INFO:tasks.workunit.client.1.smithi100.stdout:7/676: unlink d1/ca 0 2024-04-27T07:33:41.272 INFO:tasks.workunit.client.1.smithi100.stdout:7/677: write d1/dd/d16/d31/d4c/d4d/d3b/faf [847998,58199] 0 2024-04-27T07:33:41.272 INFO:tasks.workunit.client.1.smithi100.stdout:0/701: rename d1/d8/d20/f5a to d1/d8/d14/d59/ff2 0 2024-04-27T07:33:41.273 INFO:tasks.workunit.client.1.smithi100.stdout:0/702: stat d1/d8/d14/d59/d99/fc5 0 2024-04-27T07:33:41.275 INFO:tasks.workunit.client.1.smithi100.stdout:6/766: write de/d58/d21/d24/d9f/db9/fd9 [489369,117559] 0 2024-04-27T07:33:41.276 INFO:tasks.workunit.client.1.smithi100.stdout:0/703: fdatasync d1/d8/d20/f29 0 2024-04-27T07:33:41.281 INFO:tasks.workunit.client.1.smithi100.stdout:0/704: chown d1/d8/c44 5 1 2024-04-27T07:33:41.281 INFO:tasks.workunit.client.1.smithi100.stdout:4/780: write d5/d16/d19/d21/d87/f90 [810609,104995] 0 2024-04-27T07:33:41.282 INFO:tasks.workunit.client.1.smithi100.stdout:0/705: readlink d1/d38/d3a/ld3 0 2024-04-27T07:33:41.284 INFO:tasks.workunit.client.1.smithi100.stdout:7/678: getdents d1/dd/d16/d31/d4c/d4d/d3b 0 2024-04-27T07:33:41.286 INFO:tasks.workunit.client.1.smithi100.stdout:0/706: mkdir d1/d8/d20/d72/d96/df3 0 2024-04-27T07:33:41.286 INFO:tasks.workunit.client.1.smithi100.stdout:0/707: chown d1/d8/d20/fc0 15552368 1 2024-04-27T07:33:41.288 INFO:tasks.workunit.client.1.smithi100.stdout:9/704: sync 2024-04-27T07:33:41.289 INFO:tasks.workunit.client.1.smithi100.stdout:0/708: unlink d1/d30/f52 0 2024-04-27T07:33:41.290 INFO:tasks.workunit.client.1.smithi100.stdout:0/709: chown d1/d8/d14/d59 6225 1 2024-04-27T07:33:41.291 INFO:tasks.workunit.client.1.smithi100.stdout:0/710: write d1/d8/d20/d72/fb6 [826176,63108] 0 2024-04-27T07:33:41.294 INFO:tasks.workunit.client.1.smithi100.stdout:9/705: mkdir d1/d9/db/d2b/dfd 0 2024-04-27T07:33:41.294 INFO:tasks.workunit.client.1.smithi100.stdout:6/767: write de/d2e/d86/fb8 [122290,10434] 0 2024-04-27T07:33:41.295 INFO:tasks.workunit.client.1.smithi100.stdout:0/711: rename d1/d8/d14/d59/c5e to d1/d8/d14/d59/d64/cf4 0 2024-04-27T07:33:41.296 INFO:tasks.workunit.client.1.smithi100.stdout:4/781: write d5/f8 [4557520,88443] 0 2024-04-27T07:33:41.299 INFO:tasks.workunit.client.1.smithi100.stdout:9/706: chown d1/d9/db/d2b/d4f/d57/l69 0 1 2024-04-27T07:33:41.300 INFO:tasks.workunit.client.1.smithi100.stdout:4/782: read d5/d1b/d65/fc1 [628389,25087] 0 2024-04-27T07:33:41.300 INFO:tasks.workunit.client.1.smithi100.stdout:7/679: write d1/dd/d16/d31/d4c/d4d/d3b/fb9 [1649447,25631] 0 2024-04-27T07:33:41.303 INFO:tasks.workunit.client.1.smithi100.stdout:6/768: creat de/d58/d21/f103 x:0 0 0 2024-04-27T07:33:41.304 INFO:tasks.workunit.client.1.smithi100.stdout:6/769: readlink de/d58/d28/l3a 0 2024-04-27T07:33:41.305 INFO:tasks.workunit.client.1.smithi100.stdout:4/783: dread d5/d16/d19/f30 [0,4194304] 0 2024-04-27T07:33:41.307 INFO:tasks.workunit.client.1.smithi100.stdout:4/784: write d5/d23/f25 [2882665,34170] 0 2024-04-27T07:33:41.312 INFO:tasks.workunit.client.1.smithi100.stdout:4/785: mkdir d5/d1b/df8/d50/db0/d10f 0 2024-04-27T07:33:41.312 INFO:tasks.workunit.client.1.smithi100.stdout:4/786: dread - d5/d16/d4c/f107 zero size 2024-04-27T07:33:41.313 INFO:tasks.workunit.client.1.smithi100.stdout:9/707: getdents d1/d9/db/d2b/d4f/d57 0 2024-04-27T07:33:41.315 INFO:tasks.workunit.client.1.smithi100.stdout:6/770: rename de/d58/d21/d5b/c6e to de/d58/d21/d24/d9f/db9/c104 0 2024-04-27T07:33:41.316 INFO:tasks.workunit.client.1.smithi100.stdout:6/771: readlink de/d58/d21/d24/d9f/ld8 0 2024-04-27T07:33:41.318 INFO:tasks.workunit.client.1.smithi100.stdout:0/712: dread d1/d38/f7c [0,4194304] 0 2024-04-27T07:33:41.318 INFO:tasks.workunit.client.1.smithi100.stdout:4/787: mknod d5/d16/d19/dca/de0/c110 0 2024-04-27T07:33:41.324 INFO:tasks.workunit.client.1.smithi100.stdout:9/708: rename d1/d9/db/d2b/d31/f5b to d1/d9/db/d56/d5c/de3/ffe 0 2024-04-27T07:33:41.325 INFO:tasks.workunit.client.1.smithi100.stdout:9/709: fdatasync d1/d9/db/d56/d5c/de3/d4a/fec 0 2024-04-27T07:33:41.326 INFO:tasks.workunit.client.1.smithi100.stdout:6/772: write de/d58/d21/d24/f27 [68454,25052] 0 2024-04-27T07:33:41.326 INFO:tasks.workunit.client.1.smithi100.stdout:9/710: chown d1/d9/ca 26779 1 2024-04-27T07:33:41.332 INFO:tasks.workunit.client.1.smithi100.stdout:9/711: write d1/d9/db/d56/d5c/de3/ffe [4504684,4212] 0 2024-04-27T07:33:41.332 INFO:tasks.workunit.client.1.smithi100.stdout:6/773: mknod de/d2e/dc0/c105 0 2024-04-27T07:33:41.334 INFO:tasks.workunit.client.1.smithi100.stdout:6/774: readlink de/d58/l1d 0 2024-04-27T07:33:41.334 INFO:tasks.workunit.client.1.smithi100.stdout:4/788: dwrite d5/f88 [0,4194304] 0 2024-04-27T07:33:41.335 INFO:tasks.workunit.client.1.smithi100.stdout:0/713: write d1/d8/d20/f77 [887600,98362] 0 2024-04-27T07:33:41.338 INFO:tasks.workunit.client.1.smithi100.stdout:9/712: symlink d1/lff 0 2024-04-27T07:33:41.341 INFO:tasks.workunit.client.1.smithi100.stdout:6/775: link de/d2e/d86/cd2 de/d58/d21/d23/d73/c106 0 2024-04-27T07:33:41.344 INFO:tasks.workunit.client.1.smithi100.stdout:0/714: dwrite d1/d38/fef [0,4194304] 0 2024-04-27T07:33:41.346 INFO:tasks.workunit.client.1.smithi100.stdout:6/776: creat de/d58/d28/f107 x:0 0 0 2024-04-27T07:33:41.346 INFO:tasks.workunit.client.1.smithi100.stdout:6/777: chown de 97101 1 2024-04-27T07:33:41.346 INFO:tasks.workunit.client.1.smithi100.stdout:0/715: rmdir d1/d8/d20/d61 39 2024-04-27T07:33:41.352 INFO:tasks.workunit.client.1.smithi100.stdout:6/778: read de/d2e/d3f/f6d [1939838,86823] 0 2024-04-27T07:33:41.352 INFO:tasks.workunit.client.1.smithi100.stdout:0/716: getdents d1/d8/d14/d59/d64 0 2024-04-27T07:33:41.354 INFO:tasks.workunit.client.1.smithi100.stdout:9/713: truncate d1/d9/db/d56/fc0 2370096 0 2024-04-27T07:33:41.357 INFO:tasks.workunit.client.1.smithi100.stdout:4/789: dread d5/d16/d19/d21/f41 [0,4194304] 0 2024-04-27T07:33:41.357 INFO:tasks.workunit.client.1.smithi100.stdout:0/717: rename d1/d8/d20/d72/fb6 to d1/d38/dae/ff5 0 2024-04-27T07:33:41.358 INFO:tasks.workunit.client.1.smithi100.stdout:9/714: creat d1/d76/dd6/dda/f100 x:0 0 0 2024-04-27T07:33:41.359 INFO:tasks.workunit.client.1.smithi100.stdout:6/779: link de/d58/d21/f61 de/d58/d21/d91/df0/f108 0 2024-04-27T07:33:41.362 INFO:tasks.workunit.client.1.smithi100.stdout:6/780: truncate de/d58/d21/d24/d9f/fbc 4286648 0 2024-04-27T07:33:41.362 INFO:tasks.workunit.client.1.smithi100.stdout:0/718: read d1/d38/f40 [1247329,52362] 0 2024-04-27T07:33:41.363 INFO:tasks.workunit.client.1.smithi100.stdout:4/790: creat d5/d16/d19/d46/d53/dba/f111 x:0 0 0 2024-04-27T07:33:41.364 INFO:tasks.workunit.client.1.smithi100.stdout:6/781: chown de/d58/d21/c4a 405500 1 2024-04-27T07:33:41.366 INFO:tasks.workunit.client.1.smithi100.stdout:0/719: mkdir d1/d8/d20/df6 0 2024-04-27T07:33:41.368 INFO:tasks.workunit.client.1.smithi100.stdout:6/782: rmdir de/d2e/d3f/d80 39 2024-04-27T07:33:41.371 INFO:tasks.workunit.client.1.smithi100.stdout:4/791: creat d5/d16/d19/d21/d77/d94/f112 x:0 0 0 2024-04-27T07:33:41.372 INFO:tasks.workunit.client.1.smithi100.stdout:6/783: dread de/d58/d21/f61 [0,4194304] 0 2024-04-27T07:33:41.377 INFO:tasks.workunit.client.1.smithi100.stdout:6/784: mkdir de/d109 0 2024-04-27T07:33:41.378 INFO:tasks.workunit.client.1.smithi100.stdout:4/792: dwrite d5/fe3 [0,4194304] 0 2024-04-27T07:33:41.380 INFO:tasks.workunit.client.1.smithi100.stdout:0/720: getdents d1/d8/d14 0 2024-04-27T07:33:41.381 INFO:tasks.workunit.client.1.smithi100.stdout:6/785: read de/d2e/d3f/f60 [3308612,127932] 0 2024-04-27T07:33:41.383 INFO:tasks.workunit.client.1.smithi100.stdout:9/715: dwrite d1/d9/db/d2b/fab [0,4194304] 0 2024-04-27T07:33:41.389 INFO:tasks.workunit.client.1.smithi100.stdout:0/721: creat d1/d38/d3a/ff7 x:0 0 0 2024-04-27T07:33:41.390 INFO:tasks.workunit.client.1.smithi100.stdout:6/786: creat de/d58/d21/d23/d73/f10a x:0 0 0 2024-04-27T07:33:41.391 INFO:tasks.workunit.client.1.smithi100.stdout:0/722: read - d1/d8/d14/d59/f8f zero size 2024-04-27T07:33:41.393 INFO:tasks.workunit.client.1.smithi100.stdout:6/787: creat de/dc8/f10b x:0 0 0 2024-04-27T07:33:41.397 INFO:tasks.workunit.client.1.smithi100.stdout:0/723: rename d1/le4 to d1/d38/d3a/lf8 0 2024-04-27T07:33:41.398 INFO:tasks.workunit.client.1.smithi100.stdout:6/788: creat de/d58/d21/d24/d9f/f10c x:0 0 0 2024-04-27T07:33:41.400 INFO:tasks.workunit.client.1.smithi100.stdout:6/789: fdatasync de/d58/d28/f30 0 2024-04-27T07:33:41.402 INFO:tasks.workunit.client.1.smithi100.stdout:6/790: write de/d2e/d3f/d80/fcb [310878,31683] 0 2024-04-27T07:33:41.403 INFO:tasks.workunit.client.1.smithi100.stdout:0/724: link d1/d8/fd0 d1/d8/d20/ff9 0 2024-04-27T07:33:41.404 INFO:tasks.workunit.client.1.smithi100.stdout:6/791: symlink de/d2e/d86/l10d 0 2024-04-27T07:33:41.405 INFO:tasks.workunit.client.1.smithi100.stdout:8/663: sync 2024-04-27T07:33:41.405 INFO:tasks.workunit.client.1.smithi100.stdout:5/636: sync 2024-04-27T07:33:41.405 INFO:tasks.workunit.client.1.smithi100.stdout:1/795: sync 2024-04-27T07:33:41.405 INFO:tasks.workunit.client.1.smithi100.stdout:3/821: sync 2024-04-27T07:33:41.406 INFO:tasks.workunit.client.1.smithi100.stdout:9/716: dread d1/d9/db/d2b/ff6 [0,4194304] 0 2024-04-27T07:33:41.406 INFO:tasks.workunit.client.1.smithi100.stdout:0/725: mknod d1/d8/d20/d1e/cfa 0 2024-04-27T07:33:41.407 INFO:tasks.workunit.client.1.smithi100.stdout:5/637: stat d0/fa1 0 2024-04-27T07:33:41.407 INFO:tasks.workunit.client.1.smithi100.stdout:3/822: fdatasync d7/d9/d26/f38 0 2024-04-27T07:33:41.408 INFO:tasks.workunit.client.1.smithi100.stdout:4/793: write d5/d16/d19/d46/d53/f98 [842547,113602] 0 2024-04-27T07:33:41.411 INFO:tasks.workunit.client.1.smithi100.stdout:0/726: dread - d1/d8/fcd zero size 2024-04-27T07:33:41.411 INFO:tasks.workunit.client.1.smithi100.stdout:8/664: creat d6/d20/d54/d91/fd6 x:0 0 0 2024-04-27T07:33:41.412 INFO:tasks.workunit.client.1.smithi100.stdout:5/638: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/f4d 446583 0 2024-04-27T07:33:41.413 INFO:tasks.workunit.client.1.smithi100.stdout:3/823: mkdir d7/d9/d10/d28/dfb 0 2024-04-27T07:33:41.415 INFO:tasks.workunit.client.1.smithi100.stdout:6/792: getdents de/d58/d21 0 2024-04-27T07:33:41.418 INFO:tasks.workunit.client.1.smithi100.stdout:6/793: write de/d58/d21/d24/f27 [858814,40068] 0 2024-04-27T07:33:41.420 INFO:tasks.workunit.client.1.smithi100.stdout:8/665: dread d6/d20/f40 [0,4194304] 0 2024-04-27T07:33:41.422 INFO:tasks.workunit.client.1.smithi100.stdout:5/639: dwrite d0/d42/d94/d97/d60/f96 [0,4194304] 0 2024-04-27T07:33:41.423 INFO:tasks.workunit.client.1.smithi100.stdout:3/824: creat d7/d9/d10/d33/d90/d3a/ddd/ffc x:0 0 0 2024-04-27T07:33:41.424 INFO:tasks.workunit.client.1.smithi100.stdout:4/794: mkdir d5/d16/d19/df3/d113 0 2024-04-27T07:33:41.425 INFO:tasks.workunit.client.1.smithi100.stdout:4/795: fdatasync d5/d1b/df8/d50/dbf/fff 0 2024-04-27T07:33:41.425 INFO:tasks.workunit.client.1.smithi100.stdout:0/727: readlink d1/d8/d20/d61/d6a/lc7 0 2024-04-27T07:33:41.426 INFO:tasks.workunit.client.1.smithi100.stdout:4/796: chown d5/d16/d19/d21/d6d/lda 290400 1 2024-04-27T07:33:41.427 INFO:tasks.workunit.client.1.smithi100.stdout:4/797: fsync d5/d1b/df8/d50/db0/fcf 0 2024-04-27T07:33:41.427 INFO:tasks.workunit.client.1.smithi100.stdout:6/794: fsync de/d2e/d3f/f60 0 2024-04-27T07:33:41.428 INFO:tasks.workunit.client.1.smithi100.stdout:9/717: write d1/d9/db/d56/d5c/fcf [3220753,16359] 0 2024-04-27T07:33:41.430 INFO:tasks.workunit.client.1.smithi100.stdout:5/640: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a/d30 39 2024-04-27T07:33:41.433 INFO:tasks.workunit.client.1.smithi100.stdout:1/796: getdents d0/d1f/d6d/dc7/de1 0 2024-04-27T07:33:41.436 INFO:tasks.workunit.client.1.smithi100.stdout:6/795: creat de/f10e x:0 0 0 2024-04-27T07:33:41.437 INFO:tasks.workunit.client.1.smithi100.stdout:0/728: dwrite d1/d8/d20/d72/d96/fc4 [0,4194304] 0 2024-04-27T07:33:41.439 INFO:tasks.workunit.client.1.smithi100.stdout:3/825: rename d7/dad/fbf to d7/d9/d10/ffd 0 2024-04-27T07:33:41.439 INFO:tasks.workunit.client.1.smithi100.stdout:5/641: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 0 2024-04-27T07:33:41.439 INFO:tasks.workunit.client.1.smithi100.stdout:1/797: creat d0/d1b/f105 x:0 0 0 2024-04-27T07:33:41.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.439+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a8804c710 con 0x7f9a880fbcb0 2024-04-27T07:33:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.440+0000 7f9a7dffb700 1 -- 172.21.15.82:0/2385758599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f9a84013e60 con 0x7f9a880fbcb0 2024-04-27T07:33:41.443 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:33:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:33:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:33:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:33:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:33:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 13, 2024-04-27T07:33:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:33:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:33:41.445 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:33:41.446 INFO:tasks.workunit.client.1.smithi100.stdout:6/796: chown de/d2e/d3f/d80/cb1 1993 1 2024-04-27T07:33:41.446 INFO:tasks.workunit.client.1.smithi100.stdout:2/691: sync 2024-04-27T07:33:41.446 INFO:tasks.workunit.client.1.smithi100.stdout:9/718: dwrite d1/f94 [0,4194304] 0 2024-04-27T07:33:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 msgr2=0x7f9a7406e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 0x7f9a7406e1b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a78004f40 tx=0x7f9a7800b040 comp rx=0 tx=0).stop 2024-04-27T07:33:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 msgr2=0x7f9a88066c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009150 tx=0x7f9a84009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 shutdown_connections 2024-04-27T07:33:41.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f9a7406bd00 0x7f9a7406e1b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a880fbcb0 0x7f9a88066c00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 --2- 172.21.15.82:0/2385758599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a880fcf60 0x7f9a88112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.444+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 >> 172.21.15.82:0/2385758599 conn(0x7f9a880f7430 msgr2=0x7f9a880f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:41.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.445+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 shutdown_connections 2024-04-27T07:33:41.449 INFO:tasks.workunit.client.1.smithi100.stdout:0/729: dread - d1/d8/da8/ff1 zero size 2024-04-27T07:33:41.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.445+0000 7f9a8f669700 1 -- 172.21.15.82:0/2385758599 wait complete. 2024-04-27T07:33:41.449 INFO:tasks.workunit.client.1.smithi100.stdout:0/730: readlink d1/d38/d3a/ld3 0 2024-04-27T07:33:41.456 INFO:tasks.workunit.client.1.smithi100.stdout:5/642: creat d0/d4/d21/d24/d2f/d39/d56/d67/fd0 x:0 0 0 2024-04-27T07:33:41.456 INFO:tasks.workunit.client.1.smithi100.stdout:8/666: write d6/d20/d8b/dc0/fcf [6704711,84777] 0 2024-04-27T07:33:41.458 INFO:tasks.workunit.client.1.smithi100.stdout:2/692: dread d0/da/d29/d47/da1/da3/f65 [0,4194304] 0 2024-04-27T07:33:41.459 INFO:tasks.workunit.client.1.smithi100.stdout:9/719: dread d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f90 [0,4194304] 0 2024-04-27T07:33:41.459 INFO:tasks.workunit.client.1.smithi100.stdout:5/643: truncate d0/d42/d94/d97/d60/fbb 696668 0 2024-04-27T07:33:41.460 INFO:tasks.workunit.client.1.smithi100.stdout:9/720: fsync d1/d9/db/d2b/d4f/d57/ff0 0 2024-04-27T07:33:41.465 INFO:tasks.workunit.client.1.smithi100.stdout:5/644: unlink d0/d4/d21/f50 0 2024-04-27T07:33:41.472 INFO:tasks.workunit.client.1.smithi100.stdout:4/798: dread d5/d16/fa1 [0,4194304] 0 2024-04-27T07:33:41.473 INFO:tasks.workunit.client.1.smithi100.stdout:8/667: mknod d6/d1b/d1d/cd7 0 2024-04-27T07:33:41.475 INFO:tasks.workunit.client.1.smithi100.stdout:1/798: dread d0/f18 [0,4194304] 0 2024-04-27T07:33:41.477 INFO:tasks.workunit.client.1.smithi100.stdout:9/721: rename d1/d9/db/f2e to d1/d9/db/da1/dfb/f101 0 2024-04-27T07:33:41.480 INFO:tasks.workunit.client.1.smithi100.stdout:9/722: write d1/d9/db/d2b/d4f/dac/d54/d61/d9b/fce [470959,112483] 0 2024-04-27T07:33:41.481 INFO:tasks.workunit.client.1.smithi100.stdout:3/826: chown d7/d9/d10/fc8 0 1 2024-04-27T07:33:41.486 INFO:tasks.workunit.client.1.smithi100.stdout:5/645: unlink d0/d4/d21/d24/d2f/d39/d56/f6b 0 2024-04-27T07:33:41.487 INFO:tasks.workunit.client.1.smithi100.stdout:9/723: truncate d1/d9/db/d2b/d4f/d57/dbe/ff2 77410 0 2024-04-27T07:33:41.488 INFO:tasks.workunit.client.1.smithi100.stdout:6/797: getdents de 0 2024-04-27T07:33:41.489 INFO:tasks.workunit.client.1.smithi100.stdout:2/693: write d0/da/f50 [421711,120491] 0 2024-04-27T07:33:41.491 INFO:tasks.workunit.client.1.smithi100.stdout:8/668: fdatasync d6/d20/f81 0 2024-04-27T07:33:41.492 INFO:tasks.workunit.client.1.smithi100.stdout:9/724: truncate d1/d9/db/d2b/d4f/d57/ff0 419432 0 2024-04-27T07:33:41.492 INFO:tasks.workunit.client.1.smithi100.stdout:1/799: fsync d0/d1b/d20/f38 0 2024-04-27T07:33:41.494 INFO:tasks.workunit.client.1.smithi100.stdout:8/669: write d6/d20/d50/d72/f87 [1244373,2000] 0 2024-04-27T07:33:41.496 INFO:tasks.workunit.client.1.smithi100.stdout:5/646: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/cd1 0 2024-04-27T07:33:41.496 INFO:tasks.workunit.client.1.smithi100.stdout:6/798: truncate de/d58/d28/f47 371245 0 2024-04-27T07:33:41.497 INFO:tasks.workunit.client.1.smithi100.stdout:5/647: write d0/d4/fa9 [746071,11095] 0 2024-04-27T07:33:41.498 INFO:tasks.workunit.client.1.smithi100.stdout:6/799: chown de/d2e/fd5 108 1 2024-04-27T07:33:41.499 INFO:tasks.workunit.client.1.smithi100.stdout:5/648: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d31/l95 2266 1 2024-04-27T07:33:41.501 INFO:tasks.workunit.client.1.smithi100.stdout:9/725: chown d1/d9/db/d56/d5c/fcc 14 1 2024-04-27T07:33:41.503 INFO:tasks.workunit.client.1.smithi100.stdout:2/694: mkdir d0/d79/d94/dbc/d98/db1/de9 0 2024-04-27T07:33:41.507 INFO:tasks.workunit.client.1.smithi100.stdout:1/800: symlink d0/d1b/d20/d2d/d35/l106 0 2024-04-27T07:33:41.509 INFO:tasks.workunit.client.1.smithi100.stdout:4/799: rename d5/d16/d19/d46/d53/f92 to d5/d16/d19/d46/d53/f114 0 2024-04-27T07:33:41.512 INFO:tasks.workunit.client.1.smithi100.stdout:8/670: rename d6/l4b to d6/d1b/d75/ld8 0 2024-04-27T07:33:41.512 INFO:tasks.workunit.client.1.smithi100.stdout:3/827: write d7/d9/d26/d2a/f20 [2980780,121351] 0 2024-04-27T07:33:41.514 INFO:tasks.workunit.client.1.smithi100.stdout:8/671: stat d6/d20/d54/d91/dae/c64 0 2024-04-27T07:33:41.522 INFO:tasks.workunit.client.1.smithi100.stdout:6/800: rename de/fc3 to de/d58/d21/d5b/f10f 0 2024-04-27T07:33:41.527 INFO:tasks.workunit.client.1.smithi100.stdout:4/800: dread d5/d16/d19/d46/f81 [0,4194304] 0 2024-04-27T07:33:41.527 INFO:tasks.workunit.client.1.smithi100.stdout:3/828: write d7/d9/d10/f86 [4838070,24363] 0 2024-04-27T07:33:41.527 INFO:tasks.workunit.client.1.smithi100.stdout:5/649: write d0/d4/f70 [2854708,65888] 0 2024-04-27T07:33:41.530 INFO:tasks.workunit.client.1.smithi100.stdout:5/650: dread - d0/d4/d21/d24/d2f/d57/d37/d48/fc6 zero size 2024-04-27T07:33:41.531 INFO:tasks.workunit.client.1.smithi100.stdout:1/801: mkdir d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/d107 0 2024-04-27T07:33:41.532 INFO:tasks.workunit.client.1.smithi100.stdout:6/801: creat de/dfc/f110 x:0 0 0 2024-04-27T07:33:41.537 INFO:tasks.workunit.client.1.smithi100.stdout:9/726: dread d1/d9/db/da1/dfb/fb8 [0,4194304] 0 2024-04-27T07:33:41.537 INFO:tasks.workunit.client.1.smithi100.stdout:4/801: mknod d5/d16/d19/d21/d87/c115 0 2024-04-27T07:33:41.539 INFO:tasks.workunit.client.1.smithi100.stdout:5/651: creat d0/d4/d21/d24/d2f/d39/d56/fd2 x:0 0 0 2024-04-27T07:33:41.540 INFO:tasks.workunit.client.1.smithi100.stdout:5/652: chown d0/d4/d21/d24/d2f/d39/d56 2541018 1 2024-04-27T07:33:41.543 INFO:tasks.workunit.client.1.smithi100.stdout:3/829: write d7/d9/d10/d3e/f7c [4095950,90552] 0 2024-04-27T07:33:41.544 INFO:tasks.workunit.client.1.smithi100.stdout:1/802: unlink d0/d1b/d20/d2d/d35/d4d/d60/da4/fb7 0 2024-04-27T07:33:41.548 INFO:tasks.workunit.client.1.smithi100.stdout:6/802: write de/d58/d21/f85 [1930733,82338] 0 2024-04-27T07:33:41.551 INFO:tasks.workunit.client.1.smithi100.stdout:5/653: rename d0/d4/d21/d24/d2f/d39/d56/f64 to d0/d42/d94/d97/d60/dc4/d9d/fd3 0 2024-04-27T07:33:41.551 INFO:tasks.workunit.client.1.smithi100.stdout:8/672: dwrite d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:41.554 INFO:tasks.workunit.client.1.smithi100.stdout:3/830: creat d7/d9/d26/d2a/d5e/d98/ffe x:0 0 0 2024-04-27T07:33:41.558 INFO:tasks.workunit.client.1.smithi100.stdout:2/695: link d0/da/d29/d47/d5a/dd9/fd2 d0/da/d29/d47/d5a/d8d/fea 0 2024-04-27T07:33:41.558 INFO:tasks.workunit.client.1.smithi100.stdout:6/803: dwrite de/f10e [0,4194304] 0 2024-04-27T07:33:41.559 INFO:tasks.workunit.client.1.smithi100.stdout:4/802: getdents d5/d1b/d65/de9 0 2024-04-27T07:33:41.562 INFO:tasks.workunit.client.1.smithi100.stdout:3/831: mknod d7/d9/d26/cff 0 2024-04-27T07:33:41.565 INFO:tasks.workunit.client.1.smithi100.stdout:5/654: dread d0/fa [0,4194304] 0 2024-04-27T07:33:41.567 INFO:tasks.workunit.client.1.smithi100.stdout:5/655: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fa5 0 2024-04-27T07:33:41.568 INFO:tasks.workunit.client.1.smithi100.stdout:4/803: rmdir d5/d16/d19/d21/d6d 39 2024-04-27T07:33:41.569 INFO:tasks.workunit.client.1.smithi100.stdout:2/696: truncate d0/d1e/f7c 910179 0 2024-04-27T07:33:41.570 INFO:tasks.workunit.client.1.smithi100.stdout:4/804: truncate d5/fe 5032805 0 2024-04-27T07:33:41.570 INFO:tasks.workunit.client.1.smithi100.stdout:3/832: readlink d7/d9/d10/d3e/l78 0 2024-04-27T07:33:41.572 INFO:tasks.workunit.client.1.smithi100.stdout:2/697: stat d0/da/d29/d47/d5a/dd9/fd2 0 2024-04-27T07:33:41.573 INFO:tasks.workunit.client.1.smithi100.stdout:9/727: dwrite d1/d9/db/d2b/f36 [0,4194304] 0 2024-04-27T07:33:41.573 INFO:tasks.workunit.client.1.smithi100.stdout:1/803: rename d0/d1f/f8f to d0/d1f/d6d/dc7/f108 0 2024-04-27T07:33:41.576 INFO:tasks.workunit.client.1.smithi100.stdout:3/833: write d7/d9/d10/d22/fc9 [1020624,117869] 0 2024-04-27T07:33:41.578 INFO:tasks.workunit.client.1.smithi100.stdout:3/834: write d7/d9/d26/d2a/f87 [4955138,49279] 0 2024-04-27T07:33:41.579 INFO:tasks.workunit.client.1.smithi100.stdout:9/728: rmdir d1/d9/db/d2b/d4f/d57/dbe 39 2024-04-27T07:33:41.583 INFO:tasks.workunit.client.1.smithi100.stdout:8/673: truncate d6/f10 1605954 0 2024-04-27T07:33:41.586 INFO:tasks.workunit.client.1.smithi100.stdout:6/804: write de/d58/d21/d24/f9c [3693293,105602] 0 2024-04-27T07:33:41.588 INFO:tasks.workunit.client.1.smithi100.stdout:9/729: stat d1/d9/db/d2b/d4f/d57/dbe/fea 0 2024-04-27T07:33:41.588 INFO:tasks.workunit.client.1.smithi100.stdout:1/804: dwrite d0/d1f/d6d/db4/f100 [0,4194304] 0 2024-04-27T07:33:41.593 INFO:tasks.workunit.client.1.smithi100.stdout:4/805: write d5/d16/d19/d21/f41 [2583442,45813] 0 2024-04-27T07:33:41.595 INFO:tasks.workunit.client.1.smithi100.stdout:2/698: getdents d0/d79/d94/dbc/d98 0 2024-04-27T07:33:41.596 INFO:tasks.workunit.client.1.smithi100.stdout:3/835: dwrite d7/d9/d26/d2a/f87 [0,4194304] 0 2024-04-27T07:33:41.601 INFO:tasks.workunit.client.1.smithi100.stdout:4/806: mkdir d5/d1b/df8/d50/dfc/d116 0 2024-04-27T07:33:41.602 INFO:tasks.workunit.client.1.smithi100.stdout:7/680: sync 2024-04-27T07:33:41.604 INFO:tasks.workunit.client.1.smithi100.stdout:9/730: truncate d1/d9/db/d2b/d4f/dac/d54/f5f 3914819 0 2024-04-27T07:33:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 -- 172.21.15.82:0/2548017428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 msgr2=0x7feff40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 --2- 172.21.15.82:0/2548017428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fd3d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fefe4004940 tx=0x7fefe4009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 -- 172.21.15.82:0/2548017428 shutdown_connections 2024-04-27T07:33:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 --2- 172.21.15.82:0/2548017428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fd3d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 --2- 172.21.15.82:0/2548017428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 0x7feff40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 -- 172.21.15.82:0/2548017428 >> 172.21.15.82:0/2548017428 conn(0x7feff40f7430 msgr2=0x7feff40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 -- 172.21.15.82:0/2548017428 shutdown_connections 2024-04-27T07:33:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 -- 172.21.15.82:0/2548017428 wait complete. 2024-04-27T07:33:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.608+0000 7feffa170700 1 Processor -- start 2024-04-27T07:33:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feffa170700 1 -- start start 2024-04-27T07:33:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feffa170700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 0x7feff40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feffa170700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feffa170700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff4111770 con 0x7feff40fcf60 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feffa170700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff41118b0 con 0x7feff40fbcb0 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feff2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48736/0 (socket says 172.21.15.82:48736) 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feff2ffd700 1 -- 172.21.15.82:0/2954258706 learned_addr learned my addr 172.21.15.82:0/2954258706 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.609+0000 7feff37fe700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 0x7feff40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feff2ffd700 1 -- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 msgr2=0x7feff40ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feff2ffd700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 0x7feff40ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feff2ffd700 1 -- 172.21.15.82:0/2954258706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4005040 con 0x7feff40fcf60 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feff2ffd700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009380 tx=0x7fefe4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe400e040 con 0x7feff40fcf60 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefe400bcc0 con 0x7feff40fcf60 2024-04-27T07:33:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff40fe8a0 con 0x7feff40fcf60 2024-04-27T07:33:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe401c5f0 con 0x7feff40fcf60 2024-04-27T07:33:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.610+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff40fee60 con 0x7feff40fcf60 2024-04-27T07:33:41.614 INFO:tasks.workunit.client.1.smithi100.stdout:5/656: dread d0/d42/d94/d97/d60/dc4/f8b [0,4194304] 0 2024-04-27T07:33:41.615 INFO:tasks.workunit.client.1.smithi100.stdout:3/836: rename d7/d9/d10/f7b to d7/d9/d10/d3e/d55/f100 0 2024-04-27T07:33:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.611+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff4101af0 con 0x7feff40fcf60 2024-04-27T07:33:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.612+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fefe4013a80 con 0x7feff40fcf60 2024-04-27T07:33:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.612+0000 7fefdbfff700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 0x7fefdc06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.613+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fefe408b6e0 con 0x7feff40fcf60 2024-04-27T07:33:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.613+0000 7feff37fe700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 0x7fefdc06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.614+0000 7feff37fe700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 0x7fefdc06e270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feff40ffb10 tx=0x7fefec009620 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:41.617 INFO:tasks.workunit.client.1.smithi100.stdout:9/731: creat d1/d9/db/d2b/dfd/f102 x:0 0 0 2024-04-27T07:33:41.617 INFO:tasks.workunit.client.1.smithi100.stdout:2/699: dwrite d0/da/d29/d47/d87/d88/faa [0,4194304] 0 2024-04-27T07:33:41.618 INFO:tasks.workunit.client.1.smithi100.stdout:4/807: dwrite d5/d16/fa1 [0,4194304] 0 2024-04-27T07:33:41.620 INFO:tasks.workunit.client.1.smithi100.stdout:8/674: dread d6/d1b/d1d/f32 [0,4194304] 0 2024-04-27T07:33:41.620 INFO:tasks.workunit.client.1.smithi100.stdout:0/731: sync 2024-04-27T07:33:41.621 INFO:tasks.workunit.client.1.smithi100.stdout:7/681: truncate d1/dd/d16/d70/d51/d6f/f92 1966006 0 2024-04-27T07:33:41.621 INFO:tasks.workunit.client.1.smithi100.stdout:5/657: write d0/d42/d94/d97/d60/dc4/d99/da0/faa [692332,110347] 0 2024-04-27T07:33:41.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:41.620+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fefe4054df0 con 0x7feff40fcf60 2024-04-27T07:33:41.625 INFO:tasks.workunit.client.1.smithi100.stdout:6/805: dread de/d2e/d3f/f6d [0,4194304] 0 2024-04-27T07:33:41.626 INFO:tasks.workunit.client.1.smithi100.stdout:8/675: creat d6/d20/d50/fd9 x:0 0 0 2024-04-27T07:33:41.629 INFO:tasks.workunit.client.1.smithi100.stdout:0/732: creat d1/d8/d20/d61/d66/ffb x:0 0 0 2024-04-27T07:33:41.629 INFO:tasks.workunit.client.1.smithi100.stdout:1/805: dread d0/d1b/f96 [0,4194304] 0 2024-04-27T07:33:41.632 INFO:tasks.workunit.client.1.smithi100.stdout:4/808: creat d5/d16/d19/d21/d6d/dad/f117 x:0 0 0 2024-04-27T07:33:41.634 INFO:tasks.workunit.client.1.smithi100.stdout:0/733: readlink d1/d38/d3a/lba 0 2024-04-27T07:33:41.635 INFO:tasks.workunit.client.1.smithi100.stdout:8/676: chown d6/f10 131 1 2024-04-27T07:33:41.637 INFO:tasks.workunit.client.1.smithi100.stdout:9/732: dwrite d1/d9/db/d2b/d4f/dac/d54/f99 [0,4194304] 0 2024-04-27T07:33:41.638 INFO:tasks.workunit.client.1.smithi100.stdout:2/700: truncate d0/da/d29/d47/d5a/dd9/fd2 247828 0 2024-04-27T07:33:41.644 INFO:tasks.workunit.client.1.smithi100.stdout:4/809: unlink d5/d16/d19/d46/d53/f106 0 2024-04-27T07:33:41.646 INFO:tasks.workunit.client.1.smithi100.stdout:0/734: creat d1/d8/d20/d61/d66/ffc x:0 0 0 2024-04-27T07:33:41.647 INFO:tasks.workunit.client.1.smithi100.stdout:0/735: fdatasync d1/d8/d20/f74 0 2024-04-27T07:33:41.647 INFO:tasks.workunit.client.1.smithi100.stdout:1/806: mknod d0/d1b/d20/d2d/d35/d4d/de2/c109 0 2024-04-27T07:33:41.648 INFO:tasks.workunit.client.1.smithi100.stdout:5/658: write d0/f14 [1829902,102437] 0 2024-04-27T07:33:41.651 INFO:tasks.workunit.client.1.smithi100.stdout:5/659: dread d0/d4/d21/d24/d2f/d39/d56/f5d [0,4194304] 0 2024-04-27T07:33:41.653 INFO:tasks.workunit.client.1.smithi100.stdout:7/682: rename d1/dd/d16/d70/f79 to d1/dd/d16/d2b/d7f/fc9 0 2024-04-27T07:33:41.655 INFO:tasks.workunit.client.1.smithi100.stdout:8/677: mkdir d6/dda 0 2024-04-27T07:33:41.658 INFO:tasks.workunit.client.1.smithi100.stdout:0/736: mkdir d1/d8/d20/d61/dfd 0 2024-04-27T07:33:41.659 INFO:tasks.workunit.client.1.smithi100.stdout:1/807: mknod d0/d23/c10a 0 2024-04-27T07:33:41.660 INFO:tasks.workunit.client.1.smithi100.stdout:1/808: stat d0/d1f/d97/la7 0 2024-04-27T07:33:41.661 INFO:tasks.workunit.client.1.smithi100.stdout:1/809: dread - d0/d1f/d6d/dc7/fe8 zero size 2024-04-27T07:33:41.662 INFO:tasks.workunit.client.1.smithi100.stdout:6/806: link de/d58/f37 de/d58/d21/d23/da0/f111 0 2024-04-27T07:33:41.664 INFO:tasks.workunit.client.1.smithi100.stdout:9/733: dwrite d1/d9/db/d56/f83 [0,4194304] 0 2024-04-27T07:33:41.666 INFO:tasks.workunit.client.1.smithi100.stdout:3/837: rename d7/d9/d10/d33/d90/d3a/ddd/ffc to d7/d9/d10/d33/d90/d3a/dd6/dee/f101 0 2024-04-27T07:33:41.666 INFO:tasks.workunit.client.1.smithi100.stdout:3/838: stat d7/dad/fe6 0 2024-04-27T07:33:41.668 INFO:tasks.workunit.client.1.smithi100.stdout:4/810: symlink d5/d1b/df8/d50/l118 0 2024-04-27T07:33:41.669 INFO:tasks.workunit.client.1.smithi100.stdout:4/811: chown d5/d16/d19/d21/d77/d94/d9f 27615 1 2024-04-27T07:33:41.670 INFO:tasks.workunit.client.1.smithi100.stdout:4/812: dread - d5/ffe zero size 2024-04-27T07:33:41.671 INFO:tasks.workunit.client.1.smithi100.stdout:2/701: creat d0/da/feb x:0 0 0 2024-04-27T07:33:41.675 INFO:tasks.workunit.client.1.smithi100.stdout:7/683: mkdir d1/dd/d16/d3e/dc3/dca 0 2024-04-27T07:33:41.677 INFO:tasks.workunit.client.1.smithi100.stdout:3/839: fsync d7/d9/d10/d3e/d74/fa3 0 2024-04-27T07:33:41.679 INFO:tasks.workunit.client.1.smithi100.stdout:9/734: dread d1/f85 [0,4194304] 0 2024-04-27T07:33:41.680 INFO:tasks.workunit.client.1.smithi100.stdout:9/735: chown d1/d9/db/d2b/de7 247596 1 2024-04-27T07:33:41.682 INFO:tasks.workunit.client.1.smithi100.stdout:2/702: unlink d0/d1e/fd5 0 2024-04-27T07:33:41.688 INFO:tasks.workunit.client.1.smithi100.stdout:7/684: mkdir d1/dd/d16/d3e/dcb 0 2024-04-27T07:33:41.691 INFO:tasks.workunit.client.1.smithi100.stdout:2/703: dwrite d0/d79/d94/dbc/d98/fab [0,4194304] 0 2024-04-27T07:33:41.695 INFO:tasks.workunit.client.1.smithi100.stdout:8/678: write d6/d1b/d1d/f68 [352979,25157] 0 2024-04-27T07:33:41.695 INFO:tasks.workunit.client.1.smithi100.stdout:6/807: creat de/d2e/d3f/f112 x:0 0 0 2024-04-27T07:33:41.695 INFO:tasks.workunit.client.1.smithi100.stdout:0/737: dwrite d1/d8/d20/d88/f92 [0,4194304] 0 2024-04-27T07:33:41.696 INFO:tasks.workunit.client.1.smithi100.stdout:7/685: mkdir d1/dd/d16/d31/d4c/d4d/d3b/dcc 0 2024-04-27T07:33:41.696 INFO:tasks.workunit.client.1.smithi100.stdout:2/704: write d0/da/d29/d47/d87/d88/ddd/fe7 [663744,31039] 0 2024-04-27T07:33:41.697 INFO:tasks.workunit.client.1.smithi100.stdout:4/813: rmdir d5/d16/d19/d46/dd1/de2 0 2024-04-27T07:33:41.699 INFO:tasks.workunit.client.1.smithi100.stdout:8/679: dread - d6/d20/d50/fd9 zero size 2024-04-27T07:33:41.699 INFO:tasks.workunit.client.1.smithi100.stdout:0/738: dread - d1/d8/fd0 zero size 2024-04-27T07:33:41.702 INFO:tasks.workunit.client.1.smithi100.stdout:9/736: write d1/f30 [995290,35128] 0 2024-04-27T07:33:41.703 INFO:tasks.workunit.client.1.smithi100.stdout:2/705: mknod d0/d79/da7/cec 0 2024-04-27T07:33:41.704 INFO:tasks.workunit.client.1.smithi100.stdout:6/808: truncate de/d58/d21/d24/f27 6135251 0 2024-04-27T07:33:41.705 INFO:tasks.workunit.client.1.smithi100.stdout:4/814: mkdir d5/d1b/d65/d119 0 2024-04-27T07:33:41.706 INFO:tasks.workunit.client.1.smithi100.stdout:7/686: truncate d1/dd/d2a/d2c/f2e 1124909 0 2024-04-27T07:33:41.708 INFO:tasks.workunit.client.1.smithi100.stdout:1/810: dwrite d0/d23/d3a/df0/fff [0,4194304] 0 2024-04-27T07:33:41.709 INFO:tasks.workunit.client.1.smithi100.stdout:0/739: rename d1/d8/d20/fc0 to d1/d8/d14/dce/ffe 0 2024-04-27T07:33:41.713 INFO:tasks.workunit.client.1.smithi100.stdout:1/811: write d0/d1b/f96 [3649715,85345] 0 2024-04-27T07:33:41.714 INFO:tasks.workunit.client.1.smithi100.stdout:2/706: creat d0/da/d29/d47/da1/dc3/fed x:0 0 0 2024-04-27T07:33:41.717 INFO:tasks.workunit.client.1.smithi100.stdout:6/809: rename de/d2e/d86/ce0 to de/d109/c113 0 2024-04-27T07:33:41.717 INFO:tasks.workunit.client.1.smithi100.stdout:1/812: write d0/d1b/f96 [2002310,7498] 0 2024-04-27T07:33:41.717 INFO:tasks.workunit.client.1.smithi100.stdout:2/707: write d0/da/d29/d47/f91 [2585109,129900] 0 2024-04-27T07:33:41.719 INFO:tasks.workunit.client.1.smithi100.stdout:1/813: chown d0/d1b/d20/d2d/d35/dac 59144 1 2024-04-27T07:33:41.720 INFO:tasks.workunit.client.1.smithi100.stdout:7/687: mknod d1/dd/d16/d31/d4c/d4d/ccd 0 2024-04-27T07:33:41.723 INFO:tasks.workunit.client.1.smithi100.stdout:4/815: truncate d5/d16/d19/d46/d53/f98 520646 0 2024-04-27T07:33:41.724 INFO:tasks.workunit.client.1.smithi100.stdout:6/810: write de/d2e/d3f/ff2 [928168,51191] 0 2024-04-27T07:33:41.727 INFO:tasks.workunit.client.1.smithi100.stdout:9/737: rename d1/d9/db/d2b/d4f/dd1/fe6 to d1/d9/db/d56/d5c/de3/d4a/daa/f103 0 2024-04-27T07:33:41.729 INFO:tasks.workunit.client.1.smithi100.stdout:8/680: dread d6/d20/f81 [0,4194304] 0 2024-04-27T07:33:41.731 INFO:tasks.workunit.client.1.smithi100.stdout:7/688: creat d1/dd/d16/d70/fce x:0 0 0 2024-04-27T07:33:41.733 INFO:tasks.workunit.client.1.smithi100.stdout:0/740: rename d1/d38/l3e to d1/d38/d3a/d54/db1/lff 0 2024-04-27T07:33:41.737 INFO:tasks.workunit.client.1.smithi100.stdout:9/738: write d1/d9/db/da1/dfb/fb8 [1978269,24183] 0 2024-04-27T07:33:41.742 INFO:tasks.workunit.client.1.smithi100.stdout:9/739: fsync d1/d9/db/d56/d5c/de3/f7b 0 2024-04-27T07:33:41.742 INFO:tasks.workunit.client.1.smithi100.stdout:7/689: rmdir d1/dd/d16/d3e/d8b/da4 39 2024-04-27T07:33:41.742 INFO:tasks.workunit.client.1.smithi100.stdout:7/690: stat d1/dd/d2a/d2c/fc2 0 2024-04-27T07:33:41.743 INFO:tasks.workunit.client.1.smithi100.stdout:6/811: rename de/d58/d21/d23/c8a to de/d2e/dc0/c114 0 2024-04-27T07:33:41.747 INFO:tasks.workunit.client.1.smithi100.stdout:2/708: write d0/d1e/f7c [285151,106897] 0 2024-04-27T07:33:41.747 INFO:tasks.workunit.client.1.smithi100.stdout:9/740: symlink d1/d9/db/d2b/d4f/dac/d54/l104 0 2024-04-27T07:33:41.748 INFO:tasks.workunit.client.1.smithi100.stdout:1/814: truncate d0/d1b/f96 1464808 0 2024-04-27T07:33:41.750 INFO:tasks.workunit.client.1.smithi100.stdout:7/691: mkdir d1/dd/d16/d2b/d7f/dcf 0 2024-04-27T07:33:41.752 INFO:tasks.workunit.client.1.smithi100.stdout:0/741: dwrite d1/d8/d14/dce/fe0 [0,4194304] 0 2024-04-27T07:33:41.752 INFO:tasks.workunit.client.1.smithi100.stdout:1/815: write d0/d1f/d6d/ffc [258495,114834] 0 2024-04-27T07:33:41.756 INFO:tasks.workunit.client.1.smithi100.stdout:2/709: write d0/da/d29/d47/d87/f9a [3647521,12750] 0 2024-04-27T07:33:41.756 INFO:tasks.workunit.client.1.smithi100.stdout:9/741: unlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/f8f 0 2024-04-27T07:33:41.759 INFO:tasks.workunit.client.1.smithi100.stdout:6/812: creat de/d58/d21/d24/f115 x:0 0 0 2024-04-27T07:33:41.762 INFO:tasks.workunit.client.1.smithi100.stdout:8/681: dwrite d6/d1b/d75/f83 [0,4194304] 0 2024-04-27T07:33:41.767 INFO:tasks.workunit.client.1.smithi100.stdout:0/742: dwrite d1/d8/d14/d59/d99/fdf [0,4194304] 0 2024-04-27T07:33:41.770 INFO:tasks.workunit.client.1.smithi100.stdout:1/816: creat d0/d1b/d20/d2d/d35/d4d/d60/da4/f10b x:0 0 0 2024-04-27T07:33:41.773 INFO:tasks.workunit.client.1.smithi100.stdout:0/743: dread d1/d8/d20/d61/d6a/f97 [0,4194304] 0 2024-04-27T07:33:41.774 INFO:tasks.workunit.client.1.smithi100.stdout:9/742: symlink d1/d9/db/d2b/d4f/da3/l105 0 2024-04-27T07:33:41.775 INFO:tasks.workunit.client.1.smithi100.stdout:9/743: stat d1/d76/dd6/fde 0 2024-04-27T07:33:41.776 INFO:tasks.workunit.client.1.smithi100.stdout:6/813: creat de/d58/d21/d91/df0/f116 x:0 0 0 2024-04-27T07:33:41.777 INFO:tasks.workunit.client.1.smithi100.stdout:7/692: truncate d1/dd/f5d 2115899 0 2024-04-27T07:33:41.777 INFO:tasks.workunit.client.1.smithi100.stdout:6/814: chown de/d58/d21/d23/d73/c81 16 1 2024-04-27T07:33:41.778 INFO:tasks.workunit.client.1.smithi100.stdout:6/815: write de/d58/d21/d23/d73/f10a [434244,12269] 0 2024-04-27T07:33:41.780 INFO:tasks.workunit.client.1.smithi100.stdout:8/682: mkdir d6/d1b/d1d/d59/d94/ddb 0 2024-04-27T07:33:41.780 INFO:tasks.workunit.client.1.smithi100.stdout:1/817: symlink d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/l10c 0 2024-04-27T07:33:41.781 INFO:tasks.workunit.client.1.smithi100.stdout:0/744: mknod d1/d8/d14/d59/d99/c100 0 2024-04-27T07:33:41.782 INFO:tasks.workunit.client.1.smithi100.stdout:6/816: write de/d58/d21/f85 [601362,94256] 0 2024-04-27T07:33:41.784 INFO:tasks.workunit.client.1.smithi100.stdout:1/818: read - d0/d1f/d6d/db4/fe6 zero size 2024-04-27T07:33:41.784 INFO:tasks.workunit.client.1.smithi100.stdout:0/745: chown d1/d8/fcd 0 1 2024-04-27T07:33:41.784 INFO:tasks.workunit.client.1.smithi100.stdout:9/744: rmdir d1/d9/db/d56 39 2024-04-27T07:33:41.785 INFO:tasks.workunit.client.1.smithi100.stdout:6/817: write de/d58/d75/f8d [3401671,56091] 0 2024-04-27T07:33:41.788 INFO:tasks.workunit.client.1.smithi100.stdout:8/683: creat d6/d20/d54/d91/d9e/fdc x:0 0 0 2024-04-27T07:33:41.788 INFO:tasks.workunit.client.1.smithi100.stdout:7/693: dwrite d1/d54/f61 [0,4194304] 0 2024-04-27T07:33:41.789 INFO:tasks.workunit.client.1.smithi100.stdout:7/694: chown d1/dd/d16/d31/lc4 132893841 1 2024-04-27T07:33:41.789 INFO:tasks.workunit.client.1.smithi100.stdout:8/684: chown d6/d20/d50/fb3 407826 1 2024-04-27T07:33:41.790 INFO:tasks.workunit.client.1.smithi100.stdout:1/819: creat d0/d23/d3a/df0/f10d x:0 0 0 2024-04-27T07:33:41.793 INFO:tasks.workunit.client.1.smithi100.stdout:0/746: readlink d1/d38/d3a/d54/db1/lff 0 2024-04-27T07:33:41.794 INFO:tasks.workunit.client.1.smithi100.stdout:8/685: mknod d6/d20/d54/cdd 0 2024-04-27T07:33:41.796 INFO:tasks.workunit.client.1.smithi100.stdout:8/686: chown d6/d20/d2a/c28 4280 1 2024-04-27T07:33:41.796 INFO:tasks.workunit.client.1.smithi100.stdout:7/695: symlink d1/dd/d16/d3e/dc3/ld0 0 2024-04-27T07:33:41.798 INFO:tasks.workunit.client.1.smithi100.stdout:6/818: symlink de/d58/d21/dfd/l117 0 2024-04-27T07:33:41.798 INFO:tasks.workunit.client.1.smithi100.stdout:8/687: read - d6/d1b/fb6 zero size 2024-04-27T07:33:41.800 INFO:tasks.workunit.client.1.smithi100.stdout:1/820: creat d0/d1b/da1/f10e x:0 0 0 2024-04-27T07:33:41.801 INFO:tasks.workunit.client.1.smithi100.stdout:2/710: write d0/da/d29/d47/d87/d8b/fa5 [520981,90730] 0 2024-04-27T07:33:41.803 INFO:tasks.workunit.client.1.smithi100.stdout:0/747: dwrite d1/d8/fcd [0,4194304] 0 2024-04-27T07:33:41.809 INFO:tasks.workunit.client.1.smithi100.stdout:8/688: unlink d6/d20/d54/d91/dae/lbd 0 2024-04-27T07:33:41.812 INFO:tasks.workunit.client.1.smithi100.stdout:6/819: symlink de/d2e/d3f/l118 0 2024-04-27T07:33:41.813 INFO:tasks.workunit.client.1.smithi100.stdout:6/820: read - de/d2e/d3f/f112 zero size 2024-04-27T07:33:41.814 INFO:tasks.workunit.client.1.smithi100.stdout:9/745: dread d1/d9/db/d56/d5c/de3/fca [0,4194304] 0 2024-04-27T07:33:41.814 INFO:tasks.workunit.client.1.smithi100.stdout:2/711: rename d0/da/f1c to d0/da/d39/fee 0 2024-04-27T07:33:41.816 INFO:tasks.workunit.client.1.smithi100.stdout:1/821: unlink d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/l10c 0 2024-04-27T07:33:41.825 INFO:tasks.workunit.client.1.smithi100.stdout:6/821: mknod de/d58/d21/d23/da0/c119 0 2024-04-27T07:33:41.825 INFO:tasks.workunit.client.1.smithi100.stdout:2/712: dwrite d0/da/d29/d47/d87/fc0 [0,4194304] 0 2024-04-27T07:33:41.827 INFO:tasks.workunit.client.1.smithi100.stdout:6/822: chown f8 879 1 2024-04-27T07:33:41.828 INFO:tasks.workunit.client.1.smithi100.stdout:1/822: dwrite d0/d1f/d6d/db4/d40/fef [0,4194304] 0 2024-04-27T07:33:41.829 INFO:tasks.workunit.client.1.smithi100.stdout:2/713: stat d0/d1e/f27 0 2024-04-27T07:33:41.830 INFO:tasks.workunit.client.1.smithi100.stdout:7/696: rmdir d1/dd/d16/d3e/dc3/dca 0 2024-04-27T07:33:41.833 INFO:tasks.workunit.client.1.smithi100.stdout:2/714: truncate d0/da/d39/fb7 741680 0 2024-04-27T07:33:41.833 INFO:tasks.workunit.client.1.smithi100.stdout:7/697: dread - d1/dd/d16/d4a/d56/fc7 zero size 2024-04-27T07:33:41.834 INFO:tasks.workunit.client.1.smithi100.stdout:9/746: getdents d1/d9/db/d2b/d9c 0 2024-04-27T07:33:41.835 INFO:tasks.workunit.client.1.smithi100.stdout:7/698: write d1/dd/d16/d70/f59 [146435,25236] 0 2024-04-27T07:33:41.835 INFO:tasks.workunit.client.1.smithi100.stdout:2/715: write d0/da/d29/d47/d5a/d8d/d5d/f5f [1577104,79269] 0 2024-04-27T07:33:41.837 INFO:tasks.workunit.client.1.smithi100.stdout:0/748: rmdir d1/d8/d20/d72/d96/df3 0 2024-04-27T07:33:41.838 INFO:tasks.workunit.client.1.smithi100.stdout:7/699: write d1/dd/d16/d4a/d56/f94 [3030975,65185] 0 2024-04-27T07:33:41.840 INFO:tasks.workunit.client.1.smithi100.stdout:7/700: write d1/dd/d16/d31/d4c/f8f [538852,83197] 0 2024-04-27T07:33:41.842 INFO:tasks.workunit.client.1.smithi100.stdout:7/701: chown d1/dd/d16/d31/ca3 80217458 1 2024-04-27T07:33:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:41 smithi082 ceph-mon[26613]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:41 smithi082 ceph-mon[26613]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 110 MiB/s rd, 298 MiB/s wr, 645 op/s 2024-04-27T07:33:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:41 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2385758599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:33:41.846 INFO:tasks.workunit.client.1.smithi100.stdout:8/689: getdents d6/d20/d54/d91 0 2024-04-27T07:33:41.851 INFO:tasks.workunit.client.1.smithi100.stdout:9/747: unlink d1/d9/db/f1e 0 2024-04-27T07:33:41.853 INFO:tasks.workunit.client.1.smithi100.stdout:9/748: write d1/d9/db/d56/d5c/fcf [1996273,115681] 0 2024-04-27T07:33:41.853 INFO:tasks.workunit.client.1.smithi100.stdout:8/690: symlink d6/d20/d8b/dc0/lde 0 2024-04-27T07:33:41.854 INFO:tasks.workunit.client.1.smithi100.stdout:9/749: chown d1/d9/db/fad 8791 1 2024-04-27T07:33:41.860 INFO:tasks.workunit.client.1.smithi100.stdout:8/691: dwrite d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:41.862 INFO:tasks.workunit.client.1.smithi100.stdout:7/702: link d1/dd/d2a/fa2 d1/dd/d16/d70/d51/fd1 0 2024-04-27T07:33:41.862 INFO:tasks.workunit.client.1.smithi100.stdout:6/823: write de/d58/d21/fca [2409091,83007] 0 2024-04-27T07:33:41.863 INFO:tasks.workunit.client.1.smithi100.stdout:9/750: mkdir d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/d106 0 2024-04-27T07:33:41.865 INFO:tasks.workunit.client.1.smithi100.stdout:9/751: readlink d1/d9/db/d2b/la4 0 2024-04-27T07:33:41.867 INFO:tasks.workunit.client.1.smithi100.stdout:7/703: truncate d1/d54/f61 4294118 0 2024-04-27T07:33:41.867 INFO:tasks.workunit.client.1.smithi100.stdout:9/752: chown d1/d9/db/d2b/l6e 198231831 1 2024-04-27T07:33:41.867 INFO:tasks.workunit.client.1.smithi100.stdout:8/692: creat d6/d20/d54/d91/dae/fdf x:0 0 0 2024-04-27T07:33:41.868 INFO:tasks.workunit.client.1.smithi100.stdout:2/716: dread d0/da/d29/f23 [0,4194304] 0 2024-04-27T07:33:41.872 INFO:tasks.workunit.client.1.smithi100.stdout:9/753: dread d1/f85 [0,4194304] 0 2024-04-27T07:33:41.873 INFO:tasks.workunit.client.1.smithi100.stdout:8/693: mknod d6/d1b/d75/ce0 0 2024-04-27T07:33:41.873 INFO:tasks.workunit.client.1.smithi100.stdout:1/823: truncate d0/d1b/d20/d2d/d35/d65/fc6 124071 0 2024-04-27T07:33:41.876 INFO:tasks.workunit.client.1.smithi100.stdout:2/717: rename d0/da/d29/ld7 to d0/da/d29/d47/d87/d88/lef 0 2024-04-27T07:33:41.879 INFO:tasks.workunit.client.1.smithi100.stdout:7/704: dwrite d1/dd/d2a/fa2 [0,4194304] 0 2024-04-27T07:33:41.881 INFO:tasks.workunit.client.1.smithi100.stdout:1/824: creat d0/d1f/d6d/db4/d40/f10f x:0 0 0 2024-04-27T07:33:41.883 INFO:tasks.workunit.client.1.smithi100.stdout:0/749: truncate d1/d8/fcd 1436733 0 2024-04-27T07:33:41.884 INFO:tasks.workunit.client.1.smithi100.stdout:0/750: fdatasync d1/d38/fef 0 2024-04-27T07:33:41.884 INFO:tasks.workunit.client.1.smithi100.stdout:7/705: stat d1/dd/d16/d70/d51/d6f/f92 0 2024-04-27T07:33:41.885 INFO:tasks.workunit.client.1.smithi100.stdout:1/825: readlink d0/d1b/d20/d2d/d35/d4d/d60/la3 0 2024-04-27T07:33:41.886 INFO:tasks.workunit.client.1.smithi100.stdout:0/751: readlink d1/d8/d20/d72/d96/ld2 0 2024-04-27T07:33:41.886 INFO:tasks.workunit.client.1.smithi100.stdout:2/718: truncate d0/d79/d94/dbc/d98/db1/f48 843490 0 2024-04-27T07:33:41.887 INFO:tasks.workunit.client.1.smithi100.stdout:6/824: dread de/d58/d21/f85 [0,4194304] 0 2024-04-27T07:33:41.889 INFO:tasks.workunit.client.1.smithi100.stdout:0/752: chown d1/d8/fd0 10722 1 2024-04-27T07:33:41.893 INFO:tasks.workunit.client.1.smithi100.stdout:6/825: truncate de/d58/d21/d91/fd1 188488 0 2024-04-27T07:33:41.894 INFO:tasks.workunit.client.1.smithi100.stdout:7/706: dwrite d1/dd/d16/d4a/d56/f94 [0,4194304] 0 2024-04-27T07:33:41.895 INFO:tasks.workunit.client.1.smithi100.stdout:0/753: symlink d1/d8/d20/l101 0 2024-04-27T07:33:41.900 INFO:tasks.workunit.client.1.smithi100.stdout:2/719: getdents d0/d79/d94/dbc/d98/db1 0 2024-04-27T07:33:41.902 INFO:tasks.workunit.client.1.smithi100.stdout:7/707: dread d1/dd/d16/d31/d4c/f8f [0,4194304] 0 2024-04-27T07:33:41.911 INFO:tasks.workunit.client.1.smithi100.stdout:7/708: creat d1/dd/d16/d31/d4c/d4d/d3b/fd2 x:0 0 0 2024-04-27T07:33:41.912 INFO:tasks.workunit.client.1.smithi100.stdout:9/754: dread d1/d9/db/d56/fbd [0,4194304] 0 2024-04-27T07:33:41.913 INFO:tasks.workunit.client.1.smithi100.stdout:6/826: dwrite de/d58/d21/d5b/f10f [0,4194304] 0 2024-04-27T07:33:41.914 INFO:tasks.workunit.client.1.smithi100.stdout:8/694: dwrite d6/d1b/d1d/d59/f58 [0,4194304] 0 2024-04-27T07:33:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:41 smithi100 ceph-mon[34183]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:41 smithi100 ceph-mon[34183]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 110 MiB/s rd, 298 MiB/s wr, 645 op/s 2024-04-27T07:33:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:41 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2385758599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:33:41.917 INFO:tasks.workunit.client.1.smithi100.stdout:1/826: truncate d0/d1f/d6d/db4/d4e/fc5 3596715 0 2024-04-27T07:33:41.919 INFO:tasks.workunit.client.1.smithi100.stdout:7/709: write d1/dd/d16/d31/d4c/f81 [422787,14128] 0 2024-04-27T07:33:41.919 INFO:tasks.workunit.client.1.smithi100.stdout:8/695: write d6/f45 [933358,56517] 0 2024-04-27T07:33:41.920 INFO:tasks.workunit.client.1.smithi100.stdout:2/720: dread d0/da/d29/d47/d87/d88/fc6 [0,4194304] 0 2024-04-27T07:33:41.927 INFO:tasks.workunit.client.1.smithi100.stdout:8/696: creat d6/d20/d54/fe1 x:0 0 0 2024-04-27T07:33:41.928 INFO:tasks.workunit.client.1.smithi100.stdout:2/721: unlink d0/da/d29/d47/d5a/dd9/lcd 0 2024-04-27T07:33:41.930 INFO:tasks.workunit.client.1.smithi100.stdout:8/697: creat d6/d20/d54/d91/fe2 x:0 0 0 2024-04-27T07:33:41.931 INFO:tasks.workunit.client.1.smithi100.stdout:8/698: fdatasync d6/d20/d54/fe1 0 2024-04-27T07:33:41.932 INFO:tasks.workunit.client.1.smithi100.stdout:9/755: creat d1/d9/db/d56/d5c/de3/d4a/d67/f107 x:0 0 0 2024-04-27T07:33:41.933 INFO:tasks.workunit.client.1.smithi100.stdout:9/756: stat d1/d9/l10 0 2024-04-27T07:33:41.933 INFO:tasks.workunit.client.1.smithi100.stdout:2/722: mknod d0/da/d29/d47/da1/cf0 0 2024-04-27T07:33:41.935 INFO:tasks.workunit.client.1.smithi100.stdout:2/723: read - d0/da/d29/d47/da1/dc3/fed zero size 2024-04-27T07:33:41.936 INFO:tasks.workunit.client.1.smithi100.stdout:8/699: write d6/d20/d54/d91/fe2 [117575,102860] 0 2024-04-27T07:33:41.936 INFO:tasks.workunit.client.1.smithi100.stdout:1/827: rename d0/d23/f29 to d0/d1b/d20/f110 0 2024-04-27T07:33:41.938 INFO:tasks.workunit.client.1.smithi100.stdout:8/700: truncate d6/d1b/fb6 193439 0 2024-04-27T07:33:41.940 INFO:tasks.workunit.client.1.smithi100.stdout:2/724: mknod d0/da/d75/cf1 0 2024-04-27T07:33:41.940 INFO:tasks.workunit.client.1.smithi100.stdout:8/701: truncate d6/d20/d8b/f8d 561143 0 2024-04-27T07:33:41.942 INFO:tasks.workunit.client.1.smithi100.stdout:7/710: rename d1/dd/d16/d4a/d56/f94 to d1/dd/d16/d3e/dcb/fd3 0 2024-04-27T07:33:41.945 INFO:tasks.workunit.client.1.smithi100.stdout:9/757: truncate d1/d9/db/da1/dfb/f101 3603675 0 2024-04-27T07:33:41.946 INFO:tasks.workunit.client.1.smithi100.stdout:2/725: dread d0/da/d29/d47/d87/f9a [0,4194304] 0 2024-04-27T07:33:41.946 INFO:tasks.workunit.client.1.smithi100.stdout:6/827: write de/d2e/d3f/d80/f9e [2075506,67514] 0 2024-04-27T07:33:41.949 INFO:tasks.workunit.client.1.smithi100.stdout:7/711: mkdir d1/d75/dd4 0 2024-04-27T07:33:41.949 INFO:tasks.workunit.client.1.smithi100.stdout:7/712: read - d1/fc6 zero size 2024-04-27T07:33:41.950 INFO:tasks.workunit.client.1.smithi100.stdout:7/713: read d1/d54/f61 [3457675,90726] 0 2024-04-27T07:33:41.951 INFO:tasks.workunit.client.1.smithi100.stdout:8/702: symlink d6/dda/le3 0 2024-04-27T07:33:41.953 INFO:tasks.workunit.client.1.smithi100.stdout:6/828: truncate de/d58/d28/f94 284785 0 2024-04-27T07:33:41.954 INFO:tasks.workunit.client.1.smithi100.stdout:6/829: read - de/feb zero size 2024-04-27T07:33:41.957 INFO:tasks.workunit.client.1.smithi100.stdout:8/703: dread d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:41.959 INFO:tasks.workunit.client.1.smithi100.stdout:2/726: dwrite d0/da/d39/fee [4194304,4194304] 0 2024-04-27T07:33:41.963 INFO:tasks.workunit.client.1.smithi100.stdout:1/828: getdents d0/d1f 0 2024-04-27T07:33:41.968 INFO:tasks.workunit.client.1.smithi100.stdout:9/758: creat d1/d9/db/d56/d5c/de3/d4a/d67/f108 x:0 0 0 2024-04-27T07:33:41.969 INFO:tasks.workunit.client.1.smithi100.stdout:8/704: chown d6/c5d 709472 1 2024-04-27T07:33:41.969 INFO:tasks.workunit.client.1.smithi100.stdout:9/759: read - d1/d9/db/d2b/d4f/dac/d54/d61/fcd zero size 2024-04-27T07:33:41.970 INFO:tasks.workunit.client.1.smithi100.stdout:7/714: write d1/dd/d16/d31/d4c/f8f [1243195,52088] 0 2024-04-27T07:33:41.972 INFO:tasks.workunit.client.1.smithi100.stdout:2/727: mknod d0/da/d29/d47/d87/d88/cf2 0 2024-04-27T07:33:41.973 INFO:tasks.workunit.client.1.smithi100.stdout:9/760: write d1/d9/db/d56/d5c/de3/d4a/d67/d8a/fd7 [1029796,52984] 0 2024-04-27T07:33:41.977 INFO:tasks.workunit.client.1.smithi100.stdout:6/830: write de/d58/f36 [2736692,89450] 0 2024-04-27T07:33:41.983 INFO:tasks.workunit.client.1.smithi100.stdout:1/829: dread d0/d1b/d20/f110 [0,4194304] 0 2024-04-27T07:33:41.983 INFO:tasks.workunit.client.1.smithi100.stdout:7/715: creat d1/dd/d16/d31/fd5 x:0 0 0 2024-04-27T07:33:41.987 INFO:tasks.workunit.client.1.smithi100.stdout:1/830: mkdir d0/d1b/d20/d2d/d35/d4d/d60/dcd/d111 0 2024-04-27T07:33:41.988 INFO:tasks.workunit.client.1.smithi100.stdout:8/705: dread d6/d20/d8b/dc0/fcf [0,4194304] 0 2024-04-27T07:33:41.988 INFO:tasks.workunit.client.1.smithi100.stdout:1/831: dread - d0/d1f/d6d/dc7/de1/ff3 zero size 2024-04-27T07:33:41.989 INFO:tasks.workunit.client.1.smithi100.stdout:7/716: getdents d1/d75 0 2024-04-27T07:33:41.990 INFO:tasks.workunit.client.1.smithi100.stdout:8/706: fsync d6/d1b/d75/fba 0 2024-04-27T07:33:41.993 INFO:tasks.workunit.client.1.smithi100.stdout:9/761: dread d1/d9/db/d2b/f7d [0,4194304] 0 2024-04-27T07:33:41.994 INFO:tasks.workunit.client.1.smithi100.stdout:7/717: rmdir d1/dd/d2a/d2c/d9f 39 2024-04-27T07:33:41.994 INFO:tasks.workunit.client.1.smithi100.stdout:8/707: write d6/f8 [3475571,83329] 0 2024-04-27T07:33:42.000 INFO:tasks.workunit.client.1.smithi100.stdout:9/762: dread d1/d9/db/d2b/d31/f50 [0,4194304] 0 2024-04-27T07:33:42.003 INFO:tasks.workunit.client.1.smithi100.stdout:1/832: getdents d0/d1f/d6d/db4 0 2024-04-27T07:33:42.006 INFO:tasks.workunit.client.1.smithi100.stdout:6/831: dread de/d58/d75/f8f [0,4194304] 0 2024-04-27T07:33:42.006 INFO:tasks.workunit.client.1.smithi100.stdout:7/718: mknod d1/dd/d16/d2b/d7f/dcf/cd6 0 2024-04-27T07:33:42.008 INFO:tasks.workunit.client.1.smithi100.stdout:9/763: rename d1/d76/dd6/fd8 to d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/f109 0 2024-04-27T07:33:42.010 INFO:tasks.workunit.client.1.smithi100.stdout:6/832: rmdir de/d58/d28 39 2024-04-27T07:33:42.012 INFO:tasks.workunit.client.1.smithi100.stdout:8/708: dread d6/d1b/d75/f8f [0,4194304] 0 2024-04-27T07:33:42.013 INFO:tasks.workunit.client.1.smithi100.stdout:9/764: truncate d1/d9/db/d2b/d4f/d57/dbe/fea 518106 0 2024-04-27T07:33:42.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.016+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feff404bed0 con 0x7feff40fcf60 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.017+0000 7fefdbfff700 1 -- 172.21.15.82:0/2954258706 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1845 (secure 0 0 0) 0x7fefe40584b0 con 0x7feff40fcf60 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout:e16 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:42.019 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 16 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:32:40.495590+0000 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:33:42.020 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:42.021 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:42.022 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:33:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:33:42.022 INFO:tasks.workunit.client.1.smithi100.stdout:1/833: rename d0/d1f/d6d/db4/d6c/c7a to d0/d1f/d6d/dba/c112 0 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 msgr2=0x7fefdc06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 0x7fefdc06e270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feff40ffb10 tx=0x7fefec009620 comp rx=0 tx=0).stop 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 msgr2=0x7feff40fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009380 tx=0x7fefe4009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 shutdown_connections 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefdc06bdc0 0x7fefdc06e270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feff40fbcb0 0x7feff40ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 --2- 172.21.15.82:0/2954258706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff40fcf60 0x7feff40fe2a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 >> 172.21.15.82:0/2954258706 conn(0x7feff40f7430 msgr2=0x7feff4065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 shutdown_connections 2024-04-27T07:33:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.020+0000 7feffa170700 1 -- 172.21.15.82:0/2954258706 wait complete. 2024-04-27T07:33:42.024 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-04-27T07:33:42.024 INFO:tasks.workunit.client.1.smithi100.stdout:6/833: mknod de/d2e/d86/c11a 0 2024-04-27T07:33:42.024 INFO:tasks.workunit.client.1.smithi100.stdout:7/719: dread d1/dd/d16/d31/d4c/d4d/d3b/f67 [0,4194304] 0 2024-04-27T07:33:42.025 INFO:tasks.workunit.client.1.smithi100.stdout:7/720: readlink d1/dd/d16/d31/lba 0 2024-04-27T07:33:42.038 INFO:tasks.workunit.client.1.smithi100.stdout:9/765: creat d1/d76/f10a x:0 0 0 2024-04-27T07:33:42.039 INFO:tasks.workunit.client.1.smithi100.stdout:9/766: write d1/d9/db/d2b/f7d [1032678,24967] 0 2024-04-27T07:33:42.040 INFO:tasks.workunit.client.1.smithi100.stdout:7/721: mknod d1/dd/d16/d4a/cd7 0 2024-04-27T07:33:42.042 INFO:tasks.workunit.client.1.smithi100.stdout:8/709: creat d6/d20/da2/da6/fe4 x:0 0 0 2024-04-27T07:33:42.043 INFO:tasks.workunit.client.1.smithi100.stdout:1/834: mkdir d0/d23/d113 0 2024-04-27T07:33:42.045 INFO:tasks.workunit.client.1.smithi100.stdout:9/767: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/l10b 0 2024-04-27T07:33:42.046 INFO:tasks.workunit.client.1.smithi100.stdout:6/834: truncate de/d58/d28/f67 1170101 0 2024-04-27T07:33:42.047 INFO:tasks.workunit.client.1.smithi100.stdout:8/710: dread d6/d1b/d1d/f68 [0,4194304] 0 2024-04-27T07:33:42.048 INFO:tasks.workunit.client.1.smithi100.stdout:6/835: readlink de/d2e/d3f/d80/lac 0 2024-04-27T07:33:42.048 INFO:tasks.workunit.client.1.smithi100.stdout:1/835: creat d0/d1b/d20/d2d/d35/d4d/d60/dcd/f114 x:0 0 0 2024-04-27T07:33:42.049 INFO:tasks.workunit.client.1.smithi100.stdout:9/768: mknod d1/d9/db/d2b/d4f/dd1/dd0/c10c 0 2024-04-27T07:33:42.050 INFO:tasks.workunit.client.1.smithi100.stdout:6/836: fdatasync f7 0 2024-04-27T07:33:42.066 INFO:tasks.workunit.client.1.smithi100.stdout:1/836: dwrite d0/d1b/d20/d2d/f83 [4194304,4194304] 0 2024-04-27T07:33:42.067 INFO:tasks.workunit.client.1.smithi100.stdout:6/837: dwrite de/d2e/d86/f9a [0,4194304] 0 2024-04-27T07:33:42.070 INFO:tasks.workunit.client.1.smithi100.stdout:8/711: dwrite d6/f8e [4194304,4194304] 0 2024-04-27T07:33:42.070 INFO:tasks.workunit.client.1.smithi100.stdout:9/769: dwrite d1/d9/db/f4e [0,4194304] 0 2024-04-27T07:33:42.071 INFO:tasks.workunit.client.1.smithi100.stdout:7/722: dread d1/dd/d16/d31/d4c/d4d/d3b/f45 [0,4194304] 0 2024-04-27T07:33:42.077 INFO:tasks.workunit.client.1.smithi100.stdout:6/838: symlink de/d58/d21/d24/d9f/daa/l11b 0 2024-04-27T07:33:42.082 INFO:tasks.workunit.client.1.smithi100.stdout:6/839: write de/d58/d21/f103 [1022478,17113] 0 2024-04-27T07:33:42.085 INFO:tasks.workunit.client.1.smithi100.stdout:8/712: dwrite d6/d20/d54/fe1 [0,4194304] 0 2024-04-27T07:33:42.087 INFO:tasks.workunit.client.1.smithi100.stdout:9/770: getdents d1/d9/dc2 0 2024-04-27T07:33:42.089 INFO:tasks.workunit.client.1.smithi100.stdout:6/840: creat de/d2e/d3f/d80/f11c x:0 0 0 2024-04-27T07:33:42.091 INFO:tasks.workunit.client.1.smithi100.stdout:9/771: rename d1/fbc to d1/d9/db/d2b/d4f/dd1/f10d 0 2024-04-27T07:33:42.094 INFO:tasks.workunit.client.1.smithi100.stdout:9/772: truncate d1/d9/db/d56/d5c/de3/f7b 885004 0 2024-04-27T07:33:42.095 INFO:tasks.workunit.client.1.smithi100.stdout:8/713: getdents d6/d1b/d1d 0 2024-04-27T07:33:42.096 INFO:tasks.workunit.client.1.smithi100.stdout:6/841: creat de/d58/f11d x:0 0 0 2024-04-27T07:33:42.097 INFO:tasks.workunit.client.1.smithi100.stdout:9/773: rmdir d1/d9/db/d2b/d4f/dac/d54 39 2024-04-27T07:33:42.098 INFO:tasks.workunit.client.1.smithi100.stdout:8/714: write d6/d20/d54/f9f [486708,2816] 0 2024-04-27T07:33:42.099 INFO:tasks.workunit.client.1.smithi100.stdout:6/842: dread - de/d2e/d3f/d80/f11c zero size 2024-04-27T07:33:42.102 INFO:tasks.workunit.client.1.smithi100.stdout:9/774: write d1/d9/db/d56/d5c/de3/d4a/fbf [79877,74401] 0 2024-04-27T07:33:42.106 INFO:tasks.workunit.client.1.smithi100.stdout:1/837: dwrite d0/d1b/d20/d2d/d35/f7f [0,4194304] 0 2024-04-27T07:33:42.106 INFO:tasks.workunit.client.1.smithi100.stdout:9/775: fdatasync d1/d9/db/d2b/d4f/f62 0 2024-04-27T07:33:42.108 INFO:tasks.workunit.client.1.smithi100.stdout:1/838: chown d0/d1b/d20/d2d/d35/d4d/d60/la3 198 1 2024-04-27T07:33:42.112 INFO:tasks.workunit.client.1.smithi100.stdout:8/715: truncate d6/d20/d2a/f85 4043178 0 2024-04-27T07:33:42.113 INFO:tasks.workunit.client.1.smithi100.stdout:9/776: dread d1/d9/db/d56/d5c/de3/f7b [0,4194304] 0 2024-04-27T07:33:42.121 INFO:tasks.workunit.client.1.smithi100.stdout:5/660: sync 2024-04-27T07:33:42.123 INFO:tasks.workunit.client.1.smithi100.stdout:8/716: dread - d6/d20/d8b/d8c/dce/f93 zero size 2024-04-27T07:33:42.125 INFO:tasks.workunit.client.1.smithi100.stdout:8/717: read d6/d20/d8b/f8d [450488,39323] 0 2024-04-27T07:33:42.126 INFO:tasks.workunit.client.1.smithi100.stdout:6/843: dread de/d58/d21/d24/d9f/fbf [0,4194304] 0 2024-04-27T07:33:42.127 INFO:tasks.workunit.client.1.smithi100.stdout:8/718: chown d6/d20/d54/d91/fc7 14544634 1 2024-04-27T07:33:42.128 INFO:tasks.workunit.client.1.smithi100.stdout:9/777: link d1/d9/db/d2b/d4f/f72 d1/d9/db/d56/d5c/de3/d4a/f10e 0 2024-04-27T07:33:42.129 INFO:tasks.workunit.client.1.smithi100.stdout:5/661: dread d0/d4/d21/d24/d2f/d39/d56/fa6 [0,4194304] 0 2024-04-27T07:33:42.134 INFO:tasks.workunit.client.1.smithi100.stdout:1/839: dread d0/d1b/d20/d2d/d35/dac/fb2 [0,4194304] 0 2024-04-27T07:33:42.138 INFO:tasks.workunit.client.1.smithi100.stdout:1/840: dread d0/da0/f8c [0,4194304] 0 2024-04-27T07:33:42.145 INFO:tasks.workunit.client.1.smithi100.stdout:5/662: dread d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:42.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 -- 172.21.15.82:0/1580093774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fce60 msgr2=0x7f7b400fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 --2- 172.21.15.82:0/1580093774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fce60 0x7f7b400fd270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c004940 tx=0x7f7b3c009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 -- 172.21.15.82:0/1580093774 shutdown_connections 2024-04-27T07:33:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 --2- 172.21.15.82:0/1580093774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fdfd0 0x7f7b400fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 --2- 172.21.15.82:0/1580093774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fce60 0x7f7b400fd270 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.167+0000 7f7b47478700 1 -- 172.21.15.82:0/1580093774 >> 172.21.15.82:0/1580093774 conn(0x7f7b400f8540 msgr2=0x7f7b400fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 -- 172.21.15.82:0/1580093774 shutdown_connections 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 -- 172.21.15.82:0/1580093774 wait complete. 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 Processor -- start 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 -- start start 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.168+0000 7f7b47478700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b47478700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4010e4c0 con 0x7f7b400fdfd0 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b47478700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4010ed10 con 0x7f7b400fce60 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b45214700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:42.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48756/0 (socket says 172.21.15.82:48756) 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 -- 172.21.15.82:0/3533862147 learned_addr learned my addr 172.21.15.82:0/3533862147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b45214700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:44418/0 (socket says 172.21.15.82:44418) 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 -- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 msgr2=0x7f7b4010d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 -- 172.21.15.82:0/3533862147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c005040 con 0x7f7b400fdfd0 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b45214700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.169+0000 7f7b44a13700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000eb40 tx=0x7f7b3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.170+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b30007cc0 con 0x7f7b400fdfd0 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.170+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4010ef90 con 0x7f7b400fdfd0 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.170+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b3000f040 con 0x7f7b400fdfd0 2024-04-27T07:33:42.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.170+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b30009620 con 0x7f7b400fdfd0 2024-04-27T07:33:42.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.170+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4010f4d0 con 0x7f7b400fdfd0 2024-04-27T07:33:42.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.171+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4005f5c0 con 0x7f7b400fdfd0 2024-04-27T07:33:42.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.172+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f7b30009780 con 0x7f7b400fdfd0 2024-04-27T07:33:42.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.172+0000 7f7b35ffb700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 0x7f7b2c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.173+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7b3008a6a0 con 0x7f7b400fdfd0 2024-04-27T07:33:42.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.173+0000 7f7b45214700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 0x7f7b2c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:42.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.173+0000 7f7b45214700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 0x7f7b2c06e270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009b30 tx=0x7f7b3c009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:42.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.180+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7b30050930 con 0x7f7b400fdfd0 2024-04-27T07:33:42.261 INFO:tasks.workunit.client.1.smithi100.stdout:6/844: mkdir de/d58/d21/d24/d11e 0 2024-04-27T07:33:42.264 INFO:tasks.workunit.client.1.smithi100.stdout:1/841: symlink d0/d1f/d6d/db4/l115 0 2024-04-27T07:33:42.265 INFO:tasks.workunit.client.1.smithi100.stdout:5/663: mkdir d0/d4/d21/d24/d2f/d39/d56/d67/dd4 0 2024-04-27T07:33:42.265 INFO:tasks.workunit.client.1.smithi100.stdout:1/842: write d0/d1f/fc2 [183126,49875] 0 2024-04-27T07:33:42.270 INFO:tasks.workunit.client.1.smithi100.stdout:6/845: rename de/d58/d21/d24/d9f/la3 to de/d58/d21/d91/df0/l11f 0 2024-04-27T07:33:42.274 INFO:tasks.workunit.client.1.smithi100.stdout:5/664: rmdir d0/d4/d21/d51 39 2024-04-27T07:33:42.275 INFO:tasks.workunit.client.1.smithi100.stdout:9/778: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/d106/l10f 0 2024-04-27T07:33:42.276 INFO:tasks.workunit.client.1.smithi100.stdout:5/665: dread d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fb8 [0,4194304] 0 2024-04-27T07:33:42.276 INFO:tasks.workunit.client.1.smithi100.stdout:6/846: symlink de/d58/d21/d24/d9f/l120 0 2024-04-27T07:33:42.278 INFO:tasks.workunit.client.1.smithi100.stdout:5/666: chown d0/d4/d21/d24/d2f/d39/d56/f85 106 1 2024-04-27T07:33:42.278 INFO:tasks.workunit.client.1.smithi100.stdout:1/843: mknod d0/d1f/d6d/c116 0 2024-04-27T07:33:42.279 INFO:tasks.workunit.client.1.smithi100.stdout:5/667: readlink d0/d4/d21/d24/d2f/d57/d3e/l9e 0 2024-04-27T07:33:42.280 INFO:tasks.workunit.client.1.smithi100.stdout:8/719: truncate d6/d1b/d75/f83 916703 0 2024-04-27T07:33:42.282 INFO:tasks.workunit.client.1.smithi100.stdout:8/720: read f1 [3078198,7195] 0 2024-04-27T07:33:42.282 INFO:tasks.workunit.client.1.smithi100.stdout:9/779: unlink d1/d9/db/d56/d5c/de3/d4a/d67/f107 0 2024-04-27T07:33:42.283 INFO:tasks.workunit.client.1.smithi100.stdout:6/847: mkdir de/d58/d21/d24/d9f/db9/d121 0 2024-04-27T07:33:42.284 INFO:tasks.workunit.client.1.smithi100.stdout:1/844: mkdir d0/d1b/d20/d2d/d35/d65/d117 0 2024-04-27T07:33:42.287 INFO:tasks.workunit.client.1.smithi100.stdout:9/780: chown d1/d9/db/d56/d5c/de3/d4a/d67/d8a/fd7 10017546 1 2024-04-27T07:33:42.288 INFO:tasks.workunit.client.1.smithi100.stdout:5/668: dwrite d0/d4/d21/d24/d2f/d39/d56/fd2 [0,4194304] 0 2024-04-27T07:33:42.288 INFO:tasks.workunit.client.1.smithi100.stdout:1/845: truncate d0/d1f/d6d/f101 918350 0 2024-04-27T07:33:42.292 INFO:tasks.workunit.client.1.smithi100.stdout:8/721: symlink d6/d1b/d1d/d59/d94/ddb/le5 0 2024-04-27T07:33:42.294 INFO:tasks.workunit.client.1.smithi100.stdout:9/781: fdatasync d1/d9/db/d56/d5c/de3/d4a/f10e 0 2024-04-27T07:33:42.295 INFO:tasks.workunit.client.1.smithi100.stdout:9/782: chown d1/d9/db/da1/dfb/fb7 12984 1 2024-04-27T07:33:42.296 INFO:tasks.workunit.client.1.smithi100.stdout:6/848: mknod de/d58/d21/d24/c122 0 2024-04-27T07:33:42.297 INFO:tasks.workunit.client.1.smithi100.stdout:9/783: write d1/d9/db/da1/dfb/fb7 [680817,112905] 0 2024-04-27T07:33:42.298 INFO:tasks.workunit.client.1.smithi100.stdout:9/784: fdatasync d1/d9/db/da1/dfb/fb8 0 2024-04-27T07:33:42.298 INFO:tasks.workunit.client.1.smithi100.stdout:5/669: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fc7 zero size 2024-04-27T07:33:42.302 INFO:tasks.workunit.client.1.smithi100.stdout:8/722: mknod d6/d20/d8b/dc0/ce6 0 2024-04-27T07:33:42.307 INFO:tasks.workunit.client.1.smithi100.stdout:3/840: sync 2024-04-27T07:33:42.308 INFO:tasks.workunit.client.1.smithi100.stdout:6/849: dwrite de/d58/f71 [0,4194304] 0 2024-04-27T07:33:42.312 INFO:tasks.workunit.client.1.smithi100.stdout:3/841: chown d7/d9/d26/f38 0 1 2024-04-27T07:33:42.312 INFO:tasks.workunit.client.1.smithi100.stdout:1/846: dwrite d0/d23/d3a/df0/fff [0,4194304] 0 2024-04-27T07:33:42.313 INFO:tasks.workunit.client.1.smithi100.stdout:5/670: symlink d0/d42/d94/d97/d60/dc4/d99/dc9/ld5 0 2024-04-27T07:33:42.313 INFO:tasks.workunit.client.1.smithi100.stdout:9/785: dwrite d1/d9/db/d2b/f7d [0,4194304] 0 2024-04-27T07:33:42.315 INFO:tasks.workunit.client.1.smithi100.stdout:9/786: fsync d1/d9/db/d56/f83 0 2024-04-27T07:33:42.327 INFO:tasks.workunit.client.1.smithi100.stdout:3/842: rename d7/d9/d10/d33/d47/cc2 to d7/dad/c102 0 2024-04-27T07:33:42.327 INFO:tasks.workunit.client.1.smithi100.stdout:9/787: dwrite d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/fd9 [0,4194304] 0 2024-04-27T07:33:42.330 INFO:tasks.workunit.client.1.smithi100.stdout:8/723: link d6/c14 d6/d20/d54/d91/dae/ce7 0 2024-04-27T07:33:42.334 INFO:tasks.workunit.client.1.smithi100.stdout:8/724: write d6/d20/d54/d91/fe2 [795118,48896] 0 2024-04-27T07:33:42.337 INFO:tasks.workunit.client.1.smithi100.stdout:8/725: write d6/d1b/f2d [3927659,19769] 0 2024-04-27T07:33:42.339 INFO:tasks.workunit.client.1.smithi100.stdout:9/788: dwrite d1/d9/db/da1/dfb/fd5 [0,4194304] 0 2024-04-27T07:33:42.342 INFO:tasks.workunit.client.1.smithi100.stdout:5/671: rename d0/d42/f81 to d0/d4/d21/d24/d2f/d39/d56/fd6 0 2024-04-27T07:33:42.347 INFO:tasks.workunit.client.1.smithi100.stdout:1/847: dread d0/d1f/fc2 [0,4194304] 0 2024-04-27T07:33:42.348 INFO:tasks.workunit.client.1.smithi100.stdout:5/672: chown d0/d4/d21/d24/d2f/d39/l49 1055076753 1 2024-04-27T07:33:42.351 INFO:tasks.workunit.client.1.smithi100.stdout:6/850: write de/d58/d90/fb6 [518384,69970] 0 2024-04-27T07:33:42.353 INFO:tasks.workunit.client.1.smithi100.stdout:5/673: symlink d0/d4/d21/d24/d2f/d39/d56/d67/d84/ld7 0 2024-04-27T07:33:42.354 INFO:tasks.workunit.client.1.smithi100.stdout:5/674: write d0/d4/f19 [410424,96125] 0 2024-04-27T07:33:42.356 INFO:tasks.workunit.client.1.smithi100.stdout:1/848: rename d0/d1f/d6d/db4/d4e/ffd to d0/d1f/d6d/db4/d6c/f118 0 2024-04-27T07:33:42.357 INFO:tasks.workunit.client.1.smithi100.stdout:6/851: read de/d58/d21/d23/f3e [1103782,52650] 0 2024-04-27T07:33:42.359 INFO:tasks.workunit.client.1.smithi100.stdout:1/849: chown d0/d1b/d20/d2d/d35/d4d/d60/d79/l8d 37944 1 2024-04-27T07:33:42.364 INFO:tasks.workunit.client.1.smithi100.stdout:3/843: write d7/d9/d26/d2a/d5e/f72 [677351,32008] 0 2024-04-27T07:33:42.367 INFO:tasks.workunit.client.1.smithi100.stdout:1/850: mknod d0/d1f/d6d/db4/d4e/c119 0 2024-04-27T07:33:42.368 INFO:tasks.workunit.client.1.smithi100.stdout:9/789: dread d1/f46 [0,4194304] 0 2024-04-27T07:33:42.370 INFO:tasks.workunit.client.1.smithi100.stdout:3/844: mkdir d7/d9/d10/d3e/df3/d103 0 2024-04-27T07:33:42.370 INFO:tasks.workunit.client.1.smithi100.stdout:1/851: readlink d0/d1b/d20/d2d/d35/l43 0 2024-04-27T07:33:42.371 INFO:tasks.workunit.client.1.smithi100.stdout:8/726: dread d6/f41 [0,4194304] 0 2024-04-27T07:33:42.371 INFO:tasks.workunit.client.1.smithi100.stdout:3/845: readlink d7/d9/d26/d2a/le9 0 2024-04-27T07:33:42.374 INFO:tasks.workunit.client.1.smithi100.stdout:8/727: chown d6/d20/d8b/dc0 1020407576 1 2024-04-27T07:33:42.374 INFO:tasks.workunit.client.1.smithi100.stdout:9/790: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/l110 0 2024-04-27T07:33:42.376 INFO:tasks.workunit.client.1.smithi100.stdout:1/852: creat d0/d1f/d6d/db4/d4e/d7b/ddd/f11a x:0 0 0 2024-04-27T07:33:42.378 INFO:tasks.workunit.client.1.smithi100.stdout:3/846: truncate d7/d9/d10/d33/d90/d3a/feb 337036 0 2024-04-27T07:33:42.379 INFO:tasks.workunit.client.1.smithi100.stdout:1/853: readlink d0/d1b/d20/d2d/d35/l8e 0 2024-04-27T07:33:42.380 INFO:tasks.workunit.client.1.smithi100.stdout:5/675: dread d0/d4/d21/d24/d2f/d57/d37/d1a/f8e [0,4194304] 0 2024-04-27T07:33:42.380 INFO:tasks.workunit.client.1.smithi100.stdout:6/852: dread de/d58/d21/d24/f46 [0,4194304] 0 2024-04-27T07:33:42.381 INFO:tasks.workunit.client.1.smithi100.stdout:3/847: fdatasync d7/d9/d10/d3e/d74/db1/d9d/f80 0 2024-04-27T07:33:42.382 INFO:tasks.workunit.client.1.smithi100.stdout:1/854: write d0/fe4 [911703,120426] 0 2024-04-27T07:33:42.385 INFO:tasks.workunit.client.1.smithi100.stdout:6/853: read de/d2e/d3f/d80/fcc [348973,86633] 0 2024-04-27T07:33:42.385 INFO:tasks.workunit.client.1.smithi100.stdout:8/728: dread d6/d20/d2a/f55 [0,4194304] 0 2024-04-27T07:33:42.387 INFO:tasks.workunit.client.1.smithi100.stdout:4/816: sync 2024-04-27T07:33:42.389 INFO:tasks.workunit.client.1.smithi100.stdout:8/729: read d6/d20/d54/d91/fe2 [388941,3776] 0 2024-04-27T07:33:42.389 INFO:tasks.workunit.client.1.smithi100.stdout:5/676: creat d0/d42/d94/d97/d60/dc4/d99/da0/fd8 x:0 0 0 2024-04-27T07:33:42.393 INFO:tasks.workunit.client.1.smithi100.stdout:3/848: truncate d7/d9/d26/d2a/db3/fc5 1795880 0 2024-04-27T07:33:42.394 INFO:tasks.workunit.client.1.smithi100.stdout:9/791: dread d1/d9/db/d2b/d4f/da3/faf [0,4194304] 0 2024-04-27T07:33:42.396 INFO:tasks.workunit.client.1.smithi100.stdout:4/817: write d5/d1b/df8/d3f/fb9 [662345,79625] 0 2024-04-27T07:33:42.397 INFO:tasks.workunit.client.1.smithi100.stdout:5/677: dwrite d0/f1d [4194304,4194304] 0 2024-04-27T07:33:42.398 INFO:tasks.workunit.client.1.smithi100.stdout:8/730: read d6/d20/d2a/f37 [1607646,121300] 0 2024-04-27T07:33:42.399 INFO:tasks.workunit.client.1.smithi100.stdout:3/849: write d7/d9/d26/d2a/d5e/d98/fe7 [197115,92863] 0 2024-04-27T07:33:42.402 INFO:tasks.workunit.client.1.smithi100.stdout:9/792: dread - d1/d9/db/f6c zero size 2024-04-27T07:33:42.403 INFO:tasks.workunit.client.1.smithi100.stdout:5/678: creat d0/d42/d94/fd9 x:0 0 0 2024-04-27T07:33:42.403 INFO:tasks.workunit.client.1.smithi100.stdout:9/793: write d1/d9/db/f4e [619723,37977] 0 2024-04-27T07:33:42.404 INFO:tasks.workunit.client.1.smithi100.stdout:8/731: rmdir d6/d1b/d1d/d59/d94/ddb 39 2024-04-27T07:33:42.405 INFO:tasks.workunit.client.1.smithi100.stdout:6/854: link de/d2e/dc0/le6 de/d58/d21/d23/d73/l123 0 2024-04-27T07:33:42.407 INFO:tasks.workunit.client.1.smithi100.stdout:5/679: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f9c zero size 2024-04-27T07:33:42.407 INFO:tasks.workunit.client.1.smithi100.stdout:1/855: link d0/d1f/d6d/c116 d0/d1b/d20/d2d/d35/d4d/d60/dcd/c11b 0 2024-04-27T07:33:42.407 INFO:tasks.workunit.client.1.smithi100.stdout:3/850: chown d7/d9/d26/d2a/db3/fc5 237 1 2024-04-27T07:33:42.409 INFO:tasks.workunit.client.1.smithi100.stdout:9/794: unlink d1/d9/db/d2b/d4f/dac/d54/d61/l66 0 2024-04-27T07:33:42.410 INFO:tasks.workunit.client.1.smithi100.stdout:6/855: write de/d58/d21/d24/f115 [98818,3984] 0 2024-04-27T07:33:42.411 INFO:tasks.workunit.client.1.smithi100.stdout:6/856: chown de/dfc 291 1 2024-04-27T07:33:42.411 INFO:tasks.workunit.client.1.smithi100.stdout:9/795: chown d1/d9/f84 792432 1 2024-04-27T07:33:42.412 INFO:tasks.workunit.client.1.smithi100.stdout:4/818: getdents d5/d16/d19/d46/d53 0 2024-04-27T07:33:42.414 INFO:tasks.workunit.client.1.smithi100.stdout:1/856: dread - d0/d1f/d6d/db4/ff7 zero size 2024-04-27T07:33:42.416 INFO:tasks.workunit.client.1.smithi100.stdout:1/857: write d0/d1b/d20/d2d/d35/f80 [316353,29202] 0 2024-04-27T07:33:42.416 INFO:tasks.workunit.client.1.smithi100.stdout:3/851: creat d7/d9/d10/d3e/df3/f104 x:0 0 0 2024-04-27T07:33:42.417 INFO:tasks.workunit.client.1.smithi100.stdout:8/732: truncate d6/f18 4007006 0 2024-04-27T07:33:42.418 INFO:tasks.workunit.client.1.smithi100.stdout:5/680: mkdir d0/d42/d94/d97/d60/dc4/d99/dc9/dda 0 2024-04-27T07:33:42.424 INFO:tasks.workunit.client.1.smithi100.stdout:8/733: dwrite d6/d20/d8b/d8c/dce/fcc [0,4194304] 0 2024-04-27T07:33:42.425 INFO:tasks.workunit.client.1.smithi100.stdout:3/852: chown d7/da9/lea 1 1 2024-04-27T07:33:42.474 INFO:tasks.workunit.client.1.smithi100.stdout:9/796: write d1/d9/db/d56/f8c [661426,9013] 0 2024-04-27T07:33:42.476 INFO:tasks.workunit.client.1.smithi100.stdout:9/797: fdatasync d1/d9/db/d56/d5c/de3/d4a/d67/fdd 0 2024-04-27T07:33:42.478 INFO:tasks.workunit.client.1.smithi100.stdout:9/798: write d1/d9/db/d2b/ff6 [2566788,95886] 0 2024-04-27T07:33:42.482 INFO:tasks.workunit.client.1.smithi100.stdout:9/799: dread d1/f85 [0,4194304] 0 2024-04-27T07:33:42.484 INFO:tasks.workunit.client.1.smithi100.stdout:8/734: truncate d6/d20/d2a/f85 4364439 0 2024-04-27T07:33:42.485 INFO:tasks.workunit.client.1.smithi100.stdout:8/735: write d6/d20/d50/d72/f87 [3800130,86861] 0 2024-04-27T07:33:42.486 INFO:tasks.workunit.client.1.smithi100.stdout:3/853: truncate d7/d9/d10/d33/d47/f4f 1096973 0 2024-04-27T07:33:42.487 INFO:tasks.workunit.client.1.smithi100.stdout:6/857: link de/d58/d21/c4a de/d2e/c124 0 2024-04-27T07:33:42.487 INFO:tasks.workunit.client.1.smithi100.stdout:6/858: fdatasync de/d58/d75/ff5 0 2024-04-27T07:33:42.489 INFO:tasks.workunit.client.1.smithi100.stdout:6/859: chown de/d58/d21/d91/df0/ff6 1 1 2024-04-27T07:33:42.490 INFO:tasks.workunit.client.1.smithi100.stdout:6/860: stat de/d58/d21/d24/d11e 0 2024-04-27T07:33:42.495 INFO:tasks.workunit.client.1.smithi100.stdout:3/854: unlink d7/dad/daf/fd0 0 2024-04-27T07:33:42.496 INFO:tasks.workunit.client.1.smithi100.stdout:9/800: dwrite d1/d9/db/d56/d5c/de3/fca [0,4194304] 0 2024-04-27T07:33:42.500 INFO:tasks.workunit.client.1.smithi100.stdout:9/801: chown d1/d9/db/d2b/d4f/dd1/ff8 0 1 2024-04-27T07:33:42.502 INFO:tasks.workunit.client.1.smithi100.stdout:8/736: dwrite d6/d1b/d1d/f68 [0,4194304] 0 2024-04-27T07:33:42.504 INFO:tasks.workunit.client.1.smithi100.stdout:8/737: write d6/d1b/d1d/f32 [5911101,75241] 0 2024-04-27T07:33:42.504 INFO:tasks.workunit.client.1.smithi100.stdout:8/738: stat d6/d20/fd5 0 2024-04-27T07:33:42.505 INFO:tasks.workunit.client.1.smithi100.stdout:3/855: mknod d7/d9/d10/c105 0 2024-04-27T07:33:42.513 INFO:tasks.workunit.client.1.smithi100.stdout:9/802: link d1/d9/db/d2b/f6b d1/d9/db/d2b/d31/f111 0 2024-04-27T07:33:42.515 INFO:tasks.workunit.client.1.smithi100.stdout:9/803: dread - d1/d9/db/d2b/d4f/dac/f81 zero size 2024-04-27T07:33:42.520 INFO:tasks.workunit.client.1.smithi100.stdout:9/804: write d1/d9/db/d56/d5c/de3/f98 [5150813,24106] 0 2024-04-27T07:33:42.520 INFO:tasks.workunit.client.1.smithi100.stdout:5/681: dwrite d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:42.522 INFO:tasks.workunit.client.1.smithi100.stdout:5/682: chown d0/f1d 257732 1 2024-04-27T07:33:42.522 INFO:tasks.workunit.client.1.smithi100.stdout:9/805: chown d1/d9/db/d2b/d4f/d91 52751273 1 2024-04-27T07:33:42.524 INFO:tasks.workunit.client.1.smithi100.stdout:5/683: write d0/d4/f22 [7027881,22155] 0 2024-04-27T07:33:42.525 INFO:tasks.workunit.client.1.smithi100.stdout:3/856: dread d7/d9/d10/d28/db0/fb9 [0,4194304] 0 2024-04-27T07:33:42.528 INFO:tasks.workunit.client.1.smithi100.stdout:9/806: mkdir d1/d9/db/d2b/d4f/d57/dbe/d112 0 2024-04-27T07:33:42.530 INFO:tasks.workunit.client.1.smithi100.stdout:9/807: truncate d1/d76/dd6/fde 564042 0 2024-04-27T07:33:42.532 INFO:tasks.workunit.client.1.smithi100.stdout:5/684: dwrite d0/d4/f22 [0,4194304] 0 2024-04-27T07:33:42.532 INFO:tasks.workunit.client.1.smithi100.stdout:3/857: write d7/d9/d10/d28/fa4 [4839552,114965] 0 2024-04-27T07:33:42.535 INFO:tasks.workunit.client.1.smithi100.stdout:5/685: readlink d0/d4/d21/d24/d2f/d39/d56/l78 0 2024-04-27T07:33:42.538 INFO:tasks.workunit.client.1.smithi100.stdout:5/686: write d0/d4/d21/d24/d2f/d39/d56/d67/d84/fb2 [871122,107701] 0 2024-04-27T07:33:42.540 INFO:tasks.workunit.client.1.smithi100.stdout:3/858: mkdir d7/d9/d10/d33/d47/d106 0 2024-04-27T07:33:42.544 INFO:tasks.workunit.client.1.smithi100.stdout:0/754: sync 2024-04-27T07:33:42.544 INFO:tasks.workunit.client.1.smithi100.stdout:7/723: sync 2024-04-27T07:33:42.544 INFO:tasks.workunit.client.1.smithi100.stdout:2/728: sync 2024-04-27T07:33:42.546 INFO:tasks.workunit.client.1.smithi100.stdout:0/755: write d1/d8/d20/f3b [2816405,103008] 0 2024-04-27T07:33:42.548 INFO:tasks.workunit.client.1.smithi100.stdout:0/756: write d1/d38/f94 [85380,7677] 0 2024-04-27T07:33:42.550 INFO:tasks.workunit.client.1.smithi100.stdout:3/859: creat d7/d9/d10/f107 x:0 0 0 2024-04-27T07:33:42.551 INFO:tasks.workunit.client.1.smithi100.stdout:5/687: getdents d0/d4/d21/d24/d2f/d39/d56/d67/d84 0 2024-04-27T07:33:42.554 INFO:tasks.workunit.client.1.smithi100.stdout:2/729: mknod d0/da/d29/d47/d87/cf3 0 2024-04-27T07:33:42.555 INFO:tasks.workunit.client.1.smithi100.stdout:0/757: mkdir d1/d8/d14/d59/d64/d80/d102 0 2024-04-27T07:33:42.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.557+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b4010f800 con 0x7f7b2c06bdc0 2024-04-27T07:33:42.560 INFO:tasks.workunit.client.1.smithi100.stdout:2/730: mkdir d0/da/d29/d47/dae/df4 0 2024-04-27T07:33:42.564 INFO:tasks.workunit.client.1.smithi100.stdout:5/688: creat d0/d4/d21/d24/d2f/db5/fdb x:0 0 0 2024-04-27T07:33:42.570 INFO:tasks.workunit.client.1.smithi100.stdout:7/724: link d1/dd/d2a/c63 d1/dd/d16/d31/d4c/d4d/d3b/cd8 0 2024-04-27T07:33:42.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.569+0000 7f7b35ffb700 1 -- 172.21.15.82:0/3533862147 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7b4010f800 con 0x7f7b2c06bdc0 2024-04-27T07:33:42.571 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:33:42.571 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:33:42.571 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/21 daemons upgraded", 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:33:42.572 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:33:42.572 INFO:tasks.workunit.client.1.smithi100.stdout:4/819: sync 2024-04-27T07:33:42.573 INFO:tasks.workunit.client.1.smithi100.stdout:4/820: stat d5/d1b/d65/lcb 0 2024-04-27T07:33:42.573 INFO:tasks.workunit.client.1.smithi100.stdout:7/725: read d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a [88974,88434] 0 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 msgr2=0x7f7b2c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 0x7f7b2c06e270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009b30 tx=0x7f7b3c009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 msgr2=0x7f7b4010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000eb40 tx=0x7f7b3000b040 comp rx=0 tx=0).stop 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 shutdown_connections 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f7b2c06bdc0 0x7f7b2c06e270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b400fce60 0x7f7b4010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 --2- 172.21.15.82:0/3533862147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b400fdfd0 0x7f7b4010dec0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 >> 172.21.15.82:0/3533862147 conn(0x7f7b400f8540 msgr2=0x7f7b400f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 shutdown_connections 2024-04-27T07:33:42.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.572+0000 7f7b47478700 1 -- 172.21.15.82:0/3533862147 wait complete. 2024-04-27T07:33:42.575 INFO:tasks.workunit.client.1.smithi100.stdout:7/726: read d1/dd/d16/d2b/d7f/f83 [465646,110984] 0 2024-04-27T07:33:42.576 INFO:tasks.workunit.client.1.smithi100.stdout:4/821: readlink d5/d1b/df8/d7d/lbe 0 2024-04-27T07:33:42.582 INFO:tasks.workunit.client.1.smithi100.stdout:4/822: creat d5/d102/f11a x:0 0 0 2024-04-27T07:33:42.584 INFO:tasks.workunit.client.1.smithi100.stdout:4/823: mkdir d5/d16/d2e/d5a/d11b 0 2024-04-27T07:33:42.584 INFO:tasks.workunit.client.1.smithi100.stdout:4/824: readlink d5/d16/lc0 0 2024-04-27T07:33:42.588 INFO:tasks.workunit.client.1.smithi100.stdout:4/825: dread d5/d1b/df8/d3f/fb9 [0,4194304] 0 2024-04-27T07:33:42.589 INFO:tasks.workunit.client.1.smithi100.stdout:4/826: write d5/ffe [1003412,33647] 0 2024-04-27T07:33:42.591 INFO:tasks.workunit.client.1.smithi100.stdout:4/827: dread - d5/d23/fa6 zero size 2024-04-27T07:33:42.593 INFO:tasks.workunit.client.1.smithi100.stdout:1/858: unlink d0/fd 0 2024-04-27T07:33:42.596 INFO:tasks.workunit.client.1.smithi100.stdout:4/828: creat d5/d16/d19/d21/d77/d94/f11c x:0 0 0 2024-04-27T07:33:42.596 INFO:tasks.workunit.client.1.smithi100.stdout:1/859: getdents d0/d1b/d20/d2d/d35/dac 0 2024-04-27T07:33:42.599 INFO:tasks.workunit.client.1.smithi100.stdout:1/860: creat d0/d23/d3a/f11c x:0 0 0 2024-04-27T07:33:42.600 INFO:tasks.workunit.client.1.smithi100.stdout:4/829: truncate d5/d16/d19/d46/d53/f114 493906 0 2024-04-27T07:33:42.601 INFO:tasks.workunit.client.1.smithi100.stdout:4/830: stat d5/d1b/df8/d3f/f63 0 2024-04-27T07:33:42.602 INFO:tasks.workunit.client.1.smithi100.stdout:9/808: symlink d1/d9/db/d2b/l113 0 2024-04-27T07:33:42.607 INFO:tasks.workunit.client.1.smithi100.stdout:6/861: creat de/d58/d21/d24/f125 x:0 0 0 2024-04-27T07:33:42.608 INFO:tasks.workunit.client.1.smithi100.stdout:6/862: chown de/d58/d21/d24/d9f/fbc 0 1 2024-04-27T07:33:42.609 INFO:tasks.workunit.client.1.smithi100.stdout:8/739: symlink d6/d20/d50/le8 0 2024-04-27T07:33:42.611 INFO:tasks.workunit.client.1.smithi100.stdout:2/731: symlink d0/d79/lf5 0 2024-04-27T07:33:42.613 INFO:tasks.workunit.client.1.smithi100.stdout:0/758: write d1/d8/da8/feb [2550724,122765] 0 2024-04-27T07:33:42.614 INFO:tasks.workunit.client.1.smithi100.stdout:3/860: write d7/f9e [3773674,65122] 0 2024-04-27T07:33:42.621 INFO:tasks.workunit.client.1.smithi100.stdout:6/863: dwrite de/d58/d21/d24/f115 [0,4194304] 0 2024-04-27T07:33:42.621 INFO:tasks.workunit.client.1.smithi100.stdout:7/727: write d1/dd/d16/d4a/f89 [675235,97046] 0 2024-04-27T07:33:42.624 INFO:tasks.workunit.client.1.smithi100.stdout:8/740: dread d6/d1b/d1d/f68 [0,4194304] 0 2024-04-27T07:33:42.632 INFO:tasks.workunit.client.1.smithi100.stdout:6/864: rename de/d2e/d3f/f60 to de/d58/d21/dfd/f126 0 2024-04-27T07:33:42.632 INFO:tasks.workunit.client.1.smithi100.stdout:8/741: fsync d6/d20/d54/d91/fd6 0 2024-04-27T07:33:42.634 INFO:tasks.workunit.client.1.smithi100.stdout:7/728: unlink d1/dd/d16/d31/c7d 0 2024-04-27T07:33:42.634 INFO:tasks.workunit.client.1.smithi100.stdout:5/689: dwrite d0/d4/d21/f3a [0,4194304] 0 2024-04-27T07:33:42.635 INFO:tasks.workunit.client.1.smithi100.stdout:2/732: dwrite d0/da/d29/d47/d5a/d82/f89 [0,4194304] 0 2024-04-27T07:33:42.637 INFO:tasks.workunit.client.1.smithi100.stdout:3/861: dwrite d7/d9/d10/d33/d90/d3a/f94 [0,4194304] 0 2024-04-27T07:33:42.640 INFO:tasks.workunit.client.1.smithi100.stdout:6/865: write de/d58/d21/d24/f125 [473420,75782] 0 2024-04-27T07:33:42.641 INFO:tasks.workunit.client.1.smithi100.stdout:0/759: write d1/d38/f4a [884801,2516] 0 2024-04-27T07:33:42.641 INFO:tasks.workunit.client.1.smithi100.stdout:7/729: write d1/dd/d16/f66 [4997985,75341] 0 2024-04-27T07:33:42.643 INFO:tasks.workunit.client.1.smithi100.stdout:8/742: unlink d6/d20/d54/d91/dae/c64 0 2024-04-27T07:33:42.649 INFO:tasks.workunit.client.1.smithi100.stdout:8/743: stat d6/d20 0 2024-04-27T07:33:42.650 INFO:tasks.workunit.client.1.smithi100.stdout:2/733: mknod d0/da/d29/d47/cf6 0 2024-04-27T07:33:42.650 INFO:tasks.workunit.client.1.smithi100.stdout:3/862: fsync d7/d9/d10/d3e/d74/fdc 0 2024-04-27T07:33:42.651 INFO:tasks.workunit.client.1.smithi100.stdout:0/760: dread d1/d38/f94 [0,4194304] 0 2024-04-27T07:33:42.652 INFO:tasks.workunit.client.1.smithi100.stdout:7/730: stat d1/dd/d16/d3e/fa9 0 2024-04-27T07:33:42.652 INFO:tasks.workunit.client.1.smithi100.stdout:4/831: dwrite d5/d16/d19/d21/d2b/f51 [0,4194304] 0 2024-04-27T07:33:42.652 INFO:tasks.workunit.client.1.smithi100.stdout:9/809: dwrite d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/f109 [0,4194304] 0 2024-04-27T07:33:42.653 INFO:tasks.workunit.client.1.smithi100.stdout:6/866: read de/d58/d90/f97 [602617,109925] 0 2024-04-27T07:33:42.656 INFO:tasks.workunit.client.1.smithi100.stdout:8/744: rmdir d6/d20/d54/d91/d9e 39 2024-04-27T07:33:42.658 INFO:tasks.workunit.client.1.smithi100.stdout:8/745: fdatasync d6/d20/d50/fb3 0 2024-04-27T07:33:42.658 INFO:tasks.workunit.client.1.smithi100.stdout:0/761: chown d1/d8/d20/d61/d66/fc1 110 1 2024-04-27T07:33:42.660 INFO:tasks.workunit.client.1.smithi100.stdout:3/863: write d7/d9/d10/d33/d90/d3a/feb [720443,72254] 0 2024-04-27T07:33:42.662 INFO:tasks.workunit.client.1.smithi100.stdout:9/810: symlink d1/d9/db/da1/l114 0 2024-04-27T07:33:42.664 INFO:tasks.workunit.client.1.smithi100.stdout:2/734: rename d0/da/fd to d0/da/d29/d47/d5a/ff7 0 2024-04-27T07:33:42.665 INFO:tasks.workunit.client.1.smithi100.stdout:6/867: read de/f5c [1732928,124003] 0 2024-04-27T07:33:42.666 INFO:tasks.workunit.client.1.smithi100.stdout:4/832: creat d5/d16/d19/dca/de0/f11d x:0 0 0 2024-04-27T07:33:42.667 INFO:tasks.workunit.client.1.smithi100.stdout:9/811: write d1/d76/dd6/fde [1329883,89441] 0 2024-04-27T07:33:42.668 INFO:tasks.workunit.client.1.smithi100.stdout:6/868: readlink de/d2e/l45 0 2024-04-27T07:33:42.669 INFO:tasks.workunit.client.1.smithi100.stdout:4/833: dread - d5/d23/fa6 zero size 2024-04-27T07:33:42.669 INFO:tasks.workunit.client.1.smithi100.stdout:8/746: symlink d6/d20/d50/d72/da4/le9 0 2024-04-27T07:33:42.673 INFO:tasks.workunit.client.1.smithi100.stdout:0/762: dwrite d1/d8/d14/d59/fb5 [0,4194304] 0 2024-04-27T07:33:42.673 INFO:tasks.workunit.client.1.smithi100.stdout:9/812: chown d1/d9/db/d2b/d4f/dac/f7c 39 1 2024-04-27T07:33:42.673 INFO:tasks.workunit.client.1.smithi100.stdout:3/864: fsync d7/d9/d10/d3e/d55/f100 0 2024-04-27T07:33:42.676 INFO:tasks.workunit.client.1.smithi100.stdout:5/690: write d0/d4/d21/d24/f5a [856110,31549] 0 2024-04-27T07:33:42.677 INFO:tasks.workunit.client.1.smithi100.stdout:2/735: read - d0/da/d29/d47/d5a/d8d/fa9 zero size 2024-04-27T07:33:42.681 INFO:tasks.workunit.client.1.smithi100.stdout:6/869: mknod de/d58/d21/d24/d9f/db9/d121/c127 0 2024-04-27T07:33:42.683 INFO:tasks.workunit.client.1.smithi100.stdout:9/813: creat d1/d9/db/d2b/d4f/d91/f115 x:0 0 0 2024-04-27T07:33:42.686 INFO:tasks.workunit.client.1.smithi100.stdout:8/747: rename d6/d20/d50/cc6 to d6/dda/cea 0 2024-04-27T07:33:42.689 INFO:tasks.workunit.client.1.smithi100.stdout:8/748: readlink d6/d20/d50/d72/lb5 0 2024-04-27T07:33:42.690 INFO:tasks.workunit.client.1.smithi100.stdout:2/736: dwrite d0/d79/d94/dbc/d98/db1/fb8 [0,4194304] 0 2024-04-27T07:33:42.690 INFO:tasks.workunit.client.1.smithi100.stdout:7/731: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:42.693 INFO:tasks.workunit.client.1.smithi100.stdout:3/865: rename d7/d9/d10/d3e/d74/fdc to d7/d9/d10/d33/d90/d3a/f108 0 2024-04-27T07:33:42.694 INFO:tasks.workunit.client.1.smithi100.stdout:5/691: symlink d0/d4/d21/d24/d2f/d57/ldc 0 2024-04-27T07:33:42.699 INFO:tasks.workunit.client.1.smithi100.stdout:4/834: dread d5/d16/d4c/f7f [0,4194304] 0 2024-04-27T07:33:42.700 INFO:tasks.workunit.client.1.smithi100.stdout:4/835: dread - d5/d16/d19/d21/d6d/dad/f117 zero size 2024-04-27T07:33:42.700 INFO:tasks.workunit.client.1.smithi100.stdout:5/692: mknod d0/d42/d94/d97/d60/dc4/d99/dc9/cdd 0 2024-04-27T07:33:42.702 INFO:tasks.workunit.client.1.smithi100.stdout:0/763: dread d1/d8/d14/f41 [0,4194304] 0 2024-04-27T07:33:42.703 INFO:tasks.workunit.client.1.smithi100.stdout:0/764: chown d1/d38/cdc 47049879 1 2024-04-27T07:33:42.703 INFO:tasks.workunit.client.1.smithi100.stdout:3/866: rename d7/d9/d26/d2a/f87 to d7/d9/d10/d3e/df3/d103/f109 0 2024-04-27T07:33:42.706 INFO:tasks.workunit.client.1.smithi100.stdout:0/765: truncate d1/d8/d14/d59/d99/fbf 1047164 0 2024-04-27T07:33:42.706 INFO:tasks.workunit.client.1.smithi100.stdout:5/693: dread d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:42.708 INFO:tasks.workunit.client.1.smithi100.stdout:2/737: mknod d0/da/d29/d47/dae/df4/cf8 0 2024-04-27T07:33:42.709 INFO:tasks.workunit.client.1.smithi100.stdout:0/766: write d1/d8/d20/f7b [4520197,104588] 0 2024-04-27T07:33:42.714 INFO:tasks.workunit.client.1.smithi100.stdout:5/694: dread d0/d4/d21/d24/d2f/d57/d37/d1a/f4e [0,4194304] 0 2024-04-27T07:33:42.716 INFO:tasks.workunit.client.1.smithi100.stdout:4/836: rename d5/d16/d19/d21/d2b to d5/d16/d19/d46/dd1/d11e 0 2024-04-27T07:33:42.717 INFO:tasks.workunit.client.1.smithi100.stdout:2/738: dwrite d0/da/d29/d47/da1/dc3/fed [0,4194304] 0 2024-04-27T07:33:42.717 INFO:tasks.workunit.client.1.smithi100.stdout:9/814: truncate d1/f94 2761476 0 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 -- 172.21.15.82:0/394802755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 msgr2=0x7fe9a8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 --2- 172.21.15.82:0/394802755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a8102380 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe990004940 tx=0x7fe990009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 -- 172.21.15.82:0/394802755 shutdown_connections 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 --2- 172.21.15.82:0/394802755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a8102380 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 --2- 172.21.15.82:0/394802755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9a8066200 0x7fe9a80ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 -- 172.21.15.82:0/394802755 >> 172.21.15.82:0/394802755 conn(0x7fe9a80f7430 msgr2=0x7fe9a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.715+0000 7fe9aca21700 1 -- 172.21.15.82:0/394802755 shutdown_connections 2024-04-27T07:33:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.716+0000 7fe9aca21700 1 -- 172.21.15.82:0/394802755 wait complete. 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.716+0000 7fe9aca21700 1 Processor -- start 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.716+0000 7fe9aca21700 1 -- start start 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe9aca21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9a8066200 0x7fe9a810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe9aca21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe9aca21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810e520 con 0x7fe9a80fffa0 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe9aca21700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a810ed20 con 0x7fe9a8066200 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48772/0 (socket says 172.21.15.82:48772) 2024-04-27T07:33:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 -- 172.21.15.82:0/728444811 learned_addr learned my addr 172.21.15.82:0/728444811 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:33:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 -- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9a8066200 msgr2=0x7fe9a810d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9a8066200 0x7fe9a810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.717+0000 7fe99ffff700 1 -- 172.21.15.82:0/728444811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990005040 con 0x7fe9a80fffa0 2024-04-27T07:33:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.718+0000 7fe99ffff700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe990004090 tx=0x7fe990009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:42.722 INFO:tasks.workunit.client.1.smithi100.stdout:2/739: dread - d0/d79/d94/dbc/d98/db1/f6f zero size 2024-04-27T07:33:42.722 INFO:tasks.workunit.client.1.smithi100.stdout:6/870: truncate de/d58/d21/dfd/f126 980574 0 2024-04-27T07:33:42.722 INFO:tasks.workunit.client.1.smithi100.stdout:8/749: link d6/d20/d2a/c53 d6/dda/ceb 0 2024-04-27T07:33:42.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.719+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe990021070 con 0x7fe9a80fffa0 2024-04-27T07:33:42.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.719+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe99001c400 con 0x7fe9a80fffa0 2024-04-27T07:33:42.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.719+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99000e070 con 0x7fe9a80fffa0 2024-04-27T07:33:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.719+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a810efa0 con 0x7fe9a80fffa0 2024-04-27T07:33:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.719+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a810f420 con 0x7fe9a80fffa0 2024-04-27T07:33:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.721+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe99001ca20 con 0x7fe9a80fffa0 2024-04-27T07:33:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.721+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a805f5c0 con 0x7fe9a80fffa0 2024-04-27T07:33:42.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.722+0000 7fe99effd700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 0x7fe99406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:33:42.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.722+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe99008bb80 con 0x7fe9a80fffa0 2024-04-27T07:33:42.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.723+0000 7fe9a659c700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 0x7fe99406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:33:42.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.723+0000 7fe9a659c700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 0x7fe99406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8065f40 tx=0x7fe99800b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:33:42.728 INFO:tasks.workunit.client.1.smithi100.stdout:5/695: creat d0/d42/d94/d97/d60/fde x:0 0 0 2024-04-27T07:33:42.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:42.728+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe990058e80 con 0x7fe9a80fffa0 2024-04-27T07:33:42.730 INFO:tasks.workunit.client.1.smithi100.stdout:0/767: rename d1/d8/d14/d59/f81 to d1/d8/d20/df6/f103 0 2024-04-27T07:33:42.731 INFO:tasks.workunit.client.1.smithi100.stdout:7/732: dwrite d1/dd/d16/d2b/f9c [0,4194304] 0 2024-04-27T07:33:42.739 INFO:tasks.workunit.client.1.smithi100.stdout:8/750: dread d6/d20/d50/f74 [0,4194304] 0 2024-04-27T07:33:42.744 INFO:tasks.workunit.client.1.smithi100.stdout:0/768: dread - d1/d8/d20/d61/f9f zero size 2024-04-27T07:33:42.746 INFO:tasks.workunit.client.1.smithi100.stdout:9/815: dwrite d1/d9/db/d56/fbd [0,4194304] 0 2024-04-27T07:33:42.746 INFO:tasks.workunit.client.1.smithi100.stdout:3/867: dwrite d7/d9/d26/f44 [0,4194304] 0 2024-04-27T07:33:42.750 INFO:tasks.workunit.client.1.smithi100.stdout:4/837: mknod d5/d16/d2e/d5a/d11b/c11f 0 2024-04-27T07:33:42.750 INFO:tasks.workunit.client.1.smithi100.stdout:7/733: dread d1/dd/d16/d70/f59 [0,4194304] 0 2024-04-27T07:33:42.758 INFO:tasks.workunit.client.1.smithi100.stdout:6/871: dwrite de/d58/d21/d24/f46 [4194304,4194304] 0 2024-04-27T07:33:42.760 INFO:tasks.workunit.client.1.smithi100.stdout:2/740: link d0/da/d29/d47/cf6 d0/d79/d94/dbc/d98/cf9 0 2024-04-27T07:33:42.760 INFO:tasks.workunit.client.1.smithi100.stdout:4/838: creat d5/d16/d19/df3/f120 x:0 0 0 2024-04-27T07:33:42.762 INFO:tasks.workunit.client.1.smithi100.stdout:0/769: fdatasync d1/d8/fcd 0 2024-04-27T07:33:42.763 INFO:tasks.workunit.client.1.smithi100.stdout:9/816: mknod d1/d9/db/d56/d5c/de3/c116 0 2024-04-27T07:33:42.766 INFO:tasks.workunit.client.1.smithi100.stdout:7/734: truncate d1/dd/d16/d31/d4c/d4d/d3b/f46 829803 0 2024-04-27T07:33:42.768 INFO:tasks.workunit.client.1.smithi100.stdout:2/741: creat d0/d79/d94/dbc/d98/db1/ffa x:0 0 0 2024-04-27T07:33:42.771 INFO:tasks.workunit.client.1.smithi100.stdout:2/742: truncate d0/d79/d94/fbf 2750322 0 2024-04-27T07:33:42.772 INFO:tasks.workunit.client.1.smithi100.stdout:9/817: dwrite d1/d9/db/d2b/d4f/dac/f7c [0,4194304] 0 2024-04-27T07:33:42.781 INFO:tasks.workunit.client.1.smithi100.stdout:3/868: link d7/d9/d10/d3e/d74/l93 d7/d9/d26/l10a 0 2024-04-27T07:33:42.784 INFO:tasks.workunit.client.1.smithi100.stdout:4/839: rename d5/d1b/df8/d7d/c108 to d5/d1b/df8/dd7/c121 0 2024-04-27T07:33:42.784 INFO:tasks.workunit.client.1.smithi100.stdout:8/751: dwrite d6/d1b/d1d/d59/f56 [0,4194304] 0 2024-04-27T07:33:42.787 INFO:tasks.workunit.client.1.smithi100.stdout:4/840: dread - d5/d1b/df8/d7d/d8a/fe7 zero size 2024-04-27T07:33:42.787 INFO:tasks.workunit.client.1.smithi100.stdout:6/872: write de/d58/f22 [734496,126882] 0 2024-04-27T07:33:42.792 INFO:tasks.workunit.client.1.smithi100.stdout:8/752: unlink d6/d20/f84 0 2024-04-27T07:33:42.795 INFO:tasks.workunit.client.1.smithi100.stdout:3/869: symlink d7/d9/d10/d33/d47/d106/l10b 0 2024-04-27T07:33:42.796 INFO:tasks.workunit.client.1.smithi100.stdout:0/770: dread d1/d38/d3a/fd4 [0,4194304] 0 2024-04-27T07:33:42.798 INFO:tasks.workunit.client.1.smithi100.stdout:4/841: rename d5/d16/d19/dca/de0/f11d to d5/d1b/df8/d3f/f122 0 2024-04-27T07:33:42.798 INFO:tasks.workunit.client.1.smithi100.stdout:4/842: stat d5/d16/l91 0 2024-04-27T07:33:42.800 INFO:tasks.workunit.client.1.smithi100.stdout:8/753: creat d6/d20/d8b/d8c/dce/fec x:0 0 0 2024-04-27T07:33:42.800 INFO:tasks.workunit.client.1.smithi100.stdout:2/743: dread d0/da/d29/f23 [0,4194304] 0 2024-04-27T07:33:42.805 INFO:tasks.workunit.client.1.smithi100.stdout:4/843: rmdir d5/d1b/df8/d50/db0 39 2024-04-27T07:33:42.807 INFO:tasks.workunit.client.1.smithi100.stdout:2/744: dread d0/da/d29/d47/d87/f9a [0,4194304] 0 2024-04-27T07:33:42.809 INFO:tasks.workunit.client.1.smithi100.stdout:0/771: mkdir d1/d8/d104 0 2024-04-27T07:33:42.810 INFO:tasks.workunit.client.1.smithi100.stdout:8/754: rename d6/d20/d2a to d6/dda/ded 0 2024-04-27T07:33:42.812 INFO:tasks.workunit.client.1.smithi100.stdout:7/735: dwrite d1/dd/d16/d31/d4c/d4d/d3b/f45 [0,4194304] 0 2024-04-27T07:33:42.814 INFO:tasks.workunit.client.1.smithi100.stdout:4/844: creat d5/d16/d19/d21/d6d/f123 x:0 0 0 2024-04-27T07:33:42.815 INFO:tasks.workunit.client.1.smithi100.stdout:4/845: chown d5/d16/d19/d46/d53/d7e 5975 1 2024-04-27T07:33:42.816 INFO:tasks.workunit.client.1.smithi100.stdout:2/745: fdatasync d0/d79/d94/dbc/f85 0 2024-04-27T07:33:42.819 INFO:tasks.workunit.client.1.smithi100.stdout:8/755: unlink d6/d20/d50/da8/f7f 0 2024-04-27T07:33:42.820 INFO:tasks.workunit.client.1.smithi100.stdout:7/736: chown d1/dd/d2a/c34 0 1 2024-04-27T07:33:42.820 INFO:tasks.workunit.client.1.smithi100.stdout:6/873: dread de/d2e/d3f/f6d [0,4194304] 0 2024-04-27T07:33:42.821 INFO:tasks.workunit.client.1.smithi100.stdout:0/772: fdatasync d1/d8/f7f 0 2024-04-27T07:33:42.828 INFO:tasks.workunit.client.1.smithi100.stdout:6/874: dwrite de/d58/d21/d23/f4b [0,4194304] 0 2024-04-27T07:33:42.829 INFO:tasks.workunit.client.1.smithi100.stdout:0/773: creat d1/d8/d104/f105 x:0 0 0 2024-04-27T07:33:42.831 INFO:tasks.workunit.client.1.smithi100.stdout:4/846: creat d5/d16/d19/d21/f124 x:0 0 0 2024-04-27T07:33:42.834 INFO:tasks.workunit.client.1.smithi100.stdout:3/870: truncate d7/d9/d10/d33/d90/f2e 4983621 0 2024-04-27T07:33:42.835 INFO:tasks.workunit.client.1.smithi100.stdout:8/756: dwrite d6/d20/d8b/f8d [0,4194304] 0 2024-04-27T07:33:42.836 INFO:tasks.workunit.client.1.smithi100.stdout:3/871: readlink d7/d9/d10/d33/d90/d3a/lb6 0 2024-04-27T07:33:42.837 INFO:tasks.workunit.client.1.smithi100.stdout:0/774: symlink d1/d8/d14/d59/d64/l106 0 2024-04-27T07:33:42.837 INFO:tasks.workunit.client.1.smithi100.stdout:8/757: write d6/d1b/d75/fad [163176,78592] 0 2024-04-27T07:33:42.839 INFO:tasks.workunit.client.1.smithi100.stdout:3/872: dread - d7/d9/d10/d33/d90/d3a/ddd/ff9 zero size 2024-04-27T07:33:42.842 INFO:tasks.workunit.client.1.smithi100.stdout:6/875: write de/dfc/fae [289402,82726] 0 2024-04-27T07:33:42.846 INFO:tasks.workunit.client.1.smithi100.stdout:3/873: read d7/d9/d26/d2a/d5e/f72 [1817360,23275] 0 2024-04-27T07:33:42.847 INFO:tasks.workunit.client.1.smithi100.stdout:6/876: creat de/d58/d21/d91/f128 x:0 0 0 2024-04-27T07:33:42.849 INFO:tasks.workunit.client.1.smithi100.stdout:8/758: rename d6/lbe to d6/d1b/lee 0 2024-04-27T07:33:42.851 INFO:tasks.workunit.client.1.smithi100.stdout:6/877: mknod de/c129 0 2024-04-27T07:33:42.851 INFO:tasks.workunit.client.1.smithi100.stdout:2/746: dread d0/da/d29/d47/d87/d88/faa [0,4194304] 0 2024-04-27T07:33:42.852 INFO:tasks.workunit.client.1.smithi100.stdout:6/878: write de/d2e/d3f/f43 [5937250,122755] 0 2024-04-27T07:33:42.852 INFO:tasks.workunit.client.1.smithi100.stdout:3/874: rename d7/d9/d10/c105 to d7/d9/d10/d33/d90/c10c 0 2024-04-27T07:33:42.853 INFO:tasks.workunit.client.1.smithi100.stdout:8/759: mknod d6/d20/d50/d72/daf/cef 0 2024-04-27T07:33:42.854 INFO:tasks.workunit.client.1.smithi100.stdout:6/879: write de/d58/d75/ff5 [890924,78304] 0 2024-04-27T07:33:42.856 INFO:tasks.workunit.client.1.smithi100.stdout:2/747: symlink d0/d79/d94/dbc/d98/db1/lfb 0 2024-04-27T07:33:42.857 INFO:tasks.workunit.client.1.smithi100.stdout:2/748: chown d0/da/d29/d47/dae/df4/cf8 1777597 1 2024-04-27T07:33:42.858 INFO:tasks.workunit.client.1.smithi100.stdout:3/875: mknod d7/d9/d10/d3e/d74/da8/c10d 0 2024-04-27T07:33:42.859 INFO:tasks.workunit.client.1.smithi100.stdout:6/880: creat de/d58/d21/d91/f12a x:0 0 0 2024-04-27T07:33:42.862 INFO:tasks.workunit.client.1.smithi100.stdout:2/749: rmdir d0/da/d29/d47/d87/d88 39 2024-04-27T07:33:42.864 INFO:tasks.workunit.client.1.smithi100.stdout:3/876: mknod d7/d9/d26/d2a/d5e/c10e 0 2024-04-27T07:33:42.867 INFO:tasks.workunit.client.1.smithi100.stdout:6/881: dwrite de/d2e/d86/f93 [0,4194304] 0 2024-04-27T07:33:42.868 INFO:tasks.workunit.client.1.smithi100.stdout:8/760: dread d6/dda/ded/f65 [0,4194304] 0 2024-04-27T07:33:42.869 INFO:tasks.workunit.client.1.smithi100.stdout:3/877: mknod d7/d9/d10/d3e/d91/c10f 0 2024-04-27T07:33:42.870 INFO:tasks.workunit.client.1.smithi100.stdout:8/761: chown d6/d20/da2/db0/l5e 3835 1 2024-04-27T07:33:42.871 INFO:tasks.workunit.client.1.smithi100.stdout:6/882: creat de/d2e/d3f/d80/f12b x:0 0 0 2024-04-27T07:33:42.878 INFO:tasks.workunit.client.1.smithi100.stdout:2/750: getdents d0/da/d29/d47/da1/dc3 0 2024-04-27T07:33:42.882 INFO:tasks.workunit.client.1.smithi100.stdout:6/883: dwrite de/d2e/d3f/d80/f12b [0,4194304] 0 2024-04-27T07:33:42.883 INFO:tasks.workunit.client.1.smithi100.stdout:8/762: dwrite d6/d20/d54/d91/dae/fdf [0,4194304] 0 2024-04-27T07:33:42.887 INFO:tasks.workunit.client.1.smithi100.stdout:3/878: write d7/d9/d10/d28/db0/fbe [411371,12977] 0 2024-04-27T07:33:42.888 INFO:tasks.workunit.client.1.smithi100.stdout:2/751: write d0/da/d29/d47/d87/d88/faa [1585515,38946] 0 2024-04-27T07:33:42.891 INFO:tasks.workunit.client.1.smithi100.stdout:2/752: rmdir d0/d79/da7 39 2024-04-27T07:33:42.892 INFO:tasks.workunit.client.1.smithi100.stdout:6/884: truncate de/d58/d28/f47 330457 0 2024-04-27T07:33:42.894 INFO:tasks.workunit.client.1.smithi100.stdout:6/885: symlink de/dfc/l12c 0 2024-04-27T07:33:42.898 INFO:tasks.workunit.client.1.smithi100.stdout:3/879: dwrite d7/d9/d10/d22/fe8 [0,4194304] 0 2024-04-27T07:33:42.899 INFO:tasks.workunit.client.1.smithi100.stdout:3/880: chown d7/d9/d10/d3e/d74/da8 198 1 2024-04-27T07:33:42.903 INFO:tasks.workunit.client.1.smithi100.stdout:3/881: creat d7/d9/f110 x:0 0 0 2024-04-27T07:33:42.905 INFO:tasks.workunit.client.1.smithi100.stdout:3/882: write d7/d9/d26/f38 [1956094,24555] 0 2024-04-27T07:33:42.905 INFO:tasks.workunit.client.1.smithi100.stdout:8/763: write d6/d20/d54/d91/fe2 [91319,26800] 0 2024-04-27T07:33:42.908 INFO:tasks.workunit.client.1.smithi100.stdout:3/883: creat d7/d9/d26/f111 x:0 0 0 2024-04-27T07:33:42.911 INFO:tasks.workunit.client.1.smithi100.stdout:8/764: link d6/d20/d54/d91/fc7 d6/dda/ded/ff0 0 2024-04-27T07:33:42.911 INFO:tasks.workunit.client.1.smithi100.stdout:1/861: sync 2024-04-27T07:33:42.912 INFO:tasks.workunit.client.1.smithi100.stdout:3/884: mkdir d7/d9/d10/d28/d112 0 2024-04-27T07:33:42.916 INFO:tasks.workunit.client.1.smithi100.stdout:1/862: mknod d0/d23/d113/c11d 0 2024-04-27T07:33:42.917 INFO:tasks.workunit.client.1.smithi100.stdout:8/765: truncate d6/f18 4455254 0 2024-04-27T07:33:42.919 INFO:tasks.workunit.client.1.smithi100.stdout:6/886: dwrite de/d58/d21/d24/d9f/fbf [0,4194304] 0 2024-04-27T07:33:42.922 INFO:tasks.workunit.client.1.smithi100.stdout:8/766: readlink d6/l12 0 2024-04-27T07:33:42.923 INFO:tasks.workunit.client.1.smithi100.stdout:2/753: dread d0/da/d29/d47/d87/fcc [0,4194304] 0 2024-04-27T07:33:42.925 INFO:tasks.workunit.client.1.smithi100.stdout:8/767: fdatasync d6/f45 0 2024-04-27T07:33:42.925 INFO:tasks.workunit.client.1.smithi100.stdout:6/887: symlink de/d58/d21/d23/l12d 0 2024-04-27T07:33:42.925 INFO:tasks.workunit.client.1.smithi100.stdout:3/885: dwrite d7/d9/d10/d33/d90/d3a/feb [0,4194304] 0 2024-04-27T07:33:42.928 INFO:tasks.workunit.client.1.smithi100.stdout:2/754: write d0/da/f50 [1693428,24425] 0 2024-04-27T07:33:42.930 INFO:tasks.workunit.client.1.smithi100.stdout:3/886: chown d7/d9/d10/d3e/d91 132420945 1 2024-04-27T07:33:42.931 INFO:tasks.workunit.client.1.smithi100.stdout:1/863: dwrite d0/fda [0,4194304] 0 2024-04-27T07:33:42.931 INFO:tasks.workunit.client.1.smithi100.stdout:8/768: truncate d6/d1b/d75/fad 1144515 0 2024-04-27T07:33:42.934 INFO:tasks.workunit.client.1.smithi100.stdout:8/769: chown d6/d20/da2/db0/l7b 2026017 1 2024-04-27T07:33:42.937 INFO:tasks.workunit.client.1.smithi100.stdout:1/864: dread - d0/d1f/d6d/dc7/de1/ff3 zero size 2024-04-27T07:33:42.938 INFO:tasks.workunit.client.1.smithi100.stdout:6/888: rename de/d58/d90/fe7 to de/d2e/f12e 0 2024-04-27T07:33:42.940 INFO:tasks.workunit.client.1.smithi100.stdout:2/755: unlink d0/da/d29/d47/d87/d8b/la0 0 2024-04-27T07:33:42.944 INFO:tasks.workunit.client.1.smithi100.stdout:1/865: stat d0/d1f/d6d/db4/d40/lab 0 2024-04-27T07:33:42.944 INFO:tasks.workunit.client.1.smithi100.stdout:6/889: symlink de/d2e/dc0/l12f 0 2024-04-27T07:33:42.946 INFO:tasks.workunit.client.1.smithi100.stdout:2/756: chown d0/da/d29/d47/d5a/cdf 11027639 1 2024-04-27T07:33:42.949 INFO:tasks.workunit.client.1.smithi100.stdout:3/887: link d7/d9/d10/d22/c6f d7/da9/c113 0 2024-04-27T07:33:42.950 INFO:tasks.workunit.client.1.smithi100.stdout:1/866: truncate d0/d1b/d20/f57 1917512 0 2024-04-27T07:33:42.951 INFO:tasks.workunit.client.1.smithi100.stdout:2/757: rename d0/d79/d94/dbc/d98/db1/ffa to d0/da/d29/d47/d87/d88/ddd/ffc 0 2024-04-27T07:33:42.954 INFO:tasks.workunit.client.1.smithi100.stdout:2/758: readlink d0/da/d29/d47/d87/d88/lef 0 2024-04-27T07:33:42.957 INFO:tasks.workunit.client.1.smithi100.stdout:3/888: rename d7/d9/d26/f111 to d7/f114 0 2024-04-27T07:33:42.958 INFO:tasks.workunit.client.1.smithi100.stdout:2/759: symlink d0/da/d29/d47/da1/dc3/lfd 0 2024-04-27T07:33:42.959 INFO:tasks.workunit.client.1.smithi100.stdout:2/760: fsync d0/da/feb 0 2024-04-27T07:33:42.960 INFO:tasks.workunit.client.1.smithi100.stdout:8/770: write d6/d1b/d1d/f2c [2071151,27643] 0 2024-04-27T07:33:42.961 INFO:tasks.workunit.client.1.smithi100.stdout:8/771: chown d6/d1b/d75/fba 94394197 1 2024-04-27T07:33:42.962 INFO:tasks.workunit.client.1.smithi100.stdout:2/761: mknod d0/d79/d94/dbc/cfe 0 2024-04-27T07:33:42.963 INFO:tasks.workunit.client.1.smithi100.stdout:2/762: chown d0/d79/d94/dbc/d98/db1 0 1 2024-04-27T07:33:42.965 INFO:tasks.workunit.client.1.smithi100.stdout:8/772: creat d6/d20/d8b/d8c/ff1 x:0 0 0 2024-04-27T07:33:42.968 INFO:tasks.workunit.client.1.smithi100.stdout:6/890: dwrite de/d58/d21/fb2 [0,4194304] 0 2024-04-27T07:33:42.970 INFO:tasks.workunit.client.1.smithi100.stdout:3/889: getdents d7/dad/daf 0 2024-04-27T07:33:42.971 INFO:tasks.workunit.client.1.smithi100.stdout:6/891: chown de/d58/d75/f8f 0 1 2024-04-27T07:33:42.974 INFO:tasks.workunit.client.1.smithi100.stdout:1/867: dwrite d0/d1b/d20/d2d/f52 [0,4194304] 0 2024-04-27T07:33:42.975 INFO:tasks.workunit.client.1.smithi100.stdout:6/892: rename de/f11 to de/f130 0 2024-04-27T07:33:42.975 INFO:tasks.workunit.client.1.smithi100.stdout:2/763: write d0/d79/d94/dbc/f85 [680307,27663] 0 2024-04-27T07:33:42.980 INFO:tasks.workunit.client.1.smithi100.stdout:1/868: mknod d0/d1f/d6d/dc7/c11e 0 2024-04-27T07:33:42.980 INFO:tasks.workunit.client.1.smithi100.stdout:8/773: dwrite d6/f41 [0,4194304] 0 2024-04-27T07:33:42.983 INFO:tasks.workunit.client.1.smithi100.stdout:6/893: fdatasync de/d58/d21/d24/d9f/db9/fd9 0 2024-04-27T07:33:42.985 INFO:tasks.workunit.client.1.smithi100.stdout:8/774: readlink d6/d1b/d75/ld8 0 2024-04-27T07:33:42.987 INFO:tasks.workunit.client.1.smithi100.stdout:6/894: mkdir de/d58/d21/d23/da0/d131 0 2024-04-27T07:33:42.987 INFO:tasks.workunit.client.1.smithi100.stdout:2/764: getdents d0/da/d29/d47/dae/df4 0 2024-04-27T07:33:42.989 INFO:tasks.workunit.client.1.smithi100.stdout:6/895: truncate de/d2e/d3f/d80/f9e 4390761 0 2024-04-27T07:33:42.989 INFO:tasks.workunit.client.1.smithi100.stdout:8/775: symlink d6/d20/d50/d72/lf2 0 2024-04-27T07:33:42.991 INFO:tasks.workunit.client.1.smithi100.stdout:2/765: write d0/f12 [2253069,56784] 0 2024-04-27T07:33:42.991 INFO:tasks.workunit.client.1.smithi100.stdout:1/869: getdents d0/d1f/d6d/db4/d6c 0 2024-04-27T07:33:42.994 INFO:tasks.workunit.client.1.smithi100.stdout:1/870: chown d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/d107 62 1 2024-04-27T07:33:42.994 INFO:tasks.workunit.client.1.smithi100.stdout:8/776: unlink d6/d20/d8b/d8c/dce/cbc 0 2024-04-27T07:33:42.995 INFO:tasks.workunit.client.1.smithi100.stdout:1/871: readlink d0/d1b/d20/d2d/d35/d4d/d60/d79/l8d 0 2024-04-27T07:33:42.998 INFO:tasks.workunit.client.1.smithi100.stdout:6/896: rename de/d58/d21/d24/d9f/db9 to de/d2e/d132 0 2024-04-27T07:33:42.998 INFO:tasks.workunit.client.1.smithi100.stdout:2/766: dread d0/da/d29/d47/da1/da3/f65 [0,4194304] 0 2024-04-27T07:33:42.998 INFO:tasks.workunit.client.1.smithi100.stdout:1/872: readlink d0/d1f/l42 0 2024-04-27T07:33:43.000 INFO:tasks.workunit.client.1.smithi100.stdout:1/873: dread - d0/d1b/f105 zero size 2024-04-27T07:33:43.002 INFO:tasks.workunit.client.1.smithi100.stdout:8/777: dwrite d6/d20/fa5 [0,4194304] 0 2024-04-27T07:33:43.005 INFO:tasks.workunit.client.1.smithi100.stdout:1/874: mknod d0/d1f/d6d/db4/d4e/d7b/ddd/c11f 0 2024-04-27T07:33:43.006 INFO:tasks.workunit.client.1.smithi100.stdout:8/778: mkdir d6/d20/d54/d91/dae/df3 0 2024-04-27T07:33:43.011 INFO:tasks.workunit.client.1.smithi100.stdout:1/875: rename d0/d1f/d6d/db4/d4e/c7e to d0/d1b/d20/d2d/d35/d65/c120 0 2024-04-27T07:33:43.028 INFO:tasks.workunit.client.1.smithi100.stdout:6/897: dread de/d58/d21/d23/f3e [0,4194304] 0 2024-04-27T07:33:43.032 INFO:tasks.workunit.client.1.smithi100.stdout:1/876: dwrite d0/d1b/f2f [0,4194304] 0 2024-04-27T07:33:43.033 INFO:tasks.workunit.client.1.smithi100.stdout:8/779: dread d6/f8 [0,4194304] 0 2024-04-27T07:33:43.039 INFO:tasks.workunit.client.1.smithi100.stdout:1/877: dwrite d0/d23/d3a/f59 [0,4194304] 0 2024-04-27T07:33:43.042 INFO:tasks.workunit.client.1.smithi100.stdout:8/780: mkdir d6/d20/d8b/d8c/dce/df4 0 2024-04-27T07:33:43.053 INFO:tasks.workunit.client.1.smithi100.stdout:6/898: dread de/d58/f36 [0,4194304] 0 2024-04-27T07:33:43.056 INFO:tasks.workunit.client.1.smithi100.stdout:8/781: truncate d6/f27 4975524 0 2024-04-27T07:33:43.059 INFO:tasks.workunit.client.1.smithi100.stdout:8/782: rmdir d6/d20/d8b/d8c/dce 39 2024-04-27T07:33:43.061 INFO:tasks.workunit.client.1.smithi100.stdout:6/899: dwrite f8 [0,4194304] 0 2024-04-27T07:33:43.061 INFO:tasks.workunit.client.1.smithi100.stdout:1/878: dwrite d0/d1b/d20/d2d/d35/d4d/d60/da4/fd0 [0,4194304] 0 2024-04-27T07:33:43.066 INFO:tasks.workunit.client.1.smithi100.stdout:6/900: chown de/d58/d21/d24/d9f/fbc 740247 1 2024-04-27T07:33:43.069 INFO:tasks.workunit.client.1.smithi100.stdout:8/783: dread d6/d1b/d1d/d59/f56 [0,4194304] 0 2024-04-27T07:33:43.073 INFO:tasks.workunit.client.1.smithi100.stdout:6/901: mknod de/d58/d21/d5b/c133 0 2024-04-27T07:33:43.074 INFO:tasks.workunit.client.1.smithi100.stdout:8/784: symlink d6/d20/d50/d72/lf5 0 2024-04-27T07:33:43.075 INFO:tasks.workunit.client.1.smithi100.stdout:6/902: stat de/d2e/dc0/c114 0 2024-04-27T07:33:43.091 INFO:tasks.workunit.client.1.smithi100.stdout:6/903: dread de/d2e/d86/fb8 [0,4194304] 0 2024-04-27T07:33:43.092 INFO:tasks.workunit.client.1.smithi100.stdout:6/904: stat de/d58/d28/l4e 0 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2954258706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:33:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:42 smithi082 ceph-mon[26613]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:43.097 INFO:tasks.workunit.client.1.smithi100.stdout:6/905: rename de/d58/d75 to de/d109/d134 0 2024-04-27T07:33:43.100 INFO:tasks.workunit.client.1.smithi100.stdout:6/906: creat de/d58/d21/d91/df0/f135 x:0 0 0 2024-04-27T07:33:43.101 INFO:tasks.workunit.client.1.smithi100.stdout:1/879: truncate d0/d1f/d6d/db4/d4e/d7b/fcf 3881027 0 2024-04-27T07:33:43.102 INFO:tasks.workunit.client.1.smithi100.stdout:8/785: dread d6/d1b/d75/faa [0,4194304] 0 2024-04-27T07:33:43.102 INFO:tasks.workunit.client.1.smithi100.stdout:6/907: write de/d2e/d86/f9a [4453177,6589] 0 2024-04-27T07:33:43.105 INFO:tasks.workunit.client.1.smithi100.stdout:8/786: dread d6/d1b/d1d/d59/fb4 [0,4194304] 0 2024-04-27T07:33:43.107 INFO:tasks.workunit.client.1.smithi100.stdout:1/880: rename d0/d1b/d20/d2d/d35/l8e to d0/d1b/d20/d2d/d35/d4d/d60/dcd/l121 0 2024-04-27T07:33:43.108 INFO:tasks.workunit.client.1.smithi100.stdout:6/908: dwrite de/f69 [0,4194304] 0 2024-04-27T07:33:43.113 INFO:tasks.workunit.client.1.smithi100.stdout:8/787: mknod d6/d20/d8b/d8c/cf6 0 2024-04-27T07:33:43.113 INFO:tasks.workunit.client.1.smithi100.stdout:5/696: sync 2024-04-27T07:33:43.113 INFO:tasks.workunit.client.1.smithi100.stdout:6/909: fsync de/d58/d21/f85 0 2024-04-27T07:33:43.114 INFO:tasks.workunit.client.1.smithi100.stdout:1/881: dread d0/d1f/f2b [0,4194304] 0 2024-04-27T07:33:43.115 INFO:tasks.workunit.client.1.smithi100.stdout:6/910: dread - de/f95 zero size 2024-04-27T07:33:43.116 INFO:tasks.workunit.client.1.smithi100.stdout:5/697: readlink d0/d42/d94/d97/d60/dc4/d99/dc9/ld5 0 2024-04-27T07:33:43.119 INFO:tasks.workunit.client.1.smithi100.stdout:8/788: unlink d6/d1b/d75/c97 0 2024-04-27T07:33:43.122 INFO:tasks.workunit.client.1.smithi100.stdout:5/698: rmdir d0/d4/d21/d24/d2f/db5 39 2024-04-27T07:33:43.123 INFO:tasks.workunit.client.1.smithi100.stdout:5/699: stat d0/d4/d21/d24/d2f/d57/f55 0 2024-04-27T07:33:43.125 INFO:tasks.workunit.client.1.smithi100.stdout:1/882: creat d0/d23/f122 x:0 0 0 2024-04-27T07:33:43.130 INFO:tasks.workunit.client.1.smithi100.stdout:5/700: dread d0/d42/f9b [0,4194304] 0 2024-04-27T07:33:43.132 INFO:tasks.workunit.client.1.smithi100.stdout:6/911: link de/d58/d21/d23/d73/l123 de/d58/d21/dfd/l136 0 2024-04-27T07:33:43.134 INFO:tasks.workunit.client.1.smithi100.stdout:1/883: dwrite d0/fe4 [0,4194304] 0 2024-04-27T07:33:43.134 INFO:tasks.workunit.client.1.smithi100.stdout:8/789: getdents d6/d1b 0 2024-04-27T07:33:43.134 INFO:tasks.workunit.client.1.smithi100.stdout:5/701: stat d0/d4/d21/d24/d2f/d57/d37/d48 0 2024-04-27T07:33:43.136 INFO:tasks.workunit.client.1.smithi100.stdout:6/912: write de/d58/d21/d91/df0/f116 [768065,7437] 0 2024-04-27T07:33:43.141 INFO:tasks.workunit.client.1.smithi100.stdout:6/913: creat de/d2e/dc0/f137 x:0 0 0 2024-04-27T07:33:43.142 INFO:tasks.workunit.client.1.smithi100.stdout:8/790: mkdir d6/d1b/d1d/d59/d94/ddb/df7 0 2024-04-27T07:33:43.144 INFO:tasks.workunit.client.1.smithi100.stdout:1/884: creat d0/d1f/d6d/db4/f123 x:0 0 0 2024-04-27T07:33:43.145 INFO:tasks.workunit.client.1.smithi100.stdout:5/702: dwrite d0/d4/d21/d24/d2f/db5/fdb [0,4194304] 0 2024-04-27T07:33:43.148 INFO:tasks.workunit.client.1.smithi100.stdout:8/791: creat d6/d20/d54/d91/d9e/ff8 x:0 0 0 2024-04-27T07:33:43.153 INFO:tasks.workunit.client.1.smithi100.stdout:5/703: link d0/d4/d21/d24/d2f/d57/d37/d1a/d30/l33 d0/d42/d94/d97/d60/dc4/d9d/ldf 0 2024-04-27T07:33:43.156 INFO:tasks.workunit.client.1.smithi100.stdout:1/885: dread d0/d1b/d20/d2d/d35/d4d/d60/fbd [0,4194304] 0 2024-04-27T07:33:43.157 INFO:tasks.workunit.client.1.smithi100.stdout:1/886: dread - d0/d23/d3a/f11c zero size 2024-04-27T07:33:43.159 INFO:tasks.workunit.client.1.smithi100.stdout:5/704: rename d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/cab to d0/d4/d21/d24/d2f/d57/d37/d1a/d30/ce0 0 2024-04-27T07:33:43.162 INFO:tasks.workunit.client.1.smithi100.stdout:5/705: mkdir d0/d4/d21/d24/de1 0 2024-04-27T07:33:43.162 INFO:tasks.workunit.client.1.smithi100.stdout:5/706: readlink d0/l13 0 2024-04-27T07:33:43.163 INFO:tasks.workunit.client.1.smithi100.stdout:1/887: getdents d0/d1f/d6d/db4/d4e/d7b/ddd 0 2024-04-27T07:33:43.164 INFO:tasks.workunit.client.1.smithi100.stdout:1/888: stat d0/d1f/d6d/db4/d4e/d7b/ddd 0 2024-04-27T07:33:43.165 INFO:tasks.workunit.client.1.smithi100.stdout:5/707: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fbd 716220 0 2024-04-27T07:33:43.166 INFO:tasks.workunit.client.1.smithi100.stdout:8/792: write d6/d1b/d75/faa [1607348,39051] 0 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2954258706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:33:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:42 smithi100 ceph-mon[34183]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:33:43.172 INFO:tasks.workunit.client.1.smithi100.stdout:5/708: rename d0/d4/d21/d24/d2f/d57/d37/d1a/d31/l95 to d0/d4/d21/d51/le2 0 2024-04-27T07:33:43.173 INFO:tasks.workunit.client.1.smithi100.stdout:1/889: write d0/f3d [3159458,37540] 0 2024-04-27T07:33:43.175 INFO:tasks.workunit.client.1.smithi100.stdout:5/709: creat d0/d42/d94/d97/d60/dc4/d9d/fe3 x:0 0 0 2024-04-27T07:33:43.176 INFO:tasks.workunit.client.1.smithi100.stdout:1/890: creat d0/d23/d113/f124 x:0 0 0 2024-04-27T07:33:43.178 INFO:tasks.workunit.client.1.smithi100.stdout:8/793: dwrite d6/d20/f33 [0,4194304] 0 2024-04-27T07:33:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.176+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9a81058a0 con 0x7fe9a80fffa0 2024-04-27T07:33:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.177+0000 7fe99effd700 1 -- 172.21.15.82:0/728444811 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe990058a10 con 0x7fe9a80fffa0 2024-04-27T07:33:43.180 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:33:43.180 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:33:43.180 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:33:43.180 INFO:tasks.workunit.client.1.smithi100.stdout:5/710: creat d0/d4/d21/d24/d2f/d39/d56/fe4 x:0 0 0 2024-04-27T07:33:43.181 INFO:tasks.workunit.client.1.smithi100.stdout:8/794: truncate d6/d20/d50/fb3 1029188 0 2024-04-27T07:33:43.182 INFO:tasks.workunit.client.1.smithi100.stdout:8/795: readlink d6/d1b/l78 0 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.180+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 msgr2=0x7fe99406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.180+0000 7fe9aca21700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 0x7fe99406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8065f40 tx=0x7fe99800b040 comp rx=0 tx=0).stop 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.180+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 msgr2=0x7fe9a810df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.180+0000 7fe9aca21700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe990004090 tx=0x7fe990009e30 comp rx=0 tx=0).stop 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 shutdown_connections 2024-04-27T07:33:43.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe99406bdb0 0x7fe99406e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:43.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9a8066200 0x7fe9a810d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:43.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 --2- 172.21.15.82:0/728444811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9a80fffa0 0x7fe9a810df20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:33:43.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 >> 172.21.15.82:0/728444811 conn(0x7fe9a80f7430 msgr2=0x7fe9a80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:33:43.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 shutdown_connections 2024-04-27T07:33:43.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:33:43.181+0000 7fe9aca21700 1 -- 172.21.15.82:0/728444811 wait complete. 2024-04-27T07:33:43.184 INFO:tasks.workunit.client.1.smithi100.stdout:8/796: fdatasync d6/d20/d8b/d8c/ff1 0 2024-04-27T07:33:43.185 INFO:tasks.workunit.client.1.smithi100.stdout:1/891: dwrite d0/d1b/d20/feb [0,4194304] 0 2024-04-27T07:33:43.189 INFO:tasks.workunit.client.1.smithi100.stdout:8/797: creat d6/dda/ff9 x:0 0 0 2024-04-27T07:33:43.190 INFO:tasks.workunit.client.1.smithi100.stdout:5/711: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/f8e [0,4194304] 0 2024-04-27T07:33:43.192 INFO:tasks.workunit.client.1.smithi100.stdout:1/892: mknod d0/d1f/d6d/db4/d40/c125 0 2024-04-27T07:33:43.195 INFO:tasks.workunit.client.1.smithi100.stdout:5/712: getdents d0/d4/d21/d24/d2f/d57/d37/d1a/d31 0 2024-04-27T07:33:43.196 INFO:tasks.workunit.client.1.smithi100.stdout:1/893: truncate d0/d1b/d20/d2d/d35/d65/fc6 459285 0 2024-04-27T07:33:43.196 INFO:tasks.workunit.client.1.smithi100.stdout:5/713: rmdir d0/d42/d94/d97 39 2024-04-27T07:33:43.198 INFO:tasks.workunit.client.1.smithi100.stdout:5/714: dread d0/d42/f9b [0,4194304] 0 2024-04-27T07:33:43.222 INFO:tasks.workunit.client.1.smithi100.stdout:1/894: link d0/d1f/d6d/dc7/fcc d0/d1f/d6d/db4/d6c/f126 0 2024-04-27T07:33:43.223 INFO:tasks.workunit.client.1.smithi100.stdout:5/715: chown d0/d4/d21/d24/d2f/d57/d37/d48/c7b 1737 1 2024-04-27T07:33:43.224 INFO:tasks.workunit.client.1.smithi100.stdout:5/716: dread - d0/fcb zero size 2024-04-27T07:33:43.228 INFO:tasks.workunit.client.1.smithi100.stdout:5/717: read d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 [409067,41087] 0 2024-04-27T07:33:43.230 INFO:tasks.workunit.client.1.smithi100.stdout:5/718: mkdir d0/d4/d21/d24/de1/de5 0 2024-04-27T07:33:43.235 INFO:tasks.workunit.client.1.smithi100.stdout:5/719: creat d0/d42/d94/d97/d60/dc4/d99/da0/fe6 x:0 0 0 2024-04-27T07:33:43.237 INFO:tasks.workunit.client.1.smithi100.stdout:1/895: dwrite d0/d1f/d6d/dc7/fcc [0,4194304] 0 2024-04-27T07:33:43.238 INFO:tasks.workunit.client.1.smithi100.stdout:5/720: creat d0/d42/d94/d97/d60/dc4/d99/fe7 x:0 0 0 2024-04-27T07:33:43.238 INFO:tasks.workunit.client.1.smithi100.stdout:1/896: chown d0/d1b/da1/fb0 52703230 1 2024-04-27T07:33:43.247 INFO:tasks.workunit.client.1.smithi100.stdout:1/897: truncate d0/d1f/d6d/db4/d40/fe3 1938186 0 2024-04-27T07:33:43.248 INFO:tasks.workunit.client.1.smithi100.stdout:5/721: dwrite d0/d4/d21/d24/d2f/d39/d56/fd2 [0,4194304] 0 2024-04-27T07:33:43.252 INFO:tasks.workunit.client.1.smithi100.stdout:5/722: rmdir d0/d4/d21/d24/de1/de5 0 2024-04-27T07:33:43.258 INFO:tasks.workunit.client.1.smithi100.stdout:1/898: truncate d0/d1f/d6d/dc7/fcc 1509202 0 2024-04-27T07:33:43.260 INFO:tasks.workunit.client.1.smithi100.stdout:5/723: dwrite d0/d4/d21/d24/d2f/d57/d37/f3f [0,4194304] 0 2024-04-27T07:33:43.260 INFO:tasks.workunit.client.1.smithi100.stdout:1/899: rmdir d0/d1f/d6d/db4/d4e/d7b 39 2024-04-27T07:33:43.268 INFO:tasks.workunit.client.1.smithi100.stdout:5/724: getdents d0/d42/d94/d97/d60/dc4/d9d 0 2024-04-27T07:33:43.269 INFO:tasks.workunit.client.1.smithi100.stdout:5/725: chown d0/d42/f52 19364 1 2024-04-27T07:33:43.270 INFO:tasks.workunit.client.1.smithi100.stdout:1/900: dwrite d0/d1b/d20/d2d/d35/f72 [8388608,4194304] 0 2024-04-27T07:33:43.272 INFO:tasks.workunit.client.1.smithi100.stdout:1/901: dread - d0/d1f/d6d/db4/f123 zero size 2024-04-27T07:33:43.273 INFO:tasks.workunit.client.1.smithi100.stdout:1/902: write d0/d1b/fea [1002611,43694] 0 2024-04-27T07:33:43.278 INFO:tasks.workunit.client.1.smithi100.stdout:1/903: symlink d0/d1b/d20/d2d/l127 0 2024-04-27T07:33:43.279 INFO:tasks.workunit.client.1.smithi100.stdout:5/726: dwrite d0/d4/d21/d24/d2f/f5c [0,4194304] 0 2024-04-27T07:33:43.282 INFO:tasks.workunit.client.1.smithi100.stdout:5/727: getdents d0/d4/d21/d24/d2f/d39/d56/d67/dd4 0 2024-04-27T07:33:43.288 INFO:tasks.workunit.client.1.smithi100.stdout:5/728: rename d0/d4/d21/d24/d2f/d57/d37/d1a/f4d to d0/d4/d21/d24/d2f/d57/d37/db4/fe8 0 2024-04-27T07:33:43.291 INFO:tasks.workunit.client.1.smithi100.stdout:5/729: mknod d0/d4/d21/d24/d2f/d39/d7c/d92/ce9 0 2024-04-27T07:33:43.292 INFO:tasks.workunit.client.1.smithi100.stdout:1/904: truncate d0/d1f/d6d/dba/ff9 1496460 0 2024-04-27T07:33:43.293 INFO:tasks.workunit.client.1.smithi100.stdout:5/730: truncate d0/d4/f22 7583761 0 2024-04-27T07:33:43.294 INFO:tasks.workunit.client.1.smithi100.stdout:1/905: symlink d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/l128 0 2024-04-27T07:33:43.295 INFO:tasks.workunit.client.1.smithi100.stdout:5/731: write d0/d4/d21/d24/d2f/d57/d37/d1a/f83 [53391,56340] 0 2024-04-27T07:33:43.297 INFO:tasks.workunit.client.1.smithi100.stdout:5/732: write d0/d4/f19 [1054003,79497] 0 2024-04-27T07:33:43.300 INFO:tasks.workunit.client.1.smithi100.stdout:5/733: chown d0/d42/d94/d97/d60/fde 47 1 2024-04-27T07:33:43.301 INFO:tasks.workunit.client.1.smithi100.stdout:1/906: dwrite d0/d1b/d20/d2d/d35/f7f [0,4194304] 0 2024-04-27T07:33:43.302 INFO:tasks.workunit.client.1.smithi100.stdout:5/734: stat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/lbe 0 2024-04-27T07:33:43.305 INFO:tasks.workunit.client.1.smithi100.stdout:1/907: rmdir d0/d1b/d20/d2d/d35/d4d/d60/dcd 39 2024-04-27T07:33:43.306 INFO:tasks.workunit.client.1.smithi100.stdout:5/735: rename d0/d4 to d0/d4/d21/d24/d2f/d57/d37/d1a/dea 22 2024-04-27T07:33:43.308 INFO:tasks.workunit.client.1.smithi100.stdout:1/908: symlink d0/d1f/d6d/dc7/de1/l129 0 2024-04-27T07:33:43.310 INFO:tasks.workunit.client.1.smithi100.stdout:5/736: creat d0/d4/d21/d24/de1/feb x:0 0 0 2024-04-27T07:33:43.315 INFO:tasks.workunit.client.1.smithi100.stdout:1/909: dwrite d0/d1f/d6d/dc7/fe9 [0,4194304] 0 2024-04-27T07:33:43.321 INFO:tasks.workunit.client.1.smithi100.stdout:1/910: readlink d0/lb 0 2024-04-27T07:33:43.322 INFO:tasks.workunit.client.1.smithi100.stdout:1/911: write d0/d1f/d6d/db4/f123 [639730,43052] 0 2024-04-27T07:33:43.324 INFO:tasks.workunit.client.1.smithi100.stdout:1/912: truncate d0/d23/d3a/f11c 738316 0 2024-04-27T07:33:43.328 INFO:tasks.workunit.client.1.smithi100.stdout:1/913: mkdir d0/d1b/d20/d2d/d35/d4d/d60/dcd/d111/d12a 0 2024-04-27T07:33:43.331 INFO:tasks.workunit.client.1.smithi100.stdout:5/737: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 2406242 0 2024-04-27T07:33:43.341 INFO:tasks.workunit.client.1.smithi100.stdout:9/818: sync 2024-04-27T07:33:43.398 INFO:tasks.workunit.client.1.smithi100.stdout:1/914: mkdir d0/d1b/d20/d2d/d35/d4d/d60/d79/d12b 0 2024-04-27T07:33:43.399 INFO:tasks.workunit.client.1.smithi100.stdout:9/819: symlink d1/d9/db/d2b/d4f/d91/l117 0 2024-04-27T07:33:43.400 INFO:tasks.workunit.client.1.smithi100.stdout:1/915: creat d0/da0/f12c x:0 0 0 2024-04-27T07:33:43.401 INFO:tasks.workunit.client.1.smithi100.stdout:9/820: chown d1/d9/db/d56/d5c/de3/l2d 366639 1 2024-04-27T07:33:43.405 INFO:tasks.workunit.client.1.smithi100.stdout:5/738: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 [0,4194304] 0 2024-04-27T07:33:43.405 INFO:tasks.workunit.client.1.smithi100.stdout:9/821: mknod d1/d9/db/d2b/d4f/dac/d54/d61/c118 0 2024-04-27T07:33:43.406 INFO:tasks.workunit.client.1.smithi100.stdout:1/916: mkdir d0/d1b/d20/d2d/d35/d4d/d60/da4/de7/d107/d12d 0 2024-04-27T07:33:43.408 INFO:tasks.workunit.client.1.smithi100.stdout:9/822: read d1/d9/db/d2b/ff6 [3236418,34352] 0 2024-04-27T07:33:43.409 INFO:tasks.workunit.client.1.smithi100.stdout:5/739: rename d0/d4/d21/l32 to d0/d42/d94/d97/d60/dc4/dca/lec 0 2024-04-27T07:33:43.410 INFO:tasks.workunit.client.1.smithi100.stdout:5/740: dread - d0/d4/d21/d24/de1/feb zero size 2024-04-27T07:33:43.412 INFO:tasks.workunit.client.1.smithi100.stdout:9/823: mknod d1/d76/dd6/c119 0 2024-04-27T07:33:43.417 INFO:tasks.workunit.client.1.smithi100.stdout:9/824: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/f11a x:0 0 0 2024-04-27T07:33:43.419 INFO:tasks.workunit.client.1.smithi100.stdout:1/917: rename d0/d1b/d20/d2d/d35/d4d/d60/f102 to d0/d1f/d6d/db4/d4e/f12e 0 2024-04-27T07:33:43.420 INFO:tasks.workunit.client.1.smithi100.stdout:1/918: readlink d0/d1b/d20/d2d/d35/d4d/d60/d79/l8d 0 2024-04-27T07:33:43.421 INFO:tasks.workunit.client.1.smithi100.stdout:1/919: fsync d0/d1b/d20/d2d/ffe 0 2024-04-27T07:33:43.422 INFO:tasks.workunit.client.1.smithi100.stdout:1/920: write d0/d1b/da1/f10e [81261,114485] 0 2024-04-27T07:33:43.423 INFO:tasks.workunit.client.1.smithi100.stdout:1/921: fsync d0/d1f/d6d/ffc 0 2024-04-27T07:33:43.427 INFO:tasks.workunit.client.1.smithi100.stdout:9/825: rmdir d1/d9/db/d2b/d4f/dac 39 2024-04-27T07:33:43.430 INFO:tasks.workunit.client.1.smithi100.stdout:9/826: readlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/l10b 0 2024-04-27T07:33:43.431 INFO:tasks.workunit.client.1.smithi100.stdout:1/922: getdents d0/d1f/d6d/db4/d4e/d7b 0 2024-04-27T07:33:43.432 INFO:tasks.workunit.client.1.smithi100.stdout:1/923: fdatasync d0/d1f/ff2 0 2024-04-27T07:33:43.433 INFO:tasks.workunit.client.1.smithi100.stdout:9/827: creat d1/d9/db/d56/d5c/de3/d4a/d67/d8a/f11b x:0 0 0 2024-04-27T07:33:43.434 INFO:tasks.workunit.client.1.smithi100.stdout:5/741: dread d0/d42/d94/d97/d60/f61 [0,4194304] 0 2024-04-27T07:33:43.439 INFO:tasks.workunit.client.1.smithi100.stdout:1/924: dwrite d0/d23/d113/f124 [0,4194304] 0 2024-04-27T07:33:43.439 INFO:tasks.workunit.client.1.smithi100.stdout:5/742: mkdir d0/d4/d21/d24/d2f/d57/ded 0 2024-04-27T07:33:43.440 INFO:tasks.workunit.client.1.smithi100.stdout:1/925: dread - d0/d23/f122 zero size 2024-04-27T07:33:43.441 INFO:tasks.workunit.client.1.smithi100.stdout:9/828: write d1/d9/db/d56/d5c/de3/f3a [4732648,86694] 0 2024-04-27T07:33:43.442 INFO:tasks.workunit.client.1.smithi100.stdout:9/829: chown d1/d9/f25 162 1 2024-04-27T07:33:43.443 INFO:tasks.workunit.client.1.smithi100.stdout:5/743: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a/d30 39 2024-04-27T07:33:43.446 INFO:tasks.workunit.client.1.smithi100.stdout:9/830: creat d1/d9/db/da1/dfb/f11c x:0 0 0 2024-04-27T07:33:43.446 INFO:tasks.workunit.client.1.smithi100.stdout:1/926: dread d0/da0/f8c [0,4194304] 0 2024-04-27T07:33:43.447 INFO:tasks.workunit.client.1.smithi100.stdout:1/927: stat d0/d1f/d97/la7 0 2024-04-27T07:33:43.448 INFO:tasks.workunit.client.1.smithi100.stdout:5/744: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fee x:0 0 0 2024-04-27T07:33:43.449 INFO:tasks.workunit.client.1.smithi100.stdout:9/831: symlink d1/d9/dc2/l11d 0 2024-04-27T07:33:43.450 INFO:tasks.workunit.client.1.smithi100.stdout:1/928: mknod d0/d1f/d6d/db4/d6c/c12f 0 2024-04-27T07:33:43.456 INFO:tasks.workunit.client.1.smithi100.stdout:5/745: link d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 d0/d4/d21/d24/d2f/d39/d56/fef 0 2024-04-27T07:33:43.459 INFO:tasks.workunit.client.1.smithi100.stdout:5/746: symlink d0/d4/d21/d24/lf0 0 2024-04-27T07:33:43.460 INFO:tasks.workunit.client.1.smithi100.stdout:1/929: link d0/d23/c45 d0/d23/d3a/d75/c130 0 2024-04-27T07:33:43.465 INFO:tasks.workunit.client.1.smithi100.stdout:1/930: creat d0/d1b/d20/d2d/d35/d65/f131 x:0 0 0 2024-04-27T07:33:43.470 INFO:tasks.workunit.client.1.smithi100.stdout:9/832: dwrite d1/d9/db/d56/d5c/de3/f7b [0,4194304] 0 2024-04-27T07:33:43.472 INFO:tasks.workunit.client.1.smithi100.stdout:1/931: chown d0/d1b/d20/d2d/d35/d4d/d60/c77 27930075 1 2024-04-27T07:33:43.475 INFO:tasks.workunit.client.1.smithi100.stdout:5/747: dwrite d0/d4/d21/d24/d2f/d39/d56/d67/fd0 [0,4194304] 0 2024-04-27T07:33:43.479 INFO:tasks.workunit.client.1.smithi100.stdout:9/833: creat d1/d9/db/d2b/d4f/dd1/f11e x:0 0 0 2024-04-27T07:33:43.480 INFO:tasks.workunit.client.1.smithi100.stdout:5/748: read d0/d4/d21/d24/d2f/d57/d37/db4/fe8 [201349,63122] 0 2024-04-27T07:33:43.483 INFO:tasks.workunit.client.1.smithi100.stdout:9/834: dread - d1/d9/f84 zero size 2024-04-27T07:33:43.487 INFO:tasks.workunit.client.1.smithi100.stdout:9/835: unlink d1/d9/db/d2b/d31/f35 0 2024-04-27T07:33:43.489 INFO:tasks.workunit.client.1.smithi100.stdout:5/749: rename d0/d4/d21/d24/de1/feb to d0/d4/d21/d24/d2f/ff1 0 2024-04-27T07:33:43.560 INFO:tasks.workunit.client.1.smithi100.stdout:5/750: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/cf2 0 2024-04-27T07:33:43.560 INFO:tasks.workunit.client.1.smithi100.stdout:9/836: dwrite d1/d9/db/d2b/d4f/d91/f115 [0,4194304] 0 2024-04-27T07:33:43.561 INFO:tasks.workunit.client.1.smithi100.stdout:1/932: dwrite d0/d1b/d20/d2d/d35/f9b [0,4194304] 0 2024-04-27T07:33:43.562 INFO:tasks.workunit.client.1.smithi100.stdout:9/837: rename d1/d9 to d1/d9/db/da1/d11f 22 2024-04-27T07:33:43.565 INFO:tasks.workunit.client.1.smithi100.stdout:1/933: stat d0/d1f/d6d/db4/fe6 0 2024-04-27T07:33:43.641 INFO:tasks.workunit.client.1.smithi100.stdout:7/737: sync 2024-04-27T07:33:43.641 INFO:tasks.workunit.client.1.smithi100.stdout:9/838: mknod d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/c120 0 2024-04-27T07:33:43.643 INFO:tasks.workunit.client.1.smithi100.stdout:9/839: write d1/f30 [1149202,120792] 0 2024-04-27T07:33:43.647 INFO:tasks.workunit.client.1.smithi100.stdout:5/751: dwrite d0/d4/d21/d24/d2f/d57/f91 [0,4194304] 0 2024-04-27T07:33:43.653 INFO:tasks.workunit.client.1.smithi100.stdout:1/934: dwrite d0/d1f/fc2 [0,4194304] 0 2024-04-27T07:33:43.653 INFO:tasks.workunit.client.1.smithi100.stdout:5/752: stat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fa2 0 2024-04-27T07:33:43.653 INFO:tasks.workunit.client.1.smithi100.stdout:7/738: dwrite d1/dd/d16/f66 [0,4194304] 0 2024-04-27T07:33:43.656 INFO:tasks.workunit.client.1.smithi100.stdout:1/935: mkdir d0/d1f/d6d/db4/d6c/d132 0 2024-04-27T07:33:43.657 INFO:tasks.workunit.client.1.smithi100.stdout:5/753: mknod d0/d4/d21/d24/de1/cf3 0 2024-04-27T07:33:43.659 INFO:tasks.workunit.client.1.smithi100.stdout:7/739: fsync d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a 0 2024-04-27T07:33:43.662 INFO:tasks.workunit.client.1.smithi100.stdout:9/840: truncate d1/d9/db/d2b/d4f/da3/fc9 800400 0 2024-04-27T07:33:43.663 INFO:tasks.workunit.client.1.smithi100.stdout:9/841: stat d1/d9/db/d2b/f7d 0 2024-04-27T07:33:43.666 INFO:tasks.workunit.client.1.smithi100.stdout:1/936: rename d0/d1f/d6d/db4/d4e/c55 to d0/c133 0 2024-04-27T07:33:43.668 INFO:tasks.workunit.client.1.smithi100.stdout:7/740: creat d1/dd/d16/d31/d4c/fd9 x:0 0 0 2024-04-27T07:33:43.674 INFO:tasks.workunit.client.1.smithi100.stdout:1/937: fdatasync d0/d1b/d20/d2d/d35/d4d/d60/da4/fd0 0 2024-04-27T07:33:43.675 INFO:tasks.workunit.client.1.smithi100.stdout:1/938: dread - d0/d1f/d6d/db4/ff7 zero size 2024-04-27T07:33:43.676 INFO:tasks.workunit.client.1.smithi100.stdout:5/754: rename d0/d4/d21/d24/d2f/d57/d3e/f8d to d0/d42/d94/ff4 0 2024-04-27T07:33:43.677 INFO:tasks.workunit.client.1.smithi100.stdout:7/741: creat d1/dd/d16/d31/d4c/d4d/d3b/dcc/fda x:0 0 0 2024-04-27T07:33:43.682 INFO:tasks.workunit.client.1.smithi100.stdout:1/939: mknod d0/d1b/d20/d2d/d35/d4d/d60/d79/d12b/c134 0 2024-04-27T07:33:43.686 INFO:tasks.workunit.client.1.smithi100.stdout:9/842: dwrite d1/d9/db/d2b/d4f/dac/d54/f5f [0,4194304] 0 2024-04-27T07:33:43.688 INFO:tasks.workunit.client.1.smithi100.stdout:1/940: truncate d0/d1f/d6d/db4/f103 274679 0 2024-04-27T07:33:43.690 INFO:tasks.workunit.client.1.smithi100.stdout:7/742: link d1/dd/d16/d70/d51/d6f/l97 d1/dd/d16/d2b/d7f/dcf/ldb 0 2024-04-27T07:33:43.690 INFO:tasks.workunit.client.1.smithi100.stdout:9/843: symlink d1/d9/db/d2b/d4f/dac/d54/l121 0 2024-04-27T07:33:43.690 INFO:tasks.workunit.client.1.smithi100.stdout:5/755: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [3329437,104071] 0 2024-04-27T07:33:43.693 INFO:tasks.workunit.client.1.smithi100.stdout:1/941: creat d0/d1b/d20/d2d/d35/d4d/d60/dcd/d111/d12a/f135 x:0 0 0 2024-04-27T07:33:43.696 INFO:tasks.workunit.client.1.smithi100.stdout:7/743: rename d1/dd/d16/d70/d51/fd1 to d1/dd/d16/d2b/fdc 0 2024-04-27T07:33:43.697 INFO:tasks.workunit.client.1.smithi100.stdout:1/942: mknod d0/d1f/d6d/dba/c136 0 2024-04-27T07:33:43.701 INFO:tasks.workunit.client.1.smithi100.stdout:1/943: mknod d0/d1b/d20/d2d/d35/d4d/d60/d79/d12b/c137 0 2024-04-27T07:33:43.705 INFO:tasks.workunit.client.1.smithi100.stdout:7/744: dread d1/dd/d16/d4a/d56/f86 [0,4194304] 0 2024-04-27T07:33:43.706 INFO:tasks.workunit.client.1.smithi100.stdout:1/944: rename d0/d1f/d6d/dc7 to d0/d1f/d6d/db4/d4e/d7b/d138 0 2024-04-27T07:33:43.707 INFO:tasks.workunit.client.1.smithi100.stdout:9/844: dwrite d1/d9/db/fb2 [0,4194304] 0 2024-04-27T07:33:43.709 INFO:tasks.workunit.client.1.smithi100.stdout:7/745: symlink d1/dd/d16/d2b/d7f/dcf/ldd 0 2024-04-27T07:33:43.711 INFO:tasks.workunit.client.1.smithi100.stdout:1/945: creat d0/d1b/d20/d2d/d35/d4d/f139 x:0 0 0 2024-04-27T07:33:43.713 INFO:tasks.workunit.client.1.smithi100.stdout:9/845: rename d1/d9/db/d56/d5c/de3/fd3 to d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/f122 0 2024-04-27T07:33:43.714 INFO:tasks.workunit.client.1.smithi100.stdout:9/846: chown d1/d9/db/d2b/f6b 8 1 2024-04-27T07:33:43.726 INFO:tasks.workunit.client.1.smithi100.stdout:7/746: truncate d1/dd/d16/d70/f36 3351914 0 2024-04-27T07:33:43.729 INFO:tasks.workunit.client.1.smithi100.stdout:7/747: creat d1/d54/fde x:0 0 0 2024-04-27T07:33:43.732 INFO:tasks.workunit.client.1.smithi100.stdout:7/748: write d1/dd/d16/d31/d4c/d4d/d3b/f45 [4145890,1030] 0 2024-04-27T07:33:43.732 INFO:tasks.workunit.client.1.smithi100.stdout:1/946: dwrite d0/d1b/d20/d2d/d35/f69 [0,4194304] 0 2024-04-27T07:33:43.734 INFO:tasks.workunit.client.1.smithi100.stdout:9/847: dread d1/d9/db/d2b/d4f/dac/f7e [0,4194304] 0 2024-04-27T07:33:43.734 INFO:tasks.workunit.client.1.smithi100.stdout:1/947: chown d0/d1f/d6d/f101 0 1 2024-04-27T07:33:43.737 INFO:tasks.workunit.client.1.smithi100.stdout:9/848: chown d1/d9/db/d56/d5c/de3/d4a/d67/f108 5128000 1 2024-04-27T07:33:43.738 INFO:tasks.workunit.client.1.smithi100.stdout:1/948: creat d0/d1b/d20/d2d/d35/f13a x:0 0 0 2024-04-27T07:33:43.739 INFO:tasks.workunit.client.1.smithi100.stdout:1/949: write d0/f14 [2925734,43844] 0 2024-04-27T07:33:43.739 INFO:tasks.workunit.client.1.smithi100.stdout:9/849: fdatasync d1/d9/db/d2b/d4f/dac/d54/d61/d9b/fce 0 2024-04-27T07:33:43.740 INFO:tasks.workunit.client.1.smithi100.stdout:9/850: readlink d1/d9/l10 0 2024-04-27T07:33:43.740 INFO:tasks.workunit.client.1.smithi100.stdout:7/749: creat d1/dd/d16/d70/d51/fdf x:0 0 0 2024-04-27T07:33:43.741 INFO:tasks.workunit.client.1.smithi100.stdout:7/750: readlink d1/l4 0 2024-04-27T07:33:43.746 INFO:tasks.workunit.client.1.smithi100.stdout:7/751: creat d1/dd/d2a/d2c/fe0 x:0 0 0 2024-04-27T07:33:43.748 INFO:tasks.workunit.client.1.smithi100.stdout:7/752: truncate d1/dd/d16/d31/d4c/fc1 873985 0 2024-04-27T07:33:43.749 INFO:tasks.workunit.client.1.smithi100.stdout:9/851: getdents d1/d9/db/d56/d5c/de3/d4a/d67 0 2024-04-27T07:33:43.753 INFO:tasks.workunit.client.1.smithi100.stdout:9/852: truncate d1/d9/db/d56/d5c/de3/d4a/d67/fc1 4744489 0 2024-04-27T07:33:43.753 INFO:tasks.workunit.client.1.smithi100.stdout:7/753: getdents d1/dd/d16/d2b 0 2024-04-27T07:33:43.758 INFO:tasks.workunit.client.1.smithi100.stdout:7/754: rmdir d1/dd/d16/d3e/d8b/da4 39 2024-04-27T07:33:43.759 INFO:tasks.workunit.client.1.smithi100.stdout:1/950: dread d0/d1b/d20/d2d/d35/f72 [0,4194304] 0 2024-04-27T07:33:43.759 INFO:tasks.workunit.client.1.smithi100.stdout:7/755: stat d1/dd/d16/d2b/d7f/f83 0 2024-04-27T07:33:43.761 INFO:tasks.workunit.client.1.smithi100.stdout:7/756: chown d1/dd/d16/d70/c7b 8700074 1 2024-04-27T07:33:43.763 INFO:tasks.workunit.client.1.smithi100.stdout:9/853: dwrite d1/fd [0,4194304] 0 2024-04-27T07:33:43.767 INFO:tasks.workunit.client.1.smithi100.stdout:9/854: mkdir d1/d9/db/d56/d5c/de3/d4a/daa/de9/d123 0 2024-04-27T07:33:43.772 INFO:tasks.workunit.client.1.smithi100.stdout:7/757: dwrite d1/dd/d16/d70/f59 [0,4194304] 0 2024-04-27T07:33:43.776 INFO:tasks.workunit.client.1.smithi100.stdout:7/758: write d1/dd/d16/d70/fa0 [632289,59245] 0 2024-04-27T07:33:43.778 INFO:tasks.workunit.client.1.smithi100.stdout:9/855: dwrite d1/d9/db/d56/d5c/de3/f7a [0,4194304] 0 2024-04-27T07:33:43.779 INFO:tasks.workunit.client.1.smithi100.stdout:9/856: chown d1/d9/db/d2b/d4f/dac 1 1 2024-04-27T07:33:43.782 INFO:tasks.workunit.client.1.smithi100.stdout:9/857: mkdir d1/d9/dc2/d124 0 2024-04-27T07:33:43.785 INFO:tasks.workunit.client.1.smithi100.stdout:1/951: dread d0/d23/d3a/dae/fcb [0,4194304] 0 2024-04-27T07:33:43.788 INFO:tasks.workunit.client.1.smithi100.stdout:9/858: rename d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/ldb to d1/d9/db/d56/d5c/de3/d4a/daa/de9/l125 0 2024-04-27T07:33:43.789 INFO:tasks.workunit.client.1.smithi100.stdout:9/859: chown d1/d9/db/f93 6796089 1 2024-04-27T07:33:43.795 INFO:tasks.workunit.client.1.smithi100.stdout:9/860: dwrite d1/d9/db/d56/d5c/de3/f3a [0,4194304] 0 2024-04-27T07:33:43.797 INFO:tasks.workunit.client.1.smithi100.stdout:9/861: chown d1/d9/db/d2b/d4f/d57/dbe 69518 1 2024-04-27T07:33:43.805 INFO:tasks.workunit.client.1.smithi100.stdout:9/862: creat d1/d9/db/d2b/f126 x:0 0 0 2024-04-27T07:33:43.806 INFO:tasks.workunit.client.1.smithi100.stdout:9/863: chown d1/d9/db/d56/d5c/de3/d4a/d67/fc1 128899234 1 2024-04-27T07:33:43.809 INFO:tasks.workunit.client.1.smithi100.stdout:9/864: creat d1/d9/db/f127 x:0 0 0 2024-04-27T07:33:43.810 INFO:tasks.workunit.client.1.smithi100.stdout:9/865: write d1/d9/db/d2b/dfd/f102 [864363,25312] 0 2024-04-27T07:33:43.812 INFO:tasks.workunit.client.1.smithi100.stdout:9/866: creat d1/d9/db/da1/f128 x:0 0 0 2024-04-27T07:33:43.814 INFO:tasks.workunit.client.1.smithi100.stdout:9/867: dread - d1/d9/db/d2b/d4f/d91/fcb zero size 2024-04-27T07:33:43.815 INFO:tasks.workunit.client.1.smithi100.stdout:9/868: stat d1/d9/db/d2b/d4f/da3/fe5 0 2024-04-27T07:33:43.816 INFO:tasks.workunit.client.1.smithi100.stdout:9/869: fsync d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/fc5 0 2024-04-27T07:33:43.818 INFO:tasks.workunit.client.1.smithi100.stdout:9/870: write d1/d9/db/d56/d5c/de3/fca [2944018,118506] 0 2024-04-27T07:33:43.819 INFO:tasks.workunit.client.1.smithi100.stdout:9/871: truncate d1/d9/db/da1/dfb/f11c 640884 0 2024-04-27T07:33:43.820 INFO:tasks.workunit.client.1.smithi100.stdout:9/872: chown d1/d9/db/d2b/d4f/f72 195 1 2024-04-27T07:33:43.820 INFO:tasks.workunit.client.1.smithi100.stdout:9/873: chown d1/f30 286436 1 2024-04-27T07:33:43.822 INFO:tasks.workunit.client.1.smithi100.stdout:0/775: sync 2024-04-27T07:33:43.822 INFO:tasks.workunit.client.1.smithi100.stdout:4/847: sync 2024-04-27T07:33:43.822 INFO:tasks.workunit.client.1.smithi100.stdout:3/890: sync 2024-04-27T07:33:43.824 INFO:tasks.workunit.client.1.smithi100.stdout:9/874: read d1/d9/db/d2b/d4f/d91/f115 [426514,108126] 0 2024-04-27T07:33:43.824 INFO:tasks.workunit.client.1.smithi100.stdout:3/891: dread - d7/d9/fac zero size 2024-04-27T07:33:43.825 INFO:tasks.workunit.client.1.smithi100.stdout:1/952: dread d0/d1b/d20/d2d/f83 [4194304,4194304] 0 2024-04-27T07:33:43.826 INFO:tasks.workunit.client.1.smithi100.stdout:9/875: chown d1/d9/db/d2b/d4f/d57/f87 968060 1 2024-04-27T07:33:43.827 INFO:tasks.workunit.client.1.smithi100.stdout:4/848: fsync d5/d1b/df8/f64 0 2024-04-27T07:33:43.831 INFO:tasks.workunit.client.1.smithi100.stdout:3/892: mkdir d7/d9/d10/d28/db0/d115 0 2024-04-27T07:33:43.832 INFO:tasks.workunit.client.1.smithi100.stdout:3/893: chown d7/d9/d10/d33 23143877 1 2024-04-27T07:33:43.832 INFO:tasks.workunit.client.1.smithi100.stdout:3/894: dread - d7/d9/d10/d28/db0/fbd zero size 2024-04-27T07:33:43.833 INFO:tasks.workunit.client.1.smithi100.stdout:1/953: creat d0/d1b/d20/d2d/d35/d4d/d60/dcd/f13b x:0 0 0 2024-04-27T07:33:43.833 INFO:tasks.workunit.client.1.smithi100.stdout:1/954: dread - d0/d1b/f105 zero size 2024-04-27T07:33:43.838 INFO:tasks.workunit.client.1.smithi100.stdout:1/955: mknod d0/d23/d113/c13c 0 2024-04-27T07:33:43.840 INFO:tasks.workunit.client.1.smithi100.stdout:0/776: dwrite d1/d8/d20/ff9 [0,4194304] 0 2024-04-27T07:33:43.841 INFO:tasks.workunit.client.1.smithi100.stdout:3/895: creat d7/d9/d26/d2a/db3/f116 x:0 0 0 2024-04-27T07:33:43.844 INFO:tasks.workunit.client.1.smithi100.stdout:9/876: write d1/d9/db/d2b/f86 [1418919,30923] 0 2024-04-27T07:33:43.845 INFO:tasks.workunit.client.1.smithi100.stdout:4/849: dwrite d5/d1b/df8/d3f/f122 [0,4194304] 0 2024-04-27T07:33:43.845 INFO:tasks.workunit.client.1.smithi100.stdout:0/777: fsync d1/d8/d20/d61/d66/ffc 0 2024-04-27T07:33:43.847 INFO:tasks.workunit.client.1.smithi100.stdout:9/877: rename d1/d9/db to d1/d9/db/da1/d129 22 2024-04-27T07:33:43.850 INFO:tasks.workunit.client.1.smithi100.stdout:3/896: rename d7/d9/d10/d28/fca to d7/d9/d26/d2a/dc4/f117 0 2024-04-27T07:33:43.853 INFO:tasks.workunit.client.1.smithi100.stdout:9/878: creat d1/d9/db/d2b/d4f/dac/d54/d61/f12a x:0 0 0 2024-04-27T07:33:43.854 INFO:tasks.workunit.client.1.smithi100.stdout:3/897: symlink d7/l118 0 2024-04-27T07:33:43.868 INFO:tasks.workunit.client.1.smithi100.stdout:9/879: dwrite d1/d9/db/d56/fc0 [0,4194304] 0 2024-04-27T07:33:43.869 INFO:tasks.workunit.client.1.smithi100.stdout:0/778: dread d1/d8/d14/d59/fb5 [0,4194304] 0 2024-04-27T07:33:43.870 INFO:tasks.workunit.client.1.smithi100.stdout:9/880: write d1/f46 [2868298,22954] 0 2024-04-27T07:33:43.873 INFO:tasks.workunit.client.1.smithi100.stdout:9/881: unlink d1/d9/db/d2b/d4f/d57/dbe/ff2 0 2024-04-27T07:33:43.875 INFO:tasks.workunit.client.1.smithi100.stdout:9/882: readlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/d106/l10f 0 2024-04-27T07:33:43.876 INFO:tasks.workunit.client.1.smithi100.stdout:0/779: dwrite d1/d8/d20/f37 [4194304,4194304] 0 2024-04-27T07:33:43.877 INFO:tasks.workunit.client.1.smithi100.stdout:0/780: chown d1/d8/d20/f4b 3 1 2024-04-27T07:33:43.878 INFO:tasks.workunit.client.1.smithi100.stdout:0/781: dread - d1/d8/da8/fe9 zero size 2024-04-27T07:33:43.879 INFO:tasks.workunit.client.1.smithi100.stdout:9/883: creat d1/d9/db/d2b/d4f/dac/d54/d61/f12b x:0 0 0 2024-04-27T07:33:43.880 INFO:tasks.workunit.client.1.smithi100.stdout:9/884: chown d1/d9/db/d2b/d4f/dac/d54/d61 10773086 1 2024-04-27T07:33:43.883 INFO:tasks.workunit.client.1.smithi100.stdout:9/885: creat d1/d9/db/d56/d5c/de3/d4a/daa/f12c x:0 0 0 2024-04-27T07:33:43.897 INFO:tasks.workunit.client.1.smithi100.stdout:9/886: dread d1/d9/db/d56/d5c/de3/d4a/d67/d8a/fd7 [0,4194304] 0 2024-04-27T07:33:43.899 INFO:tasks.workunit.client.1.smithi100.stdout:9/887: truncate d1/d9/db/d56/d5c/de3/d4a/fbf 889079 0 2024-04-27T07:33:43.903 INFO:tasks.workunit.client.1.smithi100.stdout:0/782: dread d1/d8/d14/d59/d99/fdf [0,4194304] 0 2024-04-27T07:33:43.904 INFO:tasks.workunit.client.1.smithi100.stdout:9/888: dwrite d1/d9/db/d2b/f79 [0,4194304] 0 2024-04-27T07:33:43.906 INFO:tasks.workunit.client.1.smithi100.stdout:9/889: write d1/d9/db/d2b/fab [4709846,110697] 0 2024-04-27T07:33:43.911 INFO:tasks.workunit.client.1.smithi100.stdout:9/890: chown d1/d9/db/d2b/d4f/da3/fc9 1741624917 1 2024-04-27T07:33:43.911 INFO:tasks.workunit.client.1.smithi100.stdout:0/783: write d1/f39 [911200,79983] 0 2024-04-27T07:33:43.914 INFO:tasks.workunit.client.1.smithi100.stdout:9/891: fsync d1/d9/db/d2b/d4f/d91/f115 0 2024-04-27T07:33:43.915 INFO:tasks.workunit.client.1.smithi100.stdout:0/784: fsync d1/d8/d20/d61/f9f 0 2024-04-27T07:33:43.920 INFO:tasks.workunit.client.1.smithi100.stdout:9/892: link d1/d9/db/d2b/d4f/dac/d54/d61/f12b d1/d9/db/d56/f12d 0 2024-04-27T07:33:43.921 INFO:tasks.workunit.client.1.smithi100.stdout:9/893: mkdir d1/d76/dd6/d12e 0 2024-04-27T07:33:43.926 INFO:tasks.workunit.client.1.smithi100.stdout:0/785: dread d1/d8/d20/d1e/f85 [0,4194304] 0 2024-04-27T07:33:43.927 INFO:tasks.workunit.client.1.smithi100.stdout:0/786: stat d1/d8/d14/dce 0 2024-04-27T07:33:43.927 INFO:tasks.workunit.client.1.smithi100.stdout:9/894: write d1/d9/db/d56/d5c/de3/d4a/d67/fc1 [5302657,861] 0 2024-04-27T07:33:43.933 INFO:tasks.workunit.client.1.smithi100.stdout:0/787: dwrite d1/d8/d20/d1e/f6e [0,4194304] 0 2024-04-27T07:33:43.936 INFO:tasks.workunit.client.1.smithi100.stdout:0/788: unlink d1/d8/d20/f77 0 2024-04-27T07:33:43.936 INFO:tasks.workunit.client.1.smithi100.stdout:0/789: dread - d1/d8/d20/d61/f9f zero size 2024-04-27T07:33:43.938 INFO:tasks.workunit.client.1.smithi100.stdout:0/790: rmdir d1/d38/d3a/d54 39 2024-04-27T07:33:43.984 INFO:tasks.workunit.client.1.smithi100.stdout:2/767: sync 2024-04-27T07:33:43.984 INFO:tasks.workunit.client.1.smithi100.stdout:8/798: sync 2024-04-27T07:33:43.985 INFO:tasks.workunit.client.1.smithi100.stdout:6/914: sync 2024-04-27T07:33:43.986 INFO:tasks.workunit.client.1.smithi100.stdout:8/799: symlink d6/d20/d54/d91/d9e/lfa 0 2024-04-27T07:33:43.987 INFO:tasks.workunit.client.1.smithi100.stdout:2/768: readlink d0/da/d29/d47/d5a/d8d/lb9 0 2024-04-27T07:33:43.987 INFO:tasks.workunit.client.1.smithi100.stdout:8/800: dread - d6/dda/ff9 zero size 2024-04-27T07:33:43.988 INFO:tasks.workunit.client.1.smithi100.stdout:2/769: write d0/da/d39/fb7 [1224121,12607] 0 2024-04-27T07:33:44.036 INFO:tasks.workunit.client.1.smithi100.stdout:6/915: link de/d109/c113 de/d58/d28/c138 0 2024-04-27T07:33:44.039 INFO:tasks.workunit.client.1.smithi100.stdout:8/801: dwrite d6/d20/d54/d91/fd0 [0,4194304] 0 2024-04-27T07:33:44.042 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:43 smithi082 ceph-mon[26613]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 90 MiB/s rd, 230 MiB/s wr, 487 op/s 2024-04-27T07:33:44.042 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:43 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/728444811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:33:44.058 INFO:tasks.workunit.client.1.smithi100.stdout:2/770: rename d0/da/d29/d47/d87 to d0/da/d29/d47/d5a/dd9/dff 0 2024-04-27T07:33:44.063 INFO:tasks.workunit.client.1.smithi100.stdout:2/771: mkdir d0/da/d29/d47/d5a/dd9/dff/d8b/d100 0 2024-04-27T07:33:44.070 INFO:tasks.workunit.client.1.smithi100.stdout:2/772: dwrite d0/d79/d94/dbc/d98/db1/fe1 [0,4194304] 0 2024-04-27T07:33:44.075 INFO:tasks.workunit.client.1.smithi100.stdout:8/802: dread d6/d20/d54/d91/dae/f5c [0,4194304] 0 2024-04-27T07:33:44.077 INFO:tasks.workunit.client.1.smithi100.stdout:8/803: truncate d6/d20/d54/d91/d9e/ff8 754058 0 2024-04-27T07:33:44.079 INFO:tasks.workunit.client.1.smithi100.stdout:8/804: unlink d6/d20/d50/d72/da4/fc5 0 2024-04-27T07:33:44.082 INFO:tasks.workunit.client.1.smithi100.stdout:8/805: mkdir d6/dda/dfb 0 2024-04-27T07:33:44.083 INFO:tasks.workunit.client.1.smithi100.stdout:8/806: write d6/d1b/f2d [616857,56720] 0 2024-04-27T07:33:44.087 INFO:tasks.workunit.client.1.smithi100.stdout:8/807: write d6/d1b/d1d/d59/f56 [2107571,101719] 0 2024-04-27T07:33:44.088 INFO:tasks.workunit.client.1.smithi100.stdout:6/916: dwrite de/f3c [0,4194304] 0 2024-04-27T07:33:44.089 INFO:tasks.workunit.client.1.smithi100.stdout:6/917: stat de/feb 0 2024-04-27T07:33:44.093 INFO:tasks.workunit.client.1.smithi100.stdout:8/808: rename d6/c14 to d6/d20/d8b/dc0/cfc 0 2024-04-27T07:33:44.094 INFO:tasks.workunit.client.1.smithi100.stdout:8/809: stat d6/d1b/d75/faa 0 2024-04-27T07:33:44.099 INFO:tasks.workunit.client.1.smithi100.stdout:8/810: dwrite d6/d20/d54/d91/fd0 [0,4194304] 0 2024-04-27T07:33:44.107 INFO:tasks.workunit.client.1.smithi100.stdout:2/773: dread d0/da/d29/d47/f91 [0,4194304] 0 2024-04-27T07:33:44.107 INFO:tasks.workunit.client.1.smithi100.stdout:8/811: dwrite d6/d1b/d1d/f9c [0,4194304] 0 2024-04-27T07:33:44.108 INFO:tasks.workunit.client.1.smithi100.stdout:8/812: read d6/d1b/d1d/f9c [3516851,100744] 0 2024-04-27T07:33:44.112 INFO:tasks.workunit.client.1.smithi100.stdout:8/813: getdents d6/d20/d8b/d8c 0 2024-04-27T07:33:44.113 INFO:tasks.workunit.client.1.smithi100.stdout:8/814: dread - d6/d1b/d1d/d59/fc2 zero size 2024-04-27T07:33:44.116 INFO:tasks.workunit.client.1.smithi100.stdout:8/815: creat d6/dda/dfb/ffd x:0 0 0 2024-04-27T07:33:44.117 INFO:tasks.workunit.client.1.smithi100.stdout:8/816: dread - d6/d20/d8b/d8c/ff1 zero size 2024-04-27T07:33:44.119 INFO:tasks.workunit.client.1.smithi100.stdout:8/817: symlink d6/d20/d50/d72/daf/lfe 0 2024-04-27T07:33:44.121 INFO:tasks.workunit.client.1.smithi100.stdout:8/818: creat d6/d20/d54/d91/dae/fff x:0 0 0 2024-04-27T07:33:44.124 INFO:tasks.workunit.client.1.smithi100.stdout:8/819: rename d6/d20/d54/d91/dae/fff to d6/d1b/d1d/d59/d94/ddb/f100 0 2024-04-27T07:33:44.127 INFO:tasks.workunit.client.1.smithi100.stdout:8/820: rename d6/d1b/fb6 to d6/d1b/d1d/d59/f101 0 2024-04-27T07:33:44.129 INFO:tasks.workunit.client.1.smithi100.stdout:8/821: unlink d6/d20/d54/cbb 0 2024-04-27T07:33:44.133 INFO:tasks.workunit.client.1.smithi100.stdout:8/822: creat d6/d20/f102 x:0 0 0 2024-04-27T07:33:44.138 INFO:tasks.workunit.client.1.smithi100.stdout:8/823: dread d6/d1b/f34 [0,4194304] 0 2024-04-27T07:33:44.139 INFO:tasks.workunit.client.1.smithi100.stdout:5/756: sync 2024-04-27T07:33:44.140 INFO:tasks.workunit.client.1.smithi100.stdout:8/824: write d6/d1b/f2d [4125162,116154] 0 2024-04-27T07:33:44.142 INFO:tasks.workunit.client.1.smithi100.stdout:5/757: truncate d0/d4/d21/d24/d2f/d39/d56/fe4 35098 0 2024-04-27T07:33:44.143 INFO:tasks.workunit.client.1.smithi100.stdout:8/825: creat d6/d20/d50/f103 x:0 0 0 2024-04-27T07:33:44.144 INFO:tasks.workunit.client.1.smithi100.stdout:8/826: chown d6/d20/c48 1380764 1 2024-04-27T07:33:44.146 INFO:tasks.workunit.client.1.smithi100.stdout:8/827: truncate d6/d20/d50/d72/daf/fcb 532647 0 2024-04-27T07:33:44.147 INFO:tasks.workunit.client.1.smithi100.stdout:5/758: link d0/d4/d21/d24/d2f/d39/d7c/lce d0/d42/d94/d97/lf5 0 2024-04-27T07:33:44.154 INFO:tasks.workunit.client.1.smithi100.stdout:5/759: creat d0/d4/d21/d24/d2f/db5/ff6 x:0 0 0 2024-04-27T07:33:44.156 INFO:tasks.workunit.client.1.smithi100.stdout:8/828: rmdir d6/d20 39 2024-04-27T07:33:44.160 INFO:tasks.workunit.client.1.smithi100.stdout:5/760: dread d0/d42/d94/d97/d60/dc4/d99/da0/faa [0,4194304] 0 2024-04-27T07:33:44.160 INFO:tasks.workunit.client.1.smithi100.stdout:8/829: mknod d6/d20/d50/d72/daf/c104 0 2024-04-27T07:33:44.162 INFO:tasks.workunit.client.1.smithi100.stdout:8/830: write d6/d20/d54/d91/dae/fdf [4709173,16372] 0 2024-04-27T07:33:44.166 INFO:tasks.workunit.client.1.smithi100.stdout:8/831: stat d6/d1b/d1d/d59/c92 0 2024-04-27T07:33:44.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:43 smithi100 ceph-mon[34183]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 90 MiB/s rd, 230 MiB/s wr, 487 op/s 2024-04-27T07:33:44.166 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:43 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/728444811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:33:44.168 INFO:tasks.workunit.client.1.smithi100.stdout:8/832: dread - d6/d1b/d1d/d59/d94/ddb/f100 zero size 2024-04-27T07:33:44.169 INFO:tasks.workunit.client.1.smithi100.stdout:5/761: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fc7 [0,4194304] 0 2024-04-27T07:33:44.171 INFO:tasks.workunit.client.1.smithi100.stdout:5/762: chown d0/d4/d21/d24/d2f/d57/d3e/l40 7652907 1 2024-04-27T07:33:44.173 INFO:tasks.workunit.client.1.smithi100.stdout:5/763: symlink d0/d4/d21/d51/lf7 0 2024-04-27T07:33:44.176 INFO:tasks.workunit.client.1.smithi100.stdout:8/833: getdents d6/d20/d8b/d8c/dce 0 2024-04-27T07:33:44.177 INFO:tasks.workunit.client.1.smithi100.stdout:8/834: symlink d6/dda/dfb/l105 0 2024-04-27T07:33:44.179 INFO:tasks.workunit.client.1.smithi100.stdout:8/835: write d6/d20/d50/f8a [721802,82282] 0 2024-04-27T07:33:44.182 INFO:tasks.workunit.client.1.smithi100.stdout:8/836: write d6/d1b/d1d/d59/f101 [1136487,22104] 0 2024-04-27T07:33:44.184 INFO:tasks.workunit.client.1.smithi100.stdout:8/837: mkdir d6/d20/da2/db0/d106 0 2024-04-27T07:33:44.186 INFO:tasks.workunit.client.1.smithi100.stdout:8/838: rmdir d6/d20/d54/d91 39 2024-04-27T07:33:44.192 INFO:tasks.workunit.client.1.smithi100.stdout:5/764: dread d0/d4/d21/d24/d2f/d39/d56/f85 [0,4194304] 0 2024-04-27T07:33:44.192 INFO:tasks.workunit.client.1.smithi100.stdout:8/839: truncate d6/d1b/d1d/f68 2078378 0 2024-04-27T07:33:44.195 INFO:tasks.workunit.client.1.smithi100.stdout:8/840: creat d6/d1b/f107 x:0 0 0 2024-04-27T07:33:44.197 INFO:tasks.workunit.client.1.smithi100.stdout:8/841: write d6/d20/d54/d91/fd6 [840213,30171] 0 2024-04-27T07:33:44.201 INFO:tasks.workunit.client.1.smithi100.stdout:8/842: dread d6/d20/d54/d91/fe2 [0,4194304] 0 2024-04-27T07:33:44.202 INFO:tasks.workunit.client.1.smithi100.stdout:8/843: chown d6/d20/d54/d91/d9e 775130436 1 2024-04-27T07:33:44.203 INFO:tasks.workunit.client.1.smithi100.stdout:8/844: fdatasync d6/d20/f40 0 2024-04-27T07:33:44.205 INFO:tasks.workunit.client.1.smithi100.stdout:8/845: mkdir d6/d20/d50/d108 0 2024-04-27T07:33:44.209 INFO:tasks.workunit.client.1.smithi100.stdout:8/846: getdents d6/d20/d50/d72/daf 0 2024-04-27T07:33:44.210 INFO:tasks.workunit.client.1.smithi100.stdout:8/847: rmdir d6/d20/d50/d72 39 2024-04-27T07:33:44.213 INFO:tasks.workunit.client.1.smithi100.stdout:8/848: rename d6/d20/d54/d91/dae/f5c to d6/dda/f109 0 2024-04-27T07:33:44.214 INFO:tasks.workunit.client.1.smithi100.stdout:8/849: dread - d6/d1b/f107 zero size 2024-04-27T07:33:44.217 INFO:tasks.workunit.client.1.smithi100.stdout:8/850: rmdir d6/d1b/d1d/d59/d94/ddb/df7 0 2024-04-27T07:33:44.220 INFO:tasks.workunit.client.1.smithi100.stdout:8/851: unlink d6/d20/d50/d72/lbf 0 2024-04-27T07:33:44.222 INFO:tasks.workunit.client.1.smithi100.stdout:8/852: read d6/dda/ded/f37 [3636497,74000] 0 2024-04-27T07:33:44.230 INFO:tasks.workunit.client.1.smithi100.stdout:8/853: dwrite d6/dda/ded/f3c [0,4194304] 0 2024-04-27T07:33:44.236 INFO:tasks.workunit.client.1.smithi100.stdout:8/854: write d6/d1b/d1d/f68 [700738,115925] 0 2024-04-27T07:33:44.237 INFO:tasks.workunit.client.1.smithi100.stdout:8/855: stat d6/d20/d54/d91/dae/c6d 0 2024-04-27T07:33:44.239 INFO:tasks.workunit.client.1.smithi100.stdout:8/856: mkdir d6/d20/d50/d72/d10a 0 2024-04-27T07:33:44.241 INFO:tasks.workunit.client.1.smithi100.stdout:8/857: truncate d6/f3b 2114462 0 2024-04-27T07:33:44.241 INFO:tasks.workunit.client.1.smithi100.stdout:8/858: chown d6/d20 252 1 2024-04-27T07:33:44.242 INFO:tasks.workunit.client.1.smithi100.stdout:8/859: creat d6/dda/f10b x:0 0 0 2024-04-27T07:33:44.245 INFO:tasks.workunit.client.1.smithi100.stdout:8/860: rename d6/d20/d50/d72/c9b to d6/d20/d54/d91/d9e/c10c 0 2024-04-27T07:33:44.247 INFO:tasks.workunit.client.1.smithi100.stdout:8/861: rmdir d6/d1b/d1d/d59 39 2024-04-27T07:33:44.250 INFO:tasks.workunit.client.1.smithi100.stdout:8/862: read d6/dda/ded/f55 [3856429,105060] 0 2024-04-27T07:33:44.252 INFO:tasks.workunit.client.1.smithi100.stdout:8/863: write d6/dda/ff9 [600255,13548] 0 2024-04-27T07:33:44.253 INFO:tasks.workunit.client.1.smithi100.stdout:8/864: mkdir d6/d20/da2/d10d 0 2024-04-27T07:33:44.259 INFO:tasks.workunit.client.1.smithi100.stdout:8/865: dwrite d6/dda/ded/f44 [4194304,4194304] 0 2024-04-27T07:33:44.262 INFO:tasks.workunit.client.1.smithi100.stdout:8/866: chown d6/d1b/lee 1 1 2024-04-27T07:33:44.264 INFO:tasks.workunit.client.1.smithi100.stdout:8/867: symlink d6/d20/d50/l10e 0 2024-04-27T07:33:44.265 INFO:tasks.workunit.client.1.smithi100.stdout:8/868: readlink d6/d20/l7a 0 2024-04-27T07:33:44.267 INFO:tasks.workunit.client.1.smithi100.stdout:8/869: mkdir d6/d1b/d10f 0 2024-04-27T07:33:44.267 INFO:tasks.workunit.client.1.smithi100.stdout:8/870: read - d6/d20/d50/f89 zero size 2024-04-27T07:33:44.269 INFO:tasks.workunit.client.1.smithi100.stdout:8/871: symlink d6/d20/d8b/d8c/dce/l110 0 2024-04-27T07:33:44.270 INFO:tasks.workunit.client.1.smithi100.stdout:8/872: rmdir d6/d20/d50/da8 39 2024-04-27T07:33:44.271 INFO:tasks.workunit.client.1.smithi100.stdout:8/873: symlink d6/d20/d54/d91/dae/df3/l111 0 2024-04-27T07:33:44.273 INFO:tasks.workunit.client.1.smithi100.stdout:8/874: getdents d6/d20/da2/d10d 0 2024-04-27T07:33:44.274 INFO:tasks.workunit.client.1.smithi100.stdout:8/875: read d6/d20/d50/f52 [2970168,75165] 0 2024-04-27T07:33:44.285 INFO:tasks.workunit.client.1.smithi100.stdout:8/876: dread d6/f45 [0,4194304] 0 2024-04-27T07:33:44.285 INFO:tasks.workunit.client.1.smithi100.stdout:8/877: stat d6/d20/d54/d91/dae 0 2024-04-27T07:33:44.287 INFO:tasks.workunit.client.1.smithi100.stdout:8/878: symlink d6/d20/d54/d91/dae/df3/l112 0 2024-04-27T07:33:44.287 INFO:tasks.workunit.client.1.smithi100.stdout:8/879: fdatasync d6/d20/d54/d91/d9e/fdc 0 2024-04-27T07:33:44.288 INFO:tasks.workunit.client.1.smithi100.stdout:8/880: stat d6/d1b/d1d/d59 0 2024-04-27T07:33:44.303 INFO:tasks.workunit.client.1.smithi100.stdout:8/881: dread d6/d20/d8b/f8d [0,4194304] 0 2024-04-27T07:33:44.306 INFO:tasks.workunit.client.1.smithi100.stdout:8/882: write d6/f3b [613251,99578] 0 2024-04-27T07:33:44.318 INFO:tasks.workunit.client.1.smithi100.stdout:8/883: dread d6/dda/ded/f55 [0,4194304] 0 2024-04-27T07:33:44.319 INFO:tasks.workunit.client.1.smithi100.stdout:8/884: symlink d6/d1b/d10f/l113 0 2024-04-27T07:33:44.321 INFO:tasks.workunit.client.1.smithi100.stdout:8/885: rename d6/d20/da2/da6/fe4 to d6/dda/f114 0 2024-04-27T07:33:44.322 INFO:tasks.workunit.client.1.smithi100.stdout:8/886: rename d6/d20/d50 to d6/d20/d50/d72/d10a/d115 22 2024-04-27T07:33:44.323 INFO:tasks.workunit.client.1.smithi100.stdout:8/887: fsync d6/d20/d50/f89 0 2024-04-27T07:33:44.324 INFO:tasks.workunit.client.1.smithi100.stdout:8/888: dread - d6/d1b/d75/fcd zero size 2024-04-27T07:33:44.353 INFO:tasks.workunit.client.1.smithi100.stdout:7/759: sync 2024-04-27T07:33:44.357 INFO:tasks.workunit.client.1.smithi100.stdout:7/760: mknod d1/dd/d16/d3e/d8b/ce1 0 2024-04-27T07:33:44.359 INFO:tasks.workunit.client.1.smithi100.stdout:8/889: dread d6/dda/ded/f65 [0,4194304] 0 2024-04-27T07:33:44.360 INFO:tasks.workunit.client.1.smithi100.stdout:7/761: creat d1/dd/d16/d31/d4c/d4d/fe2 x:0 0 0 2024-04-27T07:33:44.361 INFO:tasks.workunit.client.1.smithi100.stdout:8/890: mknod d6/d1b/d75/c116 0 2024-04-27T07:33:44.362 INFO:tasks.workunit.client.1.smithi100.stdout:8/891: stat d6/d1b/d1d/f9c 0 2024-04-27T07:33:44.363 INFO:tasks.workunit.client.1.smithi100.stdout:7/762: unlink d1/dd/d16/d31/l53 0 2024-04-27T07:33:44.365 INFO:tasks.workunit.client.1.smithi100.stdout:8/892: creat d6/d20/f117 x:0 0 0 2024-04-27T07:33:44.366 INFO:tasks.workunit.client.1.smithi100.stdout:7/763: creat d1/dd/d16/d3e/dc3/fe3 x:0 0 0 2024-04-27T07:33:44.373 INFO:tasks.workunit.client.1.smithi100.stdout:8/893: truncate d6/d1b/d1d/d59/f101 600017 0 2024-04-27T07:33:44.374 INFO:tasks.workunit.client.1.smithi100.stdout:8/894: rmdir d6/d20/d8b/dc0 39 2024-04-27T07:33:44.380 INFO:tasks.workunit.client.1.smithi100.stdout:7/764: dread d1/f15 [0,4194304] 0 2024-04-27T07:33:44.502 INFO:tasks.workunit.client.1.smithi100.stdout:1/956: sync 2024-04-27T07:33:44.506 INFO:tasks.workunit.client.1.smithi100.stdout:1/957: creat d0/d1f/d6d/db4/f13d x:0 0 0 2024-04-27T07:33:44.511 INFO:tasks.workunit.client.1.smithi100.stdout:1/958: rename d0/d1b/f96 to d0/da0/f13e 0 2024-04-27T07:33:44.524 INFO:tasks.workunit.client.1.smithi100.stdout:1/959: dwrite d0/d1f/d97/fb3 [0,4194304] 0 2024-04-27T07:33:44.526 INFO:tasks.workunit.client.1.smithi100.stdout:1/960: write d0/d1f/d6d/db4/d4e/d7b/ddd/f11a [286474,69952] 0 2024-04-27T07:33:44.530 INFO:tasks.workunit.client.1.smithi100.stdout:1/961: creat d0/d1b/d20/f13f x:0 0 0 2024-04-27T07:33:44.531 INFO:tasks.workunit.client.1.smithi100.stdout:1/962: readlink d0/d1b/d20/d2d/d35/l43 0 2024-04-27T07:33:44.534 INFO:tasks.workunit.client.1.smithi100.stdout:1/963: creat d0/d1b/d20/d2d/d35/d4d/d60/dcd/f140 x:0 0 0 2024-04-27T07:33:44.536 INFO:tasks.workunit.client.1.smithi100.stdout:1/964: dread - d0/d1f/d6d/db4/d4e/d7b/d138/fe8 zero size 2024-04-27T07:33:44.541 INFO:tasks.workunit.client.1.smithi100.stdout:1/965: link d0/d23/d113/c11d d0/d1f/d6d/db4/d4e/d7b/ddd/c141 0 2024-04-27T07:33:44.548 INFO:tasks.workunit.client.1.smithi100.stdout:1/966: dwrite d0/d1f/d6d/db4/d4e/d7b/fcf [0,4194304] 0 2024-04-27T07:33:44.552 INFO:tasks.workunit.client.1.smithi100.stdout:1/967: fdatasync d0/d1b/d20/d2d/d35/d65/fc6 0 2024-04-27T07:33:44.559 INFO:tasks.workunit.client.1.smithi100.stdout:1/968: dwrite d0/f85 [0,4194304] 0 2024-04-27T07:33:44.563 INFO:tasks.workunit.client.1.smithi100.stdout:1/969: fsync d0/d1f/d6d/db4/d4e/d7b/fc0 0 2024-04-27T07:33:44.567 INFO:tasks.workunit.client.1.smithi100.stdout:4/850: sync 2024-04-27T07:33:44.570 INFO:tasks.workunit.client.1.smithi100.stdout:4/851: unlink d5/d16/d19/d46/d53/l60 0 2024-04-27T07:33:44.573 INFO:tasks.workunit.client.1.smithi100.stdout:1/970: truncate d0/d1f/d6d/db4/d4e/d7b/fcf 558247 0 2024-04-27T07:33:44.574 INFO:tasks.workunit.client.1.smithi100.stdout:1/971: chown d0/d1b/d20/d2d/d35/f72 143124121 1 2024-04-27T07:33:44.575 INFO:tasks.workunit.client.1.smithi100.stdout:4/852: mknod d5/d1b/df8/d50/db0/d10f/c125 0 2024-04-27T07:33:44.575 INFO:tasks.workunit.client.1.smithi100.stdout:1/972: truncate d0/d1b/d20/d2d/f52 4715335 0 2024-04-27T07:33:44.578 INFO:tasks.workunit.client.1.smithi100.stdout:1/973: unlink d0/d1b/da1/fa2 0 2024-04-27T07:33:44.580 INFO:tasks.workunit.client.1.smithi100.stdout:1/974: fsync d0/d1b/d20/f38 0 2024-04-27T07:33:44.582 INFO:tasks.workunit.client.1.smithi100.stdout:1/975: truncate d0/d1f/d6d/db4/d4e/d7b/d138/fe8 447078 0 2024-04-27T07:33:44.584 INFO:tasks.workunit.client.1.smithi100.stdout:1/976: mkdir d0/d1f/d6d/db4/d4e/d7b/ddd/d142 0 2024-04-27T07:33:44.588 INFO:tasks.workunit.client.1.smithi100.stdout:4/853: dwrite d5/d1b/f6c [0,4194304] 0 2024-04-27T07:33:44.590 INFO:tasks.workunit.client.1.smithi100.stdout:1/977: link d0/d23/d3a/cb8 d0/d1b/d20/d2d/d35/d65/d117/c143 0 2024-04-27T07:33:44.592 INFO:tasks.workunit.client.1.smithi100.stdout:4/854: creat d5/d16/d2e/d5a/f126 x:0 0 0 2024-04-27T07:33:44.596 INFO:tasks.workunit.client.1.smithi100.stdout:4/855: symlink d5/d1b/df8/d50/dbf/l127 0 2024-04-27T07:33:44.596 INFO:tasks.workunit.client.1.smithi100.stdout:1/978: getdents d0/d1b/d20/d2d/d35/d4d/de2 0 2024-04-27T07:33:44.598 INFO:tasks.workunit.client.1.smithi100.stdout:4/856: truncate d5/d1b/df8/d7d/f8b 420519 0 2024-04-27T07:33:44.600 INFO:tasks.workunit.client.1.smithi100.stdout:1/979: link d0/d1f/d6d/fd3 d0/d1b/d20/d2d/d35/f144 0 2024-04-27T07:33:44.601 INFO:tasks.workunit.client.1.smithi100.stdout:1/980: write d0/d1f/d97/fbe [171948,837] 0 2024-04-27T07:33:44.604 INFO:tasks.workunit.client.1.smithi100.stdout:1/981: creat d0/d1b/da1/f145 x:0 0 0 2024-04-27T07:33:44.607 INFO:tasks.workunit.client.1.smithi100.stdout:4/857: truncate d5/d16/fa1 1793875 0 2024-04-27T07:33:44.607 INFO:tasks.workunit.client.1.smithi100.stdout:4/858: chown d5/d16/d19/d21/f124 745506 1 2024-04-27T07:33:44.609 INFO:tasks.workunit.client.1.smithi100.stdout:1/982: link d0/d1b/d20/d2d/d35/f8b d0/f146 0 2024-04-27T07:33:44.609 INFO:tasks.workunit.client.1.smithi100.stdout:4/859: rmdir d5/d1b/df8/d50/dfc 39 2024-04-27T07:33:44.617 INFO:tasks.workunit.client.1.smithi100.stdout:5/765: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:0/791: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:2/774: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:6/918: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:3/898: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:8/895: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:7/765: sync 2024-04-27T07:33:44.618 INFO:tasks.workunit.client.1.smithi100.stdout:9/895: sync 2024-04-27T07:33:44.620 INFO:tasks.workunit.client.1.smithi100.stdout:1/983: dwrite d0/d1b/d20/d2d/f2e [0,4194304] 0 2024-04-27T07:33:44.621 INFO:tasks.workunit.client.1.smithi100.stdout:3/899: rmdir d7/dad/daf 39 2024-04-27T07:33:44.624 INFO:tasks.workunit.client.1.smithi100.stdout:8/896: chown d6/d20/d8b/d8c/ff1 1 1 2024-04-27T07:33:44.624 INFO:tasks.workunit.client.1.smithi100.stdout:6/919: stat de/d58/d21/d23/d73/l123 0 2024-04-27T07:33:44.629 INFO:tasks.workunit.client.1.smithi100.stdout:9/896: symlink d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/d106/l12f 0 2024-04-27T07:33:44.629 INFO:tasks.workunit.client.1.smithi100.stdout:5/766: write d0/d4/d21/d24/d2f/d57/d37/f1b [5384164,64564] 0 2024-04-27T07:33:44.630 INFO:tasks.workunit.client.1.smithi100.stdout:0/792: creat d1/d8/d20/d61/d66/dcf/f107 x:0 0 0 2024-04-27T07:33:44.631 INFO:tasks.workunit.client.1.smithi100.stdout:4/860: dread d5/d16/f26 [0,4194304] 0 2024-04-27T07:33:44.632 INFO:tasks.workunit.client.1.smithi100.stdout:3/900: symlink d7/d9/d10/d33/d47/l119 0 2024-04-27T07:33:44.634 INFO:tasks.workunit.client.1.smithi100.stdout:7/766: truncate d1/dd/d16/d2b/d7f/fc9 272347 0 2024-04-27T07:33:44.635 INFO:tasks.workunit.client.1.smithi100.stdout:2/775: dwrite d0/f24 [0,4194304] 0 2024-04-27T07:33:44.635 INFO:tasks.workunit.client.1.smithi100.stdout:0/793: write d1/d8/d20/d61/fb2 [1089214,68637] 0 2024-04-27T07:33:44.636 INFO:tasks.workunit.client.1.smithi100.stdout:5/767: write d0/d4/d21/d24/d2f/f5c [1120073,62572] 0 2024-04-27T07:33:44.636 INFO:tasks.workunit.client.1.smithi100.stdout:6/920: mkdir de/d58/d21/d24/d139 0 2024-04-27T07:33:44.643 INFO:tasks.workunit.client.1.smithi100.stdout:8/897: creat d6/d1b/f118 x:0 0 0 2024-04-27T07:33:44.646 INFO:tasks.workunit.client.1.smithi100.stdout:9/897: symlink d1/d9/db/d2b/d4f/d91/l130 0 2024-04-27T07:33:44.649 INFO:tasks.workunit.client.1.smithi100.stdout:2/776: unlink d0/d79/d94/dbc/c42 0 2024-04-27T07:33:44.650 INFO:tasks.workunit.client.1.smithi100.stdout:9/898: write d1/f46 [303999,97693] 0 2024-04-27T07:33:44.651 INFO:tasks.workunit.client.1.smithi100.stdout:6/921: creat de/d109/f13a x:0 0 0 2024-04-27T07:33:44.652 INFO:tasks.workunit.client.1.smithi100.stdout:0/794: dwrite d1/d8/d104/f105 [0,4194304] 0 2024-04-27T07:33:44.655 INFO:tasks.workunit.client.1.smithi100.stdout:5/768: dwrite d0/d4/f19 [0,4194304] 0 2024-04-27T07:33:44.657 INFO:tasks.workunit.client.1.smithi100.stdout:1/984: link d0/d23/d3a/f41 d0/f147 0 2024-04-27T07:33:44.658 INFO:tasks.workunit.client.1.smithi100.stdout:9/899: chown d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/f122 285 1 2024-04-27T07:33:44.660 INFO:tasks.workunit.client.1.smithi100.stdout:5/769: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 0 2024-04-27T07:33:44.660 INFO:tasks.workunit.client.1.smithi100.stdout:1/985: write d0/d1b/d20/feb [2503050,5427] 0 2024-04-27T07:33:44.664 INFO:tasks.workunit.client.1.smithi100.stdout:2/777: rmdir d0/d79/d94/dbc/d98 39 2024-04-27T07:33:44.669 INFO:tasks.workunit.client.1.smithi100.stdout:0/795: rename d1/d38/fef to d1/d8/d20/d1e/f108 0 2024-04-27T07:33:44.671 INFO:tasks.workunit.client.1.smithi100.stdout:0/796: chown d1/d8/d104 14 1 2024-04-27T07:33:44.672 INFO:tasks.workunit.client.1.smithi100.stdout:4/861: dwrite d5/f15 [0,4194304] 0 2024-04-27T07:33:44.672 INFO:tasks.workunit.client.1.smithi100.stdout:9/900: unlink d1/d9/db/d2b/d4f/d91/l130 0 2024-04-27T07:33:44.674 INFO:tasks.workunit.client.1.smithi100.stdout:5/770: dwrite d0/d42/d94/d97/d60/f96 [0,4194304] 0 2024-04-27T07:33:44.680 INFO:tasks.workunit.client.1.smithi100.stdout:7/767: dwrite d1/dd/d2a/d2c/f43 [0,4194304] 0 2024-04-27T07:33:44.684 INFO:tasks.workunit.client.1.smithi100.stdout:4/862: fsync d5/d23/fc4 0 2024-04-27T07:33:44.684 INFO:tasks.workunit.client.1.smithi100.stdout:3/901: dread d7/d9/d10/d22/fe8 [0,4194304] 0 2024-04-27T07:33:44.686 INFO:tasks.workunit.client.1.smithi100.stdout:7/768: write d1/d54/f5f [6058188,105087] 0 2024-04-27T07:33:44.686 INFO:tasks.workunit.client.1.smithi100.stdout:6/922: write de/d58/d21/d23/f82 [780592,106542] 0 2024-04-27T07:33:44.690 INFO:tasks.workunit.client.1.smithi100.stdout:3/902: dread - d7/ff7 zero size 2024-04-27T07:33:44.691 INFO:tasks.workunit.client.1.smithi100.stdout:1/986: creat d0/d1f/d6d/db4/d4e/d7b/d138/f148 x:0 0 0 2024-04-27T07:33:44.693 INFO:tasks.workunit.client.1.smithi100.stdout:9/901: mkdir d1/d9/db/d2b/d4f/dac/d131 0 2024-04-27T07:33:44.697 INFO:tasks.workunit.client.1.smithi100.stdout:6/923: dread de/d2e/d3f/ff2 [0,4194304] 0 2024-04-27T07:33:44.699 INFO:tasks.workunit.client.1.smithi100.stdout:2/778: symlink d0/d79/d94/dbc/d98/db1/de9/l101 0 2024-04-27T07:33:44.700 INFO:tasks.workunit.client.1.smithi100.stdout:1/987: rename d0/d1b/da1/la8 to d0/d1f/d6d/db4/d4e/d7b/ddd/l149 0 2024-04-27T07:33:44.701 INFO:tasks.workunit.client.1.smithi100.stdout:9/902: mknod d1/d9/db/d2b/de7/c132 0 2024-04-27T07:33:44.702 INFO:tasks.workunit.client.1.smithi100.stdout:0/797: dwrite d1/d8/d20/f2b [0,4194304] 0 2024-04-27T07:33:44.702 INFO:tasks.workunit.client.1.smithi100.stdout:4/863: symlink d5/d1b/d65/de9/l128 0 2024-04-27T07:33:44.703 INFO:tasks.workunit.client.1.smithi100.stdout:4/864: stat d5/f88 0 2024-04-27T07:33:44.706 INFO:tasks.workunit.client.1.smithi100.stdout:4/865: write d5/f88 [1128820,72018] 0 2024-04-27T07:33:44.707 INFO:tasks.workunit.client.1.smithi100.stdout:5/771: fdatasync d0/d42/d94/d97/d60/f96 0 2024-04-27T07:33:44.710 INFO:tasks.workunit.client.1.smithi100.stdout:4/866: dread - d5/d16/d4c/f5d zero size 2024-04-27T07:33:44.714 INFO:tasks.workunit.client.1.smithi100.stdout:4/867: fdatasync d5/d16/d19/d21/d87/ffa 0 2024-04-27T07:33:44.714 INFO:tasks.workunit.client.1.smithi100.stdout:7/769: write d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a [533023,10629] 0 2024-04-27T07:33:44.716 INFO:tasks.workunit.client.1.smithi100.stdout:1/988: truncate d0/d1b/d20/d2d/d35/d65/fb9 1203980 0 2024-04-27T07:33:44.717 INFO:tasks.workunit.client.1.smithi100.stdout:9/903: dwrite d1/d9/db/d2b/d4f/dac/f7c [0,4194304] 0 2024-04-27T07:33:44.718 INFO:tasks.workunit.client.1.smithi100.stdout:7/770: fdatasync d1/dd/d2a/d2c/fc2 0 2024-04-27T07:33:44.718 INFO:tasks.workunit.client.1.smithi100.stdout:6/924: dread fd [0,4194304] 0 2024-04-27T07:33:44.721 INFO:tasks.workunit.client.1.smithi100.stdout:7/771: write d1/d54/fde [236212,128592] 0 2024-04-27T07:33:44.722 INFO:tasks.workunit.client.1.smithi100.stdout:9/904: truncate d1/d9/db/fb2 5034319 0 2024-04-27T07:33:44.723 INFO:tasks.workunit.client.1.smithi100.stdout:5/772: getdents d0/d42/d94/d9a 0 2024-04-27T07:33:44.723 INFO:tasks.workunit.client.1.smithi100.stdout:6/925: write de/d58/d21/fb2 [2718465,89883] 0 2024-04-27T07:33:44.724 INFO:tasks.workunit.client.1.smithi100.stdout:0/798: getdents d1/d38/d3a/d54/db1 0 2024-04-27T07:33:44.724 INFO:tasks.workunit.client.1.smithi100.stdout:4/868: creat d5/d23/d33/f129 x:0 0 0 2024-04-27T07:33:44.728 INFO:tasks.workunit.client.1.smithi100.stdout:4/869: stat d5/d16/d19/d46/d53/d7e 0 2024-04-27T07:33:44.729 INFO:tasks.workunit.client.1.smithi100.stdout:6/926: chown de/d58/d21/d23/da0/fe3 630 1 2024-04-27T07:33:44.731 INFO:tasks.workunit.client.1.smithi100.stdout:4/870: write d5/fe3 [1896198,8536] 0 2024-04-27T07:33:44.733 INFO:tasks.workunit.client.1.smithi100.stdout:3/903: dread d7/d9/d10/d3e/d74/db1/d9d/f80 [0,4194304] 0 2024-04-27T07:33:44.734 INFO:tasks.workunit.client.1.smithi100.stdout:0/799: read d1/d8/d14/d59/d64/fe7 [2588273,98658] 0 2024-04-27T07:33:44.736 INFO:tasks.workunit.client.1.smithi100.stdout:5/773: dread d0/d4/d21/d24/f5a [0,4194304] 0 2024-04-27T07:33:44.736 INFO:tasks.workunit.client.1.smithi100.stdout:7/772: dread d1/dd/d16/d70/fa0 [0,4194304] 0 2024-04-27T07:33:44.737 INFO:tasks.workunit.client.1.smithi100.stdout:6/927: mknod de/d109/d134/c13b 0 2024-04-27T07:33:44.738 INFO:tasks.workunit.client.1.smithi100.stdout:6/928: stat de/d58/d90/cc6 0 2024-04-27T07:33:44.740 INFO:tasks.workunit.client.1.smithi100.stdout:1/989: getdents d0/d1b/d20/d2d/d35/d4d/d60/d79 0 2024-04-27T07:33:44.741 INFO:tasks.workunit.client.1.smithi100.stdout:7/773: dread - d1/dd/d16/d3e/f7c zero size 2024-04-27T07:33:44.742 INFO:tasks.workunit.client.1.smithi100.stdout:0/800: creat d1/d8/d20/df6/f109 x:0 0 0 2024-04-27T07:33:44.743 INFO:tasks.workunit.client.1.smithi100.stdout:9/905: getdents d1/d76/dd6 0 2024-04-27T07:33:44.744 INFO:tasks.workunit.client.1.smithi100.stdout:3/904: symlink d7/d9/d10/d28/dfb/l11a 0 2024-04-27T07:33:44.744 INFO:tasks.workunit.client.1.smithi100.stdout:2/779: dread d0/da/d29/d47/f7e [0,4194304] 0 2024-04-27T07:33:44.745 INFO:tasks.workunit.client.1.smithi100.stdout:4/871: dwrite d5/fe3 [0,4194304] 0 2024-04-27T07:33:44.746 INFO:tasks.workunit.client.1.smithi100.stdout:5/774: creat d0/d4/d21/d24/d2f/d57/d37/db4/ff8 x:0 0 0 2024-04-27T07:33:44.748 INFO:tasks.workunit.client.1.smithi100.stdout:6/929: write de/d58/d21/d23/f3e [525885,4328] 0 2024-04-27T07:33:44.748 INFO:tasks.workunit.client.1.smithi100.stdout:2/780: stat d0/da/fe4 0 2024-04-27T07:33:44.749 INFO:tasks.workunit.client.1.smithi100.stdout:0/801: symlink d1/d8/d20/d61/d66/dcf/l10a 0 2024-04-27T07:33:44.750 INFO:tasks.workunit.client.1.smithi100.stdout:5/775: dread - d0/d4/d21/d24/d2f/ff1 zero size 2024-04-27T07:33:44.753 INFO:tasks.workunit.client.1.smithi100.stdout:9/906: mknod d1/d9/db/da1/dfb/c133 0 2024-04-27T07:33:44.755 INFO:tasks.workunit.client.1.smithi100.stdout:6/930: symlink de/d58/d21/d23/l13c 0 2024-04-27T07:33:44.755 INFO:tasks.workunit.client.1.smithi100.stdout:0/802: chown d1/d8/c44 19 1 2024-04-27T07:33:44.756 INFO:tasks.workunit.client.1.smithi100.stdout:3/905: symlink d7/d9/d10/d33/l11b 0 2024-04-27T07:33:44.758 INFO:tasks.workunit.client.1.smithi100.stdout:1/990: creat d0/d1b/d20/d2d/d35/d4d/d60/f14a x:0 0 0 2024-04-27T07:33:44.758 INFO:tasks.workunit.client.1.smithi100.stdout:6/931: stat de/d2e/d3f/d80/fa1 0 2024-04-27T07:33:44.759 INFO:tasks.workunit.client.1.smithi100.stdout:4/872: creat d5/d16/f12a x:0 0 0 2024-04-27T07:33:44.759 INFO:tasks.workunit.client.1.smithi100.stdout:7/774: dwrite d1/dd/d16/d31/d4c/d4d/fe2 [0,4194304] 0 2024-04-27T07:33:44.764 INFO:tasks.workunit.client.1.smithi100.stdout:4/873: fdatasync d5/d16/d19/d21/f124 0 2024-04-27T07:33:44.767 INFO:tasks.workunit.client.1.smithi100.stdout:0/803: read d1/d8/d20/d61/d6a/f97 [3788892,63742] 0 2024-04-27T07:33:44.767 INFO:tasks.workunit.client.1.smithi100.stdout:1/991: creat d0/d1f/d6d/db4/d40/f14b x:0 0 0 2024-04-27T07:33:44.768 INFO:tasks.workunit.client.1.smithi100.stdout:5/776: dwrite d0/d4/d21/d24/d2f/d57/f91 [0,4194304] 0 2024-04-27T07:33:44.770 INFO:tasks.workunit.client.1.smithi100.stdout:2/781: getdents d0/da/d29/d47/d5a/d8d/d5d 0 2024-04-27T07:33:44.771 INFO:tasks.workunit.client.1.smithi100.stdout:4/874: chown d5/d1b/df8/d3f/d96 6816687 1 2024-04-27T07:33:44.772 INFO:tasks.workunit.client.1.smithi100.stdout:6/932: rename de/d58/d90/fcd to de/d58/d21/d91/df0/f13d 0 2024-04-27T07:33:44.774 INFO:tasks.workunit.client.1.smithi100.stdout:7/775: mknod d1/dd/d2a/d2c/ce4 0 2024-04-27T07:33:44.776 INFO:tasks.workunit.client.1.smithi100.stdout:9/907: dwrite d1/d9/db/d56/d5c/fcf [4194304,4194304] 0 2024-04-27T07:33:44.777 INFO:tasks.workunit.client.1.smithi100.stdout:0/804: read d1/d8/f2e [1532281,8674] 0 2024-04-27T07:33:44.778 INFO:tasks.workunit.client.1.smithi100.stdout:3/906: getdents d7/d9/d26/d2a/dc4 0 2024-04-27T07:33:44.781 INFO:tasks.workunit.client.1.smithi100.stdout:5/777: fdatasync d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 0 2024-04-27T07:33:44.781 INFO:tasks.workunit.client.1.smithi100.stdout:9/908: chown d1/d9/db/d2b/c9e 7353 1 2024-04-27T07:33:44.782 INFO:tasks.workunit.client.1.smithi100.stdout:6/933: unlink de/d58/d21/d23/c6b 0 2024-04-27T07:33:44.783 INFO:tasks.workunit.client.1.smithi100.stdout:5/778: write d0/d4/f11 [5233247,118033] 0 2024-04-27T07:33:44.784 INFO:tasks.workunit.client.1.smithi100.stdout:7/776: symlink d1/dd/d16/d3e/le5 0 2024-04-27T07:33:44.784 INFO:tasks.workunit.client.1.smithi100.stdout:9/909: dread - d1/d9/db/d2b/d4f/f62 zero size 2024-04-27T07:33:44.785 INFO:tasks.workunit.client.1.smithi100.stdout:4/875: symlink d5/d1b/df8/dd7/l12b 0 2024-04-27T07:33:44.787 INFO:tasks.workunit.client.1.smithi100.stdout:3/907: creat d7/d9/d10/d28/f11c x:0 0 0 2024-04-27T07:33:44.789 INFO:tasks.workunit.client.1.smithi100.stdout:2/782: dread d0/d1e/f7c [0,4194304] 0 2024-04-27T07:33:44.789 INFO:tasks.workunit.client.1.smithi100.stdout:9/910: truncate d1/d9/db/d2b/dfd/f102 1457709 0 2024-04-27T07:33:44.790 INFO:tasks.workunit.client.1.smithi100.stdout:1/992: link d0/d23/d3a/df0/fff d0/d1b/d20/d2d/d35/d4d/f14c 0 2024-04-27T07:33:44.793 INFO:tasks.workunit.client.1.smithi100.stdout:4/876: mkdir d5/d16/d19/d21/d6d/dad/d12c 0 2024-04-27T07:33:44.795 INFO:tasks.workunit.client.1.smithi100.stdout:6/934: dwrite de/d2e/d3f/d80/fdf [0,4194304] 0 2024-04-27T07:33:44.795 INFO:tasks.workunit.client.1.smithi100.stdout:3/908: fdatasync d7/d9/d10/f29 0 2024-04-27T07:33:44.798 INFO:tasks.workunit.client.1.smithi100.stdout:9/911: fsync d1/d9/db/d56/d5c/de3/d4a/d67/d8a/f11b 0 2024-04-27T07:33:44.799 INFO:tasks.workunit.client.1.smithi100.stdout:0/805: getdents d1/d8/d20/d61 0 2024-04-27T07:33:44.800 INFO:tasks.workunit.client.1.smithi100.stdout:1/993: mknod d0/d23/c14d 0 2024-04-27T07:33:44.800 INFO:tasks.workunit.client.1.smithi100.stdout:3/909: stat d7/d9/da5 0 2024-04-27T07:33:44.802 INFO:tasks.workunit.client.1.smithi100.stdout:4/877: mknod d5/d1b/d65/c12d 0 2024-04-27T07:33:44.803 INFO:tasks.workunit.client.1.smithi100.stdout:7/777: dwrite d1/dd/d16/d31/d4c/d4d/d3b/dcc/fda [0,4194304] 0 2024-04-27T07:33:44.804 INFO:tasks.workunit.client.1.smithi100.stdout:6/935: mknod de/d58/d21/d23/d73/c13e 0 2024-04-27T07:33:44.805 INFO:tasks.workunit.client.1.smithi100.stdout:6/936: chown de/d2e/f96 169356345 1 2024-04-27T07:33:44.805 INFO:tasks.workunit.client.1.smithi100.stdout:0/806: rmdir d1/d8 39 2024-04-27T07:33:44.807 INFO:tasks.workunit.client.1.smithi100.stdout:7/778: write d1/dd/d16/f66 [911917,24982] 0 2024-04-27T07:33:44.812 INFO:tasks.workunit.client.1.smithi100.stdout:2/783: creat d0/d79/d94/dbc/f102 x:0 0 0 2024-04-27T07:33:44.814 INFO:tasks.workunit.client.1.smithi100.stdout:1/994: symlink d0/d1b/d20/d2d/d35/dac/l14e 0 2024-04-27T07:33:44.816 INFO:tasks.workunit.client.1.smithi100.stdout:3/910: unlink d7/d9/d26/d2a/dc4/f117 0 2024-04-27T07:33:44.818 INFO:tasks.workunit.client.1.smithi100.stdout:3/911: chown d7/d9/d10/d3e/d74/db1/d9d 377264 1 2024-04-27T07:33:44.820 INFO:tasks.workunit.client.1.smithi100.stdout:6/937: creat de/d58/d28/f13f x:0 0 0 2024-04-27T07:33:44.821 INFO:tasks.workunit.client.1.smithi100.stdout:2/784: dwrite d0/da/d29/d47/da1/da3/fe0 [0,4194304] 0 2024-04-27T07:33:44.822 INFO:tasks.workunit.client.1.smithi100.stdout:3/912: chown d7/d9/d26/d2a/d5e/d98/cf1 6 1 2024-04-27T07:33:44.822 INFO:tasks.workunit.client.1.smithi100.stdout:9/912: creat d1/d76/dd6/d12e/f134 x:0 0 0 2024-04-27T07:33:44.823 INFO:tasks.workunit.client.1.smithi100.stdout:7/779: mkdir d1/d75/de6 0 2024-04-27T07:33:44.825 INFO:tasks.workunit.client.1.smithi100.stdout:6/938: dread de/d58/d21/d91/fd1 [0,4194304] 0 2024-04-27T07:33:44.825 INFO:tasks.workunit.client.1.smithi100.stdout:3/913: stat d7/d9/d10/d33/d90/d3a/dd6/dee/f101 0 2024-04-27T07:33:44.825 INFO:tasks.workunit.client.1.smithi100.stdout:4/878: symlink d5/l12e 0 2024-04-27T07:33:44.826 INFO:tasks.workunit.client.1.smithi100.stdout:2/785: read d0/d1e/f57 [687270,103103] 0 2024-04-27T07:33:44.828 INFO:tasks.workunit.client.1.smithi100.stdout:6/939: write de/d58/d21/d91/f128 [1020809,60641] 0 2024-04-27T07:33:44.831 INFO:tasks.workunit.client.1.smithi100.stdout:6/940: fsync de/d58/d21/d24/d9f/daa/fdd 0 2024-04-27T07:33:44.832 INFO:tasks.workunit.client.1.smithi100.stdout:4/879: readlink d5/d1b/df8/d3f/le5 0 2024-04-27T07:33:44.833 INFO:tasks.workunit.client.1.smithi100.stdout:6/941: write de/d58/d21/fb2 [783857,82970] 0 2024-04-27T07:33:44.835 INFO:tasks.workunit.client.1.smithi100.stdout:2/786: fdatasync d0/da/d29/d47/f91 0 2024-04-27T07:33:44.837 INFO:tasks.workunit.client.1.smithi100.stdout:0/807: symlink d1/d8/d20/d72/l10b 0 2024-04-27T07:33:44.839 INFO:tasks.workunit.client.1.smithi100.stdout:6/942: write de/d58/d28/f6a [731236,79416] 0 2024-04-27T07:33:44.840 INFO:tasks.workunit.client.1.smithi100.stdout:3/914: mkdir d7/d9/d10/d3e/d11d 0 2024-04-27T07:33:44.840 INFO:tasks.workunit.client.1.smithi100.stdout:6/943: readlink lb 0 2024-04-27T07:33:44.840 INFO:tasks.workunit.client.1.smithi100.stdout:9/913: dwrite d1/f85 [0,4194304] 0 2024-04-27T07:33:44.846 INFO:tasks.workunit.client.1.smithi100.stdout:4/880: dwrite d5/fe3 [0,4194304] 0 2024-04-27T07:33:44.849 INFO:tasks.workunit.client.1.smithi100.stdout:0/808: creat d1/d30/f10c x:0 0 0 2024-04-27T07:33:44.851 INFO:tasks.workunit.client.1.smithi100.stdout:6/944: dread de/d2e/f77 [0,4194304] 0 2024-04-27T07:33:44.853 INFO:tasks.workunit.client.1.smithi100.stdout:7/780: dread d1/dd/d16/d31/d4c/d4d/f6b [0,4194304] 0 2024-04-27T07:33:44.853 INFO:tasks.workunit.client.1.smithi100.stdout:9/914: creat d1/d9/db/d56/d5c/de3/d4a/f135 x:0 0 0 2024-04-27T07:33:44.860 INFO:tasks.workunit.client.1.smithi100.stdout:3/915: dwrite d7/d9/d26/d2a/f20 [0,4194304] 0 2024-04-27T07:33:44.860 INFO:tasks.workunit.client.1.smithi100.stdout:2/787: link d0/d1e/l4c d0/da/d29/d47/da1/dc3/l103 0 2024-04-27T07:33:44.862 INFO:tasks.workunit.client.1.smithi100.stdout:0/809: mkdir d1/d8/d14/ded/d10d 0 2024-04-27T07:33:44.865 INFO:tasks.workunit.client.1.smithi100.stdout:7/781: symlink d1/dd/d16/d4a/le7 0 2024-04-27T07:33:44.866 INFO:tasks.workunit.client.1.smithi100.stdout:9/915: dwrite d1/d9/db/d56/d5c/de3/d4a/daa/de9/ffc [4194304,4194304] 0 2024-04-27T07:33:44.867 INFO:tasks.workunit.client.1.smithi100.stdout:4/881: link d5/d16/d2e/d5a/l7a d5/d23/d33/l12f 0 2024-04-27T07:33:44.869 INFO:tasks.workunit.client.1.smithi100.stdout:9/916: dread - d1/d9/db/d2b/d4f/d57/f87 zero size 2024-04-27T07:33:44.870 INFO:tasks.workunit.client.1.smithi100.stdout:1/995: write d0/d1b/d20/d2d/d35/f144 [248116,86909] 0 2024-04-27T07:33:44.871 INFO:tasks.workunit.client.1.smithi100.stdout:3/916: readlink d7/d9/d10/d3e/d55/l56 0 2024-04-27T07:33:44.871 INFO:tasks.workunit.client.1.smithi100.stdout:0/810: chown d1/c7 32472 1 2024-04-27T07:33:44.872 INFO:tasks.workunit.client.1.smithi100.stdout:7/782: mknod d1/dd/d16/d4a/d56/ce8 0 2024-04-27T07:33:44.874 INFO:tasks.workunit.client.1.smithi100.stdout:4/882: rename d5/d23/l29 to d5/d16/d19/d46/l130 0 2024-04-27T07:33:44.876 INFO:tasks.workunit.client.1.smithi100.stdout:3/917: fdatasync d7/d9/d10/d3e/d55/fd3 0 2024-04-27T07:33:44.913 INFO:tasks.workunit.client.1.smithi100.stdout:8/898: sync 2024-04-27T07:33:44.956 INFO:tasks.workunit.client.1.smithi100.stdout:0/811: mkdir d1/d38/d10e 0 2024-04-27T07:33:44.957 INFO:tasks.workunit.client.1.smithi100.stdout:4/883: mkdir d5/d16/d19/d46/dd1/d11e/d131 0 2024-04-27T07:33:44.959 INFO:tasks.workunit.client.1.smithi100.stdout:3/918: chown d7/cf6 5385578 1 2024-04-27T07:33:44.960 INFO:tasks.workunit.client.1.smithi100.stdout:6/945: truncate de/d2e/d86/f93 1117593 0 2024-04-27T07:33:44.960 INFO:tasks.workunit.client.1.smithi100.stdout:1/996: unlink d0/d1b/d20/d2d/d35/d4d/d60/dcd/c11b 0 2024-04-27T07:33:44.960 INFO:tasks.workunit.client.1.smithi100.stdout:2/788: getdents d0/d79/d94/dbc 0 2024-04-27T07:33:44.963 INFO:tasks.workunit.client.1.smithi100.stdout:8/899: mknod d6/dda/c119 0 2024-04-27T07:33:44.963 INFO:tasks.workunit.client.1.smithi100.stdout:0/812: mknod d1/d8/d20/d72/d96/c10f 0 2024-04-27T07:33:44.964 INFO:tasks.workunit.client.1.smithi100.stdout:4/884: mknod d5/d1b/df8/d7d/c132 0 2024-04-27T07:33:44.964 INFO:tasks.workunit.client.1.smithi100.stdout:2/789: write d0/da/f50 [1279826,6678] 0 2024-04-27T07:33:44.965 INFO:tasks.workunit.client.1.smithi100.stdout:4/885: fdatasync d5/f9 0 2024-04-27T07:33:44.967 INFO:tasks.workunit.client.1.smithi100.stdout:6/946: mknod de/dfc/c140 0 2024-04-27T07:33:44.967 INFO:tasks.workunit.client.1.smithi100.stdout:0/813: dread d1/d8/d14/d59/d99/fc5 [0,4194304] 0 2024-04-27T07:33:44.968 INFO:tasks.workunit.client.1.smithi100.stdout:6/947: fsync de/d58/d21/d23/f3e 0 2024-04-27T07:33:44.969 INFO:tasks.workunit.client.1.smithi100.stdout:0/814: read - d1/d38/d3a/ff7 zero size 2024-04-27T07:33:44.969 INFO:tasks.workunit.client.1.smithi100.stdout:8/900: symlink d6/d20/da2/l11a 0 2024-04-27T07:33:44.974 INFO:tasks.workunit.client.1.smithi100.stdout:4/886: unlink d5/f32 0 2024-04-27T07:33:44.976 INFO:tasks.workunit.client.1.smithi100.stdout:1/997: creat d0/d23/d3a/d75/f14f x:0 0 0 2024-04-27T07:33:44.979 INFO:tasks.workunit.client.1.smithi100.stdout:6/948: dwrite de/d2e/d86/f9a [0,4194304] 0 2024-04-27T07:33:44.979 INFO:tasks.workunit.client.1.smithi100.stdout:7/783: dread d1/dd/d16/d31/d4c/d4d/d3b/fb9 [0,4194304] 0 2024-04-27T07:33:44.983 INFO:tasks.workunit.client.1.smithi100.stdout:8/901: creat d6/d20/d54/d91/dae/df3/f11b x:0 0 0 2024-04-27T07:33:44.984 INFO:tasks.workunit.client.1.smithi100.stdout:3/919: creat d7/d9/d10/d3e/f11e x:0 0 0 2024-04-27T07:33:44.985 INFO:tasks.workunit.client.1.smithi100.stdout:4/887: truncate d5/d1b/df8/fc3 138356 0 2024-04-27T07:33:44.991 INFO:tasks.workunit.client.1.smithi100.stdout:6/949: creat de/d58/d21/d91/f141 x:0 0 0 2024-04-27T07:33:44.993 INFO:tasks.workunit.client.1.smithi100.stdout:3/920: fdatasync d7/f114 0 2024-04-27T07:33:44.995 INFO:tasks.workunit.client.1.smithi100.stdout:1/998: symlink d0/d1f/d6d/db4/d4e/d7b/ddd/d142/l150 0 2024-04-27T07:33:44.997 INFO:tasks.workunit.client.1.smithi100.stdout:4/888: fdatasync d5/d16/d19/d21/d77/fa5 0 2024-04-27T07:33:44.999 INFO:tasks.workunit.client.1.smithi100.stdout:6/950: symlink de/d58/d21/d91/l142 0 2024-04-27T07:33:45.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/921: creat d7/d9/d26/f11f x:0 0 0 2024-04-27T07:33:45.002 INFO:tasks.workunit.client.1.smithi100.stdout:2/790: write d0/da/d29/d47/d5a/d8d/fea [1218905,67528] 0 2024-04-27T07:33:45.003 INFO:tasks.workunit.client.1.smithi100.stdout:4/889: stat d5/d16/d19/d46/d53/f98 0 2024-04-27T07:33:45.004 INFO:tasks.workunit.client.1.smithi100.stdout:6/951: creat de/d58/d21/d91/df0/f143 x:0 0 0 2024-04-27T07:33:45.007 INFO:tasks.workunit.client.1.smithi100.stdout:2/791: write d0/da/d29/d47/d5a/dd9/dff/d88/faa [4070073,30010] 0 2024-04-27T07:33:45.007 INFO:tasks.workunit.client.1.smithi100.stdout:3/922: creat d7/d9/d10/d22/f120 x:0 0 0 2024-04-27T07:33:45.009 INFO:tasks.workunit.client.1.smithi100.stdout:4/890: creat d5/d16/d19/d46/d53/d7e/f133 x:0 0 0 2024-04-27T07:33:45.009 INFO:tasks.workunit.client.1.smithi100.stdout:3/923: truncate d7/f114 36100 0 2024-04-27T07:33:45.011 INFO:tasks.workunit.client.1.smithi100.stdout:3/924: dread - d7/d9/d26/d2a/db3/f116 zero size 2024-04-27T07:33:45.012 INFO:tasks.workunit.client.1.smithi100.stdout:6/952: rename f7 to de/d58/d21/d23/f144 0 2024-04-27T07:33:45.013 INFO:tasks.workunit.client.1.smithi100.stdout:0/815: write d1/d8/d20/df6/f103 [750969,106718] 0 2024-04-27T07:33:45.014 INFO:tasks.workunit.client.1.smithi100.stdout:2/792: chown d0/da/d29/ld4 3579 1 2024-04-27T07:33:45.014 INFO:tasks.workunit.client.1.smithi100.stdout:1/999: dread d0/d23/d3a/df0/fff [0,4194304] 0 2024-04-27T07:33:45.016 INFO:tasks.workunit.client.1.smithi100.stdout:2/793: write d0/d79/d94/dbc/d98/db1/fb8 [3006371,1897] 0 2024-04-27T07:33:45.017 INFO:tasks.workunit.client.1.smithi100.stdout:4/891: symlink d5/d1b/df8/d50/dbf/l134 0 2024-04-27T07:33:45.019 INFO:tasks.workunit.client.1.smithi100.stdout:7/784: dread d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:45.019 INFO:tasks.workunit.client.1.smithi100.stdout:6/953: mknod de/d58/d90/c145 0 2024-04-27T07:33:45.020 INFO:tasks.workunit.client.1.smithi100.stdout:8/902: dread d6/f27 [0,4194304] 0 2024-04-27T07:33:45.020 INFO:tasks.workunit.client.1.smithi100.stdout:7/785: stat d1/dd/d16/d31/d4c/fd9 0 2024-04-27T07:33:45.022 INFO:tasks.workunit.client.1.smithi100.stdout:4/892: creat d5/d1b/d65/f135 x:0 0 0 2024-04-27T07:33:45.024 INFO:tasks.workunit.client.1.smithi100.stdout:0/816: truncate d1/d8/d20/d61/f7d 515926 0 2024-04-27T07:33:45.025 INFO:tasks.workunit.client.1.smithi100.stdout:2/794: symlink d0/l104 0 2024-04-27T07:33:45.026 INFO:tasks.workunit.client.1.smithi100.stdout:4/893: write d5/d16/d19/d46/d53/dba/dd0/f10a [653873,5680] 0 2024-04-27T07:33:45.027 INFO:tasks.workunit.client.1.smithi100.stdout:6/954: dwrite f6 [0,4194304] 0 2024-04-27T07:33:45.028 INFO:tasks.workunit.client.1.smithi100.stdout:7/786: creat d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/fe9 x:0 0 0 2024-04-27T07:33:45.029 INFO:tasks.workunit.client.1.smithi100.stdout:0/817: creat d1/d8/d14/ded/f110 x:0 0 0 2024-04-27T07:33:45.030 INFO:tasks.workunit.client.1.smithi100.stdout:8/903: rename d6/dda/ded/c60 to d6/d20/d50/c11c 0 2024-04-27T07:33:45.031 INFO:tasks.workunit.client.1.smithi100.stdout:8/904: dread - d6/dda/f10b zero size 2024-04-27T07:33:45.033 INFO:tasks.workunit.client.1.smithi100.stdout:2/795: getdents d0/da/d29/d47/dae/df4 0 2024-04-27T07:33:45.035 INFO:tasks.workunit.client.1.smithi100.stdout:8/905: dread d6/d1b/d1d/d59/fb4 [0,4194304] 0 2024-04-27T07:33:45.043 INFO:tasks.workunit.client.1.smithi100.stdout:4/894: dwrite d5/f9 [0,4194304] 0 2024-04-27T07:33:45.045 INFO:tasks.workunit.client.1.smithi100.stdout:4/895: chown d5/d1b/df8/dd7/df0/lf5 3068 1 2024-04-27T07:33:45.059 INFO:tasks.workunit.client.1.smithi100.stdout:0/818: dread d1/d8/f83 [0,4194304] 0 2024-04-27T07:33:45.062 INFO:tasks.workunit.client.1.smithi100.stdout:0/819: dread - d1/d8/d20/fd7 zero size 2024-04-27T07:33:45.063 INFO:tasks.workunit.client.1.smithi100.stdout:2/796: dwrite d0/da/d29/d47/d5a/d8d/fa9 [0,4194304] 0 2024-04-27T07:33:45.064 INFO:tasks.workunit.client.1.smithi100.stdout:2/797: chown d0/d79/d94/dbc/d98/db1/lfb 0 1 2024-04-27T07:33:45.067 INFO:tasks.workunit.client.1.smithi100.stdout:4/896: dread d5/d1b/df8/d50/db0/fcf [0,4194304] 0 2024-04-27T07:33:45.076 INFO:tasks.workunit.client.1.smithi100.stdout:0/820: fdatasync d1/d8/d20/d1e/f108 0 2024-04-27T07:33:45.078 INFO:tasks.workunit.client.1.smithi100.stdout:8/906: mkdir d6/d1b/d1d/d11d 0 2024-04-27T07:33:45.080 INFO:tasks.workunit.client.1.smithi100.stdout:2/798: mkdir d0/da/d105 0 2024-04-27T07:33:45.081 INFO:tasks.workunit.client.1.smithi100.stdout:0/821: write d1/d8/d14/d59/fb5 [5144704,51839] 0 2024-04-27T07:33:45.082 INFO:tasks.workunit.client.1.smithi100.stdout:0/822: chown d1/d8/d20/l1a 16398931 1 2024-04-27T07:33:45.082 INFO:tasks.workunit.client.1.smithi100.stdout:8/907: mknod d6/d20/d50/d72/c11e 0 2024-04-27T07:33:45.084 INFO:tasks.workunit.client.1.smithi100.stdout:2/799: rmdir d0/da/d29/d47 39 2024-04-27T07:33:45.084 INFO:tasks.workunit.client.1.smithi100.stdout:8/908: write d6/d20/d50/f8a [309498,80217] 0 2024-04-27T07:33:45.086 INFO:tasks.workunit.client.1.smithi100.stdout:8/909: chown d6/d20/l7a 2 1 2024-04-27T07:33:45.088 INFO:tasks.workunit.client.1.smithi100.stdout:4/897: getdents d5/d16/d19/dca/de0 0 2024-04-27T07:33:45.090 INFO:tasks.workunit.client.1.smithi100.stdout:0/823: dwrite d1/d38/dae/fe1 [0,4194304] 0 2024-04-27T07:33:45.091 INFO:tasks.workunit.client.1.smithi100.stdout:5/779: sync 2024-04-27T07:33:45.092 INFO:tasks.workunit.client.1.smithi100.stdout:4/898: readlink d5/d23/d33/lf1 0 2024-04-27T07:33:45.093 INFO:tasks.workunit.client.1.smithi100.stdout:8/910: mknod d6/d20/d54/c11f 0 2024-04-27T07:33:45.093 INFO:tasks.workunit.client.1.smithi100.stdout:5/780: write d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 [660282,106481] 0 2024-04-27T07:33:45.094 INFO:tasks.workunit.client.1.smithi100.stdout:0/824: mknod d1/d8/d104/c111 0 2024-04-27T07:33:45.094 INFO:tasks.workunit.client.1.smithi100.stdout:8/911: stat d6/d20/d54/d91/d9e/lfa 0 2024-04-27T07:33:45.095 INFO:tasks.workunit.client.1.smithi100.stdout:0/825: readlink d1/d8/d20/l101 0 2024-04-27T07:33:45.095 INFO:tasks.workunit.client.1.smithi100.stdout:2/800: creat d0/d1e/f106 x:0 0 0 2024-04-27T07:33:45.096 INFO:tasks.workunit.client.1.smithi100.stdout:4/899: symlink d5/d1b/d65/l136 0 2024-04-27T07:33:45.096 INFO:tasks.workunit.client.1.smithi100.stdout:0/826: write d1/d8/d20/faa [1186737,7223] 0 2024-04-27T07:33:45.098 INFO:tasks.workunit.client.1.smithi100.stdout:5/781: creat d0/d4/d21/d24/d2f/d39/ff9 x:0 0 0 2024-04-27T07:33:45.099 INFO:tasks.workunit.client.1.smithi100.stdout:0/827: dread d1/d8/d14/d59/d99/fbf [0,4194304] 0 2024-04-27T07:33:45.100 INFO:tasks.workunit.client.1.smithi100.stdout:8/912: rmdir d6/d20/d54/d91/dae/df3 39 2024-04-27T07:33:45.104 INFO:tasks.workunit.client.1.smithi100.stdout:4/900: dread d5/d1b/f5f [8388608,4194304] 0 2024-04-27T07:33:45.109 INFO:tasks.workunit.client.1.smithi100.stdout:2/801: dwrite d0/da/d29/d47/d5a/dd9/dff/d88/faa [0,4194304] 0 2024-04-27T07:33:45.110 INFO:tasks.workunit.client.1.smithi100.stdout:8/913: rename d6/d20/d50/d72/da4/lc3 to d6/d20/d50/d72/d10a/l120 0 2024-04-27T07:33:45.110 INFO:tasks.workunit.client.1.smithi100.stdout:5/782: dread d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 [0,4194304] 0 2024-04-27T07:33:45.111 INFO:tasks.workunit.client.1.smithi100.stdout:8/914: chown d6/d20/f33 1958633 1 2024-04-27T07:33:45.113 INFO:tasks.workunit.client.1.smithi100.stdout:8/915: chown d6/d20/d54/d91/dae/l66 1781694 1 2024-04-27T07:33:45.113 INFO:tasks.workunit.client.1.smithi100.stdout:5/783: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/cd1 58 1 2024-04-27T07:33:45.116 INFO:tasks.workunit.client.1.smithi100.stdout:5/784: write d0/d4/d21/d24/fc8 [960367,25802] 0 2024-04-27T07:33:45.119 INFO:tasks.workunit.client.1.smithi100.stdout:6/955: dwrite de/d2e/d86/f93 [0,4194304] 0 2024-04-27T07:33:45.121 INFO:tasks.workunit.client.1.smithi100.stdout:2/802: symlink d0/da/d75/l107 0 2024-04-27T07:33:45.123 INFO:tasks.workunit.client.1.smithi100.stdout:8/916: write d6/dda/ded/f65 [1800286,130429] 0 2024-04-27T07:33:45.133 INFO:tasks.workunit.client.1.smithi100.stdout:4/901: write d5/d16/d19/d46/d53/d7e/fa9 [1485028,79962] 0 2024-04-27T07:33:45.134 INFO:tasks.workunit.client.1.smithi100.stdout:2/803: creat d0/da/d29/d47/d5a/dd9/dff/f108 x:0 0 0 2024-04-27T07:33:45.135 INFO:tasks.workunit.client.1.smithi100.stdout:8/917: creat d6/d20/d50/f121 x:0 0 0 2024-04-27T07:33:45.136 INFO:tasks.workunit.client.1.smithi100.stdout:4/902: creat d5/d16/d19/d46/d53/d7e/f137 x:0 0 0 2024-04-27T07:33:45.137 INFO:tasks.workunit.client.1.smithi100.stdout:2/804: mknod d0/da/d29/d47/da1/dc3/c109 0 2024-04-27T07:33:45.138 INFO:tasks.workunit.client.1.smithi100.stdout:6/956: dread de/f10 [0,4194304] 0 2024-04-27T07:33:45.142 INFO:tasks.workunit.client.1.smithi100.stdout:6/957: rename de/d58/d21/d23/f4b to de/d58/d21/d24/d9f/daa/f146 0 2024-04-27T07:33:45.142 INFO:tasks.workunit.client.1.smithi100.stdout:4/903: dwrite d5/d23/f25 [4194304,4194304] 0 2024-04-27T07:33:45.175 INFO:tasks.workunit.client.1.smithi100.stdout:0/828: truncate d1/d8/d20/f7b 3169920 0 2024-04-27T07:33:45.176 INFO:tasks.workunit.client.1.smithi100.stdout:4/904: fdatasync d5/d16/d19/d21/d77/d94/f11c 0 2024-04-27T07:33:45.176 INFO:tasks.workunit.client.1.smithi100.stdout:5/785: write d0/d4/d21/d24/f69 [1484877,122149] 0 2024-04-27T07:33:45.180 INFO:tasks.workunit.client.1.smithi100.stdout:2/805: dread d0/da/f50 [0,4194304] 0 2024-04-27T07:33:45.181 INFO:tasks.workunit.client.1.smithi100.stdout:0/829: creat d1/d38/d3a/d54/de5/f112 x:0 0 0 2024-04-27T07:33:45.185 INFO:tasks.workunit.client.1.smithi100.stdout:0/830: dread - d1/d8/d14/dce/ffe zero size 2024-04-27T07:33:45.186 INFO:tasks.workunit.client.1.smithi100.stdout:6/958: dwrite de/d58/f35 [0,4194304] 0 2024-04-27T07:33:45.187 INFO:tasks.workunit.client.1.smithi100.stdout:4/905: dread d5/f15 [0,4194304] 0 2024-04-27T07:33:45.188 INFO:tasks.workunit.client.1.smithi100.stdout:5/786: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:45.188 INFO:tasks.workunit.client.1.smithi100.stdout:0/831: chown d1/d38/d3a/fe8 7083795 1 2024-04-27T07:33:45.188 INFO:tasks.workunit.client.1.smithi100.stdout:2/806: creat d0/da/d29/d47/d5a/d8d/f10a x:0 0 0 2024-04-27T07:33:45.189 INFO:tasks.workunit.client.1.smithi100.stdout:0/832: dread - d1/d8/d20/f28 zero size 2024-04-27T07:33:45.193 INFO:tasks.workunit.client.1.smithi100.stdout:2/807: mkdir d0/da/d29/d47/d5a/dd9/d10b 0 2024-04-27T07:33:45.194 INFO:tasks.workunit.client.1.smithi100.stdout:4/906: symlink d5/d1b/df8/l138 0 2024-04-27T07:33:45.195 INFO:tasks.workunit.client.1.smithi100.stdout:0/833: mknod d1/d8/d20/d1e/c113 0 2024-04-27T07:33:45.197 INFO:tasks.workunit.client.1.smithi100.stdout:0/834: write d1/d38/f47 [4261636,127097] 0 2024-04-27T07:33:45.199 INFO:tasks.workunit.client.1.smithi100.stdout:2/808: mkdir d0/d79/d94/dbc/d98/db1/de9/d10c 0 2024-04-27T07:33:45.202 INFO:tasks.workunit.client.1.smithi100.stdout:4/907: rename d5/d1b/df8/d3f/d96 to d5/d16/d19/d46/dd1/dd2/d139 0 2024-04-27T07:33:45.204 INFO:tasks.workunit.client.1.smithi100.stdout:5/787: dwrite d0/fc2 [0,4194304] 0 2024-04-27T07:33:45.206 INFO:tasks.workunit.client.1.smithi100.stdout:0/835: truncate d1/d8/d14/d59/f5b 1314080 0 2024-04-27T07:33:45.206 INFO:tasks.workunit.client.1.smithi100.stdout:2/809: mknod d0/d1e/c10d 0 2024-04-27T07:33:45.207 INFO:tasks.workunit.client.1.smithi100.stdout:4/908: symlink d5/d102/l13a 0 2024-04-27T07:33:45.207 INFO:tasks.workunit.client.1.smithi100.stdout:2/810: chown d0 172 1 2024-04-27T07:33:45.211 INFO:tasks.workunit.client.1.smithi100.stdout:4/909: mkdir d5/d16/d2e/d5a/d11b/d13b 0 2024-04-27T07:33:45.213 INFO:tasks.workunit.client.1.smithi100.stdout:4/910: write d5/d16/d19/d46/dd1/dd2/fd8 [1363257,2611] 0 2024-04-27T07:33:45.214 INFO:tasks.workunit.client.1.smithi100.stdout:5/788: rename d0/d4/d21/d24/d2f/d57/d37/d1a/f4e to d0/d4/d21/d24/d2f/d39/ffa 0 2024-04-27T07:33:45.214 INFO:tasks.workunit.client.1.smithi100.stdout:0/836: getdents d1/d8/d20/d88 0 2024-04-27T07:33:45.216 INFO:tasks.workunit.client.1.smithi100.stdout:2/811: mknod d0/da/d29/d47/d5a/d8d/c10e 0 2024-04-27T07:33:45.218 INFO:tasks.workunit.client.1.smithi100.stdout:4/911: dread d5/d1b/df8/fc3 [0,4194304] 0 2024-04-27T07:33:45.218 INFO:tasks.workunit.client.1.smithi100.stdout:5/789: stat d0/d4/d21/d24/d2f/d57/d3e/c98 0 2024-04-27T07:33:45.219 INFO:tasks.workunit.client.1.smithi100.stdout:0/837: chown d1/d8/d14/d59/d64/ca9 150 1 2024-04-27T07:33:45.220 INFO:tasks.workunit.client.1.smithi100.stdout:0/838: readlink d1/d8/d20/d61/d6a/l95 0 2024-04-27T07:33:45.221 INFO:tasks.workunit.client.1.smithi100.stdout:4/912: mkdir d5/d1b/df8/dd7/d13c 0 2024-04-27T07:33:45.226 INFO:tasks.workunit.client.1.smithi100.stdout:0/839: rename d1/d8/d20/d61/d6a/dd6 to d1/d8/d20/d61/d114 0 2024-04-27T07:33:45.228 INFO:tasks.workunit.client.1.smithi100.stdout:0/840: fsync d1/d8/d14/d59/d99/fbf 0 2024-04-27T07:33:45.236 INFO:tasks.workunit.client.1.smithi100.stdout:2/812: dread d0/f11 [0,4194304] 0 2024-04-27T07:33:45.237 INFO:tasks.workunit.client.1.smithi100.stdout:0/841: getdents d1/d8/d14/d59/d64 0 2024-04-27T07:33:45.239 INFO:tasks.workunit.client.1.smithi100.stdout:0/842: chown d1/d8/d20/d1e/c113 3781 1 2024-04-27T07:33:45.241 INFO:tasks.workunit.client.1.smithi100.stdout:0/843: chown d1/d8/d20/df6/f103 3893918 1 2024-04-27T07:33:45.243 INFO:tasks.workunit.client.1.smithi100.stdout:0/844: write d1/d38/f9c [3006615,39548] 0 2024-04-27T07:33:45.244 INFO:tasks.workunit.client.1.smithi100.stdout:4/913: write d5/d1b/df8/d50/dbf/fff [906092,46814] 0 2024-04-27T07:33:45.249 INFO:tasks.workunit.client.1.smithi100.stdout:9/917: sync 2024-04-27T07:33:45.250 INFO:tasks.workunit.client.1.smithi100.stdout:5/790: dwrite d0/d42/f7d [0,4194304] 0 2024-04-27T07:33:45.251 INFO:tasks.workunit.client.1.smithi100.stdout:4/914: write d5/d16/d19/d46/dd1/dd2/fd8 [4460197,69067] 0 2024-04-27T07:33:45.255 INFO:tasks.workunit.client.1.smithi100.stdout:2/813: dwrite d0/da/d29/d47/d5a/dd9/dff/d88/fc6 [0,4194304] 0 2024-04-27T07:33:45.256 INFO:tasks.workunit.client.1.smithi100.stdout:0/845: dread d1/f10 [0,4194304] 0 2024-04-27T07:33:45.256 INFO:tasks.workunit.client.1.smithi100.stdout:9/918: write d1/d9/db/d56/d5c/de3/d4a/d67/f108 [675509,117128] 0 2024-04-27T07:33:45.257 INFO:tasks.workunit.client.1.smithi100.stdout:0/846: chown d1 46740 1 2024-04-27T07:33:45.259 INFO:tasks.workunit.client.1.smithi100.stdout:4/915: creat d5/d16/d19/d46/dd1/dd2/f13d x:0 0 0 2024-04-27T07:33:45.261 INFO:tasks.workunit.client.1.smithi100.stdout:2/814: rmdir d0/da/d29/d47/d5a/dd9/dff 39 2024-04-27T07:33:45.267 INFO:tasks.workunit.client.1.smithi100.stdout:2/815: dwrite d0/d79/d94/dbc/d98/fab [0,4194304] 0 2024-04-27T07:33:45.269 INFO:tasks.workunit.client.1.smithi100.stdout:2/816: fsync d0/d79/d94/dbc/f102 0 2024-04-27T07:33:45.274 INFO:tasks.workunit.client.1.smithi100.stdout:4/916: dwrite d5/d16/d4c/fc2 [0,4194304] 0 2024-04-27T07:33:45.276 INFO:tasks.workunit.client.1.smithi100.stdout:2/817: unlink d0/d79/d94/dbc/cd1 0 2024-04-27T07:33:45.276 INFO:tasks.workunit.client.1.smithi100.stdout:2/818: chown d0/d1e/f57 98232314 1 2024-04-27T07:33:45.277 INFO:tasks.workunit.client.1.smithi100.stdout:4/917: symlink d5/d16/d4c/l13e 0 2024-04-27T07:33:45.278 INFO:tasks.workunit.client.1.smithi100.stdout:4/918: write d5/d16/d4c/fc2 [4563557,14594] 0 2024-04-27T07:33:45.280 INFO:tasks.workunit.client.1.smithi100.stdout:2/819: creat d0/f10f x:0 0 0 2024-04-27T07:33:45.284 INFO:tasks.workunit.client.1.smithi100.stdout:9/919: dread d1/d9/db/d2b/f79 [0,4194304] 0 2024-04-27T07:33:45.295 INFO:tasks.workunit.client.1.smithi100.stdout:2/820: dread - d0/d79/d94/dbc/d98/db1/f6f zero size 2024-04-27T07:33:45.296 INFO:tasks.workunit.client.1.smithi100.stdout:4/919: truncate d5/d16/d4c/f7f 3772518 0 2024-04-27T07:33:45.297 INFO:tasks.workunit.client.1.smithi100.stdout:4/920: chown d5/d16/d19/d46/d53/l89 20825605 1 2024-04-27T07:33:45.298 INFO:tasks.workunit.client.1.smithi100.stdout:2/821: creat d0/da/d29/d47/d5a/dd9/dff/d88/ddd/f110 x:0 0 0 2024-04-27T07:33:45.304 INFO:tasks.workunit.client.1.smithi100.stdout:4/921: dwrite d5/d16/d19/f30 [0,4194304] 0 2024-04-27T07:33:45.305 INFO:tasks.workunit.client.1.smithi100.stdout:2/822: write d0/da/d29/d47/d5a/d8d/d5d/f77 [2240540,24080] 0 2024-04-27T07:33:45.309 INFO:tasks.workunit.client.1.smithi100.stdout:2/823: mknod d0/da/d105/c111 0 2024-04-27T07:33:45.309 INFO:tasks.workunit.client.1.smithi100.stdout:2/824: chown d0/da/c30 6292071 1 2024-04-27T07:33:45.311 INFO:tasks.workunit.client.1.smithi100.stdout:2/825: write d0/da/d29/d47/d5a/dd9/dff/f9a [4661662,80633] 0 2024-04-27T07:33:45.318 INFO:tasks.workunit.client.1.smithi100.stdout:2/826: dread d0/da/d29/d47/d5a/d8d/fea [0,4194304] 0 2024-04-27T07:33:45.319 INFO:tasks.workunit.client.1.smithi100.stdout:2/827: chown d0/da/d75/l107 3 1 2024-04-27T07:33:45.320 INFO:tasks.workunit.client.1.smithi100.stdout:4/922: dread d5/f10 [0,4194304] 0 2024-04-27T07:33:45.321 INFO:tasks.workunit.client.1.smithi100.stdout:2/828: chown d0/d79/d94/dbc/f102 106 1 2024-04-27T07:33:45.322 INFO:tasks.workunit.client.1.smithi100.stdout:4/923: creat d5/d16/d19/df3/d113/f13f x:0 0 0 2024-04-27T07:33:45.324 INFO:tasks.workunit.client.1.smithi100.stdout:4/924: write d5/d16/d19/f3d [7100160,63437] 0 2024-04-27T07:33:45.327 INFO:tasks.workunit.client.1.smithi100.stdout:2/829: dwrite d0/da/d29/d47/d5a/dd9/dff/fc0 [0,4194304] 0 2024-04-27T07:33:45.328 INFO:tasks.workunit.client.1.smithi100.stdout:4/925: readlink d5/d1b/df8/d7d/l6b 0 2024-04-27T07:33:45.329 INFO:tasks.workunit.client.1.smithi100.stdout:4/926: fdatasync d5/fe3 0 2024-04-27T07:33:45.330 INFO:tasks.workunit.client.1.smithi100.stdout:4/927: dread - d5/d1b/df8/d7d/d8a/fe7 zero size 2024-04-27T07:33:45.331 INFO:tasks.workunit.client.1.smithi100.stdout:2/830: mknod d0/da/d29/d47/dae/df4/c112 0 2024-04-27T07:33:45.332 INFO:tasks.workunit.client.1.smithi100.stdout:4/928: symlink d5/d1b/df8/d7d/d8a/l140 0 2024-04-27T07:33:45.333 INFO:tasks.workunit.client.1.smithi100.stdout:2/831: write d0/d79/d94/dbc/d98/db1/fd6 [836860,41514] 0 2024-04-27T07:33:45.336 INFO:tasks.workunit.client.1.smithi100.stdout:2/832: readlink d0/da/d29/d47/d5a/dd9/dff/d88/lba 0 2024-04-27T07:33:45.336 INFO:tasks.workunit.client.1.smithi100.stdout:2/833: readlink d0/da/l36 0 2024-04-27T07:33:45.337 INFO:tasks.workunit.client.1.smithi100.stdout:2/834: write d0/da/d29/d47/d5a/dd9/dff/fc0 [4062428,33004] 0 2024-04-27T07:33:45.339 INFO:tasks.workunit.client.1.smithi100.stdout:2/835: creat d0/da/d105/f113 x:0 0 0 2024-04-27T07:33:45.341 INFO:tasks.workunit.client.1.smithi100.stdout:2/836: creat d0/da/d29/d47/d5a/dd9/dff/d88/ddd/f114 x:0 0 0 2024-04-27T07:33:45.341 INFO:tasks.workunit.client.1.smithi100.stdout:4/929: write d5/d1b/fee [678365,100015] 0 2024-04-27T07:33:45.343 INFO:tasks.workunit.client.1.smithi100.stdout:4/930: creat d5/d23/d33/f141 x:0 0 0 2024-04-27T07:33:45.343 INFO:tasks.workunit.client.1.smithi100.stdout:2/837: read d0/da/d29/d47/d5a/d8d/f4b [30293,57987] 0 2024-04-27T07:33:45.345 INFO:tasks.workunit.client.1.smithi100.stdout:4/931: creat d5/d1b/df8/d50/dbf/f142 x:0 0 0 2024-04-27T07:33:45.346 INFO:tasks.workunit.client.1.smithi100.stdout:2/838: mkdir d0/da/d29/d47/dae/d115 0 2024-04-27T07:33:45.347 INFO:tasks.workunit.client.1.smithi100.stdout:2/839: truncate d0/f10f 566881 0 2024-04-27T07:33:45.347 INFO:tasks.workunit.client.1.smithi100.stdout:4/932: mkdir d5/d1b/d65/d143 0 2024-04-27T07:33:45.350 INFO:tasks.workunit.client.1.smithi100.stdout:4/933: creat d5/d16/f144 x:0 0 0 2024-04-27T07:33:45.350 INFO:tasks.workunit.client.1.smithi100.stdout:4/934: fdatasync d5/d16/fcd 0 2024-04-27T07:33:45.351 INFO:tasks.workunit.client.1.smithi100.stdout:4/935: chown d5/d1b/f5f 3006662 1 2024-04-27T07:33:45.351 INFO:tasks.workunit.client.1.smithi100.stdout:2/840: link d0/f11 d0/da/d29/d47/da1/f116 0 2024-04-27T07:33:45.353 INFO:tasks.workunit.client.1.smithi100.stdout:2/841: fdatasync d0/da/d29/d47/d5a/dd9/dff/d88/ddd/ffc 0 2024-04-27T07:33:45.354 INFO:tasks.workunit.client.1.smithi100.stdout:2/842: chown d0/da/d29/d47/d5a/d8d/f10a 36817740 1 2024-04-27T07:33:45.358 INFO:tasks.workunit.client.1.smithi100.stdout:2/843: dread d0/da/d29/d47/d5a/dd9/dff/d88/fc6 [0,4194304] 0 2024-04-27T07:33:45.361 INFO:tasks.workunit.client.1.smithi100.stdout:2/844: truncate d0/d1e/fa4 764375 0 2024-04-27T07:33:45.364 INFO:tasks.workunit.client.1.smithi100.stdout:4/936: dread d5/d16/d4c/f7f [0,4194304] 0 2024-04-27T07:33:45.364 INFO:tasks.workunit.client.1.smithi100.stdout:4/937: dread - d5/d102/f11a zero size 2024-04-27T07:33:45.365 INFO:tasks.workunit.client.1.smithi100.stdout:4/938: chown d5/d16/d19/d21/d77/d94/f112 376629449 1 2024-04-27T07:33:45.368 INFO:tasks.workunit.client.1.smithi100.stdout:4/939: unlink d5/d23/d33/f141 0 2024-04-27T07:33:45.370 INFO:tasks.workunit.client.1.smithi100.stdout:4/940: symlink d5/d1b/df8/d3f/l145 0 2024-04-27T07:33:45.370 INFO:tasks.workunit.client.1.smithi100.stdout:2/845: dwrite d0/da/d29/d47/d5a/d8d/f4b [4194304,4194304] 0 2024-04-27T07:33:45.371 INFO:tasks.workunit.client.1.smithi100.stdout:2/846: readlink d0/da/d29/d47/d5a/d8d/lb9 0 2024-04-27T07:33:45.374 INFO:tasks.workunit.client.1.smithi100.stdout:4/941: rename d5/d1b/df8/d50/db0/d10f to d5/d1b/df8/d50/dbf/d146 0 2024-04-27T07:33:45.376 INFO:tasks.workunit.client.1.smithi100.stdout:2/847: mkdir d0/da/d29/d47/da1/da3/d117 0 2024-04-27T07:33:45.378 INFO:tasks.workunit.client.1.smithi100.stdout:2/848: chown d0/d79/da7/cdb 10445 1 2024-04-27T07:33:45.379 INFO:tasks.workunit.client.1.smithi100.stdout:2/849: readlink d0/d1e/lc7 0 2024-04-27T07:33:45.379 INFO:tasks.workunit.client.1.smithi100.stdout:4/942: getdents d5/d1b/df8/d50/dfc/d116 0 2024-04-27T07:33:45.385 INFO:tasks.workunit.client.1.smithi100.stdout:2/850: dwrite d0/da/d29/d47/d5a/d82/f89 [0,4194304] 0 2024-04-27T07:33:45.388 INFO:tasks.workunit.client.1.smithi100.stdout:4/943: truncate d5/fe 4574894 0 2024-04-27T07:33:45.388 INFO:tasks.workunit.client.1.smithi100.stdout:4/944: read - d5/d16/f144 zero size 2024-04-27T07:33:45.390 INFO:tasks.workunit.client.1.smithi100.stdout:4/945: symlink d5/d16/d2e/d5a/l147 0 2024-04-27T07:33:45.393 INFO:tasks.workunit.client.1.smithi100.stdout:4/946: mkdir d5/d1b/df8/dd7/d13c/d148 0 2024-04-27T07:33:45.397 INFO:tasks.workunit.client.1.smithi100.stdout:2/851: dread d0/da/f28 [0,4194304] 0 2024-04-27T07:33:45.398 INFO:tasks.workunit.client.1.smithi100.stdout:4/947: link d5/d16/d19/d21/d77/fa5 d5/d16/d19/dca/de0/f149 0 2024-04-27T07:33:45.408 INFO:tasks.workunit.client.1.smithi100.stdout:2/852: write d0/da/d29/d47/f4f [1177074,27711] 0 2024-04-27T07:33:45.409 INFO:tasks.workunit.client.1.smithi100.stdout:2/853: symlink d0/d79/d94/l118 0 2024-04-27T07:33:45.440 INFO:tasks.workunit.client.1.smithi100.stdout:3/925: sync 2024-04-27T07:33:45.440 INFO:tasks.workunit.client.1.smithi100.stdout:7/787: sync 2024-04-27T07:33:45.440 INFO:tasks.workunit.client.1.smithi100.stdout:2/854: dwrite d0/da/d29/d47/da1/da3/f97 [0,4194304] 0 2024-04-27T07:33:45.442 INFO:tasks.workunit.client.1.smithi100.stdout:7/788: dread - d1/dd/d16/d70/fce zero size 2024-04-27T07:33:45.442 INFO:tasks.workunit.client.1.smithi100.stdout:4/948: dread d5/d1b/df8/d3f/f122 [0,4194304] 0 2024-04-27T07:33:45.443 INFO:tasks.workunit.client.1.smithi100.stdout:2/855: write d0/da/d29/d47/d5a/d8d/f4b [6125328,76373] 0 2024-04-27T07:33:45.444 INFO:tasks.workunit.client.1.smithi100.stdout:3/926: fsync d7/d9/d10/d33/d90/d3a/ddd/ff9 0 2024-04-27T07:33:45.447 INFO:tasks.workunit.client.1.smithi100.stdout:2/856: mkdir d0/d79/d94/dbc/d98/db1/d119 0 2024-04-27T07:33:45.451 INFO:tasks.workunit.client.1.smithi100.stdout:7/789: dwrite d1/dd/d16/d70/f59 [0,4194304] 0 2024-04-27T07:33:45.452 INFO:tasks.workunit.client.1.smithi100.stdout:7/790: chown d1/d54/f61 4761646 1 2024-04-27T07:33:45.458 INFO:tasks.workunit.client.1.smithi100.stdout:7/791: getdents d1/dd/d16/d70/d51 0 2024-04-27T07:33:45.459 INFO:tasks.workunit.client.1.smithi100.stdout:2/857: write d0/da/d29/d47/da1/da3/f59 [418951,118498] 0 2024-04-27T07:33:45.460 INFO:tasks.workunit.client.1.smithi100.stdout:3/927: dwrite d7/d9/fa7 [0,4194304] 0 2024-04-27T07:33:45.462 INFO:tasks.workunit.client.1.smithi100.stdout:2/858: chown d0/d79/d94/dbc/d98/db1 63 1 2024-04-27T07:33:45.462 INFO:tasks.workunit.client.1.smithi100.stdout:2/859: chown d0 17350 1 2024-04-27T07:33:45.463 INFO:tasks.workunit.client.1.smithi100.stdout:7/792: truncate d1/f33 4484756 0 2024-04-27T07:33:45.463 INFO:tasks.workunit.client.1.smithi100.stdout:2/860: write d0/da/feb [205878,32368] 0 2024-04-27T07:33:45.472 INFO:tasks.workunit.client.1.smithi100.stdout:4/949: dread d5/fe [0,4194304] 0 2024-04-27T07:33:45.477 INFO:tasks.workunit.client.1.smithi100.stdout:4/950: creat d5/d16/d19/d46/dd1/d11e/d131/f14a x:0 0 0 2024-04-27T07:33:45.478 INFO:tasks.workunit.client.1.smithi100.stdout:4/951: fsync d5/d16/d19/df3/d113/f13f 0 2024-04-27T07:33:45.481 INFO:tasks.workunit.client.1.smithi100.stdout:3/928: write d7/d9/d26/d2a/fce [585628,33440] 0 2024-04-27T07:33:45.482 INFO:tasks.workunit.client.1.smithi100.stdout:2/861: write d0/d1e/f57 [3547801,119773] 0 2024-04-27T07:33:45.489 INFO:tasks.workunit.client.1.smithi100.stdout:4/952: dwrite d5/f88 [0,4194304] 0 2024-04-27T07:33:45.491 INFO:tasks.workunit.client.1.smithi100.stdout:3/929: rename d7/d9/d10/d3e/d74/fb4 to d7/d9/d10/d3e/df3/f121 0 2024-04-27T07:33:45.491 INFO:tasks.workunit.client.1.smithi100.stdout:7/793: dwrite d1/dd/d16/d70/d51/d6f/f92 [0,4194304] 0 2024-04-27T07:33:45.493 INFO:tasks.workunit.client.1.smithi100.stdout:7/794: chown d1/dd/d16/d4a/c52 7590 1 2024-04-27T07:33:45.498 INFO:tasks.workunit.client.1.smithi100.stdout:2/862: rename d0/da/d75/f78 to d0/d79/d94/dbc/d98/db1/f11a 0 2024-04-27T07:33:45.500 INFO:tasks.workunit.client.1.smithi100.stdout:3/930: truncate d7/f1f 1025087 0 2024-04-27T07:33:45.502 INFO:tasks.workunit.client.1.smithi100.stdout:3/931: write d7/d9/d26/d2a/d5e/d98/ffe [218905,1227] 0 2024-04-27T07:33:45.503 INFO:tasks.workunit.client.1.smithi100.stdout:4/953: rename d5/d16/d4c/f107 to d5/d1b/df8/dd7/d13c/f14b 0 2024-04-27T07:33:45.509 INFO:tasks.workunit.client.1.smithi100.stdout:4/954: mkdir d5/d16/d19/dca/de0/d14c 0 2024-04-27T07:33:45.511 INFO:tasks.workunit.client.1.smithi100.stdout:3/932: mknod d7/d9/d10/d3e/d55/c122 0 2024-04-27T07:33:45.514 INFO:tasks.workunit.client.1.smithi100.stdout:4/955: creat d5/d16/d19/d46/dd1/dd2/f14d x:0 0 0 2024-04-27T07:33:45.518 INFO:tasks.workunit.client.1.smithi100.stdout:3/933: rename d7/d9/d10/f107 to d7/d9/d10/d3e/d74/db1/d9d/f123 0 2024-04-27T07:33:45.519 INFO:tasks.workunit.client.1.smithi100.stdout:7/795: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:45.524 INFO:tasks.workunit.client.1.smithi100.stdout:2/863: write d0/d79/fad [3942154,89520] 0 2024-04-27T07:33:45.526 INFO:tasks.workunit.client.1.smithi100.stdout:7/796: symlink d1/dd/d16/d70/lea 0 2024-04-27T07:33:45.527 INFO:tasks.workunit.client.1.smithi100.stdout:7/797: dread - d1/dd/d16/d31/fd5 zero size 2024-04-27T07:33:45.530 INFO:tasks.workunit.client.1.smithi100.stdout:2/864: unlink d0/da/d29/d47/fde 0 2024-04-27T07:33:45.532 INFO:tasks.workunit.client.1.smithi100.stdout:3/934: link d7/da9/lea d7/d9/d10/d28/d112/l124 0 2024-04-27T07:33:45.535 INFO:tasks.workunit.client.1.smithi100.stdout:4/956: write d5/d16/d19/d21/f41 [5520291,15461] 0 2024-04-27T07:33:45.537 INFO:tasks.workunit.client.1.smithi100.stdout:7/798: dwrite d1/dd/d16/d70/d51/fdf [0,4194304] 0 2024-04-27T07:33:45.539 INFO:tasks.workunit.client.1.smithi100.stdout:4/957: chown d5/d16/d19/dca/de0/d14c 1670771 1 2024-04-27T07:33:45.540 INFO:tasks.workunit.client.1.smithi100.stdout:3/935: creat d7/d9/d10/d3e/df3/f125 x:0 0 0 2024-04-27T07:33:45.541 INFO:tasks.workunit.client.1.smithi100.stdout:2/865: rmdir d0/da/d29/d47/d5a/dd9/dff/d8b/d100 0 2024-04-27T07:33:45.545 INFO:tasks.workunit.client.1.smithi100.stdout:7/799: write d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/fb2 [684093,90647] 0 2024-04-27T07:33:45.546 INFO:tasks.workunit.client.1.smithi100.stdout:7/800: chown d1/dd/d16/d2b/d7f/dcf/cd6 1 1 2024-04-27T07:33:45.546 INFO:tasks.workunit.client.1.smithi100.stdout:4/958: creat d5/d16/d19/d21/d77/d94/d9f/f14e x:0 0 0 2024-04-27T07:33:45.547 INFO:tasks.workunit.client.1.smithi100.stdout:4/959: chown d5/d16/d19/d46/dd1/dd2 1380 1 2024-04-27T07:33:45.551 INFO:tasks.workunit.client.1.smithi100.stdout:3/936: mkdir d7/d9/d10/d33/d90/d3a/dd6/d126 0 2024-04-27T07:33:45.552 INFO:tasks.workunit.client.1.smithi100.stdout:4/960: mkdir d5/d102/d14f 0 2024-04-27T07:33:45.553 INFO:tasks.workunit.client.1.smithi100.stdout:3/937: write d7/d9/d10/d33/d90/d3a/f94 [2794074,82933] 0 2024-04-27T07:33:45.554 INFO:tasks.workunit.client.1.smithi100.stdout:7/801: mknod d1/dd/d2a/d2c/d9f/ceb 0 2024-04-27T07:33:45.559 INFO:tasks.workunit.client.1.smithi100.stdout:4/961: dread d5/d16/fcd [0,4194304] 0 2024-04-27T07:33:45.560 INFO:tasks.workunit.client.1.smithi100.stdout:4/962: stat d5/d16/d2e/le6 0 2024-04-27T07:33:45.561 INFO:tasks.workunit.client.1.smithi100.stdout:7/802: rename d1/dd/d16/d31/d4c/d4d/d3b/fd2 to d1/fec 0 2024-04-27T07:33:45.566 INFO:tasks.workunit.client.1.smithi100.stdout:7/803: creat d1/dd/d2a/fed x:0 0 0 2024-04-27T07:33:45.569 INFO:tasks.workunit.client.1.smithi100.stdout:4/963: dread d5/d16/d19/d21/d77/d94/d9f/dd6/fde [0,4194304] 0 2024-04-27T07:33:45.573 INFO:tasks.workunit.client.1.smithi100.stdout:4/964: chown d5/d1b/df8/d3f/l61 77666 1 2024-04-27T07:33:45.578 INFO:tasks.workunit.client.1.smithi100.stdout:4/965: fsync d5/d1b/df8/dd7/d13c/f14b 0 2024-04-27T07:33:45.581 INFO:tasks.workunit.client.1.smithi100.stdout:2/866: dwrite d0/da/d29/d47/da1/f116 [0,4194304] 0 2024-04-27T07:33:45.581 INFO:tasks.workunit.client.1.smithi100.stdout:7/804: dwrite d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/fb2 [0,4194304] 0 2024-04-27T07:33:45.583 INFO:tasks.workunit.client.1.smithi100.stdout:3/938: dwrite d7/d9/d10/d22/f5b [0,4194304] 0 2024-04-27T07:33:45.591 INFO:tasks.workunit.client.1.smithi100.stdout:8/918: sync 2024-04-27T07:33:45.591 INFO:tasks.workunit.client.1.smithi100.stdout:7/805: mknod d1/dd/d16/d70/d6e/cee 0 2024-04-27T07:33:45.596 INFO:tasks.workunit.client.1.smithi100.stdout:8/919: mkdir d6/d20/da2/db0/d106/d122 0 2024-04-27T07:33:45.599 INFO:tasks.workunit.client.1.smithi100.stdout:3/939: write d7/d9/d2f/f69 [784221,117694] 0 2024-04-27T07:33:45.601 INFO:tasks.workunit.client.1.smithi100.stdout:7/806: getdents d1/dd/d16/d2b/d7f 0 2024-04-27T07:33:45.604 INFO:tasks.workunit.client.1.smithi100.stdout:4/966: dwrite d5/d16/d19/d46/dd1/d11e/fab [0,4194304] 0 2024-04-27T07:33:45.609 INFO:tasks.workunit.client.1.smithi100.stdout:3/940: rename d7/d9/d10/d3e/d91/cf8 to d7/d9/d10/d3e/d11d/c127 0 2024-04-27T07:33:45.612 INFO:tasks.workunit.client.1.smithi100.stdout:4/967: dread d5/f9 [0,4194304] 0 2024-04-27T07:33:45.620 INFO:tasks.workunit.client.1.smithi100.stdout:3/941: dwrite d7/d9/d10/d33/d90/d3a/ddd/ff9 [0,4194304] 0 2024-04-27T07:33:45.620 INFO:tasks.workunit.client.1.smithi100.stdout:4/968: link d5/d16/d19/d46/dd1/d11e/f51 d5/d16/d19/dca/de0/f150 0 2024-04-27T07:33:45.621 INFO:tasks.workunit.client.1.smithi100.stdout:2/867: dread d0/da/d29/d47/f91 [0,4194304] 0 2024-04-27T07:33:45.622 INFO:tasks.workunit.client.1.smithi100.stdout:2/868: write d0/da/f6b [2197823,7624] 0 2024-04-27T07:33:45.630 INFO:tasks.workunit.client.1.smithi100.stdout:4/969: getdents d5/d16/d19/d21/d77/d94 0 2024-04-27T07:33:45.630 INFO:tasks.workunit.client.1.smithi100.stdout:2/869: truncate d0/d1e/fa4 1435600 0 2024-04-27T07:33:45.633 INFO:tasks.workunit.client.1.smithi100.stdout:4/970: creat d5/d1b/f151 x:0 0 0 2024-04-27T07:33:45.633 INFO:tasks.workunit.client.1.smithi100.stdout:7/807: dread d1/dd/d2a/f62 [0,4194304] 0 2024-04-27T07:33:45.637 INFO:tasks.workunit.client.1.smithi100.stdout:7/808: creat d1/dd/d16/d3e/d8b/fef x:0 0 0 2024-04-27T07:33:45.639 INFO:tasks.workunit.client.1.smithi100.stdout:4/971: read d5/d1b/df8/d7d/fc5 [3102933,52926] 0 2024-04-27T07:33:45.639 INFO:tasks.workunit.client.1.smithi100.stdout:3/942: write d7/d9/d10/d28/f77 [1188435,52333] 0 2024-04-27T07:33:45.641 INFO:tasks.workunit.client.1.smithi100.stdout:4/972: mknod d5/d1b/df8/d3f/c152 0 2024-04-27T07:33:45.645 INFO:tasks.workunit.client.1.smithi100.stdout:7/809: getdents d1/dd/d16/d31/d4c/d4d 0 2024-04-27T07:33:45.648 INFO:tasks.workunit.client.1.smithi100.stdout:4/973: link d5/d16/d19/d46/dd1/dd2/f13d d5/d16/d4c/f153 0 2024-04-27T07:33:45.648 INFO:tasks.workunit.client.1.smithi100.stdout:7/810: creat d1/dd/d16/d70/d51/ff0 x:0 0 0 2024-04-27T07:33:45.649 INFO:tasks.workunit.client.1.smithi100.stdout:3/943: write d7/d9/d26/d2a/d5e/f72 [2051377,127739] 0 2024-04-27T07:33:45.652 INFO:tasks.workunit.client.1.smithi100.stdout:7/811: mknod d1/dd/cf1 0 2024-04-27T07:33:45.653 INFO:tasks.workunit.client.1.smithi100.stdout:2/870: dread d0/da/d29/d47/da1/da3/fe0 [0,4194304] 0 2024-04-27T07:33:45.654 INFO:tasks.workunit.client.1.smithi100.stdout:4/974: rename d5/d16/d19/d46/l70 to d5/d1b/df8/d50/dbf/l154 0 2024-04-27T07:33:45.655 INFO:tasks.workunit.client.1.smithi100.stdout:4/975: readlink d5/d16/d4c/l9e 0 2024-04-27T07:33:45.656 INFO:tasks.workunit.client.1.smithi100.stdout:3/944: creat d7/d9/d10/d3e/d74/f128 x:0 0 0 2024-04-27T07:33:45.658 INFO:tasks.workunit.client.1.smithi100.stdout:2/871: getdents d0/da/d39 0 2024-04-27T07:33:45.660 INFO:tasks.workunit.client.1.smithi100.stdout:3/945: read d7/d9/d10/d33/d90/f81 [779029,8528] 0 2024-04-27T07:33:45.661 INFO:tasks.workunit.client.1.smithi100.stdout:7/812: dwrite d1/fc6 [0,4194304] 0 2024-04-27T07:33:45.669 INFO:tasks.workunit.client.1.smithi100.stdout:2/872: link d0/da/f6b d0/d79/d94/dbc/d98/db1/de9/d10c/f11b 0 2024-04-27T07:33:45.671 INFO:tasks.workunit.client.1.smithi100.stdout:4/976: truncate d5/d16/d19/d46/d53/d7e/fa9 281429 0 2024-04-27T07:33:45.671 INFO:tasks.workunit.client.1.smithi100.stdout:3/946: dwrite d7/d9/d10/d28/db0/fb9 [0,4194304] 0 2024-04-27T07:33:45.673 INFO:tasks.workunit.client.1.smithi100.stdout:2/873: unlink d0/d1e/f7c 0 2024-04-27T07:33:45.674 INFO:tasks.workunit.client.1.smithi100.stdout:4/977: write d5/d16/d19/d46/dd1/dd2/f14d [950878,244] 0 2024-04-27T07:33:45.676 INFO:tasks.workunit.client.1.smithi100.stdout:4/978: chown d5/d16/d19/d46/d53/l89 3713703 1 2024-04-27T07:33:45.680 INFO:tasks.workunit.client.1.smithi100.stdout:4/979: mknod d5/d1b/df8/d3f/c155 0 2024-04-27T07:33:45.682 INFO:tasks.workunit.client.1.smithi100.stdout:4/980: creat d5/d16/d19/df3/f156 x:0 0 0 2024-04-27T07:33:45.685 INFO:tasks.workunit.client.1.smithi100.stdout:4/981: mkdir d5/d16/d19/dca/de0/d14c/d157 0 2024-04-27T07:33:45.685 INFO:tasks.workunit.client.1.smithi100.stdout:7/813: dread d1/f32 [0,4194304] 0 2024-04-27T07:33:45.690 INFO:tasks.workunit.client.1.smithi100.stdout:4/982: rename d5/d16/d19/d46/d53/dba/dd0 to d5/d1b/df8/dd7/d13c/d148/d158 0 2024-04-27T07:33:45.691 INFO:tasks.workunit.client.1.smithi100.stdout:7/814: getdents d1/d75/de6 0 2024-04-27T07:33:45.692 INFO:tasks.workunit.client.1.smithi100.stdout:3/947: truncate d7/d9/d26/d2a/f20 2796159 0 2024-04-27T07:33:45.693 INFO:tasks.workunit.client.1.smithi100.stdout:4/983: mknod d5/d16/d2e/d5a/d11b/c159 0 2024-04-27T07:33:45.694 INFO:tasks.workunit.client.1.smithi100.stdout:2/874: truncate d0/da/f50 1668411 0 2024-04-27T07:33:45.707 INFO:tasks.workunit.client.1.smithi100.stdout:2/875: link d0/d1e/l4c d0/da/d75/l11c 0 2024-04-27T07:33:45.709 INFO:tasks.workunit.client.1.smithi100.stdout:7/815: write d1/dd/f5d [1960373,8908] 0 2024-04-27T07:33:45.711 INFO:tasks.workunit.client.1.smithi100.stdout:2/876: write d0/d1e/f57 [7119495,106314] 0 2024-04-27T07:33:45.712 INFO:tasks.workunit.client.1.smithi100.stdout:3/948: dwrite d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:45.716 INFO:tasks.workunit.client.1.smithi100.stdout:7/816: readlink d1/dd/d16/d70/d6e/l99 0 2024-04-27T07:33:45.716 INFO:tasks.workunit.client.1.smithi100.stdout:4/984: dwrite d5/f82 [4194304,4194304] 0 2024-04-27T07:33:45.725 INFO:tasks.workunit.client.1.smithi100.stdout:7/817: symlink d1/dd/d16/d3e/d8b/lf2 0 2024-04-27T07:33:45.726 INFO:tasks.workunit.client.1.smithi100.stdout:2/877: rename d0/da/d29/d47/da1/da3/f63 to d0/da/d29/d47/d5a/dd9/dff/f11d 0 2024-04-27T07:33:45.727 INFO:tasks.workunit.client.1.smithi100.stdout:3/949: dread d7/d9/d10/d33/d90/f34 [0,4194304] 0 2024-04-27T07:33:45.728 INFO:tasks.workunit.client.1.smithi100.stdout:7/818: mkdir d1/dd/d16/d31/d4c/d4d/d3b/dcc/df3 0 2024-04-27T07:33:45.728 INFO:tasks.workunit.client.1.smithi100.stdout:3/950: chown d7/d9/d10/d28/dfb 306669919 1 2024-04-27T07:33:45.729 INFO:tasks.workunit.client.1.smithi100.stdout:4/985: rename d5/f10 to d5/d16/d19/d46/d53/d7e/f15a 0 2024-04-27T07:33:45.731 INFO:tasks.workunit.client.1.smithi100.stdout:4/986: fdatasync d5/d16/d19/d21/f41 0 2024-04-27T07:33:45.734 INFO:tasks.workunit.client.1.smithi100.stdout:7/819: creat d1/d75/dd4/ff4 x:0 0 0 2024-04-27T07:33:45.738 INFO:tasks.workunit.client.1.smithi100.stdout:7/820: creat d1/dd/d2a/d2c/d9f/ff5 x:0 0 0 2024-04-27T07:33:45.739 INFO:tasks.workunit.client.1.smithi100.stdout:4/987: dwrite d5/d1b/df8/d3f/f63 [4194304,4194304] 0 2024-04-27T07:33:45.745 INFO:tasks.workunit.client.1.smithi100.stdout:4/988: write d5/d16/d19/d46/f81 [1223931,121309] 0 2024-04-27T07:33:45.747 INFO:tasks.workunit.client.1.smithi100.stdout:7/821: dwrite d1/dd/d16/d2b/f9c [0,4194304] 0 2024-04-27T07:33:45.750 INFO:tasks.workunit.client.1.smithi100.stdout:7/822: creat d1/d54/ff6 x:0 0 0 2024-04-27T07:33:45.753 INFO:tasks.workunit.client.1.smithi100.stdout:2/878: dread d0/f24 [0,4194304] 0 2024-04-27T07:33:45.754 INFO:tasks.workunit.client.1.smithi100.stdout:7/823: creat d1/ff7 x:0 0 0 2024-04-27T07:33:45.756 INFO:tasks.workunit.client.1.smithi100.stdout:2/879: unlink d0/da/d29/d47/d5a/d8d/d5d/cc9 0 2024-04-27T07:33:45.758 INFO:tasks.workunit.client.1.smithi100.stdout:7/824: rename d1/dd/d16/d4a/l90 to d1/dd/d16/d4a/lf8 0 2024-04-27T07:33:45.760 INFO:tasks.workunit.client.1.smithi100.stdout:2/880: creat d0/da/d29/d47/da1/dc3/f11e x:0 0 0 2024-04-27T07:33:45.761 INFO:tasks.workunit.client.1.smithi100.stdout:7/825: mknod d1/dd/d16/d2b/d7f/cf9 0 2024-04-27T07:33:45.762 INFO:tasks.workunit.client.1.smithi100.stdout:3/951: dread d7/d9/d10/d3e/d74/fa3 [0,4194304] 0 2024-04-27T07:33:45.763 INFO:tasks.workunit.client.1.smithi100.stdout:7/826: chown d1/dd/d16/c44 3482635 1 2024-04-27T07:33:45.767 INFO:tasks.workunit.client.1.smithi100.stdout:3/952: rename d7/d9/d10/d28/fa4 to d7/d9/d10/d28/d112/f129 0 2024-04-27T07:33:45.768 INFO:tasks.workunit.client.1.smithi100.stdout:3/953: chown d7/d9/d10/d28 296816 1 2024-04-27T07:33:45.772 INFO:tasks.workunit.client.1.smithi100.stdout:2/881: link d0/d79/d94/dbc/le2 d0/da/d29/d47/d5a/dd9/dff/d8b/l11f 0 2024-04-27T07:33:45.774 INFO:tasks.workunit.client.1.smithi100.stdout:3/954: creat d7/d9/f12a x:0 0 0 2024-04-27T07:33:45.775 INFO:tasks.workunit.client.1.smithi100.stdout:2/882: mkdir d0/da/d29/d47/d5a/dd9/dff/d88/ddd/d120 0 2024-04-27T07:33:45.776 INFO:tasks.workunit.client.1.smithi100.stdout:7/827: dwrite d1/dd/f47 [0,4194304] 0 2024-04-27T07:33:45.778 INFO:tasks.workunit.client.1.smithi100.stdout:3/955: mkdir d7/d9/d10/d3e/d12b 0 2024-04-27T07:33:45.778 INFO:tasks.workunit.client.1.smithi100.stdout:3/956: stat d7/d9/d10/d33/l83 0 2024-04-27T07:33:45.779 INFO:tasks.workunit.client.1.smithi100.stdout:3/957: dread - d7/d9/fac zero size 2024-04-27T07:33:45.783 INFO:tasks.workunit.client.1.smithi100.stdout:2/883: creat d0/d79/d94/dbc/f121 x:0 0 0 2024-04-27T07:33:45.784 INFO:tasks.workunit.client.1.smithi100.stdout:6/959: sync 2024-04-27T07:33:45.789 INFO:tasks.workunit.client.1.smithi100.stdout:2/884: read d0/d79/d94/dbc/f85 [3299130,46781] 0 2024-04-27T07:33:45.790 INFO:tasks.workunit.client.1.smithi100.stdout:6/960: mkdir de/d58/d21/d24/d139/d147 0 2024-04-27T07:33:45.791 INFO:tasks.workunit.client.1.smithi100.stdout:3/958: dwrite d7/d9/d10/d28/d112/f129 [0,4194304] 0 2024-04-27T07:33:45.794 INFO:tasks.workunit.client.1.smithi100.stdout:6/961: symlink de/d2e/d132/l148 0 2024-04-27T07:33:45.794 INFO:tasks.workunit.client.1.smithi100.stdout:7/828: dread d1/dd/d16/d70/d51/d6f/fac [0,4194304] 0 2024-04-27T07:33:45.795 INFO:tasks.workunit.client.1.smithi100.stdout:3/959: mkdir d7/d9/d10/d3e/d91/d12c 0 2024-04-27T07:33:45.795 INFO:tasks.workunit.client.1.smithi100.stdout:6/962: write de/d58/d21/d23/f82 [855809,28343] 0 2024-04-27T07:33:45.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/829: fdatasync d1/f33 0 2024-04-27T07:33:45.799 INFO:tasks.workunit.client.1.smithi100.stdout:6/963: stat de/d58/f37 0 2024-04-27T07:33:45.800 INFO:tasks.workunit.client.1.smithi100.stdout:3/960: creat d7/d9/d10/d33/d90/d3a/ddd/f12d x:0 0 0 2024-04-27T07:33:45.801 INFO:tasks.workunit.client.1.smithi100.stdout:3/961: stat d7 0 2024-04-27T07:33:45.801 INFO:tasks.workunit.client.1.smithi100.stdout:6/964: rmdir de/d2e/dc0 39 2024-04-27T07:33:45.803 INFO:tasks.workunit.client.1.smithi100.stdout:3/962: chown d7/d9/d26/cff 3118573 1 2024-04-27T07:33:45.806 INFO:tasks.workunit.client.1.smithi100.stdout:3/963: chown d7/d9/d10/d33/d47/c48 38682 1 2024-04-27T07:33:45.808 INFO:tasks.workunit.client.1.smithi100.stdout:7/830: dwrite d1/dd/d16/d31/fd5 [0,4194304] 0 2024-04-27T07:33:45.812 INFO:tasks.workunit.client.1.smithi100.stdout:2/885: dread d0/f12 [0,4194304] 0 2024-04-27T07:33:45.816 INFO:tasks.workunit.client.1.smithi100.stdout:3/964: dread d7/d9/d10/d3e/d74/db1/f92 [0,4194304] 0 2024-04-27T07:33:45.817 INFO:tasks.workunit.client.1.smithi100.stdout:3/965: dread - d7/d9/d10/d3e/d55/fd3 zero size 2024-04-27T07:33:45.818 INFO:tasks.workunit.client.1.smithi100.stdout:2/886: unlink d0/d79/d94/dbc/d98/db1/c7d 0 2024-04-27T07:33:45.821 INFO:tasks.workunit.client.1.smithi100.stdout:2/887: unlink d0/da/d75/l11c 0 2024-04-27T07:33:45.822 INFO:tasks.workunit.client.1.smithi100.stdout:3/966: creat d7/d9/d10/d3e/d91/d12c/f12e x:0 0 0 2024-04-27T07:33:45.822 INFO:tasks.workunit.client.1.smithi100.stdout:2/888: fsync d0/da/d29/d47/da1/dc3/fed 0 2024-04-27T07:33:45.825 INFO:tasks.workunit.client.1.smithi100.stdout:3/967: creat d7/d9/d10/d3e/d55/f12f x:0 0 0 2024-04-27T07:33:45.826 INFO:tasks.workunit.client.1.smithi100.stdout:6/965: write de/d58/d21/dfd/f126 [603252,46195] 0 2024-04-27T07:33:45.827 INFO:tasks.workunit.client.1.smithi100.stdout:2/889: dread d0/f24 [0,4194304] 0 2024-04-27T07:33:45.829 INFO:tasks.workunit.client.1.smithi100.stdout:3/968: symlink d7/d9/d10/d3e/d74/db1/d9d/l130 0 2024-04-27T07:33:45.831 INFO:tasks.workunit.client.1.smithi100.stdout:3/969: stat d7/d9/d10/d3e/d74/f128 0 2024-04-27T07:33:45.833 INFO:tasks.workunit.client.1.smithi100.stdout:7/831: dwrite d1/dd/d16/d4a/f73 [4194304,4194304] 0 2024-04-27T07:33:45.835 INFO:tasks.workunit.client.1.smithi100.stdout:7/832: write d1/dd/d16/d70/d51/ff0 [1011781,105271] 0 2024-04-27T07:33:45.835 INFO:tasks.workunit.client.1.smithi100.stdout:2/890: rename d0/d1e/f106 to d0/da/d29/d47/da1/da3/d117/f122 0 2024-04-27T07:33:45.839 INFO:tasks.workunit.client.1.smithi100.stdout:7/833: mkdir d1/dd/d16/d2b/dfa 0 2024-04-27T07:33:45.840 INFO:tasks.workunit.client.1.smithi100.stdout:6/966: dwrite de/d58/d28/f4f [0,4194304] 0 2024-04-27T07:33:45.841 INFO:tasks.workunit.client.1.smithi100.stdout:2/891: unlink d0/d1e/f57 0 2024-04-27T07:33:45.844 INFO:tasks.workunit.client.1.smithi100.stdout:3/970: write d7/d9/d10/d3e/d74/db1/fcc [85971,124863] 0 2024-04-27T07:33:45.847 INFO:tasks.workunit.client.1.smithi100.stdout:2/892: rename d0/d1e/c10d to d0/da/d29/d47/da1/da3/d117/c123 0 2024-04-27T07:33:45.849 INFO:tasks.workunit.client.1.smithi100.stdout:6/967: fsync de/d58/d28/f47 0 2024-04-27T07:33:45.854 INFO:tasks.workunit.client.1.smithi100.stdout:2/893: symlink d0/da/d29/d47/d5a/dd9/dff/d88/ddd/d120/l124 0 2024-04-27T07:33:45.854 INFO:tasks.workunit.client.1.smithi100.stdout:6/968: write de/d2e/f12e [820299,107569] 0 2024-04-27T07:33:45.857 INFO:tasks.workunit.client.1.smithi100.stdout:3/971: dwrite d7/d9/d10/d3e/d74/db1/d9d/f123 [0,4194304] 0 2024-04-27T07:33:45.861 INFO:tasks.workunit.client.1.smithi100.stdout:3/972: fsync d7/d9/f21 0 2024-04-27T07:33:45.864 INFO:tasks.workunit.client.1.smithi100.stdout:6/969: dwrite de/d58/d90/fb6 [0,4194304] 0 2024-04-27T07:33:45.867 INFO:tasks.workunit.client.1.smithi100.stdout:3/973: readlink d7/dad/daf/le0 0 2024-04-27T07:33:45.868 INFO:tasks.workunit.client.1.smithi100.stdout:6/970: creat de/d2e/d132/f149 x:0 0 0 2024-04-27T07:33:45.872 INFO:tasks.workunit.client.1.smithi100.stdout:6/971: dread de/d58/d28/f94 [0,4194304] 0 2024-04-27T07:33:45.872 INFO:tasks.workunit.client.1.smithi100.stdout:6/972: stat de/d58/d28/f107 0 2024-04-27T07:33:45.872 INFO:tasks.workunit.client.1.smithi100.stdout:3/974: mkdir d7/d9/d10/d3e/d131 0 2024-04-27T07:33:45.874 INFO:tasks.workunit.client.1.smithi100.stdout:6/973: rmdir de/d58/d21/d24/d9f/daa/dde 39 2024-04-27T07:33:45.875 INFO:tasks.workunit.client.1.smithi100.stdout:2/894: write d0/da/d29/d47/d5a/ff7 [4558003,58756] 0 2024-04-27T07:33:45.876 INFO:tasks.workunit.client.1.smithi100.stdout:3/975: creat d7/d9/d10/d33/d47/f132 x:0 0 0 2024-04-27T07:33:45.879 INFO:tasks.workunit.client.1.smithi100.stdout:6/974: rename de/d58/d21/d23/da0/lab to de/d58/d21/d23/da0/d131/l14a 0 2024-04-27T07:33:45.881 INFO:tasks.workunit.client.1.smithi100.stdout:6/975: chown de/d58/d28/c138 4 1 2024-04-27T07:33:45.886 INFO:tasks.workunit.client.1.smithi100.stdout:3/976: write d7/d9/d10/d3e/d74/da8/fec [704497,25261] 0 2024-04-27T07:33:45.887 INFO:tasks.workunit.client.1.smithi100.stdout:2/895: truncate d0/d79/d94/dbc/d98/db1/fb8 2814847 0 2024-04-27T07:33:45.889 INFO:tasks.workunit.client.1.smithi100.stdout:3/977: read d7/d9/d10/d28/f75 [250574,8901] 0 2024-04-27T07:33:45.890 INFO:tasks.workunit.client.1.smithi100.stdout:2/896: fsync d0/da/d29/d47/d5a/dd9/fd2 0 2024-04-27T07:33:45.891 INFO:tasks.workunit.client.1.smithi100.stdout:3/978: dread - d7/d9/d10/d28/fe1 zero size 2024-04-27T07:33:45.893 INFO:tasks.workunit.client.1.smithi100.stdout:2/897: rename d0/da/d39/fb7 to d0/da/d75/f125 0 2024-04-27T07:33:45.894 INFO:tasks.workunit.client.1.smithi100.stdout:6/976: dread de/d58/d21/d24/d9f/fc1 [0,4194304] 0 2024-04-27T07:33:45.896 INFO:tasks.workunit.client.1.smithi100.stdout:6/977: symlink de/d109/l14b 0 2024-04-27T07:33:45.897 INFO:tasks.workunit.client.1.smithi100.stdout:6/978: chown de/d58/d21/d5b/f62 401959 1 2024-04-27T07:33:45.897 INFO:tasks.workunit.client.1.smithi100.stdout:2/898: dread d0/da/d29/d47/f91 [0,4194304] 0 2024-04-27T07:33:45.902 INFO:tasks.workunit.client.1.smithi100.stdout:3/979: truncate d7/d9/d10/d28/f77 689119 0 2024-04-27T07:33:45.905 INFO:tasks.workunit.client.1.smithi100.stdout:6/979: creat de/d2e/f14c x:0 0 0 2024-04-27T07:33:45.905 INFO:tasks.workunit.client.1.smithi100.stdout:3/980: dread - d7/d9/d10/d3e/d74/ff5 zero size 2024-04-27T07:33:45.906 INFO:tasks.workunit.client.1.smithi100.stdout:6/980: readlink de/d58/d21/l2a 0 2024-04-27T07:33:45.907 INFO:tasks.workunit.client.1.smithi100.stdout:2/899: dwrite d0/da/d29/d47/d5a/fb6 [0,4194304] 0 2024-04-27T07:33:45.909 INFO:tasks.workunit.client.1.smithi100.stdout:3/981: rename d7/d9/d10/d3e/df3/f104 to d7/d9/d10/d3e/d131/f133 0 2024-04-27T07:33:45.911 INFO:tasks.workunit.client.1.smithi100.stdout:2/900: truncate d0/d79/d94/dbc/d98/fab 5223686 0 2024-04-27T07:33:45.913 INFO:tasks.workunit.client.1.smithi100.stdout:2/901: mknod d0/d79/d94/dbc/d98/db1/d119/c126 0 2024-04-27T07:33:45.915 INFO:tasks.workunit.client.1.smithi100.stdout:2/902: creat d0/d79/d94/dbc/d98/db1/de9/f127 x:0 0 0 2024-04-27T07:33:45.920 INFO:tasks.workunit.client.1.smithi100.stdout:2/903: unlink d0/d79/d94/dbc/cfe 0 2024-04-27T07:33:45.924 INFO:tasks.workunit.client.1.smithi100.stdout:2/904: symlink d0/da/d29/d47/d5a/dd9/l128 0 2024-04-27T07:33:45.930 INFO:tasks.workunit.client.1.smithi100.stdout:3/982: write d7/d9/d10/d28/f77 [585007,106429] 0 2024-04-27T07:33:45.932 INFO:tasks.workunit.client.1.smithi100.stdout:3/983: symlink d7/d9/d10/d33/d47/l134 0 2024-04-27T07:33:45.934 INFO:tasks.workunit.client.1.smithi100.stdout:3/984: readlink d7/d9/l4b 0 2024-04-27T07:33:45.936 INFO:tasks.workunit.client.1.smithi100.stdout:2/905: dwrite d0/da/d29/f8e [0,4194304] 0 2024-04-27T07:33:45.942 INFO:tasks.workunit.client.1.smithi100.stdout:3/985: link d7/d9/d10/d33/d90/d3a/ddd/ff9 d7/d9/d26/f135 0 2024-04-27T07:33:45.946 INFO:tasks.workunit.client.1.smithi100.stdout:2/906: dwrite d0/da/d29/d47/d5a/dd9/dff/d88/fc6 [0,4194304] 0 2024-04-27T07:33:45.949 INFO:tasks.workunit.client.1.smithi100.stdout:3/986: dwrite d7/d9/d10/d33/d47/f4f [0,4194304] 0 2024-04-27T07:33:45.950 INFO:tasks.workunit.client.1.smithi100.stdout:2/907: creat d0/da/d29/d47/d5a/d8d/d5d/f129 x:0 0 0 2024-04-27T07:33:45.953 INFO:tasks.workunit.client.1.smithi100.stdout:2/908: chown d0/da/d39/l66 22 1 2024-04-27T07:33:45.955 INFO:tasks.workunit.client.1.smithi100.stdout:3/987: link d7/d9/d10/d3e/d91/d12c/f12e d7/d9/d26/d2a/d5e/f136 0 2024-04-27T07:33:45.956 INFO:tasks.workunit.client.1.smithi100.stdout:2/909: unlink d0/l6 0 2024-04-27T07:33:45.957 INFO:tasks.workunit.client.1.smithi100.stdout:3/988: write d7/d9/d10/d3e/df3/d103/f109 [3374694,69152] 0 2024-04-27T07:33:45.959 INFO:tasks.workunit.client.1.smithi100.stdout:2/910: getdents d0/da/d39 0 2024-04-27T07:33:45.960 INFO:tasks.workunit.client.1.smithi100.stdout:3/989: truncate d7/d9/d10/d3e/d74/da8/fec 1223708 0 2024-04-27T07:33:45.961 INFO:tasks.workunit.client.1.smithi100.stdout:2/911: dread - d0/d79/d94/dbc/d98/db1/f6f zero size 2024-04-27T07:33:45.961 INFO:tasks.workunit.client.1.smithi100.stdout:3/990: read d7/d9/d26/f135 [2805913,3946] 0 2024-04-27T07:33:45.966 INFO:tasks.workunit.client.1.smithi100.stdout:3/991: rename d7/d9/da5 to d7/d9/d10/d33/d47/d106/d137 0 2024-04-27T07:33:45.967 INFO:tasks.workunit.client.1.smithi100.stdout:3/992: creat d7/d9/d10/d28/db0/f138 x:0 0 0 2024-04-27T07:33:45.970 INFO:tasks.workunit.client.1.smithi100.stdout:3/993: creat d7/d9/d26/d2a/f139 x:0 0 0 2024-04-27T07:33:45.974 INFO:tasks.workunit.client.1.smithi100.stdout:2/912: dread d0/d79/d94/fbf [0,4194304] 0 2024-04-27T07:33:45.980 INFO:tasks.workunit.client.1.smithi100.stdout:2/913: truncate d0/d79/d94/dbc/d98/db1/de9/d10c/f11b 3106374 0 2024-04-27T07:33:45.985 INFO:tasks.workunit.client.1.smithi100.stdout:3/994: dread d7/d9/d2f/f5d [0,4194304] 0 2024-04-27T07:33:45.986 INFO:tasks.workunit.client.1.smithi100.stdout:2/914: getdents d0/da/d29/d47/da1/dc3 0 2024-04-27T07:33:45.987 INFO:tasks.workunit.client.1.smithi100.stdout:3/995: fsync d7/d9/d10/d33/d90/fd1 0 2024-04-27T07:33:45.990 INFO:tasks.workunit.client.1.smithi100.stdout:3/996: mkdir d7/d9/d10/d33/d90/d3a/ddd/d13a 0 2024-04-27T07:33:45.992 INFO:tasks.workunit.client.1.smithi100.stdout:3/997: mkdir d7/d9/d10/d3e/d91/d12c/d13b 0 2024-04-27T07:33:45.992 INFO:tasks.workunit.client.1.smithi100.stdout:2/915: dwrite d0/da/f28 [0,4194304] 0 2024-04-27T07:33:45.995 INFO:tasks.workunit.client.1.smithi100.stdout:3/998: mkdir d7/d9/d10/d3e/df3/d103/d13c 0 2024-04-27T07:33:45.998 INFO:tasks.workunit.client.1.smithi100.stdout:2/916: symlink d0/d79/d94/dbc/l12a 0 2024-04-27T07:33:46.000 INFO:tasks.workunit.client.1.smithi100.stdout:3/999: rename d7/d9/d10/d33/d47/l119 to d7/da9/l13d 0 2024-04-27T07:33:46.002 INFO:tasks.workunit.client.1.smithi100.stdout:2/917: unlink d0/d79/d94/dbc/d98/cf9 0 2024-04-27T07:33:46.004 INFO:tasks.workunit.client.1.smithi100.stdout:2/918: truncate d0/da/d29/d47/da1/dc3/fd0 319616 0 2024-04-27T07:33:46.005 INFO:tasks.workunit.client.1.smithi100.stdout:2/919: readlink d0/d1e/l6a 0 2024-04-27T07:33:46.005 INFO:tasks.workunit.client.1.smithi100.stdout:2/920: readlink d0/da/d29/d47/lc8 0 2024-04-27T07:33:46.007 INFO:tasks.workunit.client.1.smithi100.stdout:2/921: rmdir d0/d79/d94/dbc/d98/db1/de9 39 2024-04-27T07:33:46.013 INFO:tasks.workunit.client.1.smithi100.stdout:2/922: write d0/d79/d94/dbc/f85 [4231874,57997] 0 2024-04-27T07:33:46.019 INFO:tasks.workunit.client.1.smithi100.stdout:2/923: dwrite d0/da/d29/d47/d5a/d8d/fa9 [0,4194304] 0 2024-04-27T07:33:46.024 INFO:tasks.workunit.client.1.smithi100.stdout:2/924: link d0/d1e/f27 d0/da/d29/d47/d5a/f12b 0 2024-04-27T07:33:46.025 INFO:tasks.workunit.client.1.smithi100.stdout:2/925: rename d0 to d0/da/d29/d47/d5a/d82/d12c 22 2024-04-27T07:33:46.027 INFO:tasks.workunit.client.1.smithi100.stdout:5/791: sync 2024-04-27T07:33:46.027 INFO:tasks.workunit.client.1.smithi100.stdout:8/920: sync 2024-04-27T07:33:46.027 INFO:tasks.workunit.client.1.smithi100.stdout:0/847: sync 2024-04-27T07:33:46.027 INFO:tasks.workunit.client.1.smithi100.stdout:9/920: sync 2024-04-27T07:33:46.028 INFO:tasks.workunit.client.1.smithi100.stdout:2/926: creat d0/f12d x:0 0 0 2024-04-27T07:33:46.030 INFO:tasks.workunit.client.1.smithi100.stdout:0/848: symlink d1/d8/d14/ded/l115 0 2024-04-27T07:33:46.030 INFO:tasks.workunit.client.1.smithi100.stdout:9/921: chown d1/d9/db/d56/d5c/de3/d4a/daa/de9 4 1 2024-04-27T07:33:46.035 INFO:tasks.workunit.client.1.smithi100.stdout:8/921: dread d6/d1b/f34 [0,4194304] 0 2024-04-27T07:33:46.036 INFO:tasks.workunit.client.1.smithi100.stdout:0/849: creat d1/d38/d3a/f116 x:0 0 0 2024-04-27T07:33:46.037 INFO:tasks.workunit.client.1.smithi100.stdout:5/792: dwrite d0/d4/d21/d24/d2f/d39/d56/d67/fd0 [4194304,4194304] 0 2024-04-27T07:33:46.039 INFO:tasks.workunit.client.1.smithi100.stdout:2/927: creat d0/da/d29/d47/d5a/dd9/dff/f12e x:0 0 0 2024-04-27T07:33:46.041 INFO:tasks.workunit.client.1.smithi100.stdout:2/928: dread - d0/da/d29/d47/d5a/dd9/dff/d88/ddd/f114 zero size 2024-04-27T07:33:46.041 INFO:tasks.workunit.client.1.smithi100.stdout:9/922: symlink d1/d9/db/d2b/d4f/l136 0 2024-04-27T07:33:46.050 INFO:tasks.workunit.client.1.smithi100.stdout:0/850: creat d1/d38/dae/f117 x:0 0 0 2024-04-27T07:33:46.051 INFO:tasks.workunit.client.1.smithi100.stdout:9/923: fsync d1/d9/db/d2b/d31/f50 0 2024-04-27T07:33:46.073 INFO:tasks.workunit.client.1.smithi100.stdout:5/793: mkdir d0/d4/d21/d24/d2f/d57/d37/d1a/dfb 0 2024-04-27T07:33:46.074 INFO:tasks.workunit.client.1.smithi100.stdout:8/922: truncate d6/d20/d8b/d8c/fd2 4201106 0 2024-04-27T07:33:46.075 INFO:tasks.workunit.client.1.smithi100.stdout:8/923: dread - d6/d1b/f107 zero size 2024-04-27T07:33:46.075 INFO:tasks.workunit.client.1.smithi100.stdout:2/929: symlink d0/da/d29/d47/dae/d115/l12f 0 2024-04-27T07:33:46.076 INFO:tasks.workunit.client.1.smithi100.stdout:0/851: mknod d1/d38/d10e/c118 0 2024-04-27T07:33:46.078 INFO:tasks.workunit.client.1.smithi100.stdout:0/852: dread d1/d8/d14/d59/d64/d80/fa6 [0,4194304] 0 2024-04-27T07:33:46.081 INFO:tasks.workunit.client.1.smithi100.stdout:2/930: creat d0/da/d29/d47/d5a/dd9/dff/d88/ddd/f130 x:0 0 0 2024-04-27T07:33:46.082 INFO:tasks.workunit.client.1.smithi100.stdout:9/924: link d1/lff d1/d9/dc2/l137 0 2024-04-27T07:33:46.083 INFO:tasks.workunit.client.1.smithi100.stdout:8/924: mknod d6/d20/d50/c123 0 2024-04-27T07:33:46.084 INFO:tasks.workunit.client.1.smithi100.stdout:0/853: truncate d1/d8/d20/f28 303895 0 2024-04-27T07:33:46.086 INFO:tasks.workunit.client.1.smithi100.stdout:2/931: mknod d0/d79/d94/dbc/d98/db1/d119/c131 0 2024-04-27T07:33:46.089 INFO:tasks.workunit.client.1.smithi100.stdout:8/925: dwrite d6/d20/d54/d91/d9e/ff8 [0,4194304] 0 2024-04-27T07:33:46.090 INFO:tasks.workunit.client.1.smithi100.stdout:8/926: truncate d6/d20/f102 359381 0 2024-04-27T07:33:46.091 INFO:tasks.workunit.client.1.smithi100.stdout:0/854: chown d1/d38/d3a/c56 660523 1 2024-04-27T07:33:46.091 INFO:tasks.workunit.client.1.smithi100.stdout:8/927: fsync d6/d20/d54/f9f 0 2024-04-27T07:33:46.093 INFO:tasks.workunit.client.1.smithi100.stdout:2/932: write d0/d79/fda [985279,58516] 0 2024-04-27T07:33:46.094 INFO:tasks.workunit.client.1.smithi100.stdout:0/855: truncate d1/d8/d20/df6/f109 636965 0 2024-04-27T07:33:46.096 INFO:tasks.workunit.client.1.smithi100.stdout:8/928: chown d6/d20/d54/d91/dae/df3/l111 5 1 2024-04-27T07:33:46.097 INFO:tasks.workunit.client.1.smithi100.stdout:8/929: dread - d6/d20/fd5 zero size 2024-04-27T07:33:46.098 INFO:tasks.workunit.client.1.smithi100.stdout:0/856: mknod d1/d38/c119 0 2024-04-27T07:33:46.099 INFO:tasks.workunit.client.1.smithi100.stdout:0/857: chown d1/d8/d14/d59 7 1 2024-04-27T07:33:46.103 INFO:tasks.workunit.client.1.smithi100.stdout:0/858: symlink d1/d8/d20/d61/d6a/l11a 0 2024-04-27T07:33:46.104 INFO:tasks.workunit.client.1.smithi100.stdout:8/930: link d6/f10 d6/d1b/d75/f124 0 2024-04-27T07:33:46.106 INFO:tasks.workunit.client.1.smithi100.stdout:8/931: read d6/d20/d8b/d8c/dce/fcc [3695184,93495] 0 2024-04-27T07:33:46.108 INFO:tasks.workunit.client.1.smithi100.stdout:0/859: dread d1/d8/d14/d59/fb5 [4194304,4194304] 0 2024-04-27T07:33:46.111 INFO:tasks.workunit.client.1.smithi100.stdout:8/932: write d6/d20/d8b/dc0/fcf [3526906,37683] 0 2024-04-27T07:33:46.112 INFO:tasks.workunit.client.1.smithi100.stdout:8/933: chown d6/d20/d54/cd3 0 1 2024-04-27T07:33:46.115 INFO:tasks.workunit.client.1.smithi100.stdout:8/934: mknod d6/d1b/d1d/d59/c125 0 2024-04-27T07:33:46.118 INFO:tasks.workunit.client.1.smithi100.stdout:8/935: symlink d6/d1b/l126 0 2024-04-27T07:33:46.121 INFO:tasks.workunit.client.1.smithi100.stdout:8/936: truncate d6/ff 2410797 0 2024-04-27T07:33:46.123 INFO:tasks.workunit.client.1.smithi100.stdout:5/794: write d0/d4/d21/d24/d2f/d39/d56/fef [1274867,30483] 0 2024-04-27T07:33:46.123 INFO:tasks.workunit.client.1.smithi100.stdout:0/860: dread d1/d8/d14/d59/fb5 [0,4194304] 0 2024-04-27T07:33:46.126 INFO:tasks.workunit.client.1.smithi100.stdout:0/861: mkdir d1/d8/d14/d11b 0 2024-04-27T07:33:46.127 INFO:tasks.workunit.client.1.smithi100.stdout:5/795: symlink d0/d42/d94/d97/d60/dc4/d99/dc9/lfc 0 2024-04-27T07:33:46.129 INFO:tasks.workunit.client.1.smithi100.stdout:5/796: write d0/d4/d21/d24/d2f/d39/d56/fe4 [58495,128632] 0 2024-04-27T07:33:46.131 INFO:tasks.workunit.client.1.smithi100.stdout:0/862: rename d1/d8/d14/d59/d64/ca9 to d1/d8/d20/df6/c11c 0 2024-04-27T07:33:46.131 INFO:tasks.workunit.client.1.smithi100.stdout:5/797: write d0/d42/d94/d97/d60/dc4/d99/da0/fe6 [662014,30943] 0 2024-04-27T07:33:46.137 INFO:tasks.workunit.client.1.smithi100.stdout:9/925: dwrite d1/d9/db/fba [0,4194304] 0 2024-04-27T07:33:46.143 INFO:tasks.workunit.client.1.smithi100.stdout:8/937: dread f1 [0,4194304] 0 2024-04-27T07:33:46.145 INFO:tasks.workunit.client.1.smithi100.stdout:5/798: dwrite d0/d42/f52 [0,4194304] 0 2024-04-27T07:33:46.150 INFO:tasks.workunit.client.1.smithi100.stdout:9/926: truncate d1/f94 105176 0 2024-04-27T07:33:46.151 INFO:tasks.workunit.client.1.smithi100.stdout:0/863: write d1/d38/fcc [1436764,51791] 0 2024-04-27T07:33:46.152 INFO:tasks.workunit.client.1.smithi100.stdout:0/864: readlink d1/d38/d3a/ld3 0 2024-04-27T07:33:46.153 INFO:tasks.workunit.client.1.smithi100.stdout:5/799: symlink d0/d4/d21/d24/d2f/d57/lfd 0 2024-04-27T07:33:46.154 INFO:tasks.workunit.client.1.smithi100.stdout:0/865: chown d1/d38/c6f 82374 1 2024-04-27T07:33:46.154 INFO:tasks.workunit.client.1.smithi100.stdout:8/938: dwrite d6/dda/ded/f44 [4194304,4194304] 0 2024-04-27T07:33:46.156 INFO:tasks.workunit.client.1.smithi100.stdout:8/939: write d6/d1b/d75/faa [3272509,5168] 0 2024-04-27T07:33:46.157 INFO:tasks.workunit.client.1.smithi100.stdout:8/940: write d6/d20/d50/f52 [4478760,20207] 0 2024-04-27T07:33:46.159 INFO:tasks.workunit.client.1.smithi100.stdout:0/866: symlink d1/d8/d20/d61/d66/l11d 0 2024-04-27T07:33:46.160 INFO:tasks.workunit.client.1.smithi100.stdout:5/800: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d30/ffe x:0 0 0 2024-04-27T07:33:46.160 INFO:tasks.workunit.client.1.smithi100.stdout:0/867: fdatasync d1/d38/d3a/fe8 0 2024-04-27T07:33:46.161 INFO:tasks.workunit.client.1.smithi100.stdout:9/927: symlink d1/d9/db/d56/d5c/de3/d4a/daa/de9/d123/l138 0 2024-04-27T07:33:46.163 INFO:tasks.workunit.client.1.smithi100.stdout:0/868: mknod d1/d38/d3a/d54/de6/c11e 0 2024-04-27T07:33:46.164 INFO:tasks.workunit.client.1.smithi100.stdout:5/801: creat d0/d4/d21/d24/d2f/d39/d7c/d92/fff x:0 0 0 2024-04-27T07:33:46.165 INFO:tasks.workunit.client.1.smithi100.stdout:9/928: symlink d1/d9/db/d2b/d31/l139 0 2024-04-27T07:33:46.166 INFO:tasks.workunit.client.1.smithi100.stdout:0/869: creat d1/d38/dae/f11f x:0 0 0 2024-04-27T07:33:46.167 INFO:tasks.workunit.client.1.smithi100.stdout:5/802: symlink d0/d4/l100 0 2024-04-27T07:33:46.168 INFO:tasks.workunit.client.1.smithi100.stdout:9/929: truncate d1/f26 1250692 0 2024-04-27T07:33:46.171 INFO:tasks.workunit.client.1.smithi100.stdout:0/870: rmdir d1/d8/d14/d59/d64/d80/d102 0 2024-04-27T07:33:46.173 INFO:tasks.workunit.client.1.smithi100.stdout:0/871: read - d1/d8/d20/d61/d66/ffc zero size 2024-04-27T07:33:46.175 INFO:tasks.workunit.client.1.smithi100.stdout:5/803: rename d0/d4/d21/d24/d2f/d57/d37/db4 to d0/d4/d21/d24/d2f/d57/ded/d101 0 2024-04-27T07:33:46.175 INFO:tasks.workunit.client.1.smithi100.stdout:9/930: dwrite d1/d9/db/d2b/f7d [0,4194304] 0 2024-04-27T07:33:46.176 INFO:tasks.workunit.client.1.smithi100.stdout:0/872: mknod d1/d38/d3a/d54/de5/c120 0 2024-04-27T07:33:46.177 INFO:tasks.workunit.client.1.smithi100.stdout:0/873: readlink d1/d8/d20/d72/d96/ld2 0 2024-04-27T07:33:46.178 INFO:tasks.workunit.client.1.smithi100.stdout:5/804: creat d0/d4/d21/d24/d2f/d39/d56/f102 x:0 0 0 2024-04-27T07:33:46.179 INFO:tasks.workunit.client.1.smithi100.stdout:9/931: mkdir d1/d9/db/d2b/de7/de8/d13a 0 2024-04-27T07:33:46.183 INFO:tasks.workunit.client.1.smithi100.stdout:9/932: mkdir d1/d9/db/d2b/d4f/dd1/dd0/d13b 0 2024-04-27T07:33:46.185 INFO:tasks.workunit.client.1.smithi100.stdout:9/933: rmdir d1/d9/dc2 39 2024-04-27T07:33:46.186 INFO:tasks.workunit.client.1.smithi100.stdout:5/805: creat d0/d4/f103 x:0 0 0 2024-04-27T07:33:46.187 INFO:tasks.workunit.client.1.smithi100.stdout:9/934: chown d1/c1a 126 1 2024-04-27T07:33:46.191 INFO:tasks.workunit.client.1.smithi100.stdout:5/806: mknod d0/d4/d21/d24/d2f/d39/d56/d67/dd4/c104 0 2024-04-27T07:33:46.193 INFO:tasks.workunit.client.1.smithi100.stdout:5/807: chown d0/d4/d21/d51/lba 127400 1 2024-04-27T07:33:46.197 INFO:tasks.workunit.client.1.smithi100.stdout:5/808: creat d0/d4/d21/d24/d2f/d57/d37/d1a/dfb/f105 x:0 0 0 2024-04-27T07:33:46.198 INFO:tasks.workunit.client.1.smithi100.stdout:0/874: write d1/d38/d3a/f48 [180930,1027] 0 2024-04-27T07:33:46.201 INFO:tasks.workunit.client.1.smithi100.stdout:0/875: write d1/d8/d20/d61/d66/dcf/f107 [438836,54832] 0 2024-04-27T07:33:46.201 INFO:tasks.workunit.client.1.smithi100.stdout:5/809: write d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fc7 [3686189,80201] 0 2024-04-27T07:33:46.205 INFO:tasks.workunit.client.1.smithi100.stdout:0/876: rename d1/d8/d20/d72/fc3 to d1/d8/d20/d88/f121 0 2024-04-27T07:33:46.207 INFO:tasks.workunit.client.1.smithi100.stdout:5/810: symlink d0/d4/d21/d24/d2f/d57/d37/d1a/d34/l106 0 2024-04-27T07:33:46.209 INFO:tasks.workunit.client.1.smithi100.stdout:0/877: link d1/d8/d20/d1e/f8d d1/d8/d14/ded/f122 0 2024-04-27T07:33:46.209 INFO:tasks.workunit.client.1.smithi100.stdout:5/811: read d0/d4/d21/d24/d2f/d57/f55 [4926,30175] 0 2024-04-27T07:33:46.209 INFO:tasks.workunit.client.1.smithi100.stdout:9/935: dread d1/f46 [0,4194304] 0 2024-04-27T07:33:46.210 INFO:tasks.workunit.client.1.smithi100.stdout:9/936: chown d1/f29 1485603 1 2024-04-27T07:33:46.211 INFO:tasks.workunit.client.1.smithi100.stdout:0/878: symlink d1/d8/d20/d1e/l123 0 2024-04-27T07:33:46.212 INFO:tasks.workunit.client.1.smithi100.stdout:9/937: write d1/d76/dd6/d12e/f134 [621826,40673] 0 2024-04-27T07:33:46.212 INFO:tasks.workunit.client.1.smithi100.stdout:5/812: fdatasync d0/d4/d21/d24/d2f/d39/d7c/fad 0 2024-04-27T07:33:46.218 INFO:tasks.workunit.client.1.smithi100.stdout:9/938: mknod d1/d9/db/d56/d5c/de3/d4a/c13c 0 2024-04-27T07:33:46.218 INFO:tasks.workunit.client.1.smithi100.stdout:5/813: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a/dfb 39 2024-04-27T07:33:46.219 INFO:tasks.workunit.client.1.smithi100.stdout:0/879: dwrite d1/d8/d20/d61/d66/ffc [0,4194304] 0 2024-04-27T07:33:46.221 INFO:tasks.workunit.client.1.smithi100.stdout:5/814: creat d0/d42/d94/d97/f107 x:0 0 0 2024-04-27T07:33:46.224 INFO:tasks.workunit.client.1.smithi100.stdout:0/880: creat d1/d8/d104/f124 x:0 0 0 2024-04-27T07:33:46.224 INFO:tasks.workunit.client.1.smithi100.stdout:5/815: write d0/d4/d21/d24/d2f/d39/d56/d67/d84/fb2 [207994,81888] 0 2024-04-27T07:33:46.230 INFO:tasks.workunit.client.1.smithi100.stdout:0/881: rename d1/d8/d14/cee to d1/d8/d104/c125 0 2024-04-27T07:33:46.233 INFO:tasks.workunit.client.1.smithi100.stdout:5/816: dwrite d0/d4/d21/d24/d2f/d39/d56/fd2 [0,4194304] 0 2024-04-27T07:33:46.236 INFO:tasks.workunit.client.1.smithi100.stdout:0/882: dwrite d1/d8/d20/f3b [0,4194304] 0 2024-04-27T07:33:46.237 INFO:tasks.workunit.client.1.smithi100.stdout:0/883: write d1/d38/d3a/f48 [5290502,58324] 0 2024-04-27T07:33:46.240 INFO:tasks.workunit.client.1.smithi100.stdout:5/817: rename d0/d4/d21/d24/d2f/d39/d56/f5d to d0/d42/d94/d97/d60/dc4/d99/da0/f108 0 2024-04-27T07:33:46.240 INFO:tasks.workunit.client.1.smithi100.stdout:5/818: stat d0/fcb 0 2024-04-27T07:33:46.242 INFO:tasks.workunit.client.1.smithi100.stdout:5/819: chown d0/d4/d21/d24/d2f/d57/d3e/l9e 118922374 1 2024-04-27T07:33:46.244 INFO:tasks.workunit.client.1.smithi100.stdout:0/884: creat d1/d8/d20/f126 x:0 0 0 2024-04-27T07:33:46.246 INFO:tasks.workunit.client.1.smithi100.stdout:0/885: write d1/d8/d20/d72/d96/fc4 [4396036,23741] 0 2024-04-27T07:33:46.246 INFO:tasks.workunit.client.1.smithi100.stdout:5/820: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d31/f109 x:0 0 0 2024-04-27T07:33:46.247 INFO:tasks.workunit.client.1.smithi100.stdout:0/886: chown d1/d8/d14/ded/f110 12 1 2024-04-27T07:33:46.247 INFO:tasks.workunit.client.1.smithi100.stdout:5/821: stat d0/d4/d21/d24/d2f/db5/fdb 0 2024-04-27T07:33:46.249 INFO:tasks.workunit.client.1.smithi100.stdout:0/887: creat d1/d8/d20/d61/f127 x:0 0 0 2024-04-27T07:33:46.250 INFO:tasks.workunit.client.1.smithi100.stdout:5/822: rename d0/d4/cd to d0/d42/d94/d97/d60/dc4/d99/dc9/dda/c10a 0 2024-04-27T07:33:46.250 INFO:tasks.workunit.client.1.smithi100.stdout:0/888: write d1/d38/d3a/d54/fac [1343623,103148] 0 2024-04-27T07:33:46.253 INFO:tasks.workunit.client.1.smithi100.stdout:0/889: mknod d1/d8/d14/c128 0 2024-04-27T07:33:46.253 INFO:tasks.workunit.client.1.smithi100.stdout:5/823: creat d0/d4/d21/d24/d2f/d57/d37/d48/f10b x:0 0 0 2024-04-27T07:33:46.254 INFO:tasks.workunit.client.1.smithi100.stdout:0/890: stat d1/d8/c4f 0 2024-04-27T07:33:46.254 INFO:tasks.workunit.client.1.smithi100.stdout:0/891: fsync d1/d8/f2e 0 2024-04-27T07:33:46.258 INFO:tasks.workunit.client.1.smithi100.stdout:0/892: mkdir d1/d8/d20/d61/d66/d129 0 2024-04-27T07:33:46.260 INFO:tasks.workunit.client.1.smithi100.stdout:0/893: write d1/d38/f7c [4885282,113690] 0 2024-04-27T07:33:46.260 INFO:tasks.workunit.client.1.smithi100.stdout:0/894: chown d1/c7 424444 1 2024-04-27T07:33:46.264 INFO:tasks.workunit.client.1.smithi100.stdout:5/824: rename d0/d4/c1f to d0/d4/d21/d24/d2f/d57/d37/d1a/d34/c10c 0 2024-04-27T07:33:46.265 INFO:tasks.workunit.client.1.smithi100.stdout:0/895: write d1/d8/d14/d59/d64/fe7 [3933062,86511] 0 2024-04-27T07:33:46.270 INFO:tasks.workunit.client.1.smithi100.stdout:0/896: mknod d1/d8/d20/d61/c12a 0 2024-04-27T07:33:46.273 INFO:tasks.workunit.client.1.smithi100.stdout:0/897: creat d1/d8/d14/ded/f12b x:0 0 0 2024-04-27T07:33:46.275 INFO:tasks.workunit.client.1.smithi100.stdout:0/898: symlink d1/d8/d14/d59/d64/d80/l12c 0 2024-04-27T07:33:46.279 INFO:tasks.workunit.client.1.smithi100.stdout:0/899: rename d1/d8/d20/d61/d66/dcf/l10a to d1/d8/d14/ded/d10d/l12d 0 2024-04-27T07:33:46.282 INFO:tasks.workunit.client.1.smithi100.stdout:5/825: dwrite d0/d4/d21/d24/d2f/d39/d56/d67/fb6 [0,4194304] 0 2024-04-27T07:33:46.285 INFO:tasks.workunit.client.1.smithi100.stdout:5/826: mknod d0/d4/d21/d24/d2f/d57/d3e/c10d 0 2024-04-27T07:33:46.308 INFO:tasks.workunit.client.1.smithi100.stdout:0/900: dread d1/d8/d20/f2b [0,4194304] 0 2024-04-27T07:33:46.310 INFO:tasks.workunit.client.1.smithi100.stdout:5/827: dread d0/d4/d21/d24/d2f/d39/ffa [0,4194304] 0 2024-04-27T07:33:46.317 INFO:tasks.workunit.client.1.smithi100.stdout:5/828: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fa5 3410192 0 2024-04-27T07:33:46.318 INFO:tasks.workunit.client.1.smithi100.stdout:5/829: chown d0/d4/c15 14479757 1 2024-04-27T07:33:46.322 INFO:tasks.workunit.client.1.smithi100.stdout:0/901: dwrite d1/d8/d14/d59/d99/f9e [0,4194304] 0 2024-04-27T07:33:46.323 INFO:tasks.workunit.client.1.smithi100.stdout:5/830: getdents d0/d4/d21/d24 0 2024-04-27T07:33:46.327 INFO:tasks.workunit.client.1.smithi100.stdout:0/902: unlink d1/d8/d20/d1e/f108 0 2024-04-27T07:33:46.328 INFO:tasks.workunit.client.1.smithi100.stdout:0/903: write d1/d8/d104/f124 [180752,44236] 0 2024-04-27T07:33:46.329 INFO:tasks.workunit.client.1.smithi100.stdout:5/831: write d0/fc0 [197309,114134] 0 2024-04-27T07:33:46.329 INFO:tasks.workunit.client.1.smithi100.stdout:0/904: dread - d1/d8/da8/ff1 zero size 2024-04-27T07:33:46.331 INFO:tasks.workunit.client.1.smithi100.stdout:0/905: chown d1/d8/d14/d59/d64/d80 207064635 1 2024-04-27T07:33:46.344 INFO:tasks.workunit.client.1.smithi100.stdout:5/832: dread d0/fc2 [0,4194304] 0 2024-04-27T07:33:46.344 INFO:tasks.workunit.client.1.smithi100.stdout:0/906: dwrite d1/d38/d3a/fd4 [0,4194304] 0 2024-04-27T07:33:46.345 INFO:tasks.workunit.client.1.smithi100.stdout:4/989: sync 2024-04-27T07:33:46.346 INFO:tasks.workunit.client.1.smithi100.stdout:0/907: write d1/d8/d20/d72/d96/fc4 [1389961,14751] 0 2024-04-27T07:33:46.346 INFO:tasks.workunit.client.1.smithi100.stdout:4/990: dread - d5/d16/f12a zero size 2024-04-27T07:33:46.350 INFO:tasks.workunit.client.1.smithi100.stdout:0/908: creat d1/d8/d14/d59/d99/f12e x:0 0 0 2024-04-27T07:33:46.352 INFO:tasks.workunit.client.1.smithi100.stdout:0/909: chown d1/d38/d3a/d54/c6c 3 1 2024-04-27T07:33:46.352 INFO:tasks.workunit.client.1.smithi100.stdout:5/833: link d0/d42/d94/d97/d60/dc4/d99/dc9/lfc d0/d4/d21/d24/d2f/d57/d37/d1a/d30/l10e 0 2024-04-27T07:33:46.355 INFO:tasks.workunit.client.1.smithi100.stdout:5/834: read d0/d4/d21/d24/d2f/d57/d37/f3f [3582359,36746] 0 2024-04-27T07:33:46.356 INFO:tasks.workunit.client.1.smithi100.stdout:4/991: write d5/d16/d19/f73 [2972587,34262] 0 2024-04-27T07:33:46.358 INFO:tasks.workunit.client.1.smithi100.stdout:0/910: getdents d1/d8/d14/d59 0 2024-04-27T07:33:46.358 INFO:tasks.workunit.client.1.smithi100.stdout:5/835: creat d0/d4/d21/d24/d2f/d57/d37/d48/f10f x:0 0 0 2024-04-27T07:33:46.360 INFO:tasks.workunit.client.1.smithi100.stdout:0/911: readlink d1/d8/d20/d72/l7a 0 2024-04-27T07:33:46.361 INFO:tasks.workunit.client.1.smithi100.stdout:0/912: chown d1/d8/d20/d61/d6a/lc7 50376485 1 2024-04-27T07:33:46.361 INFO:tasks.workunit.client.1.smithi100.stdout:5/836: creat d0/d4/d21/d24/d2f/d57/ded/f110 x:0 0 0 2024-04-27T07:33:46.363 INFO:tasks.workunit.client.1.smithi100.stdout:5/837: stat d0/d4/d21/d24/d2f/d57/d37/d48 0 2024-04-27T07:33:46.364 INFO:tasks.workunit.client.1.smithi100.stdout:0/913: mkdir d1/d8/d14/ded/d10d/d12f 0 2024-04-27T07:33:46.366 INFO:tasks.workunit.client.1.smithi100.stdout:0/914: creat d1/d38/d3a/d54/de6/f130 x:0 0 0 2024-04-27T07:33:46.367 INFO:tasks.workunit.client.1.smithi100.stdout:5/838: mknod d0/d4/d21/d24/d2f/d57/c111 0 2024-04-27T07:33:46.369 INFO:tasks.workunit.client.1.smithi100.stdout:0/915: fsync d1/d8/d20/f42 0 2024-04-27T07:33:46.369 INFO:tasks.workunit.client.1.smithi100.stdout:5/839: truncate d0/d42/d94/ff4 949406 0 2024-04-27T07:33:46.371 INFO:tasks.workunit.client.1.smithi100.stdout:0/916: truncate d1/d8/f83 4974290 0 2024-04-27T07:33:46.393 INFO:tasks.workunit.client.1.smithi100.stdout:4/992: dwrite d5/d16/d19/d46/d53/fb5 [0,4194304] 0 2024-04-27T07:33:46.393 INFO:tasks.workunit.client.1.smithi100.stdout:5/840: creat d0/d4/d21/d24/d2f/d39/d7c/f112 x:0 0 0 2024-04-27T07:33:46.393 INFO:tasks.workunit.client.1.smithi100.stdout:0/917: chown d1/d30/c68 41387 1 2024-04-27T07:33:46.395 INFO:tasks.workunit.client.1.smithi100.stdout:5/841: truncate d0/d4/d21/d24/d2f/d57/ded/f110 513921 0 2024-04-27T07:33:46.398 INFO:tasks.workunit.client.1.smithi100.stdout:5/842: dread - d0/d4/d21/d24/d2f/d39/d7c/d92/fff zero size 2024-04-27T07:33:46.401 INFO:tasks.workunit.client.1.smithi100.stdout:4/993: dwrite d5/d1b/df8/dd7/d13c/d148/d158/f10a [0,4194304] 0 2024-04-27T07:33:46.405 INFO:tasks.workunit.client.1.smithi100.stdout:4/994: symlink d5/d1b/df8/dd7/d13c/d148/l15b 0 2024-04-27T07:33:46.407 INFO:tasks.workunit.client.1.smithi100.stdout:0/918: dwrite d1/d30/fde [0,4194304] 0 2024-04-27T07:33:46.410 INFO:tasks.workunit.client.1.smithi100.stdout:4/995: creat d5/d23/f15c x:0 0 0 2024-04-27T07:33:46.411 INFO:tasks.workunit.client.1.smithi100.stdout:4/996: truncate d5/d16/fcd 1472305 0 2024-04-27T07:33:46.412 INFO:tasks.workunit.client.1.smithi100.stdout:0/919: symlink d1/d8/d20/d61/dfd/l131 0 2024-04-27T07:33:46.414 INFO:tasks.workunit.client.1.smithi100.stdout:4/997: mknod d5/d16/d19/d21/d77/d94/d9f/dd6/c15d 0 2024-04-27T07:33:46.416 INFO:tasks.workunit.client.1.smithi100.stdout:0/920: mkdir d1/d38/d3a/d132 0 2024-04-27T07:33:46.417 INFO:tasks.workunit.client.1.smithi100.stdout:4/998: mknod d5/d16/d19/d46/dd1/d11e/c15e 0 2024-04-27T07:33:46.420 INFO:tasks.workunit.client.1.smithi100.stdout:0/921: getdents d1/d38 0 2024-04-27T07:33:46.421 INFO:tasks.workunit.client.1.smithi100.stdout:4/999: rename d5/d16/d19/c10c to d5/d16/d19/df3/c15f 0 2024-04-27T07:33:46.429 INFO:tasks.workunit.client.1.smithi100.stdout:0/922: dwrite d1/d38/f60 [0,4194304] 0 2024-04-27T07:33:46.431 INFO:tasks.workunit.client.1.smithi100.stdout:0/923: mkdir d1/d8/d104/d133 0 2024-04-27T07:33:46.432 INFO:tasks.workunit.client.1.smithi100.stdout:0/924: rmdir d1/d8/d20/d61/d114 39 2024-04-27T07:33:46.440 INFO:tasks.workunit.client.1.smithi100.stdout:0/925: write d1/d38/d3a/d54/db1/fd1 [865629,116320] 0 2024-04-27T07:33:46.442 INFO:tasks.workunit.client.1.smithi100.stdout:0/926: mknod d1/d38/d3a/d54/c134 0 2024-04-27T07:33:46.447 INFO:tasks.workunit.client.1.smithi100.stdout:0/927: truncate d1/d8/d20/faa 992089 0 2024-04-27T07:33:46.449 INFO:tasks.workunit.client.1.smithi100.stdout:0/928: write d1/d38/dae/ff5 [265969,7976] 0 2024-04-27T07:33:46.460 INFO:tasks.workunit.client.1.smithi100.stdout:0/929: dread d1/d38/d3a/f48 [0,4194304] 0 2024-04-27T07:33:46.462 INFO:tasks.workunit.client.1.smithi100.stdout:0/930: unlink d1/d8/d20/d61/c12a 0 2024-04-27T07:33:46.463 INFO:tasks.workunit.client.1.smithi100.stdout:0/931: dread - d1/d8/d20/f74 zero size 2024-04-27T07:33:46.465 INFO:tasks.workunit.client.1.smithi100.stdout:0/932: link d1/d8/d20/f2b d1/d8/d20/d72/d96/f135 0 2024-04-27T07:33:46.466 INFO:tasks.workunit.client.1.smithi100.stdout:0/933: chown d1/d8/d20/d88 12031714 1 2024-04-27T07:33:46.467 INFO:tasks.workunit.client.1.smithi100.stdout:0/934: chown d1/d8/d20/f7b 17526 1 2024-04-27T07:33:46.470 INFO:tasks.workunit.client.1.smithi100.stdout:0/935: link d1/d38/d3a/f48 d1/d8/d14/d59/d99/f136 0 2024-04-27T07:33:46.470 INFO:tasks.workunit.client.1.smithi100.stdout:0/936: readlink d1/d8/l15 0 2024-04-27T07:33:46.472 INFO:tasks.workunit.client.1.smithi100.stdout:0/937: unlink d1/d30/l6d 0 2024-04-27T07:33:46.473 INFO:tasks.workunit.client.1.smithi100.stdout:0/938: dread - d1/d8/d20/d88/f121 zero size 2024-04-27T07:33:46.480 INFO:tasks.workunit.client.1.smithi100.stdout:0/939: write d1/d8/d20/d72/fcb [628531,59003] 0 2024-04-27T07:33:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:46 smithi082 ceph-mon[26613]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 122 MiB/s rd, 300 MiB/s wr, 689 op/s 2024-04-27T07:33:46.615 INFO:tasks.workunit.client.1.smithi100.stdout:7/834: sync 2024-04-27T07:33:46.618 INFO:tasks.workunit.client.1.smithi100.stdout:7/835: symlink d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/lfb 0 2024-04-27T07:33:46.622 INFO:tasks.workunit.client.1.smithi100.stdout:7/836: dwrite d1/d54/f5f [0,4194304] 0 2024-04-27T07:33:46.646 INFO:tasks.workunit.client.1.smithi100.stdout:7/837: dread d1/f15 [0,4194304] 0 2024-04-27T07:33:46.647 INFO:tasks.workunit.client.1.smithi100.stdout:7/838: fsync d1/dd/d16/d70/d51/fdf 0 2024-04-27T07:33:46.649 INFO:tasks.workunit.client.1.smithi100.stdout:7/839: unlink d1/dd/d16/d4a/d56/ce8 0 2024-04-27T07:33:46.651 INFO:tasks.workunit.client.1.smithi100.stdout:7/840: mkdir d1/dd/dfc 0 2024-04-27T07:33:46.653 INFO:tasks.workunit.client.1.smithi100.stdout:7/841: mkdir d1/dd/d16/d2b/dfd 0 2024-04-27T07:33:46.660 INFO:tasks.workunit.client.1.smithi100.stdout:7/842: dwrite d1/dd/d16/d31/d4c/d4d/f6b [0,4194304] 0 2024-04-27T07:33:46.662 INFO:tasks.workunit.client.1.smithi100.stdout:7/843: creat d1/dd/d16/d3e/ffe x:0 0 0 2024-04-27T07:33:46.663 INFO:tasks.workunit.client.1.smithi100.stdout:6/981: sync 2024-04-27T07:33:46.663 INFO:tasks.workunit.client.1.smithi100.stdout:2/933: sync 2024-04-27T07:33:46.665 INFO:tasks.workunit.client.1.smithi100.stdout:6/982: write de/d58/d21/f103 [1412279,41978] 0 2024-04-27T07:33:46.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:46 smithi100 ceph-mon[34183]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 122 MiB/s rd, 300 MiB/s wr, 689 op/s 2024-04-27T07:33:46.667 INFO:tasks.workunit.client.1.smithi100.stdout:7/844: unlink d1/l4 0 2024-04-27T07:33:46.672 INFO:tasks.workunit.client.1.smithi100.stdout:2/934: dwrite d0/da/d29/d47/d5a/d8d/d5d/f77 [0,4194304] 0 2024-04-27T07:33:46.672 INFO:tasks.workunit.client.1.smithi100.stdout:6/983: link de/d58/d28/f59 de/d58/d21/d5b/f14d 0 2024-04-27T07:33:46.674 INFO:tasks.workunit.client.1.smithi100.stdout:6/984: rmdir de/d58/d21/d24/d9f 39 2024-04-27T07:33:46.676 INFO:tasks.workunit.client.1.smithi100.stdout:7/845: dwrite d1/dd/fe [0,4194304] 0 2024-04-27T07:33:46.676 INFO:tasks.workunit.client.1.smithi100.stdout:2/935: mkdir d0/da/d29/d132 0 2024-04-27T07:33:46.678 INFO:tasks.workunit.client.1.smithi100.stdout:2/936: fdatasync d0/da/d29/d47/da1/f116 0 2024-04-27T07:33:46.678 INFO:tasks.workunit.client.1.smithi100.stdout:6/985: mkdir de/dfc/d14e 0 2024-04-27T07:33:46.681 INFO:tasks.workunit.client.1.smithi100.stdout:6/986: truncate de/d58/d28/f8b 4982902 0 2024-04-27T07:33:46.685 INFO:tasks.workunit.client.1.smithi100.stdout:2/937: mknod d0/d79/d94/dbc/d98/db1/c133 0 2024-04-27T07:33:46.686 INFO:tasks.workunit.client.1.smithi100.stdout:7/846: dwrite d1/dd/d16/d4a/f73 [4194304,4194304] 0 2024-04-27T07:33:46.687 INFO:tasks.workunit.client.1.smithi100.stdout:7/847: write d1/dd/d2a/fc5 [946172,51796] 0 2024-04-27T07:33:46.688 INFO:tasks.workunit.client.1.smithi100.stdout:2/938: symlink d0/da/d29/d47/d5a/dd9/dff/d88/ddd/d120/l134 0 2024-04-27T07:33:46.690 INFO:tasks.workunit.client.1.smithi100.stdout:7/848: mknod d1/dd/d16/d3e/dcb/cff 0 2024-04-27T07:33:46.691 INFO:tasks.workunit.client.1.smithi100.stdout:2/939: mkdir d0/d79/d94/dbc/d98/d135 0 2024-04-27T07:33:46.693 INFO:tasks.workunit.client.1.smithi100.stdout:7/849: mknod d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/c100 0 2024-04-27T07:33:46.701 INFO:tasks.workunit.client.1.smithi100.stdout:2/940: dwrite d0/da/d39/fee [4194304,4194304] 0 2024-04-27T07:33:46.703 INFO:tasks.workunit.client.1.smithi100.stdout:2/941: write d0/da/d29/d47/d5a/d8d/d5d/f77 [5110615,84139] 0 2024-04-27T07:33:46.715 INFO:tasks.workunit.client.1.smithi100.stdout:6/987: dread de/d58/d28/f4d [0,4194304] 0 2024-04-27T07:33:46.717 INFO:tasks.workunit.client.1.smithi100.stdout:6/988: symlink de/d2e/l14f 0 2024-04-27T07:33:46.723 INFO:tasks.workunit.client.1.smithi100.stdout:6/989: write de/d58/d21/d5b/f14d [207276,43616] 0 2024-04-27T07:33:46.726 INFO:tasks.workunit.client.1.smithi100.stdout:6/990: mknod de/d58/d21/dfd/c150 0 2024-04-27T07:33:46.727 INFO:tasks.workunit.client.1.smithi100.stdout:2/942: dwrite d0/da/fe4 [4194304,4194304] 0 2024-04-27T07:33:46.728 INFO:tasks.workunit.client.1.smithi100.stdout:6/991: chown de/d58/d21/d24/d9f/daa 232 1 2024-04-27T07:33:46.730 INFO:tasks.workunit.client.1.smithi100.stdout:2/943: symlink d0/d79/d94/dbc/d98/db1/l136 0 2024-04-27T07:33:46.733 INFO:tasks.workunit.client.1.smithi100.stdout:2/944: link d0/da/d29/d47/d5a/dd9/dff/d88/ddd/f110 d0/d79/f137 0 2024-04-27T07:33:46.738 INFO:tasks.workunit.client.1.smithi100.stdout:2/945: dwrite d0/da/d29/d47/d5a/ff7 [0,4194304] 0 2024-04-27T07:33:46.815 INFO:tasks.workunit.client.1.smithi100.stdout:5/843: sync 2024-04-27T07:33:46.815 INFO:tasks.workunit.client.1.smithi100.stdout:0/940: sync 2024-04-27T07:33:46.815 INFO:tasks.workunit.client.1.smithi100.stdout:8/941: sync 2024-04-27T07:33:46.815 INFO:tasks.workunit.client.1.smithi100.stdout:9/939: sync 2024-04-27T07:33:46.816 INFO:tasks.workunit.client.1.smithi100.stdout:5/844: chown d0/d42/d94/d9a 1 1 2024-04-27T07:33:46.816 INFO:tasks.workunit.client.1.smithi100.stdout:8/942: chown d6/d1b/lee 33 1 2024-04-27T07:33:46.817 INFO:tasks.workunit.client.1.smithi100.stdout:8/943: chown d6/d20/d50/f89 85177 1 2024-04-27T07:33:46.817 INFO:tasks.workunit.client.1.smithi100.stdout:2/946: creat d0/d1e/f138 x:0 0 0 2024-04-27T07:33:46.818 INFO:tasks.workunit.client.1.smithi100.stdout:5/845: read - d0/d4/d21/d24/d2f/d57/ded/d101/ff8 zero size 2024-04-27T07:33:46.818 INFO:tasks.workunit.client.1.smithi100.stdout:0/941: truncate d1/d8/d14/d59/d99/fdf 5193601 0 2024-04-27T07:33:46.818 INFO:tasks.workunit.client.1.smithi100.stdout:0/942: fdatasync d1/d8/d20/f74 0 2024-04-27T07:33:46.819 INFO:tasks.workunit.client.1.smithi100.stdout:2/947: fdatasync d0/da/d29/d47/da1/da3/f65 0 2024-04-27T07:33:46.821 INFO:tasks.workunit.client.1.smithi100.stdout:9/940: chown d1/d9/dc2/l137 0 1 2024-04-27T07:33:46.823 INFO:tasks.workunit.client.1.smithi100.stdout:9/941: fdatasync d1/d9/db/da1/dfb/fd5 0 2024-04-27T07:33:46.830 INFO:tasks.workunit.client.1.smithi100.stdout:2/948: getdents d0/da/d29/d47/d5a/d8d/d5d 0 2024-04-27T07:33:46.831 INFO:tasks.workunit.client.1.smithi100.stdout:2/949: readlink d0/da/d75/l107 0 2024-04-27T07:33:46.832 INFO:tasks.workunit.client.1.smithi100.stdout:2/950: readlink d0/d1e/l6a 0 2024-04-27T07:33:46.832 INFO:tasks.workunit.client.1.smithi100.stdout:0/943: link d1/d38/d3a/d54/lc9 d1/d8/d14/l137 0 2024-04-27T07:33:46.832 INFO:tasks.workunit.client.1.smithi100.stdout:0/944: chown d1/d8/d104 241306818 1 2024-04-27T07:33:46.834 INFO:tasks.workunit.client.1.smithi100.stdout:2/951: stat d0/da/cdc 0 2024-04-27T07:33:46.834 INFO:tasks.workunit.client.1.smithi100.stdout:8/944: dread d6/f10 [0,4194304] 0 2024-04-27T07:33:46.835 INFO:tasks.workunit.client.1.smithi100.stdout:0/945: mkdir d1/d8/da8/d138 0 2024-04-27T07:33:46.837 INFO:tasks.workunit.client.1.smithi100.stdout:2/952: write d0/d79/d94/dbc/d98/db1/de9/f127 [398482,3877] 0 2024-04-27T07:33:46.838 INFO:tasks.workunit.client.1.smithi100.stdout:8/945: unlink d6/d20/d54/d91/lc4 0 2024-04-27T07:33:46.839 INFO:tasks.workunit.client.1.smithi100.stdout:0/946: creat d1/d8/d20/d61/d66/dcf/f139 x:0 0 0 2024-04-27T07:33:46.840 INFO:tasks.workunit.client.1.smithi100.stdout:8/946: read d6/d20/d50/f52 [3807307,30871] 0 2024-04-27T07:33:46.842 INFO:tasks.workunit.client.1.smithi100.stdout:0/947: write d1/d8/d20/d61/f127 [629586,95989] 0 2024-04-27T07:33:46.846 INFO:tasks.workunit.client.1.smithi100.stdout:5/846: dread d0/d4/d21/d24/d2f/d57/d37/f3f [0,4194304] 0 2024-04-27T07:33:46.846 INFO:tasks.workunit.client.1.smithi100.stdout:2/953: dwrite d0/da/d29/d47/d5a/ff7 [0,4194304] 0 2024-04-27T07:33:46.848 INFO:tasks.workunit.client.1.smithi100.stdout:0/948: creat d1/d8/d20/d61/d66/f13a x:0 0 0 2024-04-27T07:33:46.849 INFO:tasks.workunit.client.1.smithi100.stdout:2/954: stat d0/d79/d94/dbc/d98/db1/f11a 0 2024-04-27T07:33:46.851 INFO:tasks.workunit.client.1.smithi100.stdout:8/947: link d6/l16 d6/d20/l127 0 2024-04-27T07:33:46.852 INFO:tasks.workunit.client.1.smithi100.stdout:9/942: dwrite d1/d9/db/d2b/d31/f50 [0,4194304] 0 2024-04-27T07:33:46.861 INFO:tasks.workunit.client.1.smithi100.stdout:2/955: dwrite d0/d79/d94/dbc/d98/db1/fe1 [0,4194304] 0 2024-04-27T07:33:46.862 INFO:tasks.workunit.client.1.smithi100.stdout:5/847: link d0/d4/d21/d24/d2f/d57/d37/d48/f10b d0/d4/d21/d24/d2f/d57/d37/f113 0 2024-04-27T07:33:46.862 INFO:tasks.workunit.client.1.smithi100.stdout:0/949: link d1/d8/d14/f50 d1/d8/d14/d11b/f13b 0 2024-04-27T07:33:46.867 INFO:tasks.workunit.client.1.smithi100.stdout:2/956: symlink d0/d79/d94/dbc/d98/db1/d119/l139 0 2024-04-27T07:33:46.868 INFO:tasks.workunit.client.1.smithi100.stdout:0/950: symlink d1/d8/da8/l13c 0 2024-04-27T07:33:46.870 INFO:tasks.workunit.client.1.smithi100.stdout:5/848: creat d0/d4/d21/d24/d2f/d39/d7c/f114 x:0 0 0 2024-04-27T07:33:46.871 INFO:tasks.workunit.client.1.smithi100.stdout:2/957: rename d0/da/d29/d47/d5a/dd9/dff/cf3 to d0/da/d29/d47/da1/c13a 0 2024-04-27T07:33:46.873 INFO:tasks.workunit.client.1.smithi100.stdout:9/943: dread d1/d9/db/f4e [0,4194304] 0 2024-04-27T07:33:46.875 INFO:tasks.workunit.client.1.smithi100.stdout:5/849: symlink d0/d42/d94/d9a/l115 0 2024-04-27T07:33:46.876 INFO:tasks.workunit.client.1.smithi100.stdout:8/948: write d6/f27 [2107563,26907] 0 2024-04-27T07:33:46.877 INFO:tasks.workunit.client.1.smithi100.stdout:8/949: dread - d6/d20/d8b/d8c/dce/fec zero size 2024-04-27T07:33:46.878 INFO:tasks.workunit.client.1.smithi100.stdout:9/944: mkdir d1/d9/db/d13d 0 2024-04-27T07:33:46.878 INFO:tasks.workunit.client.1.smithi100.stdout:8/950: readlink d6/d1b/d1d/l25 0 2024-04-27T07:33:46.879 INFO:tasks.workunit.client.1.smithi100.stdout:5/850: creat d0/d42/d94/d97/d60/dc4/d9d/f116 x:0 0 0 2024-04-27T07:33:46.880 INFO:tasks.workunit.client.1.smithi100.stdout:8/951: fdatasync d6/d20/d50/d72/daf/fcb 0 2024-04-27T07:33:46.880 INFO:tasks.workunit.client.1.smithi100.stdout:0/951: dread d1/d8/d20/f4b [0,4194304] 0 2024-04-27T07:33:46.881 INFO:tasks.workunit.client.1.smithi100.stdout:2/958: truncate d0/da/d29/d47/da1/da3/f65 584431 0 2024-04-27T07:33:46.882 INFO:tasks.workunit.client.1.smithi100.stdout:9/945: mknod d1/d9/db/d2b/dfd/c13e 0 2024-04-27T07:33:46.882 INFO:tasks.workunit.client.1.smithi100.stdout:5/851: fsync d0/d42/d94/d97/d60/dc4/d9d/fe3 0 2024-04-27T07:33:46.887 INFO:tasks.workunit.client.1.smithi100.stdout:2/959: rmdir d0/da/d29/d47/d5a/d8d 39 2024-04-27T07:33:46.887 INFO:tasks.workunit.client.1.smithi100.stdout:8/952: dwrite d6/d20/d54/fe1 [0,4194304] 0 2024-04-27T07:33:46.888 INFO:tasks.workunit.client.1.smithi100.stdout:7/850: sync 2024-04-27T07:33:46.888 INFO:tasks.workunit.client.1.smithi100.stdout:6/992: sync 2024-04-27T07:33:46.893 INFO:tasks.workunit.client.1.smithi100.stdout:0/952: dwrite d1/d8/d14/d59/d99/fdf [0,4194304] 0 2024-04-27T07:33:46.894 INFO:tasks.workunit.client.1.smithi100.stdout:6/993: mkdir de/dfc/d14e/d151 0 2024-04-27T07:33:46.895 INFO:tasks.workunit.client.1.smithi100.stdout:7/851: dread - d1/dd/d16/d31/d4c/d4d/fc0 zero size 2024-04-27T07:33:46.897 INFO:tasks.workunit.client.1.smithi100.stdout:9/946: creat d1/f13f x:0 0 0 2024-04-27T07:33:46.898 INFO:tasks.workunit.client.1.smithi100.stdout:9/947: fdatasync d1/d9/db/f127 0 2024-04-27T07:33:46.902 INFO:tasks.workunit.client.1.smithi100.stdout:6/994: creat de/d58/d21/d23/d73/f152 x:0 0 0 2024-04-27T07:33:46.905 INFO:tasks.workunit.client.1.smithi100.stdout:2/960: creat d0/d79/d94/dbc/d98/d135/f13b x:0 0 0 2024-04-27T07:33:46.908 INFO:tasks.workunit.client.1.smithi100.stdout:2/961: mkdir d0/d79/d94/dbc/d98/db1/d119/d13c 0 2024-04-27T07:33:46.908 INFO:tasks.workunit.client.1.smithi100.stdout:8/953: link d6/d1b/d75/f124 d6/d20/f128 0 2024-04-27T07:33:46.920 INFO:tasks.workunit.client.1.smithi100.stdout:6/995: dread de/d58/d21/d23/da0/f111 [0,4194304] 0 2024-04-27T07:33:46.922 INFO:tasks.workunit.client.1.smithi100.stdout:6/996: rmdir de/d58/d21/d91/df0 39 2024-04-27T07:33:46.924 INFO:tasks.workunit.client.1.smithi100.stdout:6/997: mknod de/d58/d21/c153 0 2024-04-27T07:33:46.925 INFO:tasks.workunit.client.1.smithi100.stdout:0/953: write d1/d8/d20/d61/f9f [294329,19438] 0 2024-04-27T07:33:46.926 INFO:tasks.workunit.client.1.smithi100.stdout:6/998: creat de/dfc/f154 x:0 0 0 2024-04-27T07:33:46.927 INFO:tasks.workunit.client.1.smithi100.stdout:9/948: write d1/d9/f21 [4619276,102493] 0 2024-04-27T07:33:46.929 INFO:tasks.workunit.client.1.smithi100.stdout:0/954: write d1/d8/d20/d61/d66/dcf/f139 [272009,48498] 0 2024-04-27T07:33:46.933 INFO:tasks.workunit.client.1.smithi100.stdout:0/955: creat d1/d38/dae/f13d x:0 0 0 2024-04-27T07:33:46.933 INFO:tasks.workunit.client.1.smithi100.stdout:7/852: dwrite d1/dd/d16/d31/d4c/d4d/d3b/d40/f74 [0,4194304] 0 2024-04-27T07:33:46.936 INFO:tasks.workunit.client.1.smithi100.stdout:0/956: read d1/d38/d3a/d54/f93 [309301,86006] 0 2024-04-27T07:33:46.938 INFO:tasks.workunit.client.1.smithi100.stdout:7/853: rename d1/dd/d2a/fed to d1/dd/d16/d31/d4c/d4d/d3b/dcc/f101 0 2024-04-27T07:33:46.945 INFO:tasks.workunit.client.1.smithi100.stdout:5/852: dread d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:46.945 INFO:tasks.workunit.client.1.smithi100.stdout:7/854: symlink d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/l102 0 2024-04-27T07:33:46.948 INFO:tasks.workunit.client.1.smithi100.stdout:6/999: creat de/d58/d21/d5b/f155 x:0 0 0 2024-04-27T07:33:46.948 INFO:tasks.workunit.client.1.smithi100.stdout:0/957: dwrite d1/d38/d3a/fa5 [0,4194304] 0 2024-04-27T07:33:46.950 INFO:tasks.workunit.client.1.smithi100.stdout:2/962: dwrite d0/d79/f137 [0,4194304] 0 2024-04-27T07:33:46.954 INFO:tasks.workunit.client.1.smithi100.stdout:5/853: mknod d0/d4/d21/d24/d2f/d39/c117 0 2024-04-27T07:33:46.956 INFO:tasks.workunit.client.1.smithi100.stdout:7/855: truncate d1/dd/d2a/f93 141684 0 2024-04-27T07:33:46.961 INFO:tasks.workunit.client.1.smithi100.stdout:2/963: dread - d0/d79/d94/dbc/f121 zero size 2024-04-27T07:33:46.961 INFO:tasks.workunit.client.1.smithi100.stdout:8/954: dread d6/f18 [0,4194304] 0 2024-04-27T07:33:46.963 INFO:tasks.workunit.client.1.smithi100.stdout:0/958: dwrite d1/d8/d20/f74 [0,4194304] 0 2024-04-27T07:33:46.963 INFO:tasks.workunit.client.1.smithi100.stdout:2/964: chown d0/da/d29/d47/l95 1712830 1 2024-04-27T07:33:46.966 INFO:tasks.workunit.client.1.smithi100.stdout:8/955: creat d6/d20/d50/d72/da4/f129 x:0 0 0 2024-04-27T07:33:46.967 INFO:tasks.workunit.client.1.smithi100.stdout:9/949: dread d1/d9/f42 [0,4194304] 0 2024-04-27T07:33:46.968 INFO:tasks.workunit.client.1.smithi100.stdout:7/856: rename d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/c100 to d1/dd/d16/d4a/c103 0 2024-04-27T07:33:46.970 INFO:tasks.workunit.client.1.smithi100.stdout:9/950: stat d1/d9/db/d2b/d4f/d57/dbe/d112 0 2024-04-27T07:33:46.970 INFO:tasks.workunit.client.1.smithi100.stdout:8/956: mkdir d6/dda/dfb/d12a 0 2024-04-27T07:33:46.971 INFO:tasks.workunit.client.1.smithi100.stdout:2/965: creat d0/da/d29/f13d x:0 0 0 2024-04-27T07:33:46.973 INFO:tasks.workunit.client.1.smithi100.stdout:2/966: write d0/d79/f137 [3073591,76267] 0 2024-04-27T07:33:46.974 INFO:tasks.workunit.client.1.smithi100.stdout:0/959: rename d1/d38/d3a/fa5 to d1/d8/d20/d61/d66/d129/f13e 0 2024-04-27T07:33:46.975 INFO:tasks.workunit.client.1.smithi100.stdout:2/967: truncate d0/da/d105/f113 760908 0 2024-04-27T07:33:46.976 INFO:tasks.workunit.client.1.smithi100.stdout:0/960: chown d1/d8/f7f 9 1 2024-04-27T07:33:46.980 INFO:tasks.workunit.client.1.smithi100.stdout:8/957: creat d6/d20/d54/d91/dae/df3/f12b x:0 0 0 2024-04-27T07:33:46.982 INFO:tasks.workunit.client.1.smithi100.stdout:5/854: dwrite d0/d4/d21/f4b [0,4194304] 0 2024-04-27T07:33:46.991 INFO:tasks.workunit.client.1.smithi100.stdout:5/855: unlink d0/d4/d21/d24/d2f/d57/d37/d1a/d30/fc7 0 2024-04-27T07:33:46.993 INFO:tasks.workunit.client.1.smithi100.stdout:2/968: mknod d0/da/d29/d47/c13e 0 2024-04-27T07:33:46.994 INFO:tasks.workunit.client.1.smithi100.stdout:7/857: dwrite d1/dd/d16/d70/d6e/fb4 [0,4194304] 0 2024-04-27T07:33:46.996 INFO:tasks.workunit.client.1.smithi100.stdout:7/858: readlink d1/dd/d16/d3e/lb7 0 2024-04-27T07:33:46.999 INFO:tasks.workunit.client.1.smithi100.stdout:5/856: mknod d0/d4/d21/d24/d2f/d39/c118 0 2024-04-27T07:33:47.000 INFO:tasks.workunit.client.1.smithi100.stdout:9/951: truncate d1/f46 1643104 0 2024-04-27T07:33:47.001 INFO:tasks.workunit.client.1.smithi100.stdout:2/969: symlink d0/d79/d94/dbc/d98/db1/d119/l13f 0 2024-04-27T07:33:47.003 INFO:tasks.workunit.client.1.smithi100.stdout:0/961: getdents d1/d8/d14/ded 0 2024-04-27T07:33:47.004 INFO:tasks.workunit.client.1.smithi100.stdout:8/958: getdents d6/d20 0 2024-04-27T07:33:47.004 INFO:tasks.workunit.client.1.smithi100.stdout:5/857: symlink d0/d42/d94/d97/l119 0 2024-04-27T07:33:47.005 INFO:tasks.workunit.client.1.smithi100.stdout:9/952: mknod d1/d9/dc2/c140 0 2024-04-27T07:33:47.006 INFO:tasks.workunit.client.1.smithi100.stdout:9/953: chown d1/d76/ld4 559744 1 2024-04-27T07:33:47.006 INFO:tasks.workunit.client.1.smithi100.stdout:2/970: mknod d0/da/d75/c140 0 2024-04-27T07:33:47.007 INFO:tasks.workunit.client.1.smithi100.stdout:7/859: creat d1/d54/f104 x:0 0 0 2024-04-27T07:33:47.008 INFO:tasks.workunit.client.1.smithi100.stdout:8/959: mkdir d6/d1b/d1d/d59/d12c 0 2024-04-27T07:33:47.009 INFO:tasks.workunit.client.1.smithi100.stdout:9/954: rename d1/d9/db/d2b to d1/d9/db/d2b/d4f/d57/d141 22 2024-04-27T07:33:47.011 INFO:tasks.workunit.client.1.smithi100.stdout:2/971: mknod d0/da/d29/d47/da1/da3/d117/c141 0 2024-04-27T07:33:47.012 INFO:tasks.workunit.client.1.smithi100.stdout:7/860: mkdir d1/dd/d16/d4a/d56/d105 0 2024-04-27T07:33:47.013 INFO:tasks.workunit.client.1.smithi100.stdout:0/962: dread d1/f82 [0,4194304] 0 2024-04-27T07:33:47.013 INFO:tasks.workunit.client.1.smithi100.stdout:7/861: readlink d1/dd/d16/d2b/l76 0 2024-04-27T07:33:47.015 INFO:tasks.workunit.client.1.smithi100.stdout:7/862: write d1/dd/d16/d31/fd5 [4845746,6244] 0 2024-04-27T07:33:47.015 INFO:tasks.workunit.client.1.smithi100.stdout:8/960: symlink d6/dda/dfb/d12a/l12d 0 2024-04-27T07:33:47.016 INFO:tasks.workunit.client.1.smithi100.stdout:7/863: chown d1/dd/d16/d2b/f9c 23945534 1 2024-04-27T07:33:47.017 INFO:tasks.workunit.client.1.smithi100.stdout:0/963: creat d1/d8/d20/d88/f13f x:0 0 0 2024-04-27T07:33:47.021 INFO:tasks.workunit.client.1.smithi100.stdout:7/864: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:47.023 INFO:tasks.workunit.client.1.smithi100.stdout:0/964: symlink d1/d8/d20/d1e/l140 0 2024-04-27T07:33:47.024 INFO:tasks.workunit.client.1.smithi100.stdout:2/972: creat d0/d1e/f142 x:0 0 0 2024-04-27T07:33:47.026 INFO:tasks.workunit.client.1.smithi100.stdout:9/955: write d1/d9/db/d2b/d4f/da3/fe5 [364246,58919] 0 2024-04-27T07:33:47.028 INFO:tasks.workunit.client.1.smithi100.stdout:9/956: readlink d1/d9/db/d56/d5c/l88 0 2024-04-27T07:33:47.028 INFO:tasks.workunit.client.1.smithi100.stdout:0/965: mknod d1/d8/d14/dce/c141 0 2024-04-27T07:33:47.030 INFO:tasks.workunit.client.1.smithi100.stdout:8/961: link d6/d20/d54/d91/dae/c6d d6/d1b/d10f/c12e 0 2024-04-27T07:33:47.032 INFO:tasks.workunit.client.1.smithi100.stdout:7/865: rename d1/dd/d16/d2b/d7f/dcf to d1/d106 0 2024-04-27T07:33:47.032 INFO:tasks.workunit.client.1.smithi100.stdout:5/858: dread d0/d42/d94/d97/fa3 [0,4194304] 0 2024-04-27T07:33:47.034 INFO:tasks.workunit.client.1.smithi100.stdout:0/966: fsync d1/d8/d20/d1e/f86 0 2024-04-27T07:33:47.037 INFO:tasks.workunit.client.1.smithi100.stdout:2/973: rename d0/d79/d94/dbc/d98/cd3 to d0/d79/d94/dbc/d98/db1/de9/c143 0 2024-04-27T07:33:47.040 INFO:tasks.workunit.client.1.smithi100.stdout:2/974: truncate d0/da/d29/d47/da1/f116 5003847 0 2024-04-27T07:33:47.041 INFO:tasks.workunit.client.1.smithi100.stdout:0/967: dwrite d1/d8/d20/d61/d66/ffb [0,4194304] 0 2024-04-27T07:33:47.046 INFO:tasks.workunit.client.1.smithi100.stdout:8/962: mknod d6/d20/d8b/c12f 0 2024-04-27T07:33:47.049 INFO:tasks.workunit.client.1.smithi100.stdout:9/957: rename d1/d9/db/d2b/d4f/dac/f5d to d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/d106/f142 0 2024-04-27T07:33:47.158 INFO:tasks.workunit.client.1.smithi100.stdout:0/968: mkdir d1/d8/d14/d59/d142 0 2024-04-27T07:33:47.158 INFO:tasks.workunit.client.1.smithi100.stdout:7/866: rmdir d1/dd/d16 39 2024-04-27T07:33:47.159 INFO:tasks.workunit.client.1.smithi100.stdout:8/963: mknod d6/d1b/c130 0 2024-04-27T07:33:47.160 INFO:tasks.workunit.client.1.smithi100.stdout:0/969: creat d1/d38/dae/f143 x:0 0 0 2024-04-27T07:33:47.161 INFO:tasks.workunit.client.1.smithi100.stdout:7/867: fsync d1/d75/f8e 0 2024-04-27T07:33:47.165 INFO:tasks.workunit.client.1.smithi100.stdout:5/859: dwrite d0/d4/d21/d24/d2f/d39/d56/fd6 [0,4194304] 0 2024-04-27T07:33:47.169 INFO:tasks.workunit.client.1.smithi100.stdout:5/860: truncate d0/d4/d21/d24/fc8 1851309 0 2024-04-27T07:33:47.171 INFO:tasks.workunit.client.1.smithi100.stdout:0/970: dwrite d1/d8/d14/dce/ffe [0,4194304] 0 2024-04-27T07:33:47.177 INFO:tasks.workunit.client.1.smithi100.stdout:0/971: dread - d1/d8/d14/d59/f8f zero size 2024-04-27T07:33:47.180 INFO:tasks.workunit.client.1.smithi100.stdout:7/868: dread d1/dd/d2a/f68 [0,4194304] 0 2024-04-27T07:33:47.183 INFO:tasks.workunit.client.1.smithi100.stdout:7/869: mkdir d1/d75/de6/d107 0 2024-04-27T07:33:47.193 INFO:tasks.workunit.client.1.smithi100.stdout:5/861: write d0/d4/f22 [6867494,60214] 0 2024-04-27T07:33:47.194 INFO:tasks.workunit.client.1.smithi100.stdout:7/870: write d1/dd/d16/d31/d4c/d4d/d3b/f67 [413332,109417] 0 2024-04-27T07:33:47.199 INFO:tasks.workunit.client.1.smithi100.stdout:8/964: dwrite d6/d20/fd5 [0,4194304] 0 2024-04-27T07:33:47.199 INFO:tasks.workunit.client.1.smithi100.stdout:7/871: mknod d1/dd/d16/d31/c108 0 2024-04-27T07:33:47.202 INFO:tasks.workunit.client.1.smithi100.stdout:8/965: chown d6/d20/da2/l11a 1151814 1 2024-04-27T07:33:47.202 INFO:tasks.workunit.client.1.smithi100.stdout:5/862: dwrite d0/fa [0,4194304] 0 2024-04-27T07:33:47.205 INFO:tasks.workunit.client.1.smithi100.stdout:7/872: symlink d1/dd/d16/d2b/d7f/l109 0 2024-04-27T07:33:47.206 INFO:tasks.workunit.client.1.smithi100.stdout:8/966: rmdir d6/d20/d50/d72/daf 39 2024-04-27T07:33:47.209 INFO:tasks.workunit.client.1.smithi100.stdout:7/873: read d1/dd/d16/d70/d51/d6f/f92 [1181547,30645] 0 2024-04-27T07:33:47.210 INFO:tasks.workunit.client.1.smithi100.stdout:7/874: readlink d1/dd/d16/d31/d4c/l7e 0 2024-04-27T07:33:47.211 INFO:tasks.workunit.client.1.smithi100.stdout:5/863: link d0/d4/d21/d24/d2f/d57/d3e/l9e d0/d42/d94/d97/d60/dc4/d99/l11a 0 2024-04-27T07:33:47.213 INFO:tasks.workunit.client.1.smithi100.stdout:7/875: creat d1/d75/de6/f10a x:0 0 0 2024-04-27T07:33:47.214 INFO:tasks.workunit.client.1.smithi100.stdout:8/967: rename d6/d1b/d1d/f9c to d6/d20/d50/f131 0 2024-04-27T07:33:47.216 INFO:tasks.workunit.client.1.smithi100.stdout:7/876: creat d1/dd/d16/d31/d4c/d4d/d3b/dcc/f10b x:0 0 0 2024-04-27T07:33:47.219 INFO:tasks.workunit.client.1.smithi100.stdout:7/877: getdents d1/dd/d16/d2b/dfa 0 2024-04-27T07:33:47.221 INFO:tasks.workunit.client.1.smithi100.stdout:5/864: link d0/d42/d94/d97/d60/dc4/d9d/ldf d0/d4/l11b 0 2024-04-27T07:33:47.224 INFO:tasks.workunit.client.1.smithi100.stdout:5/865: chown d0/d42/d94/d97/d60/dc4/d99/dc9/dda/c10a 1 1 2024-04-27T07:33:47.226 INFO:tasks.workunit.client.1.smithi100.stdout:5/866: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fb0 zero size 2024-04-27T07:33:47.227 INFO:tasks.workunit.client.1.smithi100.stdout:8/968: write d6/dda/ded/f55 [4203734,110633] 0 2024-04-27T07:33:47.230 INFO:tasks.workunit.client.1.smithi100.stdout:8/969: creat d6/d20/da2/f132 x:0 0 0 2024-04-27T07:33:47.231 INFO:tasks.workunit.client.1.smithi100.stdout:5/867: mknod d0/d4/d21/d24/d2f/d57/d37/d1a/dfb/c11c 0 2024-04-27T07:33:47.233 INFO:tasks.workunit.client.1.smithi100.stdout:5/868: read d0/d4/d21/d24/fc8 [1512438,93013] 0 2024-04-27T07:33:47.234 INFO:tasks.workunit.client.1.smithi100.stdout:7/878: dwrite d1/dd/d16/d2b/d7f/fc9 [0,4194304] 0 2024-04-27T07:33:47.239 INFO:tasks.workunit.client.1.smithi100.stdout:5/869: mkdir d0/d4/d21/d24/d2f/d57/d37/d48/d11d 0 2024-04-27T07:33:47.241 INFO:tasks.workunit.client.1.smithi100.stdout:8/970: truncate d6/dda/ded/f55 3732630 0 2024-04-27T07:33:47.242 INFO:tasks.workunit.client.1.smithi100.stdout:8/971: fsync d6/f31 0 2024-04-27T07:33:47.242 INFO:tasks.workunit.client.1.smithi100.stdout:5/870: truncate d0/d4/d21/d24/d2f/d57/d37/f113 452915 0 2024-04-27T07:33:47.245 INFO:tasks.workunit.client.1.smithi100.stdout:7/879: link d1/dd/d16/d3e/d8b/ce1 d1/dd/d16/d3e/d8b/da4/c10c 0 2024-04-27T07:33:47.246 INFO:tasks.workunit.client.1.smithi100.stdout:5/871: mkdir d0/d4/d11e 0 2024-04-27T07:33:47.248 INFO:tasks.workunit.client.1.smithi100.stdout:7/880: creat d1/dd/d16/d4a/d56/f10d x:0 0 0 2024-04-27T07:33:47.250 INFO:tasks.workunit.client.1.smithi100.stdout:8/972: dwrite d6/d20/d50/f89 [0,4194304] 0 2024-04-27T07:33:47.254 INFO:tasks.workunit.client.1.smithi100.stdout:5/872: creat d0/d4/d21/d24/d2f/d57/d37/d1a/f11f x:0 0 0 2024-04-27T07:33:47.257 INFO:tasks.workunit.client.1.smithi100.stdout:7/881: mkdir d1/dd/d2a/db0/d10e 0 2024-04-27T07:33:47.259 INFO:tasks.workunit.client.1.smithi100.stdout:8/973: symlink d6/d1b/l133 0 2024-04-27T07:33:47.260 INFO:tasks.workunit.client.1.smithi100.stdout:8/974: chown d6/d20/d50/f74 5268 1 2024-04-27T07:33:47.262 INFO:tasks.workunit.client.1.smithi100.stdout:7/882: dread d1/dd/d16/d31/d4c/d4d/d3b/d40/f74 [0,4194304] 0 2024-04-27T07:33:47.264 INFO:tasks.workunit.client.1.smithi100.stdout:8/975: link d6/dda/dfb/ffd d6/d1b/d75/f134 0 2024-04-27T07:33:47.265 INFO:tasks.workunit.client.1.smithi100.stdout:7/883: mknod d1/dd/c10f 0 2024-04-27T07:33:47.268 INFO:tasks.workunit.client.1.smithi100.stdout:8/976: creat d6/d20/d8b/d8c/f135 x:0 0 0 2024-04-27T07:33:47.269 INFO:tasks.workunit.client.1.smithi100.stdout:7/884: rmdir d1/dd/d16/d31/d4c 39 2024-04-27T07:33:47.270 INFO:tasks.workunit.client.1.smithi100.stdout:8/977: chown d6/d20/d50/d72/daf/cef 99455 1 2024-04-27T07:33:47.271 INFO:tasks.workunit.client.1.smithi100.stdout:8/978: read - d6/dda/dfb/ffd zero size 2024-04-27T07:33:47.273 INFO:tasks.workunit.client.1.smithi100.stdout:7/885: rename d1/d75 to d1/dd/d16/d70/d51/d9d/d110 0 2024-04-27T07:33:47.275 INFO:tasks.workunit.client.1.smithi100.stdout:8/979: truncate d6/d1b/f34 1286212 0 2024-04-27T07:33:47.278 INFO:tasks.workunit.client.1.smithi100.stdout:8/980: creat d6/d20/da2/db0/f136 x:0 0 0 2024-04-27T07:33:47.279 INFO:tasks.workunit.client.1.smithi100.stdout:8/981: fsync d6/d20/d54/d91/d9e/fdc 0 2024-04-27T07:33:47.280 INFO:tasks.workunit.client.1.smithi100.stdout:7/886: link d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a d1/dd/d16/d2b/dfa/f111 0 2024-04-27T07:33:47.283 INFO:tasks.workunit.client.1.smithi100.stdout:7/887: read d1/d54/f5f [7908692,127884] 0 2024-04-27T07:33:47.287 INFO:tasks.workunit.client.1.smithi100.stdout:8/982: write d6/f45 [2505163,53864] 0 2024-04-27T07:33:47.291 INFO:tasks.workunit.client.1.smithi100.stdout:7/888: dwrite d1/dd/d16/d4a/d56/f10d [0,4194304] 0 2024-04-27T07:33:47.293 INFO:tasks.workunit.client.1.smithi100.stdout:8/983: getdents d6/d20/da2/d10d 0 2024-04-27T07:33:47.304 INFO:tasks.workunit.client.1.smithi100.stdout:8/984: truncate d6/d1b/d1d/f2c 262186 0 2024-04-27T07:33:47.310 INFO:tasks.workunit.client.1.smithi100.stdout:7/889: dread d1/dd/d16/d31/d4c/d4d/f95 [0,4194304] 0 2024-04-27T07:33:47.312 INFO:tasks.workunit.client.1.smithi100.stdout:7/890: readlink d1/dd/d16/d3e/d8b/l9b 0 2024-04-27T07:33:47.316 INFO:tasks.workunit.client.1.smithi100.stdout:8/985: dwrite d6/d1b/d75/f83 [0,4194304] 0 2024-04-27T07:33:47.318 INFO:tasks.workunit.client.1.smithi100.stdout:7/891: getdents d1/dd/d2a/d2c/d9f 0 2024-04-27T07:33:47.322 INFO:tasks.workunit.client.1.smithi100.stdout:7/892: rmdir d1/dd/d16/d31/d4c/d4d/d3b/dcc 39 2024-04-27T07:33:47.325 INFO:tasks.workunit.client.1.smithi100.stdout:7/893: mkdir d1/dd/d16/d31/dbf/d112 0 2024-04-27T07:33:47.326 INFO:tasks.workunit.client.1.smithi100.stdout:7/894: dread - d1/dd/d16/d3e/dc3/fe3 zero size 2024-04-27T07:33:47.328 INFO:tasks.workunit.client.1.smithi100.stdout:7/895: creat d1/dd/d16/d2b/f113 x:0 0 0 2024-04-27T07:33:47.331 INFO:tasks.workunit.client.1.smithi100.stdout:7/896: rmdir d1/dd/d16/d70/d51/d9d 39 2024-04-27T07:33:47.331 INFO:tasks.workunit.client.1.smithi100.stdout:7/897: chown d1/dd/dfc 4 1 2024-04-27T07:33:47.335 INFO:tasks.workunit.client.1.smithi100.stdout:7/898: fsync d1/dd/d16/d31/d4c/d4d/d3b/f46 0 2024-04-27T07:33:47.338 INFO:tasks.workunit.client.1.smithi100.stdout:7/899: write d1/fec [77885,84639] 0 2024-04-27T07:33:47.339 INFO:tasks.workunit.client.1.smithi100.stdout:8/986: dread d6/d1b/d1d/d59/f51 [0,4194304] 0 2024-04-27T07:33:47.342 INFO:tasks.workunit.client.1.smithi100.stdout:7/900: rmdir d1/dd/d16/d70/d51/d9d/d110 39 2024-04-27T07:33:47.343 INFO:tasks.workunit.client.1.smithi100.stdout:8/987: creat d6/d20/d50/f137 x:0 0 0 2024-04-27T07:33:47.345 INFO:tasks.workunit.client.1.smithi100.stdout:7/901: symlink d1/l114 0 2024-04-27T07:33:47.345 INFO:tasks.workunit.client.1.smithi100.stdout:8/988: creat d6/d20/d8b/d8c/dce/f138 x:0 0 0 2024-04-27T07:33:47.346 INFO:tasks.workunit.client.1.smithi100.stdout:7/902: creat d1/dd/d16/d70/f115 x:0 0 0 2024-04-27T07:33:47.348 INFO:tasks.workunit.client.1.smithi100.stdout:7/903: dread - d1/dd/d16/d3e/dc3/fe3 zero size 2024-04-27T07:33:47.348 INFO:tasks.workunit.client.1.smithi100.stdout:8/989: creat d6/d20/da2/db0/f139 x:0 0 0 2024-04-27T07:33:47.348 INFO:tasks.workunit.client.1.smithi100.stdout:7/904: chown d1/dd/d16/d4a/le7 1 1 2024-04-27T07:33:47.353 INFO:tasks.workunit.client.1.smithi100.stdout:7/905: creat d1/dd/d16/d70/d51/d9d/d110/de6/f116 x:0 0 0 2024-04-27T07:33:47.355 INFO:tasks.workunit.client.1.smithi100.stdout:8/990: dwrite d6/d20/d50/f121 [0,4194304] 0 2024-04-27T07:33:47.357 INFO:tasks.workunit.client.1.smithi100.stdout:8/991: fsync d6/d20/d54/d91/dae/df3/f11b 0 2024-04-27T07:33:47.357 INFO:tasks.workunit.client.1.smithi100.stdout:7/906: mknod d1/dd/d16/d70/c117 0 2024-04-27T07:33:47.359 INFO:tasks.workunit.client.1.smithi100.stdout:8/992: chown d6/d20/d50/cb9 11 1 2024-04-27T07:33:47.361 INFO:tasks.workunit.client.1.smithi100.stdout:7/907: fdatasync d1/dd/d16/d31/d4c/d4d/d3b/faf 0 2024-04-27T07:33:47.362 INFO:tasks.workunit.client.1.smithi100.stdout:0/972: sync 2024-04-27T07:33:47.362 INFO:tasks.workunit.client.1.smithi100.stdout:9/958: sync 2024-04-27T07:33:47.362 INFO:tasks.workunit.client.1.smithi100.stdout:2/975: sync 2024-04-27T07:33:47.366 INFO:tasks.workunit.client.1.smithi100.stdout:8/993: mknod d6/d20/d50/c13a 0 2024-04-27T07:33:47.370 INFO:tasks.workunit.client.1.smithi100.stdout:9/959: dread d1/d9/db/d2b/d4f/dd1/f10d [0,4194304] 0 2024-04-27T07:33:47.371 INFO:tasks.workunit.client.1.smithi100.stdout:7/908: mkdir d1/d54/d118 0 2024-04-27T07:33:47.372 INFO:tasks.workunit.client.1.smithi100.stdout:0/973: write d1/d8/d20/d72/d96/f135 [2360958,36323] 0 2024-04-27T07:33:47.382 INFO:tasks.workunit.client.1.smithi100.stdout:5/873: sync 2024-04-27T07:33:47.382 INFO:tasks.workunit.client.1.smithi100.stdout:0/974: link d1/d8/d20/d61/fb2 d1/d8/d14/d59/d142/f144 0 2024-04-27T07:33:47.383 INFO:tasks.workunit.client.1.smithi100.stdout:2/976: dwrite d0/da/d29/d47/d5a/d8d/d5d/f5f [0,4194304] 0 2024-04-27T07:33:47.383 INFO:tasks.workunit.client.1.smithi100.stdout:8/994: dread d6/d20/d8b/dc0/fcf [0,4194304] 0 2024-04-27T07:33:47.384 INFO:tasks.workunit.client.1.smithi100.stdout:9/960: rmdir d1/d9/db/d2b/d4f/dac/d131 0 2024-04-27T07:33:47.386 INFO:tasks.workunit.client.1.smithi100.stdout:8/995: write d6/d20/da2/db0/f139 [822731,6008] 0 2024-04-27T07:33:47.386 INFO:tasks.workunit.client.1.smithi100.stdout:7/909: link d1/dd/cb3 d1/dd/d16/d70/d51/d9d/d110/c119 0 2024-04-27T07:33:47.387 INFO:tasks.workunit.client.1.smithi100.stdout:9/961: dread - d1/d9/db/d2b/d4f/dd1/f11e zero size 2024-04-27T07:33:47.390 INFO:tasks.workunit.client.1.smithi100.stdout:5/874: dread d0/d42/d94/d97/d60/dc4/d99/da0/f108 [0,4194304] 0 2024-04-27T07:33:47.391 INFO:tasks.workunit.client.1.smithi100.stdout:0/975: mkdir d1/d8/d14/d59/d64/d80/d145 0 2024-04-27T07:33:47.391 INFO:tasks.workunit.client.1.smithi100.stdout:7/910: read d1/dd/d16/d31/d4c/d4d/d3b/f46 [484742,90148] 0 2024-04-27T07:33:47.392 INFO:tasks.workunit.client.1.smithi100.stdout:9/962: fdatasync d1/d9/db/d2b/d4f/d57/dbe/fea 0 2024-04-27T07:33:47.394 INFO:tasks.workunit.client.1.smithi100.stdout:5/875: write d0/d4/d21/d24/d2f/d39/d7c/f114 [743853,122272] 0 2024-04-27T07:33:47.398 INFO:tasks.workunit.client.1.smithi100.stdout:2/977: creat d0/d79/f144 x:0 0 0 2024-04-27T07:33:47.399 INFO:tasks.workunit.client.1.smithi100.stdout:7/911: read d1/dd/d16/d31/d4c/d4d/fe2 [293362,42620] 0 2024-04-27T07:33:47.399 INFO:tasks.workunit.client.1.smithi100.stdout:5/876: write d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f9c [53141,122277] 0 2024-04-27T07:33:47.403 INFO:tasks.workunit.client.1.smithi100.stdout:8/996: rename d6/d20/d54/d91/fd6 to d6/f13b 0 2024-04-27T07:33:47.404 INFO:tasks.workunit.client.1.smithi100.stdout:5/877: write d0/d4/d21/d24/d2f/d39/d56/f102 [852770,15823] 0 2024-04-27T07:33:47.404 INFO:tasks.workunit.client.1.smithi100.stdout:0/976: dwrite d1/d8/d20/df6/f103 [0,4194304] 0 2024-04-27T07:33:47.406 INFO:tasks.workunit.client.1.smithi100.stdout:7/912: write d1/dd/d16/d31/d4c/d4d/d3b/dcc/fda [552168,30852] 0 2024-04-27T07:33:47.407 INFO:tasks.workunit.client.1.smithi100.stdout:5/878: dread - d0/d4/d21/d24/d2f/d57/d37/d1a/f11f zero size 2024-04-27T07:33:47.412 INFO:tasks.workunit.client.1.smithi100.stdout:7/913: dwrite d1/dd/d16/d2b/f113 [0,4194304] 0 2024-04-27T07:33:47.414 INFO:tasks.workunit.client.1.smithi100.stdout:7/914: stat d1/dd/d16/d31/dbf/d112 0 2024-04-27T07:33:47.415 INFO:tasks.workunit.client.1.smithi100.stdout:7/915: chown d1/dd/d16/d4a/d56/fc7 4551380 1 2024-04-27T07:33:47.427 INFO:tasks.workunit.client.1.smithi100.stdout:8/997: unlink d6/d1b/d1d/d59/c92 0 2024-04-27T07:33:47.427 INFO:tasks.workunit.client.1.smithi100.stdout:9/963: write d1/d9/db/d2b/d4f/d57/ff0 [543163,92046] 0 2024-04-27T07:33:47.430 INFO:tasks.workunit.client.1.smithi100.stdout:9/964: read d1/d9/db/d2b/d4f/d91/f115 [3072441,76025] 0 2024-04-27T07:33:47.492 INFO:tasks.workunit.client.1.smithi100.stdout:5/879: creat d0/d4/d21/d24/d2f/d39/d56/f120 x:0 0 0 2024-04-27T07:33:47.501 INFO:tasks.workunit.client.1.smithi100.stdout:5/880: symlink d0/d4/d21/d24/d2f/d39/d56/d67/dd4/l121 0 2024-04-27T07:33:47.524 INFO:tasks.workunit.client.1.smithi100.stdout:0/977: rename d1/d38/d3a/d54/de5/c120 to d1/d8/d14/c146 0 2024-04-27T07:33:47.528 INFO:tasks.workunit.client.1.smithi100.stdout:0/978: creat d1/d38/d3a/d54/de6/f147 x:0 0 0 2024-04-27T07:33:47.557 INFO:tasks.workunit.client.1.smithi100.stdout:2/978: sync 2024-04-27T07:33:47.559 INFO:tasks.workunit.client.1.smithi100.stdout:2/979: write d0/da/d29/d47/da1/da3/f97 [2463559,101479] 0 2024-04-27T07:33:47.560 INFO:tasks.workunit.client.1.smithi100.stdout:2/980: readlink d0/d1e/l6a 0 2024-04-27T07:33:47.563 INFO:tasks.workunit.client.1.smithi100.stdout:2/981: dread d0/da/d29/d47/da1/f116 [4194304,4194304] 0 2024-04-27T07:33:47.571 INFO:tasks.workunit.client.1.smithi100.stdout:2/982: mkdir d0/da/d29/d47/d5a/dd9/d145 0 2024-04-27T07:33:47.578 INFO:tasks.workunit.client.1.smithi100.stdout:7/916: write d1/dd/d16/d4a/fab [2189102,26343] 0 2024-04-27T07:33:47.583 INFO:tasks.workunit.client.1.smithi100.stdout:7/917: symlink d1/dd/d16/d31/d4c/d4d/d3b/dcc/df3/l11a 0 2024-04-27T07:33:47.584 INFO:tasks.workunit.client.1.smithi100.stdout:9/965: truncate d1/d9/db/d56/d5c/de3/d4a/d67/fc1 4553332 0 2024-04-27T07:33:47.587 INFO:tasks.workunit.client.1.smithi100.stdout:7/918: mknod d1/dd/d2a/d2c/c11b 0 2024-04-27T07:33:47.589 INFO:tasks.workunit.client.1.smithi100.stdout:9/966: rmdir d1/d9/db/d2b/d4f/dd1/dd0 39 2024-04-27T07:33:47.600 INFO:tasks.workunit.client.1.smithi100.stdout:8/998: rename d6/d20/d54/d91/dae/df3/f12b to d6/d20/f13c 0 2024-04-27T07:33:47.602 INFO:tasks.workunit.client.1.smithi100.stdout:8/999: stat d6/ff 0 2024-04-27T07:33:47.605 INFO:tasks.workunit.client.1.smithi100.stdout:5/881: rename d0/d4/d21/l27 to d0/d4/d21/d24/d2f/d57/d37/d48/d11d/l122 0 2024-04-27T07:33:47.612 INFO:tasks.workunit.client.1.smithi100.stdout:0/979: write d1/fb0 [1006826,122692] 0 2024-04-27T07:33:47.616 INFO:tasks.workunit.client.1.smithi100.stdout:0/980: truncate d1/d8/d20/d61/fb2 143632 0 2024-04-27T07:33:47.617 INFO:tasks.workunit.client.1.smithi100.stdout:9/967: dread d1/d9/f21 [0,4194304] 0 2024-04-27T07:33:47.620 INFO:tasks.workunit.client.1.smithi100.stdout:7/919: creat d1/dd/f11c x:0 0 0 2024-04-27T07:33:47.622 INFO:tasks.workunit.client.1.smithi100.stdout:7/920: fdatasync d1/d54/f104 0 2024-04-27T07:33:47.622 INFO:tasks.workunit.client.1.smithi100.stdout:2/983: mkdir d0/da/d146 0 2024-04-27T07:33:47.624 INFO:tasks.workunit.client.1.smithi100.stdout:7/921: dread - d1/dd/d16/d70/fce zero size 2024-04-27T07:33:47.627 INFO:tasks.workunit.client.1.smithi100.stdout:0/981: dwrite d1/d38/dae/f13d [0,4194304] 0 2024-04-27T07:33:47.630 INFO:tasks.workunit.client.1.smithi100.stdout:7/922: read d1/dd/d16/d2b/f9c [612840,109833] 0 2024-04-27T07:33:47.632 INFO:tasks.workunit.client.1.smithi100.stdout:9/968: rename d1/d9/db/fba to d1/d9/db/d2b/d4f/dac/f143 0 2024-04-27T07:33:47.637 INFO:tasks.workunit.client.1.smithi100.stdout:0/982: symlink d1/d8/d14/d59/d64/d80/l148 0 2024-04-27T07:33:47.638 INFO:tasks.workunit.client.1.smithi100.stdout:7/923: write d1/dd/f5d [2588345,48870] 0 2024-04-27T07:33:47.642 INFO:tasks.workunit.client.1.smithi100.stdout:9/969: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/dc7/f144 x:0 0 0 2024-04-27T07:33:47.645 INFO:tasks.workunit.client.1.smithi100.stdout:0/983: dwrite d1/d8/d104/f105 [0,4194304] 0 2024-04-27T07:33:47.647 INFO:tasks.workunit.client.1.smithi100.stdout:0/984: write d1/d30/fde [3210407,105006] 0 2024-04-27T07:33:47.652 INFO:tasks.workunit.client.1.smithi100.stdout:9/970: creat d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/db1/f145 x:0 0 0 2024-04-27T07:33:47.652 INFO:tasks.workunit.client.1.smithi100.stdout:7/924: dwrite d1/dd/d16/d3e/dcb/fd3 [0,4194304] 0 2024-04-27T07:33:47.653 INFO:tasks.workunit.client.1.smithi100.stdout:0/985: creat d1/d8/d20/d72/d96/f149 x:0 0 0 2024-04-27T07:33:47.654 INFO:tasks.workunit.client.1.smithi100.stdout:2/984: dread d0/da/f28 [0,4194304] 0 2024-04-27T07:33:47.659 INFO:tasks.workunit.client.1.smithi100.stdout:0/986: mkdir d1/d8/d20/df6/d14a 0 2024-04-27T07:33:47.661 INFO:tasks.workunit.client.1.smithi100.stdout:5/882: write d0/d42/d94/d97/d60/dc4/f71 [1987169,108700] 0 2024-04-27T07:33:47.661 INFO:tasks.workunit.client.1.smithi100.stdout:7/925: mknod d1/dd/d16/d31/d4c/d4d/d3b/d40/c11d 0 2024-04-27T07:33:47.663 INFO:tasks.workunit.client.1.smithi100.stdout:2/985: creat d0/da/d29/d47/dae/df4/f147 x:0 0 0 2024-04-27T07:33:47.665 INFO:tasks.workunit.client.1.smithi100.stdout:7/926: chown d1/dd/cb3 119827 1 2024-04-27T07:33:47.666 INFO:tasks.workunit.client.1.smithi100.stdout:9/971: dwrite d1/d9/db/d56/d5c/de3/f7a [4194304,4194304] 0 2024-04-27T07:33:47.668 INFO:tasks.workunit.client.1.smithi100.stdout:2/986: read d0/da/d29/d47/da1/dc3/fd0 [155571,120805] 0 2024-04-27T07:33:47.669 INFO:tasks.workunit.client.1.smithi100.stdout:7/927: write d1/dd/d16/d3e/d8b/fef [618172,28202] 0 2024-04-27T07:33:47.670 INFO:tasks.workunit.client.1.smithi100.stdout:5/883: creat d0/d42/d94/d97/d60/dc4/f123 x:0 0 0 2024-04-27T07:33:47.672 INFO:tasks.workunit.client.1.smithi100.stdout:5/884: chown d0/d4/d21/d24/d2f/d57/d37/d1a/f8e 3574462 1 2024-04-27T07:33:47.674 INFO:tasks.workunit.client.1.smithi100.stdout:5/885: fsync d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 0 2024-04-27T07:33:47.675 INFO:tasks.workunit.client.1.smithi100.stdout:9/972: dread d1/d9/db/d56/f8c [0,4194304] 0 2024-04-27T07:33:47.676 INFO:tasks.workunit.client.1.smithi100.stdout:7/928: mkdir d1/dd/d16/d70/d11e 0 2024-04-27T07:33:47.681 INFO:tasks.workunit.client.1.smithi100.stdout:5/886: creat d0/d4/d21/d24/f124 x:0 0 0 2024-04-27T07:33:47.683 INFO:tasks.workunit.client.1.smithi100.stdout:0/987: dread d1/d8/fcd [0,4194304] 0 2024-04-27T07:33:47.693 INFO:tasks.workunit.client.1.smithi100.stdout:7/929: getdents d1/dd/d2a/d2c 0 2024-04-27T07:33:47.694 INFO:tasks.workunit.client.1.smithi100.stdout:2/987: write d0/da/d29/d47/d5a/dd9/dff/f11d [773278,1132] 0 2024-04-27T07:33:47.694 INFO:tasks.workunit.client.1.smithi100.stdout:0/988: dwrite d1/d8/d14/d59/d99/f9e [0,4194304] 0 2024-04-27T07:33:47.697 INFO:tasks.workunit.client.1.smithi100.stdout:2/988: chown d0/d79/d94/dbc/f85 7442641 1 2024-04-27T07:33:47.702 INFO:tasks.workunit.client.1.smithi100.stdout:7/930: dwrite d1/dd/d16/d4a/fab [0,4194304] 0 2024-04-27T07:33:47.705 INFO:tasks.workunit.client.1.smithi100.stdout:5/887: dread d0/d4/d21/d24/d2f/db5/fdb [0,4194304] 0 2024-04-27T07:33:47.705 INFO:tasks.workunit.client.1.smithi100.stdout:9/973: dread d1/d9/db/d56/f83 [0,4194304] 0 2024-04-27T07:33:47.705 INFO:tasks.workunit.client.1.smithi100.stdout:2/989: dread d0/d79/d94/dbc/d98/db1/f11a [0,4194304] 0 2024-04-27T07:33:47.708 INFO:tasks.workunit.client.1.smithi100.stdout:7/931: mknod d1/dd/d16/d4a/d56/d105/c11f 0 2024-04-27T07:33:47.711 INFO:tasks.workunit.client.1.smithi100.stdout:9/974: creat d1/d9/db/d2b/dfd/f146 x:0 0 0 2024-04-27T07:33:47.711 INFO:tasks.workunit.client.1.smithi100.stdout:0/989: dwrite d1/d8/d20/f28 [0,4194304] 0 2024-04-27T07:33:47.713 INFO:tasks.workunit.client.1.smithi100.stdout:2/990: mkdir d0/d79/d94/dbc/d98/db1/d119/d13c/d148 0 2024-04-27T07:33:47.715 INFO:tasks.workunit.client.1.smithi100.stdout:7/932: unlink d1/dd/d16/d31/d4c/d4d/d3b/dcc/df3/l11a 0 2024-04-27T07:33:47.717 INFO:tasks.workunit.client.1.smithi100.stdout:7/933: chown d1/dd/d16/d2b/d7f/fc9 214 1 2024-04-27T07:33:47.720 INFO:tasks.workunit.client.1.smithi100.stdout:0/990: creat d1/d8/d20/d61/f14b x:0 0 0 2024-04-27T07:33:47.722 INFO:tasks.workunit.client.1.smithi100.stdout:7/934: link d1/fc6 d1/dd/d16/d70/d6e/f120 0 2024-04-27T07:33:47.722 INFO:tasks.workunit.client.1.smithi100.stdout:2/991: rmdir d0/da/d29/d132 0 2024-04-27T07:33:47.723 INFO:tasks.workunit.client.1.smithi100.stdout:7/935: stat d1/dd/d16/d4a/d56/fc7 0 2024-04-27T07:33:47.723 INFO:tasks.workunit.client.1.smithi100.stdout:0/991: dread - d1/d8/fa1 zero size 2024-04-27T07:33:47.725 INFO:tasks.workunit.client.1.smithi100.stdout:2/992: mknod d0/da/d29/d47/d5a/dd9/d145/c149 0 2024-04-27T07:33:47.731 INFO:tasks.workunit.client.1.smithi100.stdout:0/992: dwrite d1/d8/d14/ded/f12b [0,4194304] 0 2024-04-27T07:33:47.732 INFO:tasks.workunit.client.1.smithi100.stdout:5/888: write d0/d42/d94/d97/d60/dc4/f80 [1209800,52573] 0 2024-04-27T07:33:47.734 INFO:tasks.workunit.client.1.smithi100.stdout:5/889: fdatasync d0/d4/f11 0 2024-04-27T07:33:47.735 INFO:tasks.workunit.client.1.smithi100.stdout:2/993: dwrite d0/da/d29/d47/d5a/dd9/dff/d88/faa [0,4194304] 0 2024-04-27T07:33:47.738 INFO:tasks.workunit.client.1.smithi100.stdout:9/975: write d1/d9/db/d2b/f6b [328751,15942] 0 2024-04-27T07:33:47.744 INFO:tasks.workunit.client.1.smithi100.stdout:5/890: mkdir d0/d4/d21/d125 0 2024-04-27T07:33:47.746 INFO:tasks.workunit.client.1.smithi100.stdout:2/994: mknod d0/da/d29/c14a 0 2024-04-27T07:33:47.752 INFO:tasks.workunit.client.1.smithi100.stdout:2/995: mkdir d0/da/d14b 0 2024-04-27T07:33:47.754 INFO:tasks.workunit.client.1.smithi100.stdout:0/993: dwrite d1/d8/d14/f50 [0,4194304] 0 2024-04-27T07:33:47.757 INFO:tasks.workunit.client.1.smithi100.stdout:9/976: dread d1/d9/f25 [0,4194304] 0 2024-04-27T07:33:47.760 INFO:tasks.workunit.client.1.smithi100.stdout:0/994: symlink d1/d8/da8/d138/l14c 0 2024-04-27T07:33:47.760 INFO:tasks.workunit.client.1.smithi100.stdout:7/936: dread d1/dd/f1e [0,4194304] 0 2024-04-27T07:33:47.761 INFO:tasks.workunit.client.1.smithi100.stdout:0/995: chown d1/d38/fa7 0 1 2024-04-27T07:33:47.762 INFO:tasks.workunit.client.1.smithi100.stdout:9/977: creat d1/d9/db/d56/d5c/de3/d4a/d67/f147 x:0 0 0 2024-04-27T07:33:47.764 INFO:tasks.workunit.client.1.smithi100.stdout:7/937: creat d1/dd/dfc/f121 x:0 0 0 2024-04-27T07:33:47.767 INFO:tasks.workunit.client.1.smithi100.stdout:0/996: symlink d1/d8/d20/df6/d14a/l14d 0 2024-04-27T07:33:47.770 INFO:tasks.workunit.client.1.smithi100.stdout:5/891: dwrite d0/d42/d94/d97/d60/fbb [0,4194304] 0 2024-04-27T07:33:47.772 INFO:tasks.workunit.client.1.smithi100.stdout:0/997: mkdir d1/d8/d14/dce/d14e 0 2024-04-27T07:33:47.774 INFO:tasks.workunit.client.1.smithi100.stdout:0/998: fsync d1/d8/d14/d59/f8f 0 2024-04-27T07:33:47.776 INFO:tasks.workunit.client.1.smithi100.stdout:5/892: symlink d0/d4/d21/d24/d2f/d57/l126 0 2024-04-27T07:33:47.780 INFO:tasks.workunit.client.1.smithi100.stdout:0/999: symlink d1/d8/d20/d61/d6a/l14f 0 2024-04-27T07:33:47.782 INFO:tasks.workunit.client.1.smithi100.stdout:7/938: truncate d1/dd/d2a/d2c/f43 2592981 0 2024-04-27T07:33:47.784 INFO:tasks.workunit.client.1.smithi100.stdout:2/996: dread d0/da/d29/d47/d5a/dd9/dff/f11d [0,4194304] 0 2024-04-27T07:33:47.785 INFO:tasks.workunit.client.1.smithi100.stdout:9/978: dwrite d1/d76/fe0 [0,4194304] 0 2024-04-27T07:33:47.786 INFO:tasks.workunit.client.1.smithi100.stdout:7/939: mkdir d1/dd/d16/d3e/d8b/da4/d122 0 2024-04-27T07:33:47.789 INFO:tasks.workunit.client.1.smithi100.stdout:5/893: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [0,4194304] 0 2024-04-27T07:33:47.792 INFO:tasks.workunit.client.1.smithi100.stdout:5/894: write d0/d42/d94/d97/d60/dc4/f71 [1078406,19410] 0 2024-04-27T07:33:47.792 INFO:tasks.workunit.client.1.smithi100.stdout:7/940: fdatasync d1/dd/f1e 0 2024-04-27T07:33:47.794 INFO:tasks.workunit.client.1.smithi100.stdout:9/979: write d1/d9/db/d2b/d4f/dac/d54/d61/d9b/d92/f122 [579513,65355] 0 2024-04-27T07:33:47.797 INFO:tasks.workunit.client.1.smithi100.stdout:5/895: readlink d0/l25 0 2024-04-27T07:33:47.801 INFO:tasks.workunit.client.1.smithi100.stdout:9/980: dread d1/d9/f25 [0,4194304] 0 2024-04-27T07:33:47.814 INFO:tasks.workunit.client.1.smithi100.stdout:5/896: write d0/d4/d21/d24/d2f/d57/d37/d48/fc6 [767602,3638] 0 2024-04-27T07:33:47.816 INFO:tasks.workunit.client.1.smithi100.stdout:5/897: fsync d0/d4/d21/d24/d2f/d57/f91 0 2024-04-27T07:33:47.819 INFO:tasks.workunit.client.1.smithi100.stdout:7/941: dwrite d1/dd/d16/d3e/fa9 [0,4194304] 0 2024-04-27T07:33:47.825 INFO:tasks.workunit.client.1.smithi100.stdout:2/997: dread d0/da/d29/d47/d5a/dd9/dff/fc0 [0,4194304] 0 2024-04-27T07:33:47.826 INFO:tasks.workunit.client.1.smithi100.stdout:5/898: dwrite d0/d4/d21/d24/d2f/d39/ffa [4194304,4194304] 0 2024-04-27T07:33:47.830 INFO:tasks.workunit.client.1.smithi100.stdout:5/899: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f73 [2690974,96534] 0 2024-04-27T07:33:47.838 INFO:tasks.workunit.client.1.smithi100.stdout:9/981: dread d1/d9/db/d56/d5c/de3/d4a/f4d [0,4194304] 0 2024-04-27T07:33:47.839 INFO:tasks.workunit.client.1.smithi100.stdout:5/900: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fbd [0,4194304] 0 2024-04-27T07:33:47.841 INFO:tasks.workunit.client.1.smithi100.stdout:9/982: chown d1/fb9 40835 1 2024-04-27T07:33:47.845 INFO:tasks.workunit.client.1.smithi100.stdout:9/983: rename d1/d9/db/d2b/c4c to d1/d9/db/d2b/d4f/dac/d54/d61/d9b/c148 0 2024-04-27T07:33:47.848 INFO:tasks.workunit.client.1.smithi100.stdout:9/984: symlink d1/d9/db/d2b/de7/de8/d13a/l149 0 2024-04-27T07:33:47.851 INFO:tasks.workunit.client.1.smithi100.stdout:9/985: getdents d1/d9/db/d2b/d4f/dac 0 2024-04-27T07:33:47.852 INFO:tasks.workunit.client.1.smithi100.stdout:9/986: fsync d1/d9/db/d56/d5c/de3/d4a/f135 0 2024-04-27T07:33:47.854 INFO:tasks.workunit.client.1.smithi100.stdout:7/942: dread d1/fc6 [0,4194304] 0 2024-04-27T07:33:47.854 INFO:tasks.workunit.client.1.smithi100.stdout:9/987: mkdir d1/d9/db/d56/d5c/de3/d4a/daa/d14a 0 2024-04-27T07:33:47.856 INFO:tasks.workunit.client.1.smithi100.stdout:7/943: unlink d1/l98 0 2024-04-27T07:33:47.857 INFO:tasks.workunit.client.1.smithi100.stdout:9/988: unlink d1/d76/dd6/c119 0 2024-04-27T07:33:47.858 INFO:tasks.workunit.client.1.smithi100.stdout:7/944: creat d1/dd/d16/d31/d4c/d4d/d3b/dcc/f123 x:0 0 0 2024-04-27T07:33:47.859 INFO:tasks.workunit.client.1.smithi100.stdout:7/945: stat d1/dd/d16/d70/d51/d9d/d110/de6/f116 0 2024-04-27T07:33:47.860 INFO:tasks.workunit.client.1.smithi100.stdout:7/946: dread - d1/dd/d16/d4a/d56/fc7 zero size 2024-04-27T07:33:47.862 INFO:tasks.workunit.client.1.smithi100.stdout:7/947: creat d1/dd/d16/d2b/d7f/f124 x:0 0 0 2024-04-27T07:33:47.864 INFO:tasks.workunit.client.1.smithi100.stdout:7/948: symlink d1/dd/d16/d31/d4c/d4d/d3b/dcc/l125 0 2024-04-27T07:33:47.865 INFO:tasks.workunit.client.1.smithi100.stdout:7/949: readlink d1/dd/d16/d2b/l8d 0 2024-04-27T07:33:47.866 INFO:tasks.workunit.client.1.smithi100.stdout:7/950: dread - d1/dd/d2a/d2c/d9f/ff5 zero size 2024-04-27T07:33:47.869 INFO:tasks.workunit.client.1.smithi100.stdout:7/951: link d1/dd/d16/d2b/d7f/cf9 d1/dd/d16/d31/dbf/c126 0 2024-04-27T07:33:47.872 INFO:tasks.workunit.client.1.smithi100.stdout:9/989: dread d1/d9/db/fb2 [4194304,4194304] 0 2024-04-27T07:33:47.877 INFO:tasks.workunit.client.1.smithi100.stdout:9/990: dwrite d1/d9/db/d56/d5c/de3/f3a [0,4194304] 0 2024-04-27T07:33:47.880 INFO:tasks.workunit.client.1.smithi100.stdout:9/991: rename d1/d9/f6f to d1/d9/db/d13d/f14b 0 2024-04-27T07:33:47.881 INFO:tasks.workunit.client.1.smithi100.stdout:9/992: fsync d1/d9/db/d2b/d31/f111 0 2024-04-27T07:33:47.934 INFO:tasks.workunit.client.1.smithi100.stdout:2/998: write d0/da/d29/d47/d5a/dd9/dff/d88/ddd/fe7 [1550171,108126] 0 2024-04-27T07:33:47.944 INFO:tasks.workunit.client.1.smithi100.stdout:7/952: getdents d1/dd/d16/d31/d4c/d4d/d3b/dcc 0 2024-04-27T07:33:47.948 INFO:tasks.workunit.client.1.smithi100.stdout:2/999: truncate d0/da/d29/d47/d5a/dd9/dff/f9a 3767740 0 2024-04-27T07:33:47.951 INFO:tasks.workunit.client.1.smithi100.stdout:9/993: dwrite d1/f46 [0,4194304] 0 2024-04-27T07:33:47.952 INFO:tasks.workunit.client.1.smithi100.stdout:9/994: chown d1/d9/db/d2b/dfd/f146 0 1 2024-04-27T07:33:47.953 INFO:tasks.workunit.client.1.smithi100.stdout:7/953: write d1/dd/d16/d31/f60 [4985492,86865] 0 2024-04-27T07:33:47.954 INFO:tasks.workunit.client.1.smithi100.stdout:9/995: symlink d1/d76/l14c 0 2024-04-27T07:33:47.956 INFO:tasks.workunit.client.1.smithi100.stdout:9/996: chown d1/d9/f75 253 1 2024-04-27T07:33:47.961 INFO:tasks.workunit.client.1.smithi100.stdout:9/997: rename d1/d76/dd6 to d1/d9/db/d2b/d4f/d14d 0 2024-04-27T07:33:47.963 INFO:tasks.workunit.client.1.smithi100.stdout:9/998: symlink d1/d9/db/d2b/l14e 0 2024-04-27T07:33:47.965 INFO:tasks.workunit.client.1.smithi100.stdout:7/954: truncate d1/dd/d16/d2b/d7f/fc9 3121759 0 2024-04-27T07:33:47.971 INFO:tasks.workunit.client.1.smithi100.stdout:9/999: mkdir d1/d9/db/d56/d5c/de3/d4a/d67/d8a/d14f 0 2024-04-27T07:33:48.190 INFO:tasks.workunit.client.1.smithi100.stdout:5/901: sync 2024-04-27T07:33:48.191 INFO:tasks.workunit.client.1.smithi100.stdout:7/955: sync 2024-04-27T07:33:48.192 INFO:tasks.workunit.client.1.smithi100.stdout:5/902: write d0/d42/d94/d97/d60/dc4/d9d/f116 [170687,7340] 0 2024-04-27T07:33:48.202 INFO:tasks.workunit.client.1.smithi100.stdout:5/903: mkdir d0/d4/d21/d24/d2f/d57/ded/d127 0 2024-04-27T07:33:48.204 INFO:tasks.workunit.client.1.smithi100.stdout:5/904: unlink d0/d42/d94/d97/fa3 0 2024-04-27T07:33:48.207 INFO:tasks.workunit.client.1.smithi100.stdout:5/905: truncate d0/d4/d21/d24/d2f/f8a 95362 0 2024-04-27T07:33:48.220 INFO:tasks.workunit.client.1.smithi100.stdout:7/956: write d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a [2763478,74076] 0 2024-04-27T07:33:48.221 INFO:tasks.workunit.client.1.smithi100.stdout:7/957: stat d1/dd/d16/d70 0 2024-04-27T07:33:48.223 INFO:tasks.workunit.client.1.smithi100.stdout:5/906: write d0/d4/d21/d24/d2f/d57/d37/f113 [1415203,30516] 0 2024-04-27T07:33:48.224 INFO:tasks.workunit.client.1.smithi100.stdout:7/958: mkdir d1/d127 0 2024-04-27T07:33:48.225 INFO:tasks.workunit.client.1.smithi100.stdout:7/959: chown d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/fb2 14 1 2024-04-27T07:33:48.225 INFO:tasks.workunit.client.1.smithi100.stdout:5/907: creat d0/d42/d94/d97/d60/dc4/d99/f128 x:0 0 0 2024-04-27T07:33:48.227 INFO:tasks.workunit.client.1.smithi100.stdout:5/908: fsync d0/d42/d94/d97/d60/fde 0 2024-04-27T07:33:48.231 INFO:tasks.workunit.client.1.smithi100.stdout:7/960: getdents d1/dd/d16/d3e/d8b/da4/d122 0 2024-04-27T07:33:48.232 INFO:tasks.workunit.client.1.smithi100.stdout:5/909: write d0/d42/d94/fd9 [226894,4998] 0 2024-04-27T07:33:48.233 INFO:tasks.workunit.client.1.smithi100.stdout:5/910: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d31 204 1 2024-04-27T07:33:48.243 INFO:tasks.workunit.client.1.smithi100.stdout:7/961: dread d1/dd/fe [0,4194304] 0 2024-04-27T07:33:48.245 INFO:tasks.workunit.client.1.smithi100.stdout:5/911: dread d0/d42/f52 [0,4194304] 0 2024-04-27T07:33:48.246 INFO:tasks.workunit.client.1.smithi100.stdout:7/962: symlink d1/dd/d16/d70/d51/l128 0 2024-04-27T07:33:48.247 INFO:tasks.workunit.client.1.smithi100.stdout:5/912: symlink d0/d4/d21/d125/l129 0 2024-04-27T07:33:48.248 INFO:tasks.workunit.client.1.smithi100.stdout:7/963: write d1/dd/d16/d70/fa0 [887604,78604] 0 2024-04-27T07:33:48.250 INFO:tasks.workunit.client.1.smithi100.stdout:5/913: creat d0/d4/d21/d24/d2f/d57/ded/d127/f12a x:0 0 0 2024-04-27T07:33:48.251 INFO:tasks.workunit.client.1.smithi100.stdout:5/914: chown d0/l12 60044 1 2024-04-27T07:33:48.254 INFO:tasks.workunit.client.1.smithi100.stdout:7/964: dwrite d1/dd/d16/d70/d51/d9d/d110/de6/f116 [0,4194304] 0 2024-04-27T07:33:48.256 INFO:tasks.workunit.client.1.smithi100.stdout:7/965: truncate d1/d54/f5f 8844395 0 2024-04-27T07:33:48.256 INFO:tasks.workunit.client.1.smithi100.stdout:5/915: read d0/d4/d21/d24/d2f/d57/d37/d48/fc6 [609956,44359] 0 2024-04-27T07:33:48.257 INFO:tasks.workunit.client.1.smithi100.stdout:5/916: readlink d0/d4/d21/d24/lf0 0 2024-04-27T07:33:48.258 INFO:tasks.workunit.client.1.smithi100.stdout:5/917: write d0/d42/f7d [1659381,3239] 0 2024-04-27T07:33:48.260 INFO:tasks.workunit.client.1.smithi100.stdout:5/918: dread - d0/d42/d94/d97/d60/fde zero size 2024-04-27T07:33:48.260 INFO:tasks.workunit.client.1.smithi100.stdout:7/966: creat d1/dd/d16/d2b/dfa/f129 x:0 0 0 2024-04-27T07:33:48.262 INFO:tasks.workunit.client.1.smithi100.stdout:5/919: truncate d0/f1d 3874097 0 2024-04-27T07:33:48.264 INFO:tasks.workunit.client.1.smithi100.stdout:7/967: link d1/dd/d2a/fa2 d1/dd/d2a/f12a 0 2024-04-27T07:33:48.265 INFO:tasks.workunit.client.1.smithi100.stdout:5/920: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d34/c10c 18 1 2024-04-27T07:33:48.266 INFO:tasks.workunit.client.1.smithi100.stdout:7/968: chown d1/dd/d16/d70/d51/d9d/d110/de6/f10a 3631 1 2024-04-27T07:33:48.267 INFO:tasks.workunit.client.1.smithi100.stdout:7/969: write d1/dd/d16/d31/f60 [3928888,53866] 0 2024-04-27T07:33:48.271 INFO:tasks.workunit.client.1.smithi100.stdout:7/970: truncate d1/f15 2316425 0 2024-04-27T07:33:48.272 INFO:tasks.workunit.client.1.smithi100.stdout:7/971: chown d1/ff7 425163 1 2024-04-27T07:33:48.273 INFO:tasks.workunit.client.1.smithi100.stdout:5/921: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f9c [0,4194304] 0 2024-04-27T07:33:48.275 INFO:tasks.workunit.client.1.smithi100.stdout:5/922: chown d0/d42/d94/d97/d60/dc4/d99/fe7 70928 1 2024-04-27T07:33:48.276 INFO:tasks.workunit.client.1.smithi100.stdout:7/972: creat d1/dd/d16/d3e/f12b x:0 0 0 2024-04-27T07:33:48.277 INFO:tasks.workunit.client.1.smithi100.stdout:5/923: fsync d0/d4/d21/d24/d2f/ff1 0 2024-04-27T07:33:48.278 INFO:tasks.workunit.client.1.smithi100.stdout:5/924: dread - d0/d4/d21/d24/d2f/d39/d56/f120 zero size 2024-04-27T07:33:48.279 INFO:tasks.workunit.client.1.smithi100.stdout:7/973: mknod d1/dd/d16/d3e/c12c 0 2024-04-27T07:33:48.280 INFO:tasks.workunit.client.1.smithi100.stdout:7/974: read - d1/dd/f11c zero size 2024-04-27T07:33:48.282 INFO:tasks.workunit.client.1.smithi100.stdout:5/925: write d0/d42/d94/d97/d60/dc4/d9d/fd3 [3894072,69477] 0 2024-04-27T07:33:48.283 INFO:tasks.workunit.client.1.smithi100.stdout:5/926: read - d0/d4/d21/d24/d2f/d57/d37/d1a/f11f zero size 2024-04-27T07:33:48.285 INFO:tasks.workunit.client.1.smithi100.stdout:7/975: creat d1/dd/d16/d70/d51/d6f/f12d x:0 0 0 2024-04-27T07:33:48.285 INFO:tasks.workunit.client.1.smithi100.stdout:5/927: fdatasync d0/d42/d94/d97/d60/f96 0 2024-04-27T07:33:48.286 INFO:tasks.workunit.client.1.smithi100.stdout:5/928: write d0/fc0 [136721,113419] 0 2024-04-27T07:33:48.287 INFO:tasks.workunit.client.1.smithi100.stdout:7/976: creat d1/dd/d16/d2b/f12e x:0 0 0 2024-04-27T07:33:48.287 INFO:tasks.workunit.client.1.smithi100.stdout:5/929: dread - d0/d42/d94/d97/d60/dc4/d99/fe7 zero size 2024-04-27T07:33:48.288 INFO:tasks.workunit.client.1.smithi100.stdout:7/977: fsync d1/dd/d16/d70/d51/ff0 0 2024-04-27T07:33:48.291 INFO:tasks.workunit.client.1.smithi100.stdout:7/978: creat d1/dd/d16/d70/d51/d9d/d110/f12f x:0 0 0 2024-04-27T07:33:48.292 INFO:tasks.workunit.client.1.smithi100.stdout:7/979: readlink d1/dd/d16/d70/d51/d9d/laa 0 2024-04-27T07:33:48.294 INFO:tasks.workunit.client.1.smithi100.stdout:5/930: write d0/d42/d94/d97/d60/dc4/d99/da0/f108 [666071,86166] 0 2024-04-27T07:33:48.295 INFO:tasks.workunit.client.1.smithi100.stdout:5/931: read d0/d42/d94/d97/d60/dc4/d99/da0/fe6 [346209,66156] 0 2024-04-27T07:33:48.296 INFO:tasks.workunit.client.1.smithi100.stdout:5/932: read d0/fc0 [266135,86067] 0 2024-04-27T07:33:48.305 INFO:tasks.workunit.client.1.smithi100.stdout:5/933: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fb0 [0,4194304] 0 2024-04-27T07:33:48.308 INFO:tasks.workunit.client.1.smithi100.stdout:5/934: symlink d0/l12b 0 2024-04-27T07:33:48.313 INFO:tasks.workunit.client.1.smithi100.stdout:5/935: dwrite d0/d4/d21/d24/d2f/d39/d56/fef [0,4194304] 0 2024-04-27T07:33:48.317 INFO:tasks.workunit.client.1.smithi100.stdout:5/936: mkdir d0/d4/d21/d24/d2f/d39/d56/d67/d84/d12c 0 2024-04-27T07:33:48.319 INFO:tasks.workunit.client.1.smithi100.stdout:5/937: read d0/fc0 [13413,98650] 0 2024-04-27T07:33:48.322 INFO:tasks.workunit.client.1.smithi100.stdout:5/938: rename d0/d42/d94/d97/d60/dc4/dca/lec to d0/d4/d11e/l12d 0 2024-04-27T07:33:48.329 INFO:tasks.workunit.client.1.smithi100.stdout:5/939: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/f11f [0,4194304] 0 2024-04-27T07:33:48.330 INFO:tasks.workunit.client.1.smithi100.stdout:5/940: chown d0/d4/d21/d24/d2f/db5 114232 1 2024-04-27T07:33:48.335 INFO:tasks.workunit.client.1.smithi100.stdout:5/941: dwrite d0/fc2 [0,4194304] 0 2024-04-27T07:33:48.342 INFO:tasks.workunit.client.1.smithi100.stdout:5/942: dwrite d0/d4/d21/f4b [0,4194304] 0 2024-04-27T07:33:48.355 INFO:tasks.workunit.client.1.smithi100.stdout:5/943: dread d0/d4/d21/d24/d2f/d39/d56/d67/d84/fb2 [0,4194304] 0 2024-04-27T07:33:48.357 INFO:tasks.workunit.client.1.smithi100.stdout:5/944: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/f82 [1987065,67682] 0 2024-04-27T07:33:48.358 INFO:tasks.workunit.client.1.smithi100.stdout:5/945: stat d0/d4/d21/d24/d2f/d57/ded 0 2024-04-27T07:33:48.361 INFO:tasks.workunit.client.1.smithi100.stdout:5/946: creat d0/d4/d21/d24/d2f/d57/f12e x:0 0 0 2024-04-27T07:33:48.362 INFO:tasks.workunit.client.1.smithi100.stdout:5/947: rmdir d0/d42 39 2024-04-27T07:33:48.366 INFO:tasks.workunit.client.1.smithi100.stdout:5/948: dread d0/d4/d21/d24/d2f/d57/f55 [0,4194304] 0 2024-04-27T07:33:48.369 INFO:tasks.workunit.client.1.smithi100.stdout:5/949: write d0/d4/d21/fac [782248,21097] 0 2024-04-27T07:33:48.468 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:48 smithi082 ceph-mon[26613]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 72 MiB/s rd, 169 MiB/s wr, 421 op/s 2024-04-27T07:33:48.468 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:48 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:48 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:48 smithi082 ceph-mon[26613]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:48 smithi082 ceph-mon[26613]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:48 smithi100 ceph-mon[34183]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 72 MiB/s rd, 169 MiB/s wr, 421 op/s 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:48 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:48 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:48 smithi100 ceph-mon[34183]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:33:48.469 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:48 smithi100 ceph-mon[34183]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:33:48.511 INFO:tasks.workunit.client.1.smithi100.stdout:7/980: sync 2024-04-27T07:33:48.511 INFO:tasks.workunit.client.1.smithi100.stdout:5/950: sync 2024-04-27T07:33:48.513 INFO:tasks.workunit.client.1.smithi100.stdout:5/951: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d30/ffe 123 1 2024-04-27T07:33:48.517 INFO:tasks.workunit.client.1.smithi100.stdout:7/981: rename d1/dd/d16/d31/d4c/d4d/d3b/dcc/f101 to d1/dd/d16/d31/d4c/d4d/d3b/dcc/f130 0 2024-04-27T07:33:48.518 INFO:tasks.workunit.client.1.smithi100.stdout:7/982: fdatasync d1/dd/d16/d2b/dfa/f129 0 2024-04-27T07:33:48.519 INFO:tasks.workunit.client.1.smithi100.stdout:5/952: mkdir d0/d4/d21/d24/d2f/d57/d37/d48/d12f 0 2024-04-27T07:33:48.521 INFO:tasks.workunit.client.1.smithi100.stdout:5/953: write d0/d4/d21/d24/d2f/d57/d37/f1b [1537117,57809] 0 2024-04-27T07:33:48.524 INFO:tasks.workunit.client.1.smithi100.stdout:5/954: fdatasync d0/d4/d21/d24/d2f/d57/ded/d101/fe8 0 2024-04-27T07:33:48.528 INFO:tasks.workunit.client.1.smithi100.stdout:5/955: mknod d0/d4/d21/d24/d2f/d39/d56/d67/dd4/c130 0 2024-04-27T07:33:48.528 INFO:tasks.workunit.client.1.smithi100.stdout:7/983: write d1/dd/d16/d2b/f9c [3452960,77908] 0 2024-04-27T07:33:48.532 INFO:tasks.workunit.client.1.smithi100.stdout:7/984: unlink d1/dd/fe 0 2024-04-27T07:33:48.557 INFO:tasks.workunit.client.1.smithi100.stdout:5/956: dread d0/d42/d94/d97/d60/dc4/f71 [0,4194304] 0 2024-04-27T07:33:48.559 INFO:tasks.workunit.client.1.smithi100.stdout:5/957: mkdir d0/d131 0 2024-04-27T07:33:48.564 INFO:tasks.workunit.client.1.smithi100.stdout:5/958: rename d0/d4/l18 to d0/d4/d21/d24/d2f/d57/d37/d48/l132 0 2024-04-27T07:33:48.565 INFO:tasks.workunit.client.1.smithi100.stdout:5/959: fdatasync d0/d42/d94/d97/d60/dc4/f123 0 2024-04-27T07:33:48.568 INFO:tasks.workunit.client.1.smithi100.stdout:5/960: symlink d0/d42/d94/d97/d60/dc4/dca/l133 0 2024-04-27T07:33:48.570 INFO:tasks.workunit.client.1.smithi100.stdout:5/961: read d0/d4/f70 [2731885,58182] 0 2024-04-27T07:33:48.571 INFO:tasks.workunit.client.1.smithi100.stdout:5/962: chown d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 2 1 2024-04-27T07:33:48.573 INFO:tasks.workunit.client.1.smithi100.stdout:5/963: write d0/d4/d21/d24/d2f/d57/d37/d1a/d34/f38 [2757741,95871] 0 2024-04-27T07:33:48.575 INFO:tasks.workunit.client.1.smithi100.stdout:5/964: mknod d0/d4/d21/d24/d2f/db5/c134 0 2024-04-27T07:33:48.583 INFO:tasks.workunit.client.1.smithi100.stdout:5/965: dwrite d0/d4/d21/d24/d2f/d57/ded/f110 [0,4194304] 0 2024-04-27T07:33:48.586 INFO:tasks.workunit.client.1.smithi100.stdout:5/966: symlink d0/d4/d21/d125/l135 0 2024-04-27T07:33:48.594 INFO:tasks.workunit.client.1.smithi100.stdout:5/967: fsync d0/d42/d94/ff4 0 2024-04-27T07:33:48.596 INFO:tasks.workunit.client.1.smithi100.stdout:5/968: truncate d0/d4/d21/d24/d2f/db5/ff6 770527 0 2024-04-27T07:33:48.597 INFO:tasks.workunit.client.1.smithi100.stdout:5/969: fdatasync d0/d4/d21/d24/d2f/d39/d56/fd2 0 2024-04-27T07:33:48.602 INFO:tasks.workunit.client.1.smithi100.stdout:5/970: dread d0/d4/d21/d24/d2f/d57/d37/d48/f10b [0,4194304] 0 2024-04-27T07:33:48.604 INFO:tasks.workunit.client.1.smithi100.stdout:5/971: symlink d0/d4/d21/d24/d2f/db5/l136 0 2024-04-27T07:33:48.607 INFO:tasks.workunit.client.1.smithi100.stdout:5/972: rename d0/d4/d21/d24/d2f to d0/d4/d21/d24/d2f/d57/d37/d1a/d31/d137 22 2024-04-27T07:33:48.613 INFO:tasks.workunit.client.1.smithi100.stdout:5/973: rename d0/d4/d21/d24/d2f/d39/d56/d67/c7e to d0/d4/d21/d24/d2f/c138 0 2024-04-27T07:33:48.615 INFO:tasks.workunit.client.1.smithi100.stdout:5/974: creat d0/d4/d21/d24/d2f/d57/d37/d1a/d31/f139 x:0 0 0 2024-04-27T07:33:48.620 INFO:tasks.workunit.client.1.smithi100.stdout:5/975: dwrite d0/d4/d21/d24/d2f/d57/d37/d1a/f8e [0,4194304] 0 2024-04-27T07:33:48.625 INFO:tasks.workunit.client.1.smithi100.stdout:5/976: link d0/d4/d21/d24/d2f/d57/c111 d0/d4/d21/d24/d2f/d57/d37/d1a/d30/c13a 0 2024-04-27T07:33:48.626 INFO:tasks.workunit.client.1.smithi100.stdout:5/977: write d0/d42/d94/fd9 [858418,113246] 0 2024-04-27T07:33:48.628 INFO:tasks.workunit.client.1.smithi100.stdout:5/978: creat d0/d4/d21/d24/d2f/d57/ded/d101/f13b x:0 0 0 2024-04-27T07:33:48.629 INFO:tasks.workunit.client.1.smithi100.stdout:5/979: dread - d0/d4/d21/d24/d2f/d39/d56/f120 zero size 2024-04-27T07:33:48.631 INFO:tasks.workunit.client.1.smithi100.stdout:5/980: rmdir d0/d4/d21/d24/d2f/d57/d37/d1a 39 2024-04-27T07:33:48.637 INFO:tasks.workunit.client.1.smithi100.stdout:5/981: dwrite d0/d4/d21/d24/d2f/d39/d56/fef [0,4194304] 0 2024-04-27T07:33:48.639 INFO:tasks.workunit.client.1.smithi100.stdout:5/982: write d0/d4/d21/d24/d2f/d39/d56/d67/fd0 [9038658,119310] 0 2024-04-27T07:33:48.641 INFO:tasks.workunit.client.1.smithi100.stdout:5/983: write d0/d42/d94/d97/d60/dc4/d9d/f116 [626112,108349] 0 2024-04-27T07:33:48.643 INFO:tasks.workunit.client.1.smithi100.stdout:5/984: creat d0/d4/d21/d24/d2f/d39/d56/f13c x:0 0 0 2024-04-27T07:33:48.648 INFO:tasks.workunit.client.1.smithi100.stdout:5/985: dread d0/d42/d94/d97/d60/dc4/d99/da0/faa [0,4194304] 0 2024-04-27T07:33:48.649 INFO:tasks.workunit.client.1.smithi100.stdout:5/986: read - d0/d4/d21/d24/d2f/ff1 zero size 2024-04-27T07:33:48.654 INFO:tasks.workunit.client.1.smithi100.stdout:5/987: truncate d0/d4/d21/d24/d2f/d57/d37/d1a/d31/fa5 1174414 0 2024-04-27T07:33:48.658 INFO:tasks.workunit.client.1.smithi100.stdout:5/988: dread d0/d4/d21/d24/d2f/d57/d37/d1a/d34/fbd [0,4194304] 0 2024-04-27T07:33:48.663 INFO:tasks.workunit.client.1.smithi100.stdout:5/989: link d0/d4/d21/d24/d2f/d57/d37/d1a/d30/ce0 d0/d4/d21/d24/d2f/d57/d37/d1a/d30/c13d 0 2024-04-27T07:33:48.664 INFO:tasks.workunit.client.1.smithi100.stdout:5/990: fsync d0/d4/d21/d24/d2f/d57/d37/d1a/d30/f89 0 2024-04-27T07:33:48.766 INFO:tasks.workunit.client.1.smithi100.stdout:7/985: sync 2024-04-27T07:33:48.768 INFO:tasks.workunit.client.1.smithi100.stdout:7/986: rename d1/dd/d16/d70/f59 to d1/dd/d2a/d2c/d9f/f131 0 2024-04-27T07:33:48.775 INFO:tasks.workunit.client.1.smithi100.stdout:7/987: write d1/dd/f1e [1327699,3017] 0 2024-04-27T07:33:48.779 INFO:tasks.workunit.client.1.smithi100.stdout:7/988: write d1/dd/d16/d31/d4c/f81 [195576,129241] 0 2024-04-27T07:33:48.780 INFO:tasks.workunit.client.1.smithi100.stdout:7/989: chown d1/dd/d16/d2b/dfd 1461390 1 2024-04-27T07:33:48.781 INFO:tasks.workunit.client.1.smithi100.stdout:7/990: truncate d1/dd/d16/d3e/ffe 108750 0 2024-04-27T07:33:48.784 INFO:tasks.workunit.client.1.smithi100.stdout:7/991: getdents d1/dd/d16/d31/d4c 0 2024-04-27T07:33:48.789 INFO:tasks.workunit.client.1.smithi100.stdout:7/992: dwrite d1/dd/d2a/d2c/d9f/ff5 [0,4194304] 0 2024-04-27T07:33:48.791 INFO:tasks.workunit.client.1.smithi100.stdout:7/993: fsync d1/dd/d16/d31/d4c/d4d/d3b/d40/d78/f8a 0 2024-04-27T07:33:48.795 INFO:tasks.workunit.client.1.smithi100.stdout:7/994: creat d1/dd/d16/f132 x:0 0 0 2024-04-27T07:33:48.797 INFO:tasks.workunit.client.1.smithi100.stdout:7/995: symlink d1/dd/d16/d31/dbf/l133 0 2024-04-27T07:33:48.798 INFO:tasks.workunit.client.1.smithi100.stdout:7/996: chown d1/dd/d2a/db0 573354433 1 2024-04-27T07:33:48.809 INFO:tasks.workunit.client.1.smithi100.stdout:7/997: dwrite d1/f32 [0,4194304] 0 2024-04-27T07:33:48.816 INFO:tasks.workunit.client.1.smithi100.stdout:5/991: sync 2024-04-27T07:33:48.816 INFO:tasks.workunit.client.1.smithi100.stdout:7/998: dwrite d1/dd/d16/d31/d4c/fc1 [0,4194304] 0 2024-04-27T07:33:48.817 INFO:tasks.workunit.client.1.smithi100.stdout:7/999: fsync d1/d54/ff6 0 2024-04-27T07:33:48.819 INFO:tasks.workunit.client.1.smithi100.stdout:5/992: mkdir d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/d13e 0 2024-04-27T07:33:48.821 INFO:tasks.workunit.client.1.smithi100.stdout:5/993: fdatasync d0/d4/d21/d24/d2f/d39/d56/d67/d84/f75 0 2024-04-27T07:33:48.823 INFO:tasks.workunit.client.1.smithi100.stdout:5/994: chown d0/cb 5 1 2024-04-27T07:33:48.827 INFO:tasks.workunit.client.1.smithi100.stdout:5/995: link d0/d4/d21/d24/d2f/d39/d56/fef d0/d42/d94/f13f 0 2024-04-27T07:33:48.827 INFO:tasks.workunit.client.1.smithi100.stdout:5/996: fsync d0/d4/d21/d24/d2f/d39/d56/f13c 0 2024-04-27T07:33:48.832 INFO:tasks.workunit.client.1.smithi100.stdout:5/997: dwrite d0/d42/f7d [0,4194304] 0 2024-04-27T07:33:48.838 INFO:tasks.workunit.client.1.smithi100.stdout:5/998: rename d0/d4/d21/d24/c6f to d0/d4/d21/d24/d2f/d57/d37/d1a/d34/d6d/d13e/c140 0 2024-04-27T07:33:48.840 INFO:tasks.workunit.client.1.smithi100.stdout:5/999: chown d0/d4/d21/d24/d2f/ff1 10964740 1 2024-04-27T07:33:48.843 INFO:tasks.workunit.client.1.smithi100.stderr:+ rm -rf -- ./tmp.4f0QCSUhzJ 2024-04-27T07:33:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:50 smithi082 ceph-mon[26613]: pgmap v31: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 86 MiB/s rd, 193 MiB/s wr, 517 op/s 2024-04-27T07:33:50.666 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:50 smithi100 ceph-mon[34183]: pgmap v31: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 86 MiB/s rd, 193 MiB/s wr, 517 op/s 2024-04-27T07:33:51.014 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-27T07:33:51.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-27T07:33:52.507 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:52 smithi082 ceph-mon[26613]: pgmap v32: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 205 MiB/s wr, 582 op/s 2024-04-27T07:33:52.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:52 smithi100 ceph-mon[34183]: pgmap v32: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 205 MiB/s wr, 582 op/s 2024-04-27T07:33:54.484 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:54 smithi100 ceph-mon[34183]: pgmap v33: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 124 MiB/s wr, 389 op/s 2024-04-27T07:33:54.484 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:54 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:54.484 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:54 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:54.485 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:54 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:54.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:54 smithi082 ceph-mon[26613]: pgmap v33: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 124 MiB/s wr, 389 op/s 2024-04-27T07:33:54.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:54 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:33:54.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:54 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:54.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:54 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:55 smithi100 ceph-mon[34183]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2024-04-27T07:33:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:55 smithi100 ceph-mon[34183]: Reconfiguring daemon node-exporter.smithi100 on smithi100 2024-04-27T07:33:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:55 smithi082 ceph-mon[26613]: Reconfiguring node-exporter.smithi100 (dependencies changed)... 2024-04-27T07:33:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:55 smithi082 ceph-mon[26613]: Reconfiguring daemon node-exporter.smithi100 on smithi100 2024-04-27T07:33:56.443 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:56 smithi100 ceph-mon[34183]: pgmap v34: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 125 MiB/s wr, 505 op/s 2024-04-27T07:33:56.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:56 smithi082 ceph-mon[26613]: pgmap v34: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 125 MiB/s wr, 505 op/s 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:33:57.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-04-27T07:33:57.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:33:57.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-04-27T07:33:57.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.731 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:57 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:33:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:33:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:33:57.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:57 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: Upgrade: Need to upgrade myself (mgr.smithi100.eparbe) 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: Upgrade: Need to upgrade myself (mgr.smithi100.eparbe) 2024-04-27T07:33:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:33:58 smithi082 ceph-mon[26613]: pgmap v35: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 55 MiB/s wr, 304 op/s 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: Upgrade: Need to upgrade myself (mgr.smithi100.eparbe) 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: Upgrade: Need to upgrade myself (mgr.smithi100.eparbe) 2024-04-27T07:33:58.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:33:58 smithi100 ceph-mon[34183]: pgmap v35: 65 pgs: 65 active+clean; 1.5 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 30 MiB/s rd, 55 MiB/s wr, 304 op/s 2024-04-27T07:33:59.770 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-27T07:33:59.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-27T07:34:00.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 30 MiB/s rd, 55 MiB/s wr, 349 op/s 2024-04-27T07:34:00.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:00.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:00.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:00.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:34:00.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:00 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: pgmap v36: 65 pgs: 65 active+clean; 1.2 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 30 MiB/s rd, 55 MiB/s wr, 349 op/s 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:34:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:00 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:01.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:01 smithi082 ceph-mon[26613]: Upgrade: Updating mgr.smithi082.hhlhmf 2024-04-27T07:34:01.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:01 smithi082 ceph-mon[26613]: Deploying daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:34:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:01 smithi100 ceph-mon[34183]: Upgrade: Updating mgr.smithi082.hhlhmf 2024-04-27T07:34:01.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:01 smithi100 ceph-mon[34183]: Deploying daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:34:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:02 smithi082 ceph-mon[26613]: pgmap v37: 65 pgs: 65 active+clean; 687 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 32 MiB/s wr, 310 op/s 2024-04-27T07:34:02.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:02 smithi100 ceph-mon[34183]: pgmap v37: 65 pgs: 65 active+clean; 687 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 32 MiB/s wr, 310 op/s 2024-04-27T07:34:04.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:04 smithi082 ceph-mon[26613]: pgmap v38: 65 pgs: 65 active+clean; 687 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-04-27T07:34:04.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:04 smithi100 ceph-mon[34183]: pgmap v38: 65 pgs: 65 active+clean; 687 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-04-27T07:34:06.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:06 smithi082 ceph-mon[26613]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 298 op/s 2024-04-27T07:34:06.916 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:06 smithi100 ceph-mon[34183]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 298 op/s 2024-04-27T07:34:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:08 smithi082 ceph-mon[26613]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 182 op/s 2024-04-27T07:34:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:08 smithi082 ceph-mon[26613]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:34:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:08 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:08 smithi100 ceph-mon[34183]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 182 op/s 2024-04-27T07:34:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:08 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:34:08.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:08 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:10 smithi100 ceph-mon[34183]: pgmap v41: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 189 op/s 2024-04-27T07:34:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:10 smithi082 ceph-mon[26613]: pgmap v41: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 189 op/s 2024-04-27T07:34:12.797 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:12 smithi082 ceph-mon[26613]: pgmap v42: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 209 op/s 2024-04-27T07:34:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:12 smithi100 ceph-mon[34183]: pgmap v42: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 209 op/s 2024-04-27T07:34:13.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 -- 172.21.15.82:0/3486497739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fe430 msgr2=0x7f92940fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 --2- 172.21.15.82:0/3486497739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fe430 0x7f92940fe840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9284004940 tx=0x7f9284009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:13.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 -- 172.21.15.82:0/3486497739 shutdown_connections 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 --2- 172.21.15.82:0/3486497739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fed80 0x7f92940faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 --2- 172.21.15.82:0/3486497739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fe430 0x7f92940fe840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 -- 172.21.15.82:0/3486497739 >> 172.21.15.82:0/3486497739 conn(0x7f92940f6bd0 msgr2=0x7f92940f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 -- 172.21.15.82:0/3486497739 shutdown_connections 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.320+0000 7f9299672700 1 -- 172.21.15.82:0/3486497739 wait complete. 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 Processor -- start 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 -- start start 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fe430 0x7f929410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929410e400 con 0x7f92940fed80 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9299672700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929410e570 con 0x7f92940fe430 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f92927fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f92927fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33458/0 (socket says 172.21.15.82:33458) 2024-04-27T07:34:13.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f92927fc700 1 -- 172.21.15.82:0/553186098 learned_addr learned my addr 172.21.15.82:0/553186098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.321+0000 7f9292ffd700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fe430 0x7f929410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f92927fc700 1 -- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fe430 msgr2=0x7f929410d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f92927fc700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fe430 0x7f929410d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f92927fc700 1 -- 172.21.15.82:0/553186098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284005040 con 0x7f92940fed80 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f92927fc700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f928800eb70 tx=0x7f928800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9288007cc0 con 0x7f92940fed80 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f928800f040 con 0x7f92940fed80 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9294112f70 con 0x7f92940fed80 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928800ca90 con 0x7f92940fed80 2024-04-27T07:34:13.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.322+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9294113480 con 0x7f92940fed80 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.323+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929404c710 con 0x7f92940fed80 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.323+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f928800cbf0 con 0x7f92940fed80 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.324+0000 7f927b7fe700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 0x7f927c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.324+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f928808a600 con 0x7f92940fed80 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.324+0000 7f9292ffd700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 0x7f927c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.324+0000 7f9292ffd700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 0x7f927c06e1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9284009b30 tx=0x7f9284009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:13.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.328+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f92880576c0 con 0x7f92940fed80 2024-04-27T07:34:13.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.639+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9294102550 con 0x7f927c06bd00 2024-04-27T07:34:13.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.640+0000 7f927b7fe700 1 -- 172.21.15.82:0/553186098 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f9294102550 con 0x7f927c06bd00 2024-04-27T07:34:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 msgr2=0x7f927c06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 0x7f927c06e1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9284009b30 tx=0x7f9284009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 msgr2=0x7f929410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f928800eb70 tx=0x7f928800b040 comp rx=0 tx=0).stop 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 shutdown_connections 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f927c06bd00 0x7f927c06e1b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92940fe430 0x7f929410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 --2- 172.21.15.82:0/553186098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92940fed80 0x7f929410de00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 >> 172.21.15.82:0/553186098 conn(0x7f92940f6bd0 msgr2=0x7f92940f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 shutdown_connections 2024-04-27T07:34:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.643+0000 7f9299672700 1 -- 172.21.15.82:0/553186098 wait complete. 2024-04-27T07:34:13.657 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:34:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 -- 172.21.15.82:0/760839770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 msgr2=0x7fefbc0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/760839770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc0fc0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004940 tx=0x7fefb8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 -- 172.21.15.82:0/760839770 shutdown_connections 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/760839770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/760839770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc0fc0c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 -- 172.21.15.82:0/760839770 >> 172.21.15.82:0/760839770 conn(0x7fefbc0f7430 msgr2=0x7fefbc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 -- 172.21.15.82:0/760839770 shutdown_connections 2024-04-27T07:34:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.767+0000 7fefc3b5c700 1 -- 172.21.15.82:0/760839770 wait complete. 2024-04-27T07:34:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 Processor -- start 2024-04-27T07:34:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 -- start start 2024-04-27T07:34:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0661d0 con 0x7fefbc0fbcb0 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc3b5c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc066310 con 0x7fefbc0fcf60 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc18f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc10f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc10f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:41112/0 (socket says 172.21.15.82:41112) 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc10f7700 1 -- 172.21.15.82:0/1657037831 learned_addr learned my addr 172.21.15.82:0/1657037831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.768+0000 7fefc18f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33464/0 (socket says 172.21.15.82:33464) 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc10f7700 1 -- 172.21.15.82:0/1657037831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 msgr2=0x7fefbc112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc10f7700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc10f7700 1 -- 172.21.15.82:0/1657037831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8005040 con 0x7fefbc0fcf60 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc18f8700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc10f7700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fefac00eb40 tx=0x7fefac00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefac018070 con 0x7fefbc0fcf60 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc115570 con 0x7fefbc0fcf60 2024-04-27T07:34:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1158c0 con 0x7fefbc0fcf60 2024-04-27T07:34:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefac00f040 con 0x7fefbc0fcf60 2024-04-27T07:34:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.769+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefac00c910 con 0x7fefbc0fcf60 2024-04-27T07:34:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.770+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa00052e0 con 0x7fefbc0fcf60 2024-04-27T07:34:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.771+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fefac00cb80 con 0x7fefbc0fcf60 2024-04-27T07:34:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.771+0000 7fefb27fc700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 0x7fefa806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.771+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fefac08aa30 con 0x7fefbc0fcf60 2024-04-27T07:34:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.771+0000 7fefc18f8700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 0x7fefa806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.772+0000 7fefc18f8700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 0x7fefa806e1a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004890 tx=0x7fefb8009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:13.776+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fefac053fe0 con 0x7fefbc0fcf60 2024-04-27T07:34:14.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.074+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefa0000bf0 con 0x7fefa806bcf0 2024-04-27T07:34:14.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.076+0000 7fefb27fc700 1 -- 172.21.15.82:0/1657037831 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fefa0000bf0 con 0x7fefa806bcf0 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 msgr2=0x7fefa806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 0x7fefa806e1a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefb8004890 tx=0x7fefb8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 msgr2=0x7fefbc115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fefac00eb40 tx=0x7fefac00b040 comp rx=0 tx=0).stop 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 shutdown_connections 2024-04-27T07:34:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fefa806bcf0 0x7fefa806e1a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefbc0fbcb0 0x7fefbc112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 --2- 172.21.15.82:0/1657037831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefbc0fcf60 0x7fefbc115030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 >> 172.21.15.82:0/1657037831 conn(0x7fefbc0f7430 msgr2=0x7fefbc0f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 shutdown_connections 2024-04-27T07:34:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.079+0000 7fefc3b5c700 1 -- 172.21.15.82:0/1657037831 wait complete. 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 -- 172.21.15.82:0/1421198314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 msgr2=0x7f5b500fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 --2- 172.21.15.82:0/1421198314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b500fd400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b44004940 tx=0x7f5b44009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 -- 172.21.15.82:0/1421198314 shutdown_connections 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 --2- 172.21.15.82:0/1421198314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b500fd400 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 --2- 172.21.15.82:0/1421198314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 0x7f5b500fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 -- 172.21.15.82:0/1421198314 >> 172.21.15.82:0/1421198314 conn(0x7f5b500f7440 msgr2=0x7f5b500f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:14.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 -- 172.21.15.82:0/1421198314 shutdown_connections 2024-04-27T07:34:14.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.205+0000 7f5b552d4700 1 -- 172.21.15.82:0/1421198314 wait complete. 2024-04-27T07:34:14.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 Processor -- start 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 -- start start 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 0x7f5b50110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50066c20 con 0x7f5b500fcf90 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b552d4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50066d60 con 0x7f5b500fbce0 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.206+0000 7f5b4e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33480/0 (socket says 172.21.15.82:33480) 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 -- 172.21.15.82:0/3219245804 learned_addr learned my addr 172.21.15.82:0/3219245804 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:14.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4effd700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 0x7f5b50110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 -- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 msgr2=0x7f5b50110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 0x7f5b50110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 -- 172.21.15.82:0/3219245804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44005040 con 0x7f5b500fcf90 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b4e7fc700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b44013870 tx=0x7f5b44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b4400e070 con 0x7f5b500fcf90 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b50113150 con 0x7f5b500fcf90 2024-04-27T07:34:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.207+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b44013de0 con 0x7f5b500fcf90 2024-04-27T07:34:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.208+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b50113630 con 0x7f5b500fcf90 2024-04-27T07:34:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.208+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b4401ce70 con 0x7f5b500fcf90 2024-04-27T07:34:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.209+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c0052e0 con 0x7f5b500fcf90 2024-04-27T07:34:14.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.210+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f5b44013910 con 0x7f5b500fcf90 2024-04-27T07:34:14.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.210+0000 7f5b377fe700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 0x7f5b3806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.211+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5b4408cbb0 con 0x7f5b500fcf90 2024-04-27T07:34:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.211+0000 7f5b4effd700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 0x7f5b3806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.211+0000 7f5b4effd700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 0x7f5b3806e1a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b500668a0 tx=0x7f5b4000b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.219+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f5b44056160 con 0x7f5b500fcf90 2024-04-27T07:34:14.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.530+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c000bf0 con 0x7f5b3806bcf0 2024-04-27T07:34:14.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.546+0000 7f5b377fe700 1 -- 172.21.15.82:0/3219245804 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5b3c000bf0 con 0x7f5b3806bcf0 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 starting - - - - 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (9m) 60s ago 9m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (8m) 70s ago 8m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 starting - - - - 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (3m) 60s ago 3m 113M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (3m) 60s ago 3m 118M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (3m) 70s ago 3m 66.9M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (3m) 70s ago 3m 102M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:9283 running (10m) 60s ago 10m 395M - 17.2.7-907-g2be3efa9 1c5834633715 e51e9634e8d9 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (102s) 70s ago 8m 490M - 19.0.0-3227-gc37f63b3 d1033e293654 b143c0687007 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (10m) 60s ago 10m 49.4M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:34:14.549 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (8m) 70s ago 8m 39.2M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 starting - - - - 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 starting - - - - 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 60s ago 7m 86.4M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 60s ago 6m 95.2M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 60s ago 6m 73.7M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (6m) 70s ago 6m 95.5M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (5m) 70s ago 5m 86.3M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (5m) 70s ago 5m 77.2M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:34:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 starting - - - - 2024-04-27T07:34:14.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 msgr2=0x7f5b3806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 0x7f5b3806e1a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5b500668a0 tx=0x7f5b4000b040 comp rx=0 tx=0).stop 2024-04-27T07:34:14.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 msgr2=0x7f5b50112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b44013870 tx=0x7f5b44009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 shutdown_connections 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f5b3806bcf0 0x7f5b3806e1a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b500fbce0 0x7f5b50110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.550+0000 7f5b552d4700 1 --2- 172.21.15.82:0/3219245804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b500fcf90 0x7f5b50112bb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.551+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 >> 172.21.15.82:0/3219245804 conn(0x7f5b500f7440 msgr2=0x7f5b500f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.551+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 shutdown_connections 2024-04-27T07:34:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.551+0000 7f5b552d4700 1 -- 172.21.15.82:0/3219245804 wait complete. 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 -- 172.21.15.82:0/4232600605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fbcc0 msgr2=0x7f05b00fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/4232600605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fbcc0 0x7f05b00fc0d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05a4004940 tx=0x7f05a4009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 -- 172.21.15.82:0/4232600605 shutdown_connections 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/4232600605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fcf70 0x7f05b00fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/4232600605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fbcc0 0x7f05b00fc0d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 -- 172.21.15.82:0/4232600605 >> 172.21.15.82:0/4232600605 conn(0x7f05b00f7420 msgr2=0x7f05b00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 -- 172.21.15.82:0/4232600605 shutdown_connections 2024-04-27T07:34:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.688+0000 7f05b6fc4700 1 -- 172.21.15.82:0/4232600605 wait complete. 2024-04-27T07:34:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 Processor -- start 2024-04-27T07:34:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 -- start start 2024-04-27T07:34:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 0x7f05b0110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0066c20 con 0x7f05b00fcf70 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b6fc4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0066d60 con 0x7f05b00fbcc0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05affff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05affff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33492/0 (socket says 172.21.15.82:33492) 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05b4d60700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 0x7f05b0110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.689+0000 7f05affff700 1 -- 172.21.15.82:0/3429749569 learned_addr learned my addr 172.21.15.82:0/3429749569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b4d60700 1 -- 172.21.15.82:0/3429749569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 msgr2=0x7f05b0112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b4d60700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b4d60700 1 -- 172.21.15.82:0/3429749569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a4005040 con 0x7f05b00fbcc0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05affff700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b4d60700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 0x7f05b0110640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05a4000c00 tx=0x7f05a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a400e070 con 0x7f05b00fbcc0 2024-04-27T07:34:14.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05a401a570 con 0x7f05b00fbcc0 2024-04-27T07:34:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b010c420 con 0x7f05b00fbcc0 2024-04-27T07:34:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05a401f070 con 0x7f05b00fbcc0 2024-04-27T07:34:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.690+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b010c900 con 0x7f05b00fbcc0 2024-04-27T07:34:14.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.691+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b005f5c0 con 0x7f05b00fbcc0 2024-04-27T07:34:14.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.692+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f05a4013af0 con 0x7f05b00fbcc0 2024-04-27T07:34:14.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.692+0000 7f05ad7fa700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 0x7f05a006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:14.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.692+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f05a408fb50 con 0x7f05b00fbcc0 2024-04-27T07:34:14.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.693+0000 7f05affff700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 0x7f05a006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:14.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.693+0000 7f05affff700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 0x7f05a006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f059c0041d0 tx=0x7f059c00b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:14.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:14.698+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f05a4059160 con 0x7f05b00fbcc0 2024-04-27T07:34:14.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:14 smithi082 ceph-mon[26613]: pgmap v43: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 152 op/s 2024-04-27T07:34:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:14 smithi100 ceph-mon[34183]: pgmap v43: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 152 op/s 2024-04-27T07:34:15.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.141+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f05b01047b0 con 0x7f05b00fbcc0 2024-04-27T07:34:15.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.142+0000 7f05ad7fa700 1 -- 172.21.15.82:0/3429749569 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f05a405c820 con 0x7f05b00fbcc0 2024-04-27T07:34:15.144 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:34:15.144 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:34:15.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 13, 2024-04-27T07:34:15.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:34:15.146 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:34:15.146 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 msgr2=0x7f05a006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 0x7f05a006e1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f059c0041d0 tx=0x7f059c00b040 comp rx=0 tx=0).stop 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 msgr2=0x7f05b0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 0x7f05b0110640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05a4000c00 tx=0x7f05a4009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 shutdown_connections 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f05a006bcf0 0x7f05a006e1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05b00fbcc0 0x7f05b0110640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 --2- 172.21.15.82:0/3429749569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05b00fcf70 0x7f05b0112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.145+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 >> 172.21.15.82:0/3429749569 conn(0x7f05b00f7420 msgr2=0x7f05b00f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.146+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 shutdown_connections 2024-04-27T07:34:15.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.146+0000 7f05b6fc4700 1 -- 172.21.15.82:0/3429749569 wait complete. 2024-04-27T07:34:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- 172.21.15.82:0/368659848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fcff0 msgr2=0x7fe3e40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 --2- 172.21.15.82:0/368659848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fcff0 0x7fe3e40fd460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8004940 tx=0x7fe3d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- 172.21.15.82:0/368659848 shutdown_connections 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 --2- 172.21.15.82:0/368659848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fcff0 0x7fe3e40fd460 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 --2- 172.21.15.82:0/368659848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fbd40 0x7fe3e40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- 172.21.15.82:0/368659848 >> 172.21.15.82:0/368659848 conn(0x7fe3e40f74c0 msgr2=0x7fe3e40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- 172.21.15.82:0/368659848 shutdown_connections 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- 172.21.15.82:0/368659848 wait complete. 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 Processor -- start 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.273+0000 7fe3ea734700 1 -- start start 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fcff0 0x7fe3e4115060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4066ab0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e4066bf0 con 0x7fe3e40fcff0 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33506/0 (socket says 172.21.15.82:33506) 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 -- 172.21.15.82:0/1395730085 learned_addr learned my addr 172.21.15.82:0/1395730085 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e37fe700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fcff0 0x7fe3e4115060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 -- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fcff0 msgr2=0x7fe3e4115060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fcff0 0x7fe3e4115060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 -- 172.21.15.82:0/1395730085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d8005040 con 0x7fe3e40fbd40 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e3fff700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c8c0 tx=0x7fe3d40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d400a980 con 0x7fe3e40fbd40 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3d400ce60 con 0x7fe3e40fbd40 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3d40115e0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e41155a0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.274+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e4115970 con 0x7fe3e40fbd40 2024-04-27T07:34:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.275+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e405f5c0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.276+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe3d4012400 con 0x7fe3e40fbd40 2024-04-27T07:34:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.276+0000 7fe3e0ff9700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 0x7fe3cc06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.276+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe3d408aa80 con 0x7fe3e40fbd40 2024-04-27T07:34:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.277+0000 7fe3e37fe700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 0x7fe3cc06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.277+0000 7fe3e37fe700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 0x7fe3cc06e1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800b3b0 tx=0x7fe3d8009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.281+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe3d40541a0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.640+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe3e41047c0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.640+0000 7fe3e0ff9700 1 -- 172.21.15.82:0/1395730085 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1862 (secure 0 0 0) 0x7fe3d40126b0 con 0x7fe3e40fbd40 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:34:15.643 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:34:15.644 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:15.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 msgr2=0x7fe3cc06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 0x7fe3cc06e1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800b3b0 tx=0x7fe3d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:15.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 msgr2=0x7fe3e4112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c8c0 tx=0x7fe3d40044c0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 shutdown_connections 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe3cc06bcf0 0x7fe3cc06e1a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e40fbd40 0x7fe3e4112b10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 --2- 172.21.15.82:0/1395730085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3e40fcff0 0x7fe3e4115060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 >> 172.21.15.82:0/1395730085 conn(0x7fe3e40f74c0 msgr2=0x7fe3e40f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 shutdown_connections 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.643+0000 7fe3ea734700 1 -- 172.21.15.82:0/1395730085 wait complete. 2024-04-27T07:34:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:34:15.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 -- 172.21.15.82:0/2136526843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fed30 msgr2=0x7fe6540fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 --2- 172.21.15.82:0/2136526843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fed30 0x7fe6540fae70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe644004940 tx=0x7fe644009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 -- 172.21.15.82:0/2136526843 shutdown_connections 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 --2- 172.21.15.82:0/2136526843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fed30 0x7fe6540fae70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 --2- 172.21.15.82:0/2136526843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fe3e0 0x7fe6540fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 -- 172.21.15.82:0/2136526843 >> 172.21.15.82:0/2136526843 conn(0x7fe6540f6b80 msgr2=0x7fe6540f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 -- 172.21.15.82:0/2136526843 shutdown_connections 2024-04-27T07:34:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 -- 172.21.15.82:0/2136526843 wait complete. 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.771+0000 7fe659359700 1 Processor -- start 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe659359700 1 -- start start 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe659359700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe659359700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fed30 0x7fe65410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe659359700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65410e4a0 con 0x7fe6540fe3e0 2024-04-27T07:34:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe659359700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65410ecf0 con 0x7fe6540fed30 2024-04-27T07:34:15.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37814/0 (socket says 172.21.15.82:37814) 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 -- 172.21.15.82:0/154922759 learned_addr learned my addr 172.21.15.82:0/154922759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe6527fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fed30 0x7fe65410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 -- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fed30 msgr2=0x7fe65410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fed30 0x7fe65410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 -- 172.21.15.82:0/154922759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644005040 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe652ffd700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb40 tx=0x7fe64800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.772+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe648007cc0 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.773+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe64800f040 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.773+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe64800ca10 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.773+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65410ef70 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.773+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65410f4b0 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.774+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65405f5c0 con 0x7fe6540fe3e0 2024-04-27T07:34:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.774+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7fe64800cb70 con 0x7fe6540fe3e0 2024-04-27T07:34:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.775+0000 7fe63b7fe700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 0x7fe63c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.775+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe64808a5a0 con 0x7fe6540fe3e0 2024-04-27T07:34:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.775+0000 7fe6527fc700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 0x7fe63c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.775+0000 7fe6527fc700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 0x7fe63c06e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe64400b0d0 tx=0x7fe644009e30 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:15.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:15.779+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe648050930 con 0x7fe6540fe3e0 2024-04-27T07:34:15.928 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:15 smithi100 ceph-mon[34183]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:15.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:15 smithi100 ceph-mon[34183]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:15.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:15 smithi100 ceph-mon[34183]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:15.929 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:15 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3429749569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:34:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.081+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 --> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe65410f880 con 0x7fe63c06bcf0 2024-04-27T07:34:16.084 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:15 smithi082 ceph-mon[26613]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:16.084 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:15 smithi082 ceph-mon[26613]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:16.084 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:15 smithi082 ceph-mon[26613]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:16.084 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:15 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3429749569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.083+0000 7fe63b7fe700 1 -- 172.21.15.82:0/154922759 <== mgr.24393 v2:172.21.15.100:6828/15913842 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe65410f880 con 0x7fe63c06bcf0 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/21 daemons upgraded", 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mgr daemons", 2024-04-27T07:34:16.092 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:34:16.093 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:34:16.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.087+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 msgr2=0x7fe63c06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.087+0000 7fe659359700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 0x7fe63c06e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe64400b0d0 tx=0x7fe644009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:16.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.087+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 msgr2=0x7fe65410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.087+0000 7fe659359700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb40 tx=0x7fe64800b040 comp rx=0 tx=0).stop 2024-04-27T07:34:16.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 shutdown_connections 2024-04-27T07:34:16.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7fe63c06bcf0 0x7fe63c06e1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6540fe3e0 0x7fe65410d960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 --2- 172.21.15.82:0/154922759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6540fed30 0x7fe65410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 >> 172.21.15.82:0/154922759 conn(0x7fe6540f6b80 msgr2=0x7fe6540f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:16.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 shutdown_connections 2024-04-27T07:34:16.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.089+0000 7fe659359700 1 -- 172.21.15.82:0/154922759 wait complete. 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 -- 172.21.15.82:0/104536772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 msgr2=0x7f1ce40fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/104536772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce40fc0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40049c0 tx=0x7f1cd4009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 -- 172.21.15.82:0/104536772 shutdown_connections 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/104536772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce40fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/104536772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce40fc0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 -- 172.21.15.82:0/104536772 >> 172.21.15.82:0/104536772 conn(0x7f1ce40f7420 msgr2=0x7f1ce40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 -- 172.21.15.82:0/104536772 shutdown_connections 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.252+0000 7f1cea7a2700 1 -- 172.21.15.82:0/104536772 wait complete. 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 Processor -- start 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 -- start start 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce410bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce410c390 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1cea7a2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce410cbe0 con 0x7f1ce40fcf70 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1ce3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1ce3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37830/0 (socket says 172.21.15.82:37830) 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.253+0000 7f1ce3fff700 1 -- 172.21.15.82:0/1143928914 learned_addr learned my addr 172.21.15.82:0/1143928914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce37fe700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce410bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce3fff700 1 -- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 msgr2=0x7f1ce410bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce3fff700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce410bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce3fff700 1 -- 172.21.15.82:0/1143928914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4005040 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce37fe700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce410bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce3fff700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4008d70 tx=0x7f1cd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd4004290 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce410ce60 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cd4009620 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd401b430 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.254+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce410d3a0 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.256+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce405f5c0 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.256+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 89652+0+0 (secure 0 0 0) 0x7f1cd4019040 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.256+0000 7f1ce0ff9700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 0x7f1ccc06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.257+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f1cd408be80 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.257+0000 7f1ce37fe700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 0x7f1ccc06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.257+0000 7f1ce37fe700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 0x7f1ccc06e1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8004fd0 tx=0x7f1cd8011040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.264+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f1cd4058f40 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.702+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ce404bed0 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.702+0000 7f1ce0ff9700 1 -- 172.21.15.82:0/1143928914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1cd401f0e0 con 0x7f1ce40fbcc0 2024-04-27T07:34:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:34:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:34:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:34:16.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 msgr2=0x7f1ccc06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 0x7f1ccc06e1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8004fd0 tx=0x7f1cd8011040 comp rx=0 tx=0).stop 2024-04-27T07:34:16.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 msgr2=0x7f1ce410b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:16.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4008d70 tx=0x7f1cd4009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 shutdown_connections 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:6828/15913842,v1:172.21.15.100:6829/15913842] conn(0x7f1ccc06bcf0 0x7f1ccc06e1a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce40fbcc0 0x7f1ce410b850 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 --2- 172.21.15.82:0/1143928914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce40fcf70 0x7f1ce410bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 >> 172.21.15.82:0/1143928914 conn(0x7f1ce40f7420 msgr2=0x7f1ce40f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 shutdown_connections 2024-04-27T07:34:16.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:16.705+0000 7f1cea7a2700 1 -- 172.21.15.82:0/1143928914 wait complete. 2024-04-27T07:34:16.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:16 smithi082 ceph-mon[26613]: pgmap v44: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-04-27T07:34:16.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:16 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1395730085' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:34:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:16 smithi100 ceph-mon[34183]: pgmap v44: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 206 op/s 2024-04-27T07:34:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:16 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1395730085' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:34:17.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:17 smithi100 ceph-mon[34183]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:17.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:17 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/1143928914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:34:18.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:17 smithi082 ceph-mon[26613]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:18.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:17 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/1143928914' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:34:18.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:18 smithi082 ceph-mon[26613]: pgmap v45: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 126 op/s 2024-04-27T07:34:18.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:18.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:18 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:18.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:18 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:18 smithi100 ceph-mon[34183]: pgmap v45: 65 pgs: 65 active+clean; 318 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 126 op/s 2024-04-27T07:34:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:18 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:18.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:18 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:19.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:19 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:19.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:19 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:19.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:19 smithi082 ceph-mon[26613]: pgmap v46: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 142 op/s 2024-04-27T07:34:20.122 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:19 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:20.123 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:19 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:20.123 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:19 smithi100 ceph-mon[34183]: pgmap v46: 65 pgs: 65 active+clean; 320 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 142 op/s 2024-04-27T07:34:22.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:22 smithi100 ceph-mon[34183]: pgmap v47: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 175 op/s 2024-04-27T07:34:22.568 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:22 smithi082 ceph-mon[26613]: pgmap v47: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 175 op/s 2024-04-27T07:34:24.499 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:24 smithi100 ceph-mon[34183]: pgmap v48: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-04-27T07:34:24.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:24 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:24.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:24 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:24.500 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:24 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:24.566 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:24 smithi082 ceph-mon[26613]: pgmap v48: 65 pgs: 65 active+clean; 323 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-04-27T07:34:24.566 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:24 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:24.566 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:24 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:24.566 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:24 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:26 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:26 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:26 smithi082 ceph-mon[26613]: pgmap v49: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 152 op/s 2024-04-27T07:34:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:26 smithi082 ceph-mon[26613]: mgrmap e26: smithi100.eparbe(active, since 92s), standbys: smithi082.hhlhmf 2024-04-27T07:34:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:26 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:26 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:26 smithi100 ceph-mon[34183]: pgmap v49: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 152 op/s 2024-04-27T07:34:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:26 smithi100 ceph-mon[34183]: mgrmap e26: smithi100.eparbe(active, since 92s), standbys: smithi082.hhlhmf 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: pgmap v50: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 98 op/s 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: Standby manager daemon smithi082.hhlhmf restarted 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: Standby manager daemon smithi082.hhlhmf started 2024-04-27T07:34:28.028 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/crt"}]: dispatch 2024-04-27T07:34:28.029 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:34:28.029 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/key"}]: dispatch 2024-04-27T07:34:28.029 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:27 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: pgmap v50: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 98 op/s 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: Standby manager daemon smithi082.hhlhmf restarted 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: Standby manager daemon smithi082.hhlhmf started 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/crt"}]: dispatch 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.hhlhmf/key"}]: dispatch 2024-04-27T07:34:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:27 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:34:29.033 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:28 smithi082 ceph-mon[26613]: mgrmap e27: smithi100.eparbe(active, since 94s), standbys: smithi082.hhlhmf 2024-04-27T07:34:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:28 smithi100 ceph-mon[34183]: mgrmap e27: smithi100.eparbe(active, since 94s), standbys: smithi082.hhlhmf 2024-04-27T07:34:29.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:29 smithi100 ceph-mon[34183]: pgmap v51: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 116 op/s 2024-04-27T07:34:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:29 smithi082 ceph-mon[26613]: pgmap v51: 65 pgs: 65 active+clean; 325 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 116 op/s 2024-04-27T07:34:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: osdmap e48: 6 total, 6 up, 6 in 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd='[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]': finished 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: mgrmap e28: smithi082.hhlhmf(active, starting, since 0.00948437s) 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:34:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:32.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:34:32.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:32.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:32 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:34:32.632 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 172.21.15.100:0/468511158' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: osdmap e48: 6 total, 6 up, 6 in 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.24393 ' entity='mgr.smithi100.eparbe' cmd='[{"prefix": "mgr fail", "who": "smithi100.eparbe"}]': finished 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: mgrmap e28: smithi082.hhlhmf(active, starting, since 0.00948437s) 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:34:32.633 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:34:32.634 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:34:32.635 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:32.635 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:34:32.635 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:32.635 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:32 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: [27/Apr/2024:07:34:31] ENGINE Bus STARTING 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: [27/Apr/2024:07:34:32] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: [27/Apr/2024:07:34:32] ENGINE Serving on http://172.21.15.82:8765 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: [27/Apr/2024:07:34:32] ENGINE Bus STARTED 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: mgrmap e29: smithi082.hhlhmf(active, since 1.01079s) 2024-04-27T07:34:33.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:33 smithi100 ceph-mon[34183]: pgmap v3: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: [27/Apr/2024:07:34:31] ENGINE Bus STARTING 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: [27/Apr/2024:07:34:32] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: [27/Apr/2024:07:34:32] ENGINE Serving on http://172.21.15.82:8765 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: [27/Apr/2024:07:34:32] ENGINE Bus STARTED 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: mgrmap e29: smithi082.hhlhmf(active, since 1.01079s) 2024-04-27T07:34:33.750 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:33 smithi082 ceph-mon[26613]: pgmap v3: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:34.623 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:34 smithi100 ceph-mon[34183]: pgmap v4: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:34.623 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:34 smithi100 ceph-mon[34183]: mgrmap e30: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:34:34.829 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:34 smithi082 ceph-mon[26613]: pgmap v4: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:34.830 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:34 smithi082 ceph-mon[26613]: mgrmap e30: smithi082.hhlhmf(active, since 2s) 2024-04-27T07:34:36.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:36 smithi100 ceph-mon[34183]: pgmap v5: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:36.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:36 smithi100 ceph-mon[34183]: mgrmap e31: smithi082.hhlhmf(active, since 4s) 2024-04-27T07:34:36.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:36 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:36.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:36 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:36 smithi082 ceph-mon[26613]: pgmap v5: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:34:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:36 smithi082 ceph-mon[26613]: mgrmap e31: smithi082.hhlhmf(active, since 4s) 2024-04-27T07:34:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:36 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:36.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:36 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:38 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:38 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:38 smithi100 ceph-mon[34183]: pgmap v6: 65 pgs: 65 active+clean; 340 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 512 KiB/s rd, 436 KiB/s wr, 18 op/s 2024-04-27T07:34:38.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:38 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:38.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:38 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:38.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:38 smithi082 ceph-mon[26613]: pgmap v6: 65 pgs: 65 active+clean; 340 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 512 KiB/s rd, 436 KiB/s wr, 18 op/s 2024-04-27T07:34:40.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:40 smithi082 ceph-mon[26613]: pgmap v7: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 877 KiB/s rd, 947 KiB/s wr, 100 op/s 2024-04-27T07:34:40.862 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:40 smithi100 ceph-mon[34183]: pgmap v7: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 877 KiB/s rd, 947 KiB/s wr, 100 op/s 2024-04-27T07:34:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:41 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:34:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:41 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:34:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:41 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:34:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:41 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:34:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:41 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:34:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:41 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:34:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:41 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:34:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:41 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:34:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:41 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:34:41.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:41 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1028112077' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:34:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:42 smithi100 ceph-mon[34183]: pgmap v8: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 682 KiB/s rd, 737 KiB/s wr, 77 op/s 2024-04-27T07:34:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:42 smithi100 ceph-mon[34183]: mgrmap e32: smithi082.hhlhmf(active, since 10s), standbys: smithi100.eparbe 2024-04-27T07:34:42.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:42 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:42 smithi082 ceph-mon[26613]: pgmap v8: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 682 KiB/s rd, 737 KiB/s wr, 77 op/s 2024-04-27T07:34:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:42 smithi082 ceph-mon[26613]: mgrmap e32: smithi082.hhlhmf(active, since 10s), standbys: smithi100.eparbe 2024-04-27T07:34:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:42 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:34:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:43 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:43 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:43 smithi082 ceph-mon[26613]: pgmap v9: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 108 op/s 2024-04-27T07:34:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:43 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:43 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:43 smithi100 ceph-mon[34183]: pgmap v9: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 108 op/s 2024-04-27T07:34:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:44 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:44 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:44 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:44 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:46.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:45 smithi082 ceph-mon[26613]: pgmap v10: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 99 op/s 2024-04-27T07:34:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:45 smithi100 ceph-mon[34183]: pgmap v10: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 99 op/s 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- 172.21.15.82:0/628563268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 msgr2=0x7fba000ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 --2- 172.21.15.82:0/628563268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba000ffa10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0004940 tx=0x7fb9f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- 172.21.15.82:0/628563268 shutdown_connections 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 --2- 172.21.15.82:0/628563268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 0x7fba00102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 --2- 172.21.15.82:0/628563268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba000ffa10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- 172.21.15.82:0/628563268 >> 172.21.15.82:0/628563268 conn(0x7fba000f7420 msgr2=0x7fba000f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- 172.21.15.82:0/628563268 shutdown_connections 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- 172.21.15.82:0/628563268 wait complete. 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 Processor -- start 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 -- start start 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.840+0000 7fba048ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fba048ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 0x7fba0010df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fba048ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0010e560 con 0x7fba00066af0 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fba048ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0010edb0 con 0x7fba000fff50 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49966/0 (socket says 172.21.15.82:49966) 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 -- 172.21.15.82:0/1796703189 learned_addr learned my addr 172.21.15.82:0/1796703189 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fdd9b700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 0x7fba0010df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 -- 172.21.15.82:0/1796703189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 msgr2=0x7fba0010df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 0x7fba0010df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 -- 172.21.15.82:0/1796703189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0005040 con 0x7fba00066af0 2024-04-27T07:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9fe59c700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000b970 tx=0x7fb9f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f000e040 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9f000bbf0 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0010f030 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f001c3f0 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.841+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0010f570 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.843+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0005f5c0 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.843+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7fb9f000bd60 con 0x7fba00066af0 2024-04-27T07:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.844+0000 7fb9eeffd700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 0x7fb9e8070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.844+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb9f008f410 con 0x7fba00066af0 2024-04-27T07:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.844+0000 7fb9fdd9b700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 0x7fb9e8070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.844+0000 7fb9fdd9b700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 0x7fb9e8070ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4004f40 tx=0x7fb9f400b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:46.849+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb9f005c450 con 0x7fba00066af0 2024-04-27T07:34:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:46 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.115+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 --> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba0010f850 con 0x7fb9e806e620 2024-04-27T07:34:47.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.116+0000 7fb9eeffd700 1 -- 172.21.15.82:0/1796703189 <== mgr.14750 v2:172.21.15.82:6800/627056972 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fba0010f850 con 0x7fb9e806e620 2024-04-27T07:34:47.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 msgr2=0x7fb9e8070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 0x7fb9e8070ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4004f40 tx=0x7fb9f400b040 comp rx=0 tx=0).stop 2024-04-27T07:34:47.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 msgr2=0x7fba0010da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000b970 tx=0x7fb9f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 shutdown_connections 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fb9e806e620 0x7fb9e8070ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba00066af0 0x7fba0010da20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 --2- 172.21.15.82:0/1796703189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba000fff50 0x7fba0010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 >> 172.21.15.82:0/1796703189 conn(0x7fba000f7420 msgr2=0x7fba000f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 shutdown_connections 2024-04-27T07:34:47.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.119+0000 7fba048ff700 1 -- 172.21.15.82:0/1796703189 wait complete. 2024-04-27T07:34:47.132 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:34:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 -- 172.21.15.82:0/3989834617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f40104670 msgr2=0x7f3f40104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 --2- 172.21.15.82:0/3989834617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f40104670 0x7f3f40104ae0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f34004940 tx=0x7f3f34009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 -- 172.21.15.82:0/3989834617 shutdown_connections 2024-04-27T07:34:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 --2- 172.21.15.82:0/3989834617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f40104670 0x7f3f40104ae0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 --2- 172.21.15.82:0/3989834617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f401033c0 0x7f3f401037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 -- 172.21.15.82:0/3989834617 >> 172.21.15.82:0/3989834617 conn(0x7f3f400725e0 msgr2=0x7f3f40074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 -- 172.21.15.82:0/3989834617 shutdown_connections 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.248+0000 7f3f4632e700 1 -- 172.21.15.82:0/3989834617 wait complete. 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 Processor -- start 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 -- start start 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f40104670 0x7f3f40114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40114a70 con 0x7f3f401033c0 2024-04-27T07:34:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f4632e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401152c0 con 0x7f3f40104670 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49984/0 (socket says 172.21.15.82:49984) 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f3ffff700 1 -- 172.21.15.82:0/511830004 learned_addr learned my addr 172.21.15.82:0/511830004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.249+0000 7f3f3f7fe700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f40104670 0x7f3f40114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3ffff700 1 -- 172.21.15.82:0/511830004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f40104670 msgr2=0x7f3f40114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3ffff700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f40104670 0x7f3f40114470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3ffff700 1 -- 172.21.15.82:0/511830004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34005040 con 0x7f3f401033c0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3ffff700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000eb40 tx=0x7f3f3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f30007cc0 con 0x7f3f401033c0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f3000f040 con 0x7f3f401033c0 2024-04-27T07:34:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40115540 con 0x7f3f401033c0 2024-04-27T07:34:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3000ca10 con 0x7f3f401033c0 2024-04-27T07:34:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.250+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40115a80 con 0x7f3f401033c0 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.251+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4005f5c0 con 0x7f3f401033c0 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.252+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f3f3000cb70 con 0x7f3f401033c0 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.252+0000 7f3f3cff9700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 0x7f3f28070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.253+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f3f3008dc30 con 0x7f3f401033c0 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.253+0000 7f3f3f7fe700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 0x7f3f28070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.253+0000 7f3f3f7fe700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 0x7f3f28070ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400b0d0 tx=0x7f3f34009e30 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:47.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.257+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f3f3005ad20 con 0x7f3f401033c0 2024-04-27T07:34:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:46 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:34:47.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.515+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 --> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f40115e00 con 0x7f3f2806e620 2024-04-27T07:34:47.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.516+0000 7f3f3cff9700 1 -- 172.21.15.82:0/511830004 <== mgr.14750 v2:172.21.15.82:6800/627056972 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3f40115e00 con 0x7f3f2806e620 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.518+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 msgr2=0x7f3f28070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.518+0000 7f3f4632e700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 0x7f3f28070ad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400b0d0 tx=0x7f3f34009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 msgr2=0x7f3f40113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000eb40 tx=0x7f3f3000b040 comp rx=0 tx=0).stop 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 shutdown_connections 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f3f2806e620 0x7f3f28070ad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f401033c0 0x7f3f40113f30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 --2- 172.21.15.82:0/511830004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f40104670 0x7f3f40114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 >> 172.21.15.82:0/511830004 conn(0x7f3f400725e0 msgr2=0x7f3f40073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:47.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 shutdown_connections 2024-04-27T07:34:47.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.519+0000 7f3f4632e700 1 -- 172.21.15.82:0/511830004 wait complete. 2024-04-27T07:34:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.667+0000 7f9512fcd700 1 -- 172.21.15.82:0/3176835411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 msgr2=0x7f950c100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.667+0000 7f9512fcd700 1 --2- 172.21.15.82:0/3176835411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c100150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94f8004940 tx=0x7f94f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 -- 172.21.15.82:0/3176835411 shutdown_connections 2024-04-27T07:34:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 --2- 172.21.15.82:0/3176835411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c100150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 --2- 172.21.15.82:0/3176835411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c0fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 -- 172.21.15.82:0/3176835411 >> 172.21.15.82:0/3176835411 conn(0x7f950c0f7430 msgr2=0x7f950c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 -- 172.21.15.82:0/3176835411 shutdown_connections 2024-04-27T07:34:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.668+0000 7f9512fcd700 1 -- 172.21.15.82:0/3176835411 wait complete. 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 Processor -- start 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 -- start start 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c114ad0 con 0x7f950c0662c0 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9512fcd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c115320 con 0x7f950c0fdcd0 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9510d69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f950bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f950bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:38362/0 (socket says 172.21.15.82:38362) 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f9510d69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49994/0 (socket says 172.21.15.82:49994) 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.669+0000 7f950bfff700 1 -- 172.21.15.82:0/1574519092 learned_addr learned my addr 172.21.15.82:0/1574519092 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.670+0000 7f950bfff700 1 -- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 msgr2=0x7f950c113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.670+0000 7f950bfff700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.670+0000 7f950bfff700 1 -- 172.21.15.82:0/1574519092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8005040 con 0x7f950c0fdcd0 2024-04-27T07:34:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.670+0000 7f9510d69700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.670+0000 7f950bfff700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94f8013870 tx=0x7f94f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.671+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f800e040 con 0x7f950c0fdcd0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.671+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94f8013c20 con 0x7f950c0fdcd0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.671+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94f80123c0 con 0x7f950c0fdcd0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.671+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c1155a0 con 0x7f950c0fdcd0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.671+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c115ae0 con 0x7f950c0fdcd0 2024-04-27T07:34:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.672+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c05f5c0 con 0x7f950c0fdcd0 2024-04-27T07:34:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.673+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f94f800b300 con 0x7f950c0fdcd0 2024-04-27T07:34:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.674+0000 7f95097fa700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 0x7f94fc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.674+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f94f808ecd0 con 0x7f950c0fdcd0 2024-04-27T07:34:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.674+0000 7f9510d69700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 0x7f94fc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.675+0000 7f9510d69700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 0x7f94fc070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9500009b80 tx=0x7f950000b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.683+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f94f8094020 con 0x7f950c0fdcd0 2024-04-27T07:34:47.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.920+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 --> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f950c115dc0 con 0x7f94fc06e7b0 2024-04-27T07:34:47.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.931+0000 7f95097fa700 1 -- 172.21.15.82:0/1574519092 <== mgr.14750 v2:172.21.15.82:6800/627056972 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f950c115dc0 con 0x7f94fc06e7b0 2024-04-27T07:34:47.933 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:34:47.933 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (66s) 5s ago 9m 23.6M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:34:47.933 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (9m) 5s ago 9m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (8m) 12s ago 8m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (61s) 5s ago 9m 79.9M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (4m) 5s ago 4m 64.8M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (4m) 5s ago 4m 179M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (4m) 12s ago 4m 125M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (4m) 12s ago 4m 164M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (30s) 5s ago 11m 476M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283 running (2m) 12s ago 8m 67.2M - 19.0.0-3227-gc37f63b3 d1033e293654 b143c0687007 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (11m) 5s ago 11m 56.1M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (8m) 12s ago 8m 43.6M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (80s) 5s ago 9m 16.3M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (51s) 12s ago 8m 8774k - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 5s ago 7m 178M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:34:47.934 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (7m) 5s ago 7m 187M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:34:47.935 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 5s ago 6m 146M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:34:47.935 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (6m) 12s ago 6m 210M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:34:47.935 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (6m) 12s ago 6m 189M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:34:47.935 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (5m) 12s ago 5m 179M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:34:47.935 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (55s) 5s ago 9m 44.9M - 2.43.0 a07b618ecd1d 10fa30d80e68 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 msgr2=0x7f94fc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 0x7f94fc070c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9500009b80 tx=0x7f950000b040 comp rx=0 tx=0).stop 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 msgr2=0x7f950c1144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94f8013870 tx=0x7f94f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 shutdown_connections 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f94fc06e7b0 0x7f94fc070c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c0662c0 0x7f950c113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 --2- 172.21.15.82:0/1574519092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f950c0fdcd0 0x7f950c1144d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 >> 172.21.15.82:0/1574519092 conn(0x7f950c0f7430 msgr2=0x7f950c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:47.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 shutdown_connections 2024-04-27T07:34:47.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:47.934+0000 7f9512fcd700 1 -- 172.21.15.82:0/1574519092 wait complete. 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 -- 172.21.15.82:0/4209315380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fcf90 msgr2=0x7f0cbc0fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 --2- 172.21.15.82:0/4209315380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc0fd400 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004940 tx=0x7f0cb0009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 -- 172.21.15.82:0/4209315380 shutdown_connections 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 --2- 172.21.15.82:0/4209315380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc0fd400 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 --2- 172.21.15.82:0/4209315380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc0fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 -- 172.21.15.82:0/4209315380 >> 172.21.15.82:0/4209315380 conn(0x7f0cbc0f7440 msgr2=0x7f0cbc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 -- 172.21.15.82:0/4209315380 shutdown_connections 2024-04-27T07:34:48.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.045+0000 7f0cc2398700 1 -- 172.21.15.82:0/4209315380 wait complete. 2024-04-27T07:34:48.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 Processor -- start 2024-04-27T07:34:48.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 -- start start 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc066be0 con 0x7f0cbc0fbce0 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.046+0000 7f0cc2398700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc066d20 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:38384/0 (socket says 172.21.15.82:38384) 2024-04-27T07:34:48.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 -- 172.21.15.82:0/3417352770 learned_addr learned my addr 172.21.15.82:0/3417352770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50020/0 (socket says 172.21.15.82:50020) 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 -- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 msgr2=0x7f0cbc1106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 -- 172.21.15.82:0/3417352770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0005040 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbbfff700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cbb7fe700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000b0d0 tx=0x7f0cb0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb000e070 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cb000b410 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc113190 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb00125e0 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.047+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc113720 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.049+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc05f5c0 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.049+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f0cb0012800 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.049+0000 7f0cb8ff9700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 0x7f0ca4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.050+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f0cb008ef20 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.050+0000 7f0cbbfff700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 0x7f0ca4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.050+0000 7f0cbbfff700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 0x7f0ca4070ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc066860 tx=0x7f0cac00b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.054+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f0cb0058390 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.318 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:47 smithi100 ceph-mon[34183]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:48.318 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:47 smithi100 ceph-mon[34183]: pgmap v11: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 105 op/s 2024-04-27T07:34:48.318 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:47 smithi100 ceph-mon[34183]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:47 smithi082 ceph-mon[26613]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:47 smithi082 ceph-mon[26613]: pgmap v11: 65 pgs: 65 active+clean; 347 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 105 op/s 2024-04-27T07:34:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:47 smithi082 ceph-mon[26613]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.393+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cbc04bed0 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.393+0000 7f0cb8ff9700 1 -- 172.21.15.82:0/3417352770 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0cb0022070 con 0x7f0cbc0fcf90 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:34:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 12, 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:34:48.397 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.395+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 msgr2=0x7f0ca4070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.395+0000 7f0cc2398700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 0x7f0ca4070ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc066860 tx=0x7f0cac00b040 comp rx=0 tx=0).stop 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.395+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 msgr2=0x7f0cbc112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.395+0000 7f0cc2398700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000b0d0 tx=0x7f0cb0009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 shutdown_connections 2024-04-27T07:34:48.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f0ca406e620 0x7f0ca4070ad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0cbc0fbce0 0x7f0cbc1106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 --2- 172.21.15.82:0/3417352770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc0fcf90 0x7f0cbc112bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 >> 172.21.15.82:0/3417352770 conn(0x7f0cbc0f7440 msgr2=0x7f0cbc0f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:48.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 shutdown_connections 2024-04-27T07:34:48.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.396+0000 7f0cc2398700 1 -- 172.21.15.82:0/3417352770 wait complete. 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 -- 172.21.15.82:0/3224224805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fcf60 msgr2=0x7f36300fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 --2- 172.21.15.82:0/3224224805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fcf60 0x7f36300fd3d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3624004940 tx=0x7f3624009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 -- 172.21.15.82:0/3224224805 shutdown_connections 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 --2- 172.21.15.82:0/3224224805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fcf60 0x7f36300fd3d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 --2- 172.21.15.82:0/3224224805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fbcb0 0x7f36300fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.501+0000 7f363679e700 1 -- 172.21.15.82:0/3224224805 >> 172.21.15.82:0/3224224805 conn(0x7f36300f7430 msgr2=0x7f36300f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.502+0000 7f363679e700 1 -- 172.21.15.82:0/3224224805 shutdown_connections 2024-04-27T07:34:48.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.502+0000 7f363679e700 1 -- 172.21.15.82:0/3224224805 wait complete. 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.502+0000 7f363679e700 1 Processor -- start 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.502+0000 7f363679e700 1 -- start start 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.502+0000 7f363679e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f363679e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 0x7f36300fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f363679e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300fe7e0 con 0x7f36300fbcb0 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f363679e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300fe920 con 0x7f36300fcf60 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50034/0 (socket says 172.21.15.82:50034) 2024-04-27T07:34:48.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 0x7f36300fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362ffff700 1 -- 172.21.15.82:0/2266003184 learned_addr learned my addr 172.21.15.82:0/2266003184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362f7fe700 1 -- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 msgr2=0x7f36300ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362f7fe700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362f7fe700 1 -- 172.21.15.82:0/2266003184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624005040 con 0x7f36300fcf60 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362ffff700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362f7fe700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 0x7f36300fe2a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f3624009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362400e040 con 0x7f36300fcf60 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36300feba0 con 0x7f36300fcf60 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f362400bbf0 con 0x7f36300fcf60 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.503+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362401c650 con 0x7f36300fcf60 2024-04-27T07:34:48.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.504+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3630115ab0 con 0x7f36300fcf60 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.505+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3630101af0 con 0x7f36300fcf60 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.505+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f3624013420 con 0x7f36300fcf60 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.506+0000 7f362cff9700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 0x7f3618070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.506+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f362408f2b0 con 0x7f36300fcf60 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.506+0000 7f362ffff700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 0x7f3618070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.506+0000 7f362ffff700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 0x7f3618070ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36300ffac0 tx=0x7f362000b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.510+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f3624058860 con 0x7f36300fcf60 2024-04-27T07:34:48.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.842+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f363005f5c0 con 0x7f36300fcf60 2024-04-27T07:34:48.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.843+0000 7f362cff9700 1 -- 172.21.15.82:0/2266003184 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1862 (secure 0 0 0) 0x7f362405bf20 con 0x7f36300fcf60 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:34:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:34:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 msgr2=0x7f3618070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 0x7f3618070ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36300ffac0 tx=0x7f362000b040 comp rx=0 tx=0).stop 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 msgr2=0x7f36300fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 0x7f36300fe2a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f3624009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 shutdown_connections 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f361806e620 0x7f3618070ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36300fbcb0 0x7f36300ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 --2- 172.21.15.82:0/2266003184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300fcf60 0x7f36300fe2a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.847+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 >> 172.21.15.82:0/2266003184 conn(0x7f36300f7430 msgr2=0x7f3630065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:48.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.848+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 shutdown_connections 2024-04-27T07:34:48.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.848+0000 7f363679e700 1 -- 172.21.15.82:0/2266003184 wait complete. 2024-04-27T07:34:48.851 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:34:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/793591775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fcf60 msgr2=0x7f8e480fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/793591775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fcf60 0x7f8e480fd3d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8e38004940 tx=0x7f8e38009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/793591775 shutdown_connections 2024-04-27T07:34:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/793591775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fcf60 0x7f8e480fd3d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/793591775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fbcb0 0x7f8e480fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/793591775 >> 172.21.15.82:0/793591775 conn(0x7f8e480f7430 msgr2=0x7f8e480f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/793591775 shutdown_connections 2024-04-27T07:34:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.981+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/793591775 wait complete. 2024-04-27T07:34:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 Processor -- start 2024-04-27T07:34:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 -- start start 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fcf60 0x7f8e480fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480fe830 con 0x7f8e480fbcb0 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4f8a7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480fe970 con 0x7f8e480fcf60 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50040/0 (socket says 172.21.15.82:50040) 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 -- 172.21.15.82:0/1231339956 learned_addr learned my addr 172.21.15.82:0/1231339956 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4ce42700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fcf60 0x7f8e480fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 -- 172.21.15.82:0/1231339956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fcf60 msgr2=0x7f8e480fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fcf60 0x7f8e480fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 -- 172.21.15.82:0/1231339956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38005040 con 0x7f8e480fbcb0 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.982+0000 7f8e4d643700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400eb40 tx=0x7f8e4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.983+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e44007cc0 con 0x7f8e480fbcb0 2024-04-27T07:34:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.983+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e4400f040 con 0x7f8e480fbcb0 2024-04-27T07:34:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.983+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e480febf0 con 0x7f8e480fbcb0 2024-04-27T07:34:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.983+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4400ca10 con 0x7f8e480fbcb0 2024-04-27T07:34:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.983+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e480ff100 con 0x7f8e480fbcb0 2024-04-27T07:34:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.984+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e48101af0 con 0x7f8e480fbcb0 2024-04-27T07:34:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.984+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7f8e4400cc80 con 0x7f8e480fbcb0 2024-04-27T07:34:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.985+0000 7f8e3dffb700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 0x7f8e34070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.985+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f8e4408dce0 con 0x7f8e480fbcb0 2024-04-27T07:34:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.985+0000 7f8e4ce42700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 0x7f8e34070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.986+0000 7f8e4ce42700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 0x7f8e34070ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009b30 tx=0x7f8e38009e30 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:48.990+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8e44057220 con 0x7f8e480fbcb0 2024-04-27T07:34:49.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.248+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 --> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4805e3a0 con 0x7f8e3406e620 2024-04-27T07:34:49.250 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:49.250 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/3417352770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:34:49.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:49 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2266003184' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.249+0000 7f8e3dffb700 1 -- 172.21.15.82:0/1231339956 <== mgr.14750 v2:172.21.15.82:6800/627056972 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8e4805e3a0 con 0x7f8e3406e620 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "2/21 daemons upgraded", 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-04-27T07:34:49.252 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:34:49.253 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:34:49.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 msgr2=0x7f8e34070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 0x7f8e34070ad0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009b30 tx=0x7f8e38009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:49.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 msgr2=0x7f8e480ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400eb40 tx=0x7f8e4400b040 comp rx=0 tx=0).stop 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 shutdown_connections 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7f8e3406e620 0x7f8e34070ad0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e480fbcb0 0x7f8e480ffd80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 --2- 172.21.15.82:0/1231339956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e480fcf60 0x7f8e480fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 >> 172.21.15.82:0/1231339956 conn(0x7f8e480f7430 msgr2=0x7f8e48065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 shutdown_connections 2024-04-27T07:34:49.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.251+0000 7f8e4f8a7700 1 -- 172.21.15.82:0/1231339956 wait complete. 2024-04-27T07:34:49.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 -- 172.21.15.82:0/3908439020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 msgr2=0x7efe380fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/3908439020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe380fd3d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efe2c004940 tx=0x7efe2c009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:49.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 -- 172.21.15.82:0/3908439020 shutdown_connections 2024-04-27T07:34:49.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/3908439020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe380fd3d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/3908439020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 0x7efe380fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 -- 172.21.15.82:0/3908439020 >> 172.21.15.82:0/3908439020 conn(0x7efe380f7430 msgr2=0x7efe380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:49.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 -- 172.21.15.82:0/3908439020 shutdown_connections 2024-04-27T07:34:49.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.361+0000 7efe3e2ea700 1 -- 172.21.15.82:0/3908439020 wait complete. 2024-04-27T07:34:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 Processor -- start 2024-04-27T07:34:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 -- start start 2024-04-27T07:34:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 0x7efe3810c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:49.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3810d3e0 con 0x7efe380fcf60 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe3e2ea700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3810dc30 con 0x7efe380fbcb0 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50060/0 (socket says 172.21.15.82:50060) 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 -- 172.21.15.82:0/2121612971 learned_addr learned my addr 172.21.15.82:0/2121612971 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe37fff700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 0x7efe3810c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 -- 172.21.15.82:0/2121612971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 msgr2=0x7efe3810c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 0x7efe3810c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.362+0000 7efe377fe700 1 -- 172.21.15.82:0/2121612971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c005040 con 0x7efe380fcf60 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe377fe700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efe2c013870 tx=0x7efe2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:49.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c021070 con 0x7efe380fcf60 2024-04-27T07:34:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe2c009430 con 0x7efe380fcf60 2024-04-27T07:34:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3810deb0 con 0x7efe380fcf60 2024-04-27T07:34:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2c00e070 con 0x7efe380fcf60 2024-04-27T07:34:49.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.363+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3810e3f0 con 0x7efe380fcf60 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.364+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3805f5c0 con 0x7efe380fcf60 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.364+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 92569+0+0 (secure 0 0 0) 0x7efe2c01c750 con 0x7efe380fcf60 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.365+0000 7efe34ff9700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 0x7efe20070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.365+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7efe2c08f240 con 0x7efe380fcf60 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.365+0000 7efe37fff700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 0x7efe20070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:34:49.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.365+0000 7efe37fff700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 0x7efe20070a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe28009b80 tx=0x7efe2800b040 comp rx=0 tx=0).ready entity=mgr.14750 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:34:49.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.370+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7efe2c05c280 con 0x7efe380fcf60 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3417352770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:34:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:49 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2266003184' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:34:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.692+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efe3804bed0 con 0x7efe380fcf60 2024-04-27T07:34:49.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.693+0000 7efe34ff9700 1 -- 172.21.15.82:0/2121612971 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efe2c05be10 con 0x7efe380fcf60 2024-04-27T07:34:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:34:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:34:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:34:49.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 msgr2=0x7efe20070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 0x7efe20070a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe28009b80 tx=0x7efe2800b040 comp rx=0 tx=0).stop 2024-04-27T07:34:49.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 msgr2=0x7efe3810cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:34:49.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efe2c013870 tx=0x7efe2c009e30 comp rx=0 tx=0).stop 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 shutdown_connections 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7efe2006e5c0 0x7efe20070a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe380fbcb0 0x7efe3810c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 --2- 172.21.15.82:0/2121612971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe380fcf60 0x7efe3810cde0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 >> 172.21.15.82:0/2121612971 conn(0x7efe380f7430 msgr2=0x7efe380f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 shutdown_connections 2024-04-27T07:34:49.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:34:49.695+0000 7efe3e2ea700 1 -- 172.21.15.82:0/2121612971 wait complete. 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:34:50.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: pgmap v12: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-04-27T07:34:50.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:50 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2121612971' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:34:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: pgmap v12: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-04-27T07:34:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:50 smithi082 ceph-mon[26613]: from='client.? 172.21.15.82:0/2121612971' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:34:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:51 smithi082 ceph-mon[26613]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:34:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:51 smithi082 ceph-mon[26613]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:34:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:51 smithi100 ceph-mon[34183]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-04-27T07:34:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:51 smithi100 ceph-mon[34183]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-04-27T07:34:52.382 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:52 smithi082 ceph-mon[26613]: pgmap v13: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-04-27T07:34:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:52 smithi100 ceph-mon[34183]: pgmap v13: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 106 op/s 2024-04-27T07:34:54.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:54 smithi082 ceph-mon[26613]: pgmap v14: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-04-27T07:34:54.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:54 smithi100 ceph-mon[34183]: pgmap v14: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 187 op/s 2024-04-27T07:34:56.766 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: pgmap v15: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.767 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:56 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:56.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: pgmap v15: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-27T07:34:56.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:34:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:34:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:34:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:56 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:34:57.754 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-27T07:34:57.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-27T07:34:57.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:57 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:34:57.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:57 smithi082 ceph-mon[26613]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:34:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:57 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:34:57.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:57 smithi100 ceph-mon[34183]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082:9095"}]: dispatch 2024-04-27T07:34:58.128 DEBUG:teuthology.parallel:result is None 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: pgmap v16: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 245 op/s 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: Upgrade: Updating mgr.smithi100.eparbe 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:58.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:34:58 smithi100 ceph-mon[34183]: Deploying daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: pgmap v16: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 245 op/s 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: Upgrade: Updating mgr.smithi100.eparbe 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:34:58.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:34:58 smithi082 ceph-mon[26613]: Deploying daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:34:59.407 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-27T07:34:59.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-27T07:34:59.745 DEBUG:teuthology.parallel:result is None 2024-04-27T07:34:59.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-27T07:34:59.790 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-27T07:34:59.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-27T07:34:59.910 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-27T07:34:59.911 DEBUG:teuthology.parallel:result is None 2024-04-27T07:35:00.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:00 smithi082 ceph-mon[26613]: pgmap v17: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 239 op/s 2024-04-27T07:35:00.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:00 smithi100 ceph-mon[34183]: pgmap v17: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 239 op/s 2024-04-27T07:35:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:02 smithi082 ceph-mon[26613]: pgmap v18: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-04-27T07:35:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:02 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:02 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:02 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:02 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:02 smithi100 ceph-mon[34183]: pgmap v18: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 180 op/s 2024-04-27T07:35:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:02 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:02.895 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:02 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:02.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:02 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:02.896 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:02 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:04.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:04 smithi082 ceph-mon[26613]: pgmap v19: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 259 op/s 2024-04-27T07:35:04.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:04 smithi100 ceph-mon[34183]: pgmap v19: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 259 op/s 2024-04-27T07:35:06.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:06 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:06.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:06 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:06.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:06 smithi100 ceph-mon[34183]: pgmap v20: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-04-27T07:35:06.721 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:06 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:06.721 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:06 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:06.721 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:06 smithi082 ceph-mon[26613]: pgmap v20: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 178 op/s 2024-04-27T07:35:07.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:07 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:07.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:07 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:07.795 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:07 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:07.795 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:07 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:08.755 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:08 smithi100 ceph-mon[34183]: pgmap v21: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 182 op/s 2024-04-27T07:35:08.755 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:08 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:08.755 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:08 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:08 smithi082 ceph-mon[26613]: pgmap v21: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 182 op/s 2024-04-27T07:35:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:08 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:08.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:08 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:09.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:35:09.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:35:09.800 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:35:09.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:35:09.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:35:09.801 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:09 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:35:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:35:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:35:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:35:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:35:09.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:35:09.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:09 smithi082 ceph-mon[26613]: from='mgr.? 172.21.15.100:0/1442683119' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:35:10.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 454 KiB/s rd, 317 KiB/s wr, 82 op/s 2024-04-27T07:35:11.320 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: mgrmap e33: smithi082.hhlhmf(active, since 38s), standbys: smithi100.eparbe 2024-04-27T07:35:11.320 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.320 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.hhlhmf"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.hhlhmf"}]': finished 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.eparbe"}]: dispatch 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.eparbe"}]': finished 2024-04-27T07:35:11.321 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:10 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 454 KiB/s rd, 317 KiB/s wr, 82 op/s 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: mgrmap e33: smithi082.hhlhmf(active, since 38s), standbys: smithi100.eparbe 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.322 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.hhlhmf"}]: dispatch 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.hhlhmf"}]': finished 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.eparbe"}]: dispatch 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi100.eparbe"}]': finished 2024-04-27T07:35:11.323 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:10 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-27T07:35:11.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:11 smithi082 ceph-mon[26613]: Upgrade: Setting container_image for all mgr 2024-04-27T07:35:11.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:11 smithi100 ceph-mon[34183]: Upgrade: Setting container_image for all mgr 2024-04-27T07:35:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:12 smithi082 ceph-mon[26613]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 454 KiB/s rd, 317 KiB/s wr, 82 op/s 2024-04-27T07:35:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:12 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:12 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:12 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:12 smithi082 ceph-mon[26613]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:12 smithi100 ceph-mon[34183]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 454 KiB/s rd, 317 KiB/s wr, 82 op/s 2024-04-27T07:35:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:12 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:12 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:12 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:12 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:13.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:13 smithi082 ceph-mon[26613]: Upgrade: Updating mon.smithi082 2024-04-27T07:35:13.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:13 smithi082 ceph-mon[26613]: Deploying daemon mon.smithi082 on smithi082 2024-04-27T07:35:13.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:13 smithi100 ceph-mon[34183]: Upgrade: Updating mon.smithi082 2024-04-27T07:35:13.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:13 smithi100 ceph-mon[34183]: Deploying daemon mon.smithi082 on smithi082 2024-04-27T07:35:14.746 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:14 smithi082 ceph-mon[26613]: pgmap v24: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 455 KiB/s rd, 317 KiB/s wr, 85 op/s 2024-04-27T07:35:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:14 smithi100 ceph-mon[34183]: pgmap v24: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 455 KiB/s rd, 317 KiB/s wr, 85 op/s 2024-04-27T07:35:15.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:15 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:35:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:15 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[26609]: 2024-04-27T07:35:15.590+0000 7fe86cbb5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:35:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:15 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[26609]: 2024-04-27T07:35:15.590+0000 7fe86cbb5700 -1 mon.smithi082@0(leader) e2 *** Got Signal Terminated *** 2024-04-27T07:35:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:15 smithi082 podman[90926]: 2024-04-27 07:35:15.611591232 +0000 UTC m=+0.146606211 container died bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True) 2024-04-27T07:35:16.350 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 podman[90926]: 2024-04-27 07:35:16.099554613 +0000 UTC m=+0.634569589 container cleanup bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, RELEASE=quincy-2be3efa, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:35:16.351 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 bash[90926]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082 2024-04-27T07:35:16.662 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 podman[90941]: 2024-04-27 07:35:16.460017897 +0000 UTC m=+0.846918832 container remove bbaeaedfd19c7ed3d7b05d71f893d630f47ed1d36e2346c0d92abd0b2a01fac4 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-2be3efa, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-27T07:35:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service: Deactivated successfully. 2024-04-27T07:35:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 systemd[1]: Stopped Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:35:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service: Consumed 10.955s CPU time. 2024-04-27T07:35:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:16 smithi082 systemd[1]: Starting Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:35:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 podman[91084]: 2024-04-27 07:35:17.004570493 +0000 UTC m=+0.018179192 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:35:17.373 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 podman[91084]: 2024-04-27 07:35:17.110964884 +0000 UTC m=+0.124573567 container create 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 podman[91084]: 2024-04-27 07:35:17.355517339 +0000 UTC m=+0.369126028 container init 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b) 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 podman[91084]: 2024-04-27 07:35:17.358886972 +0000 UTC m=+0.372495658 container start 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, org.label-schema.schema-version=1.0) 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: set uid:gid to 167:167 (ceph:ceph) 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev), process ceph-mon, pid 2 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: pidfile_write: ignore empty --pid-file 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: load: jerasure load: lrc 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: RocksDB version: 7.9.2 2024-04-27T07:35:17.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Git sha 0 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Compile date 2024-04-24 00:04:22 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: DB SUMMARY 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: DB Session ID: 20U9D3ER1U79ICC5BXHI 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: CURRENT file: CURRENT 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: IDENTITY file: IDENTITY 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 1, files: 000030.sst 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000028.log size: 2315458 ; 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.error_if_exists: 0 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.create_if_missing: 0 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.paranoid_checks: 1 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-27T07:35:17.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.env: 0x55560ad9ecc0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.fs: PosixFileSystem 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.info_log: 0x55560ce0bae0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_file_opening_threads: 16 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.statistics: (nil) 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.use_fsync: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_log_file_size: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.keep_log_file_num: 1000 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.recycle_log_file_num: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_fallocate: 1 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_mmap_reads: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_mmap_writes: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.use_direct_reads: 0 2024-04-27T07:35:17.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.create_missing_column_families: 0 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.db_log_dir: 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.wal_dir: 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-27T07:35:17.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.advise_random_on_open: 1 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.db_write_buffer_size: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.write_buffer_manager: 0x55560cddb0e0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.rate_limiter: (nil) 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.wal_recovery_mode: 2 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enable_thread_tracking: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enable_pipelined_write: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.unordered_write: 0 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-27T07:35:17.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-27T07:35:17.849 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.row_cache: None 2024-04-27T07:35:17.849 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.wal_filter: None 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_ingest_behind: 0 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.two_write_queues: 0 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.manual_wal_flush: 0 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.wal_compression: 0 2024-04-27T07:35:17.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.atomic_flush: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.log_readahead_size: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.best_efforts_recovery: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.allow_data_in_errors: 0 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.db_host_id: __hostname__ 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_background_jobs: 2 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_background_compactions: -1 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_subcompactions: 1 2024-04-27T07:35:17.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_total_wal_size: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_open_files: -1 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bytes_per_sync: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_readahead_size: 0 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_background_flushes: -1 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Compression algorithms supported: 2024-04-27T07:35:17.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kZSTD supported: 0 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kXpressCompression supported: 0 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kLZ4HCCompression supported: 1 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kZlibCompression supported: 1 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kSnappyCompression supported: 1 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kLZ4Compression supported: 1 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: kBZip2Compression supported: 0 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000015 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.merge_operator: 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_filter: None 2024-04-27T07:35:17.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_filter_factory: None 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.sst_partitioner_factory: None 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55560ce0bcc0) 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 4 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-04-27T07:35:17.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x55560ce0d1f0 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-04-27T07:35:17.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: bloomfilter 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 5 2024-04-27T07:35:17.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_auto_readahead_size: 262144 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: prepopulate_block_cache: 0 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: initial_auto_readahead_size: 8192 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.write_buffer_size: 33554432 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_write_buffer_number: 2 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression: NoCompression 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression: Disabled 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.prefix_extractor: nullptr 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.num_levels: 7 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-27T07:35:17.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.level: 32767 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.strategy: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-27T07:35:17.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.enabled: false 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.target_file_size_base: 67108864 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-27T07:35:17.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.arena_block_size: 1048576 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.disable_auto_compactions: 0 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-27T07:35:17.860 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.inplace_update_support: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.bloom_locality: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.max_successive_merges: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.paranoid_file_checks: 0 2024-04-27T07:35:17.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.force_consistency_checks: 1 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.report_bg_io_stats: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.ttl: 2592000 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enable_blob_files: false 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.min_blob_size: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_file_size: 268435456 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-27T07:35:17.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.blob_file_starting_level: 0 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10509, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 55ffc632-11e8-48a1-9a05-73bc5ee38638 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203317399102, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203317405747, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2148510, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10510, "largest_seqno": 11402, "table_properties": {"data_size": 2143577, "index_size": 2800, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1093, "raw_key_size": 9914, "raw_average_key_size": 23, "raw_value_size": 2134428, "raw_average_value_size": 5130, "num_data_blocks": 128, "num_entries": 416, "num_filter_entries": 416, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714203317, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "55ffc632-11e8-48a1-9a05-73bc5ee38638", "db_session_id": "20U9D3ER1U79ICC5BXHI", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203317405820, "job": 1, "event": "recovery_finished"} 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-27T07:35:17.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55560cf24000 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: DB pointer 0x55560cf0e000 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-27T07:35:17.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 1/0 2.05 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 7.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 597.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:35:17.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 93.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 93.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache BinnedLRUCache@0x55560ce0d1f0#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: starting mon.smithi082 rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???) e2 preinit fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).mds e17 new map 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).mds e17 print_map 2024-04-27T07:35:17.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e17 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: 1 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Filesystem 'cephfs' (1) 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: fs_name cephfs 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: epoch 17 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: tableserver 0 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: root 0 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_timeout 60 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_autoclose 300 2024-04-27T07:35:17.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_file_size 1099511627776 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_xattr_size 65536 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: required_client_features {} 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure 0 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure_osd_epoch 0 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_mds 2 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: in 0,1 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: up {0=14464,1=24269} 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: failed 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: damaged 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: stopped 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_pools [3] 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_pool 2 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: inline_data enabled 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: balancer 2024-04-27T07:35:17.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: bal_rank_mask -1 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: standby_count_wanted 1 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: qdb_cluster leader: 0 members: 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 ceph-mon[91103]: mon.smithi082@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 bash[91084]: 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 2024-04-27T07:35:17.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:17 smithi082 systemd[1]: Started Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:35:19.013 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:19.013 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:19.013 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:19.013 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: pgmap v26: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: mon.smithi082 calling monitor election 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: monmap epoch 2 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: last_changed 2024-04-27T07:26:08.789192+0000 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: created 2024-04-27T07:23:23.367897+0000 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: min_mon_release 17 (quincy) 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: election_strategy: 1 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: osdmap e48: 6 total, 6 up, 6 in 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: mgrmap e33: smithi082.hhlhmf(active, since 47s), standbys: smithi100.eparbe 2024-04-27T07:35:19.014 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:19.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:19.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:19.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: from='mgr.14750 ' entity='' 2024-04-27T07:35:19.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:18 smithi082 ceph-mon[91103]: mgrmap e34: smithi082.hhlhmf(active, since 47s), standbys: smithi100.eparbe 2024-04-27T07:35:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: from='mgr.14750 172.21.15.82:0/1413797334' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: pgmap v26: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 682 B/s wr, 8 op/s 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: mon.smithi082 calling monitor election 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: monmap epoch 2 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: last_changed 2024-04-27T07:26:08.789192+0000 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: created 2024-04-27T07:23:23.367897+0000 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: min_mon_release 17 (quincy) 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: election_strategy: 1 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-04-27T07:35:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: osdmap e48: 6 total, 6 up, 6 in 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: mgrmap e33: smithi082.hhlhmf(active, since 47s), standbys: smithi100.eparbe 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: from='mgr.14750 ' entity='' 2024-04-27T07:35:19.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:18 smithi100 ceph-mon[34183]: mgrmap e34: smithi082.hhlhmf(active, since 47s), standbys: smithi100.eparbe 2024-04-27T07:35:19.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 -- 172.21.15.82:0/36458672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fcf60 msgr2=0x7fa7dc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/36458672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fd3d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0004940 tx=0x7fa7d0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 -- 172.21.15.82:0/36458672 shutdown_connections 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/36458672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fd3d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/36458672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 -- 172.21.15.82:0/36458672 >> 172.21.15.82:0/36458672 conn(0x7fa7dc0f7430 msgr2=0x7fa7dc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 -- 172.21.15.82:0/36458672 shutdown_connections 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.803+0000 7fa7e20d8700 1 -- 172.21.15.82:0/36458672 wait complete. 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 Processor -- start 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 -- start start 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0fe850 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7e20d8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0fe9c0 con 0x7fa7dc0fcf60 2024-04-27T07:35:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7db7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40680/0 (socket says 172.21.15.82:40680) 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7db7fe700 1 -- 172.21.15.82:0/53447716 learned_addr learned my addr 172.21.15.82:0/53447716 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.804+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7db7fe700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fcf60 msgr2=0x7fa7dc0fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7db7fe700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7db7fe700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0005040 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7db7fe700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc002a80 tx=0x7fa7cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc007cc0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7cc00f040 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc0feca0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc00dac0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.805+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc1159c0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.806+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7dc05f5c0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.807+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fa7cc00dc20 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.807+0000 7fa7c3fff700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.807+0000 7fa7daffd700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/627056972 2024-04-27T07:35:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.807+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fa7cc08e5c0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.807+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-27T07:35:19.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:19.817+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa7cc0573c0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:20.008+0000 7fa7daffd700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/627056972 2024-04-27T07:35:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:20.008+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-27T07:35:20.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:20.043+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7dc05e3a0 con 0x7fa7c406ed20 2024-04-27T07:35:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:20.409+0000 7fa7daffd700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/627056972 2024-04-27T07:35:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:20.409+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-27T07:35:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:21.210+0000 7fa7daffd700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/627056972 2024-04-27T07:35:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:21.210+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-27T07:35:22.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:22.811+0000 7fa7daffd700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/627056972 2024-04-27T07:35:22.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:22.811+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-27T07:35:25.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:25.738+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 35) v1 ==== 92370+0+0 (secure 0 0 0) 0x7fa7cc011d50 con 0x7fa7dc0fbcb0 2024-04-27T07:35:25.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:25.739+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 msgr2=0x7fa7c40711d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-27T07:35:25.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:25.739+0000 7fa7c3fff700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: Active manager daemon smithi082.hhlhmf restarted 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: mgrmap e35: smithi082.hhlhmf(active, starting, since 0.00567158s), standbys: smithi100.eparbe 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:35:26.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:35:26.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:35:26.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:35:26.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:35:26.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:35:26.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:35:26.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: Active manager daemon smithi082.hhlhmf restarted 2024-04-27T07:35:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: Activating manager daemon smithi082.hhlhmf 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: mgrmap e35: smithi082.hhlhmf(active, starting, since 0.00567158s), standbys: smithi100.eparbe 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi082.hhlhmf", "id": "smithi082.hhlhmf"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr metadata", "who": "smithi100.eparbe", "id": "smithi100.eparbe"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-27T07:35:26.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe restarted 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: Standby manager daemon smithi100.eparbe started 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/crt"}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: Manager daemon smithi082.hhlhmf is now available 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi100.eparbe/key"}]: dispatch 2024-04-27T07:35:26.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.? 172.21.15.100:0/1136369312' entity='mgr.smithi100.eparbe' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-27T07:35:26.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:25 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.741+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7fa7cc08c9c0 con 0x7fa7dc0fbcb0 2024-04-27T07:35:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.742+0000 7fa7c3fff700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 0x7fa7c40788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.742+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7dc05e3a0 con 0x7fa7c401dbf0 2024-04-27T07:35:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.743+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 0x7fa7c40788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:26.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.743+0000 7fa7daffd700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 0x7fa7c40788d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000b970 tx=0x7fa7d0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.747+0000 7fa7c3fff700 1 -- 172.21.15.82:0/53447716 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa7dc05e3a0 con 0x7fa7c401dbf0 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 msgr2=0x7fa7c40788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 0x7fa7c40788d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000b970 tx=0x7fa7d0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 msgr2=0x7fa7dc0ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc002a80 tx=0x7fa7cc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 shutdown_connections 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa7c401dbf0 0x7fa7c40788d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:6800/627056972,v1:172.21.15.82:6801/627056972] conn(0x7fa7c406ed20 0x7fa7c40711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7dc0fbcb0 0x7fa7dc0ffdd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 --2- 172.21.15.82:0/53447716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7dc0fcf60 0x7fa7dc0fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 >> 172.21.15.82:0/53447716 conn(0x7fa7dc0f7430 msgr2=0x7fa7dc0f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:26.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 shutdown_connections 2024-04-27T07:35:26.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.750+0000 7fa7e20d8700 1 -- 172.21.15.82:0/53447716 wait complete. 2024-04-27T07:35:26.763 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- 172.21.15.82:0/2182199610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040662c0 msgr2=0x7f24040ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 --2- 172.21.15.82:0/2182199610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040662c0 0x7f24040ff9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2400009ce0 tx=0x7f2400004d10 comp rx=0 tx=0).stop 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- 172.21.15.82:0/2182199610 shutdown_connections 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 --2- 172.21.15.82:0/2182199610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040ffee0 0x7f2404102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 --2- 172.21.15.82:0/2182199610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040662c0 0x7f24040ff9a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- 172.21.15.82:0/2182199610 >> 172.21.15.82:0/2182199610 conn(0x7f24040f7430 msgr2=0x7f24040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:26.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- 172.21.15.82:0/2182199610 shutdown_connections 2024-04-27T07:35:26.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- 172.21.15.82:0/2182199610 wait complete. 2024-04-27T07:35:26.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 Processor -- start 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.855+0000 7f240bb17700 1 -- start start 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f240bb17700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040662c0 0x7f240410dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f240bb17700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f240bb17700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240410e710 con 0x7f24040ffee0 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f240bb17700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240410ef60 con 0x7f24040662c0 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49684/0 (socket says 172.21.15.82:49684) 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 -- 172.21.15.82:0/1365968410 learned_addr learned my addr 172.21.15.82:0/1365968410 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24098b3700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040662c0 0x7f240410dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 -- 172.21.15.82:0/1365968410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040662c0 msgr2=0x7f240410dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040662c0 0x7f240410dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 -- 172.21.15.82:0/1365968410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009940 con 0x7f24040ffee0 2024-04-27T07:35:26.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f24090b2700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c830 tx=0x7f23f4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f400a760 con 0x7f24040ffee0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23f400ad90 con 0x7f24040ffee0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240410f240 con 0x7f24040ffee0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.856+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23f40113a0 con 0x7f24040ffee0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.857+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240410f780 con 0x7f24040ffee0 2024-04-27T07:35:26.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.857+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240405f5c0 con 0x7f24040ffee0 2024-04-27T07:35:26.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.858+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f23f4012400 con 0x7f24040ffee0 2024-04-27T07:35:26.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.858+0000 7f23fa7fc700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 0x7f23f0070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:26.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.858+0000 7f24098b3700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 0x7f23f0070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:26.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.859+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f23f408e2e0 con 0x7f24040ffee0 2024-04-27T07:35:26.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.859+0000 7f24098b3700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 0x7f23f0070db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2400015040 tx=0x7f2400004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:26.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:26.864+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f23f4057490 con 0x7f24040ffee0 2024-04-27T07:35:27.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:27.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:35:27.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:35:27.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:26 smithi082 ceph-mon[91103]: mgrmap e36: smithi082.hhlhmf(active, since 1.01087s), standbys: smithi100.eparbe 2024-04-27T07:35:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.100+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f240410fc10 con 0x7f23f006e900 2024-04-27T07:35:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.101+0000 7f23fa7fc700 1 -- 172.21.15.82:0/1365968410 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f240410fc10 con 0x7f23f006e900 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 msgr2=0x7f23f0070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 0x7f23f0070db0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2400015040 tx=0x7f2400004d10 comp rx=0 tx=0).stop 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 msgr2=0x7f240410e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c830 tx=0x7f23f4004470 comp rx=0 tx=0).stop 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 shutdown_connections 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f23f006e900 0x7f23f0070db0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24040662c0 0x7f240410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 --2- 172.21.15.82:0/1365968410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24040ffee0 0x7f240410e110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 >> 172.21.15.82:0/1365968410 conn(0x7f24040f7430 msgr2=0x7f24040f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 shutdown_connections 2024-04-27T07:35:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.104+0000 7f240bb17700 1 -- 172.21.15.82:0/1365968410 wait complete. 2024-04-27T07:35:27.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:26 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:27.136 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:26 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/mirror_snapshot_schedule"}]: dispatch 2024-04-27T07:35:27.137 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:26 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.hhlhmf/trash_purge_schedule"}]: dispatch 2024-04-27T07:35:27.137 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:26 smithi100 ceph-mon[34183]: mgrmap e36: smithi082.hhlhmf(active, since 1.01087s), standbys: smithi100.eparbe 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 -- 172.21.15.82:0/1857893106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 msgr2=0x7f3b040fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/1857893106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b040fd290 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3af4004940 tx=0x7f3af4009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 -- 172.21.15.82:0/1857893106 shutdown_connections 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/1857893106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 0x7f3b040fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/1857893106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b040fd290 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 -- 172.21.15.82:0/1857893106 >> 172.21.15.82:0/1857893106 conn(0x7f3b040f8590 msgr2=0x7f3b040fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 -- 172.21.15.82:0/1857893106 shutdown_connections 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.204+0000 7f3b08b9a700 1 -- 172.21.15.82:0/1857893106 wait complete. 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 Processor -- start 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 -- start start 2024-04-27T07:35:27.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 0x7f3b04110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04110780 con 0x7f3b040fce80 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b08b9a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04110fd0 con 0x7f3b040fe080 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49704/0 (socket says 172.21.15.82:49704) 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 -- 172.21.15.82:0/3021526246 learned_addr learned my addr 172.21.15.82:0/3021526246 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b01d9b700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 0x7f3b04110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 -- 172.21.15.82:0/3021526246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 msgr2=0x7f3b04110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 0x7f3b04110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 -- 172.21.15.82:0/3021526246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4005040 con 0x7f3b040fce80 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3b0259c700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b3b0 tx=0x7f3af4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.205+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af400e040 con 0x7f3b040fce80 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.206+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b04111250 con 0x7f3b040fce80 2024-04-27T07:35:27.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.206+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3af400bbf0 con 0x7f3b040fce80 2024-04-27T07:35:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.206+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af401c630 con 0x7f3b040fce80 2024-04-27T07:35:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.206+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b04111790 con 0x7f3b040fce80 2024-04-27T07:35:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.207+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b04101a10 con 0x7f3b040fce80 2024-04-27T07:35:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.207+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7f3af400bd60 con 0x7f3b040fce80 2024-04-27T07:35:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.207+0000 7f3afaffd700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 0x7f3af0070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.207+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3af408eef0 con 0x7f3b040fce80 2024-04-27T07:35:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.207+0000 7f3b01d9b700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 0x7f3af0070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.208+0000 7f3b01d9b700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 0x7f3af0070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0041d0 tx=0x7f3aec0043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.212+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3af4058020 con 0x7f3b040fce80 2024-04-27T07:35:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.424+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b041119b0 con 0x7f3af006e900 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.435+0000 7f3afaffd700 1 -- 172.21.15.82:0/3021526246 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3b041119b0 con 0x7f3af006e900 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (106s) 19s ago 10m 25.7M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (10m) 19s ago 10m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (9m) 22s ago 9m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (100s) 19s ago 10m 80.2M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (4m) 19s ago 4m 69.1M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (4m) 19s ago 4m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:35:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (4m) 22s ago 4m 76.1M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (4m) 22s ago 4m 143M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (70s) 19s ago 11m 494M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (25s) 22s ago 9m 67.5M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (11m) 19s ago 11m 55.8M 2048M 17.2.7-907-g2be3efa9 1c5834633715 bbaeaedfd19c 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (9m) 22s ago 9m 43.0M 2048M 17.2.7-907-g2be3efa9 1c5834633715 81a8d0397b9b 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (119s) 19s ago 10m 16.1M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (91s) 22s ago 9m 7922k - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (8m) 19s ago 8m 190M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (8m) 19s ago 8m 198M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (7m) 19s ago 7m 155M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (7m) 22s ago 7m 219M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (6m) 22s ago 6m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (6m) 22s ago 6m 186M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:35:27.439 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (32s) 19s ago 9m 43.7M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 msgr2=0x7f3af0070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 0x7f3af0070db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0041d0 tx=0x7f3aec0043c0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 msgr2=0x7f3b0410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b3b0 tx=0x7f3af4009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 shutdown_connections 2024-04-27T07:35:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af006e900 0x7f3af0070db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b040fce80 0x7f3b0410fc40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 --2- 172.21.15.82:0/3021526246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b040fe080 0x7f3b04110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 >> 172.21.15.82:0/3021526246 conn(0x7f3b040f8590 msgr2=0x7f3b040f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 shutdown_connections 2024-04-27T07:35:27.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.438+0000 7f3b08b9a700 1 -- 172.21.15.82:0/3021526246 wait complete. 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 -- 172.21.15.82:0/2819437777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 msgr2=0x7efcfc0fd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 --2- 172.21.15.82:0/2819437777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0fd680 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004940 tx=0x7efcf0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 -- 172.21.15.82:0/2819437777 shutdown_connections 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 --2- 172.21.15.82:0/2819437777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fdbc0 0x7efcfc0fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 --2- 172.21.15.82:0/2819437777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0fd680 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 -- 172.21.15.82:0/2819437777 >> 172.21.15.82:0/2819437777 conn(0x7efcfc0f6b80 msgr2=0x7efcfc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 -- 172.21.15.82:0/2819437777 shutdown_connections 2024-04-27T07:35:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.552+0000 7efd00ab5700 1 -- 172.21.15.82:0/2819437777 wait complete. 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 Processor -- start 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 -- start start 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 0x7efcfc0fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0fec80 con 0x7efcfc0fd270 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efd00ab5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0fedf0 con 0x7efcfc0fe2d0 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49728/0 (socket says 172.21.15.82:49728) 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 -- 172.21.15.82:0/3408646461 learned_addr learned my addr 172.21.15.82:0/3408646461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 -- 172.21.15.82:0/3408646461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 msgr2=0x7efcfc0fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcf9d9b700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 0x7efcfc0fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 0x7efcfc0fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 -- 172.21.15.82:0/3408646461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0005040 con 0x7efcfc0fd270 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcf9d9b700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 0x7efcfc0fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:35:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.553+0000 7efcfa59c700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004090 tx=0x7efcf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.554+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf0021070 con 0x7efcfc0fd270 2024-04-27T07:35:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.554+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc0ff070 con 0x7efcfc0fd270 2024-04-27T07:35:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.554+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcf001c400 con 0x7efcfc0fd270 2024-04-27T07:35:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.554+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf000e070 con 0x7efcfc0fd270 2024-04-27T07:35:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.554+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc115c40 con 0x7efcfc0fd270 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.555+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc05f5c0 con 0x7efcfc0fd270 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.555+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 92497+0+0 (secure 0 0 0) 0x7efcf001c9e0 con 0x7efcfc0fd270 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.556+0000 7efceaffd700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 0x7efce4070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.556+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efcf008f5b0 con 0x7efcfc0fd270 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.556+0000 7efcf9d9b700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 0x7efce4070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.556+0000 7efcf9d9b700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 0x7efce4070db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcec007fd0 tx=0x7efcec00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.561+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efcf00586e0 con 0x7efcfc0fd270 2024-04-27T07:35:27.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.793+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7efcf0058ab0 con 0x7efcfc0fd270 2024-04-27T07:35:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.859+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efcfc104880 con 0x7efcfc0fd270 2024-04-27T07:35:27.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.859+0000 7efceaffd700 1 -- 172.21.15.82:0/3408646461 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7efcf0046860 con 0x7efcfc0fd270 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:35:27.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 11, 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 3 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:35:27.863 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 msgr2=0x7efce4070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 0x7efce4070db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcec007fd0 tx=0x7efcec00b040 comp rx=0 tx=0).stop 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 msgr2=0x7efcfc0ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004090 tx=0x7efcf0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 shutdown_connections 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efce406e900 0x7efce4070db0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcfc0fd270 0x7efcfc0ffd60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 --2- 172.21.15.82:0/3408646461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcfc0fe2d0 0x7efcfc0fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 >> 172.21.15.82:0/3408646461 conn(0x7efcfc0f6b80 msgr2=0x7efcfc0fb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 shutdown_connections 2024-04-27T07:35:27.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.862+0000 7efd00ab5700 1 -- 172.21.15.82:0/3408646461 wait complete. 2024-04-27T07:35:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 -- 172.21.15.82:0/3537197845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef0066ed0 msgr2=0x7f3ef00ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/3537197845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00ffa10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0004940 tx=0x7f3ee0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 -- 172.21.15.82:0/3537197845 shutdown_connections 2024-04-27T07:35:27.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/3537197845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef00fff50 0x7f3ef0102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/3537197845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00ffa10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 -- 172.21.15.82:0/3537197845 >> 172.21.15.82:0/3537197845 conn(0x7f3ef00f7440 msgr2=0x7f3ef00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 -- 172.21.15.82:0/3537197845 shutdown_connections 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.971+0000 7f3ef4fce700 1 -- 172.21.15.82:0/3537197845 wait complete. 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 Processor -- start 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 -- start start 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00fd860 con 0x7f3ef00fff50 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3ef4fce700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00fbe50 con 0x7f3ef0066ed0 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3eedd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3eedd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49772/0 (socket says 172.21.15.82:49772) 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3eedd9b700 1 -- 172.21.15.82:0/2296561498 learned_addr learned my addr 172.21.15.82:0/2296561498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.972+0000 7f3eee59c700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3eedd9b700 1 -- 172.21.15.82:0/2296561498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef0066ed0 msgr2=0x7f3ef00fd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3eedd9b700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00fd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3eedd9b700 1 -- 172.21.15.82:0/2296561498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0005040 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3eedd9b700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c8c0 tx=0x7f3ee40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee400a980 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ee400ce60 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee40115e0 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef00fc100 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.973+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef00fc6c0 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.974+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef004c710 con 0x7f3ef00fff50 2024-04-27T07:35:27.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.974+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7f3ee4012400 con 0x7f3ef00fff50 2024-04-27T07:35:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.975+0000 7f3edeffd700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 0x7f3ed8071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.975+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3ee408e850 con 0x7f3ef00fff50 2024-04-27T07:35:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.975+0000 7f3eee59c700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 0x7f3ed8071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:27.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.975+0000 7f3eee59c700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 0x7f3ed8071140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b970 tx=0x7f3ee0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:27.980+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3ee405b2a0 con 0x7f3ef00fff50 2024-04-27T07:35:28.080 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: [27/Apr/2024:07:35:26] ENGINE Bus STARTING 2024-04-27T07:35:28.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: [27/Apr/2024:07:35:26] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:35:28.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:28.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: pgmap v3: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:28.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: [27/Apr/2024:07:35:26] ENGINE Serving on http://172.21.15.82:8765 2024-04-27T07:35:28.081 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:27 smithi082 ceph-mon[91103]: [27/Apr/2024:07:35:26] ENGINE Bus STARTED 2024-04-27T07:35:28.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: [27/Apr/2024:07:35:26] ENGINE Bus STARTING 2024-04-27T07:35:28.130 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: [27/Apr/2024:07:35:26] ENGINE Serving on https://172.21.15.82:7150 2024-04-27T07:35:28.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:28.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: pgmap v3: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:28.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: [27/Apr/2024:07:35:26] ENGINE Serving on http://172.21.15.82:8765 2024-04-27T07:35:28.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:27 smithi100 ceph-mon[34183]: [27/Apr/2024:07:35:26] ENGINE Bus STARTED 2024-04-27T07:35:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.229+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ef0115b20 con 0x7f3ef00fff50 2024-04-27T07:35:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.230+0000 7f3edeffd700 1 -- 172.21.15.82:0/2296561498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1932 (secure 0 0 0) 0x7f3ee40126b0 con 0x7f3ef00fff50 2024-04-27T07:35:28.232 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:35:28.232 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:35:28.232 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:28.232 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:35:28.233 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:35:28.234 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:35:28.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 msgr2=0x7f3ed8071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 0x7f3ed8071140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b970 tx=0x7f3ee0009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 msgr2=0x7f3ef00fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400c8c0 tx=0x7f3ee40044c0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 shutdown_connections 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ed806ec90 0x7f3ed8071140 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ef0066ed0 0x7f3ef00fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 --2- 172.21.15.82:0/2296561498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ef00fff50 0x7f3ef00fb910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 >> 172.21.15.82:0/2296561498 conn(0x7f3ef00f7440 msgr2=0x7f3ef00f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 shutdown_connections 2024-04-27T07:35:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.232+0000 7f3ef4fce700 1 -- 172.21.15.82:0/2296561498 wait complete. 2024-04-27T07:35:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.340+0000 7fc9fffff700 1 -- 172.21.15.82:0/672814934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800bcb0 con 0x7fca080fcab0 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.340+0000 7fca0f34c700 1 -- 172.21.15.82:0/672814934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 msgr2=0x7fca080faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.340+0000 7fca0f34c700 1 --2- 172.21.15.82:0/672814934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca080faec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8004940 tx=0x7fc9f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 -- 172.21.15.82:0/672814934 shutdown_connections 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 --2- 172.21.15.82:0/672814934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca080faec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 --2- 172.21.15.82:0/672814934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 0x7fca080fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 -- 172.21.15.82:0/672814934 >> 172.21.15.82:0/672814934 conn(0x7fca080f6bb0 msgr2=0x7fca080f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:28.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 -- 172.21.15.82:0/672814934 shutdown_connections 2024-04-27T07:35:28.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 -- 172.21.15.82:0/672814934 wait complete. 2024-04-27T07:35:28.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 Processor -- start 2024-04-27T07:35:28.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.341+0000 7fca0f34c700 1 -- start start 2024-04-27T07:35:28.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0f34c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 0x7fca08113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0f34c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0f34c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08114ac0 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0f34c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08114c30 con 0x7fca080fc160 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49802/0 (socket says 172.21.15.82:49802) 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 -- 172.21.15.82:0/964366371 learned_addr learned my addr 172.21.15.82:0/964366371 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0d0e8700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 0x7fca08113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 -- 172.21.15.82:0/964366371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 msgr2=0x7fca08113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 0x7fca08113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 -- 172.21.15.82:0/964366371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8005040 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0c8e7700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009fd0 tx=0x7fc9f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800e040 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f800bcc0 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.342+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca08119630 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.343+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f801c630 con 0x7fca080fcab0 2024-04-27T07:35:28.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.343+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca08119bf0 con 0x7fca080fcab0 2024-04-27T07:35:28.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.344+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0804c710 con 0x7fca080fcab0 2024-04-27T07:35:28.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.344+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7fc9f8013980 con 0x7fca080fcab0 2024-04-27T07:35:28.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.345+0000 7fc9fdffb700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 0x7fc9f4071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.345+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc9f808fc80 con 0x7fca080fcab0 2024-04-27T07:35:28.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.345+0000 7fca0d0e8700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 0x7fc9f4071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.346+0000 7fca0d0e8700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 0x7fc9f4071140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fca04004990 tx=0x7fca04009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.351+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc9f805c4c0 con 0x7fca080fcab0 2024-04-27T07:35:28.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.579+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca08100280 con 0x7fc9f406ec90 2024-04-27T07:35:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.580+0000 7fc9fdffb700 1 -- 172.21.15.82:0/964366371 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fca08100280 con 0x7fc9f406ec90 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "2/21 daemons upgraded", 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:35:28.583 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 msgr2=0x7fc9f4071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 0x7fc9f4071140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fca04004990 tx=0x7fca04009ee0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 msgr2=0x7fca081144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009fd0 tx=0x7fc9f8009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 shutdown_connections 2024-04-27T07:35:28.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc9f406ec90 0x7fc9f4071140 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca080fc160 0x7fca08113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 --2- 172.21.15.82:0/964366371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca080fcab0 0x7fca081144c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 >> 172.21.15.82:0/964366371 conn(0x7fca080f6bb0 msgr2=0x7fca080f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:28.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 shutdown_connections 2024-04-27T07:35:28.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.583+0000 7fca0f34c700 1 -- 172.21.15.82:0/964366371 wait complete. 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.684+0000 7fc4168d0700 1 -- 172.21.15.82:0/1622446559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fc720 msgr2=0x7fc4100fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 --2- 172.21.15.82:0/1622446559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fc720 0x7fc4100fcb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc404004940 tx=0x7fc404009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 -- 172.21.15.82:0/1622446559 shutdown_connections 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 --2- 172.21.15.82:0/1622446559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fc720 0x7fc4100fcb90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 --2- 172.21.15.82:0/1622446559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fb470 0x7fc4100fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 -- 172.21.15.82:0/1622446559 >> 172.21.15.82:0/1622446559 conn(0x7fc4100f6bd0 msgr2=0x7fc4100f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 -- 172.21.15.82:0/1622446559 shutdown_connections 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 -- 172.21.15.82:0/1622446559 wait complete. 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 Processor -- start 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 -- start start 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.685+0000 7fc4168d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc4168d0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fc720 0x7fc410112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc4168d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410112c70 con 0x7fc4100fb470 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc4168d0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410112db0 con 0x7fc4100fc720 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49814/0 (socket says 172.21.15.82:49814) 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 -- 172.21.15.82:0/3630540194 learned_addr learned my addr 172.21.15.82:0/3630540194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40f7fe700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fc720 0x7fc410112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 -- 172.21.15.82:0/3630540194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fc720 msgr2=0x7fc410112730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fc720 0x7fc410112730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 -- 172.21.15.82:0/3630540194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404005040 con 0x7fc4100fb470 2024-04-27T07:35:28.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40ffff700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c830 tx=0x7fc400004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4000106f0 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc400010d20 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc410112fb0 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4000113a0 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.686+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410113540 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.687+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41004c710 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.688+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 92791+0+0 (secure 0 0 0) 0x7fc400012400 con 0x7fc4100fb470 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.688+0000 7fc40cff9700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 0x7fc3f8071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.688+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc40008e7d0 con 0x7fc4100fb470 2024-04-27T07:35:28.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.688+0000 7fc40f7fe700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 0x7fc3f8071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:28.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.689+0000 7fc40f7fe700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 0x7fc3f8071140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b970 tx=0x7fc404009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.693+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc40005b1a0 con 0x7fc4100fb470 2024-04-27T07:35:28.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.979+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc410113790 con 0x7fc4100fb470 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: pgmap v4: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: mgrmap e37: smithi082.hhlhmf(active, since 2s), standbys: smithi100.eparbe 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3408646461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:28.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:28 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2296561498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:35:28.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.980+0000 7fc40cff9700 1 -- 172.21.15.82:0/3630540194 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc40005ad30 con 0x7fc4100fb470 2024-04-27T07:35:28.983 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:28.983 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:28.983 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.982+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 msgr2=0x7fc3f8071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.982+0000 7fc4168d0700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 0x7fc3f8071140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc40400b970 tx=0x7fc404009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 msgr2=0x7fc4100f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c830 tx=0x7fc400004470 comp rx=0 tx=0).stop 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 shutdown_connections 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc3f806ec90 0x7fc3f8071140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4100fb470 0x7fc4100f8760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 --2- 172.21.15.82:0/3630540194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4100fc720 0x7fc410112730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:28.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 >> 172.21.15.82:0/3630540194 conn(0x7fc4100f6bd0 msgr2=0x7fc4100ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:28.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 shutdown_connections 2024-04-27T07:35:28.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:28.983+0000 7fc4168d0700 1 -- 172.21.15.82:0/3630540194 wait complete. 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: pgmap v4: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: mgrmap e37: smithi082.hhlhmf(active, since 2s), standbys: smithi100.eparbe 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3408646461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:28 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/2296561498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:35:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:29 smithi082 ceph-mon[91103]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:29 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3630540194' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:35:30.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:29 smithi100 ceph-mon[34183]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:35:30.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:29 smithi100 ceph-mon[34183]: from='client.? 172.21.15.82:0/3630540194' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:35:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:30 smithi082 ceph-mon[91103]: pgmap v5: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:30 smithi082 ceph-mon[91103]: mgrmap e38: smithi082.hhlhmf(active, since 4s), standbys: smithi100.eparbe 2024-04-27T07:35:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:30 smithi100 ceph-mon[34183]: pgmap v5: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:30 smithi100 ceph-mon[34183]: mgrmap e38: smithi082.hhlhmf(active, since 4s), standbys: smithi100.eparbe 2024-04-27T07:35:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:30 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:30 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:32 smithi082 ceph-mon[91103]: pgmap v6: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:32.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:32 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:32 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:32 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:32 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:32.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:32 smithi100 ceph-mon[34183]: pgmap v6: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-27T07:35:33.792 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:33 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:33.793 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:33 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:33.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:33 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:33.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:33 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:34.662 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:34 smithi100 ceph-mon[34183]: pgmap v7: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T07:35:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:34 smithi082 ceph-mon[91103]: pgmap v7: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T07:35:36.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.conf 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.conf 2024-04-27T07:35:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:36.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:35 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.062 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: pgmap v8: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:37.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:36 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-27T07:35:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:35:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-27T07:35:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:35:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: Updating smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: pgmap v8: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:35:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: Upgrade: Updating mon.smithi100 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: Deploying daemon mon.smithi100 on smithi100 2024-04-27T07:35:38.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:38 smithi100 ceph-mon[34183]: pgmap v9: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: Upgrade: Updating mon.smithi100 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: Deploying daemon mon.smithi100 on smithi100 2024-04-27T07:35:38.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:38 smithi082 ceph-mon[91103]: pgmap v9: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T07:35:39.484 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:35:39.892 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100[34179]: 2024-04-27T07:35:39.481+0000 7fc3f794f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:35:39.893 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100[34179]: 2024-04-27T07:35:39.481+0000 7fc3f794f700 -1 mon.smithi100@1(peon) e2 *** Got Signal Terminated *** 2024-04-27T07:35:39.893 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 podman[80233]: 2024-04-27 07:35:39.604432228 +0000 UTC m=+0.233304516 container died 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-27T07:35:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 podman[80233]: 2024-04-27 07:35:39.98984023 +0000 UTC m=+0.618712524 container cleanup 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-27T07:35:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:39 smithi100 bash[80233]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100 2024-04-27T07:35:40.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 podman[80247]: 2024-04-27 07:35:40.216000177 +0000 UTC m=+0.609957253 container remove 81a8d0397b9bc160b1b6753ab898019b541555fde05d874f59046076a7f91e33 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5) 2024-04-27T07:35:40.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi100.service: Deactivated successfully. 2024-04-27T07:35:40.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 systemd[1]: Stopped Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:35:40.538 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi100.service: Consumed 5.863s CPU time. 2024-04-27T07:35:40.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 systemd[1]: Starting Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:35:40.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 podman[80379]: 2024-04-27 07:35:40.654488041 +0000 UTC m=+0.017722669 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:35:40.868 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 podman[80379]: 2024-04-27 07:35:40.761081276 +0000 UTC m=+0.124315875 container create 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b) 2024-04-27T07:35:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 podman[80379]: 2024-04-27 07:35:40.972164055 +0000 UTC m=+0.335398671 container init 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-c37f63b) 2024-04-27T07:35:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 podman[80379]: 2024-04-27 07:35:40.975255432 +0000 UTC m=+0.338490039 container start 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, org.label-schema.license=GPLv2) 2024-04-27T07:35:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 ceph-mon[80397]: set uid:gid to 167:167 (ceph:ceph) 2024-04-27T07:35:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 ceph-mon[80397]: ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev), process ceph-mon, pid 2 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:40 smithi100 ceph-mon[80397]: pidfile_write: ignore empty --pid-file 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: load: jerasure load: lrc 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: RocksDB version: 7.9.2 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Git sha 0 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Compile date 2024-04-24 00:04:22 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: DB SUMMARY 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: DB Session ID: Z6ESPA7YC8EVAQTVRY52 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: CURRENT file: CURRENT 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: IDENTITY file: IDENTITY 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1084 Bytes 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi100/store.db dir, Total Num: 1, files: 000027.sst 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi100/store.db: 000025.log size: 186 ; 2024-04-27T07:35:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.error_if_exists: 0 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.create_if_missing: 0 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.paranoid_checks: 1 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.env: 0x5606b6103cc0 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.fs: PosixFileSystem 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.info_log: 0x5606b7481ae0 2024-04-27T07:35:41.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_file_opening_threads: 16 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.statistics: (nil) 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.use_fsync: 0 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_log_file_size: 0 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.keep_log_file_num: 1000 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.recycle_log_file_num: 0 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_fallocate: 1 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_mmap_reads: 0 2024-04-27T07:35:41.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_mmap_writes: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.use_direct_reads: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.create_missing_column_families: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.db_log_dir: 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.wal_dir: 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.advise_random_on_open: 1 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.db_write_buffer_size: 0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.write_buffer_manager: 0x5606b74510e0 2024-04-27T07:35:41.172 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.rate_limiter: (nil) 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.wal_recovery_mode: 2 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enable_thread_tracking: 0 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enable_pipelined_write: 0 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.unordered_write: 0 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.row_cache: None 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.wal_filter: None 2024-04-27T07:35:41.173 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_ingest_behind: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.two_write_queues: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.manual_wal_flush: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.wal_compression: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.atomic_flush: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.log_readahead_size: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.best_efforts_recovery: 0 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-27T07:35:41.174 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.allow_data_in_errors: 0 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.db_host_id: __hostname__ 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_background_jobs: 2 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_background_compactions: -1 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_subcompactions: 1 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_total_wal_size: 0 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-27T07:35:41.175 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_open_files: -1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bytes_per_sync: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_readahead_size: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_background_flushes: -1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Compression algorithms supported: 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kZSTD supported: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kXpressCompression supported: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kLZ4HCCompression supported: 1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kZlibCompression supported: 1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kSnappyCompression supported: 1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kLZ4Compression supported: 1 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: kBZip2Compression supported: 0 2024-04-27T07:35:41.176 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.merge_operator: 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_filter: None 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_filter_factory: None 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.sst_partitioner_factory: None 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5606b7481cc0) 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-27T07:35:41.177 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_type: 0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_index_type: 0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_shortening: 1 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: checksum: 4 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: no_block_cache: 0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache: 0x5606b74831f0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_options: 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: capacity : 536870912 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_shard_bits : 4 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: strict_capacity_limit : 0 2024-04-27T07:35:41.178 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_cache_compressed: (nil) 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: persistent_cache: (nil) 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size: 4096 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_size_deviation: 10 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_restart_interval: 16 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: index_block_restart_interval: 1 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_block_size: 4096 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: partition_filters: 0 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: use_delta_encoding: 1 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: filter_policy: bloomfilter 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: whole_key_filtering: 1 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: verify_compression: 0 2024-04-27T07:35:41.179 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: format_version: 5 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_index_compression: 1 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: block_align: 0 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_auto_readahead_size: 262144 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: prepopulate_block_cache: 0 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: initial_auto_readahead_size: 8192 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.write_buffer_size: 33554432 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_write_buffer_number: 2 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression: NoCompression 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression: Disabled 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.prefix_extractor: nullptr 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-27T07:35:41.180 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.num_levels: 7 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.level: 32767 2024-04-27T07:35:41.181 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.strategy: 0 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.enabled: false 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.target_file_size_base: 67108864 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-27T07:35:41.182 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.arena_block_size: 1048576 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.disable_auto_compactions: 0 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-27T07:35:41.183 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.inplace_update_support: 0 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-27T07:35:41.184 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.bloom_locality: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.max_successive_merges: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.paranoid_file_checks: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.force_consistency_checks: 1 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.report_bg_io_stats: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.ttl: 2592000 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enable_blob_files: false 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.min_blob_size: 0 2024-04-27T07:35:41.185 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_file_size: 268435456 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.blob_file_starting_level: 0 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi100/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12303, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cfde7b78-d42f-4d05-92ae-f47a83b27ae1 2024-04-27T07:35:41.186 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203341004997, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203341005379, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1327, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12304, "largest_seqno": 12304, "table_properties": {"data_size": 188, "index_size": 45, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 35, "raw_average_key_size": 35, "raw_value_size": 136, "raw_average_value_size": 136, "num_data_blocks": 1, "num_entries": 1, "num_filter_entries": 1, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714203341, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cfde7b78-d42f-4d05-92ae-f47a83b27ae1", "db_session_id": "Z6ESPA7YC8EVAQTVRY52", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714203341005462, "job": 1, "event": "recovery_finished"} 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi100/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5606b759a000 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: DB pointer 0x5606b7584000 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** DB Stats ** 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:41.187 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L0 1/0 1.30 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: L6 1/0 8.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Sum 2/0 8.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** Compaction Stats [default] ** 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-27T07:35:41.188 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Interval compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-27T07:35:41.189 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache BinnedLRUCache@0x5606b74831f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.12 KB,2.38419e-05%) Misc(1,0.00 KB,0%) 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: starting mon.smithi100 rank 1 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi100 fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???) e2 preinit fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).mds e17 new map 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).mds e17 print_map 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: e17 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: legacy client fscid: 1 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.190 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: Filesystem 'cephfs' (1) 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: fs_name cephfs 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: epoch 17 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: tableserver 0 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: root 0 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_timeout 60 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: session_autoclose 300 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_file_size 1099511627776 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_xattr_size 65536 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: required_client_features {} 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure 0 2024-04-27T07:35:41.191 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: last_failure_osd_epoch 0 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: max_mds 2 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: in 0,1 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: up {0=14464,1=24269} 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: failed 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: damaged 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: stopped 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: data_pools [3] 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: metadata_pool 2 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: inline_data enabled 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: balancer 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: bal_rank_mask -1 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: standby_count_wanted 1 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: qdb_cluster leader: 0 members: 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:41.192 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: [mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout: 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 ceph-mon[80397]: mon.smithi100@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 bash[80379]: 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 2024-04-27T07:35:41.193 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:41 smithi100 systemd[1]: Started Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:35:42.545 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:42.545 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:42.545 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: mgrmap e38: smithi082.hhlhmf(active, since 15s), standbys: smithi100.eparbe 2024-04-27T07:35:42.545 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.545 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: mon.smithi082 calling monitor election 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: mon.smithi100 calling monitor election 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: monmap epoch 3 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: last_changed 2024-04-27T07:35:41.216587+0000 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: created 2024-04-27T07:23:23.367897+0000 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: min_mon_release 19 (squid) 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: election_strategy: 1 2024-04-27T07:35:42.546 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: mgrmap e38: smithi082.hhlhmf(active, since 15s), standbys: smithi100.eparbe 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: pgmap v11: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.547 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: mgrmap e38: smithi082.hhlhmf(active, since 15s), standbys: smithi100.eparbe 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: mon.smithi082 calling monitor election 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: mon.smithi100 calling monitor election 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-04-27T07:35:42.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: mon.smithi082 is new leader, mons smithi082,smithi100 in quorum (ranks 0,1) 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: monmap epoch 3 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: fsid ebadc0d6-0466-11ef-bc93-c7b262605968 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: last_changed 2024-04-27T07:35:41.216587+0000 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: created 2024-04-27T07:23:23.367897+0000 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: min_mon_release 19 (squid) 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: election_strategy: 1 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.smithi100 2024-04-27T07:35:42.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: osdmap e49: 6 total, 6 up, 6 in 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: mgrmap e38: smithi082.hhlhmf(active, since 15s), standbys: smithi100.eparbe 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mon metadata", "id": "smithi100"}]: dispatch 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: pgmap v11: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:42.596 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:45.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:44 smithi082 ceph-mon[91103]: pgmap v12: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T07:35:45.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:45.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:44 smithi100 ceph-mon[80397]: pgmap v12: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T07:35:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:46 smithi082 ceph-mon[91103]: pgmap v13: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:46 smithi100 ceph-mon[80397]: pgmap v13: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:49.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:48 smithi082 ceph-mon[91103]: pgmap v14: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:49.124 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:48 smithi100 ceph-mon[80397]: pgmap v14: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: Reconfiguring mon.smithi082 (monmap changed)... 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: Reconfiguring daemon mon.smithi082 on smithi082 2024-04-27T07:35:50.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:50 smithi082 ceph-mon[91103]: pgmap v15: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: Reconfiguring mon.smithi082 (monmap changed)... 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:35:50.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:35:50.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:50.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: Reconfiguring daemon mon.smithi082 on smithi082 2024-04-27T07:35:50.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:50 smithi100 ceph-mon[80397]: pgmap v15: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: Reconfiguring mgr.smithi082.hhlhmf (monmap changed)... 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:52.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: Reconfiguring daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:35:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:52 smithi082 ceph-mon[91103]: pgmap v16: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:35:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: Reconfiguring mgr.smithi082.hhlhmf (monmap changed)... 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.hhlhmf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: Reconfiguring daemon mgr.smithi082.hhlhmf on smithi082 2024-04-27T07:35:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:52 smithi100 ceph-mon[80397]: pgmap v16: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: Reconfiguring crash.smithi082 (monmap changed)... 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:54.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:53 smithi082 ceph-mon[91103]: Reconfiguring daemon crash.smithi082 on smithi082 2024-04-27T07:35:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: Reconfiguring crash.smithi082 (monmap changed)... 2024-04-27T07:35:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:35:54.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:54.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:53 smithi100 ceph-mon[80397]: Reconfiguring daemon crash.smithi082 on smithi082 2024-04-27T07:35:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:54 smithi082 ceph-mon[91103]: pgmap v17: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:35:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:54 smithi100 ceph-mon[80397]: pgmap v17: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:35:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:56.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:55 smithi082 ceph-mon[91103]: Reconfiguring osd.0 (monmap changed)... 2024-04-27T07:35:56.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:55 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.0 on smithi082 2024-04-27T07:35:56.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:55 smithi100 ceph-mon[80397]: Reconfiguring osd.0 (monmap changed)... 2024-04-27T07:35:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:55 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.0 on smithi082 2024-04-27T07:35:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:35:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:56 smithi082 ceph-mon[91103]: pgmap v18: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:35:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:56 smithi100 ceph-mon[80397]: pgmap v18: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:35:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:57.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:35:57.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:57 smithi100 ceph-mon[80397]: Reconfiguring osd.1 (monmap changed)... 2024-04-27T07:35:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:57 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.1 on smithi082 2024-04-27T07:35:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:57 smithi082 ceph-mon[91103]: Reconfiguring osd.1 (monmap changed)... 2024-04-27T07:35:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:57 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.1 on smithi082 2024-04-27T07:35:58.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:58 smithi082 ceph-mon[91103]: pgmap v19: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:58.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:58.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:58.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:35:58.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:59.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- 172.21.15.82:0/2973368429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 msgr2=0x7f6eb40fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/2973368429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb40fd3e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4004940 tx=0x7f6ea4009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- 172.21.15.82:0/2973368429 shutdown_connections 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/2973368429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb40fd3e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/2973368429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 0x7f6eb40fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- 172.21.15.82:0/2973368429 >> 172.21.15.82:0/2973368429 conn(0x7f6eb40f7440 msgr2=0x7f6eb40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- 172.21.15.82:0/2973368429 shutdown_connections 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- 172.21.15.82:0/2973368429 wait complete. 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 Processor -- start 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- start start 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 0x7f6eb4066cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4112c60 con 0x7f6eb40fcf70 2024-04-27T07:35:59.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6ebc11f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4112da0 con 0x7f6eb40fbcc0 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.090+0000 7f6eb96ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43752/0 (socket says 172.21.15.82:43752) 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 -- 172.21.15.82:0/521906302 learned_addr learned my addr 172.21.15.82:0/521906302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb9ebb700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 0x7f6eb4066cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 -- 172.21.15.82:0/521906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 msgr2=0x7f6eb4066cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 0x7f6eb4066cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 -- 172.21.15.82:0/521906302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4005040 con 0x7f6eb40fcf70 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eb96ba700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009150 tx=0x7f6ea4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ea400e040 con 0x7f6eb40fcf70 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ea4004290 con 0x7f6eb40fcf70 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ea401c630 con 0x7f6eb40fcf70 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4112fd0 con 0x7f6eb40fcf70 2024-04-27T07:35:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.091+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4113560 con 0x7f6eb40fcf70 2024-04-27T07:35:59.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.092+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb404c710 con 0x7f6eb40fcf70 2024-04-27T07:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.093+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6ea400bbf0 con 0x7f6eb40fcf70 2024-04-27T07:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.093+0000 7f6eaa7fc700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 0x7f6ea00711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.093+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6ea408f5f0 con 0x7f6eb40fcf70 2024-04-27T07:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.093+0000 7f6eb9ebb700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 0x7f6ea00711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.094+0000 7f6eb9ebb700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 0x7f6ea00711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0007fd0 tx=0x7f6eb0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.098+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6ea405bdd0 con 0x7f6eb40fcf70 2024-04-27T07:35:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:58 smithi100 ceph-mon[80397]: pgmap v19: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:35:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:35:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:35:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:35:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.328+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eb41012e0 con 0x7f6ea006ed30 2024-04-27T07:35:59.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.329+0000 7f6eaa7fc700 1 -- 172.21.15.82:0/521906302 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6eb41012e0 con 0x7f6ea006ed30 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 msgr2=0x7f6ea00711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 0x7f6ea00711e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0007fd0 tx=0x7f6eb0009040 comp rx=0 tx=0).stop 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 msgr2=0x7f6eb4112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009150 tx=0x7f6ea4009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 shutdown_connections 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6ea006ed30 0x7f6ea00711e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb40fbcc0 0x7f6eb4066cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 --2- 172.21.15.82:0/521906302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb40fcf70 0x7f6eb4112720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 >> 172.21.15.82:0/521906302 conn(0x7f6eb40f7440 msgr2=0x7f6eb40f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 shutdown_connections 2024-04-27T07:35:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.331+0000 7f6ebc11f700 1 -- 172.21.15.82:0/521906302 wait complete. 2024-04-27T07:35:59.344 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:35:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 -- 172.21.15.82:0/3508354015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fbcb0 msgr2=0x7f492c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 --2- 172.21.15.82:0/3508354015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fbcb0 0x7f492c0fc0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f491c004940 tx=0x7f491c009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 -- 172.21.15.82:0/3508354015 shutdown_connections 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 --2- 172.21.15.82:0/3508354015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fcf60 0x7f492c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 --2- 172.21.15.82:0/3508354015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fbcb0 0x7f492c0fc0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 -- 172.21.15.82:0/3508354015 >> 172.21.15.82:0/3508354015 conn(0x7f492c0f7430 msgr2=0x7f492c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 -- 172.21.15.82:0/3508354015 shutdown_connections 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 -- 172.21.15.82:0/3508354015 wait complete. 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.435+0000 7f49327f8700 1 Processor -- start 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f49327f8700 1 -- start start 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f49327f8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fbcb0 0x7f492c110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f49327f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f49327f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c066370 con 0x7f492c0fcf60 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f49327f8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0664b0 con 0x7f492c0fbcb0 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43772/0 (socket says 172.21.15.82:43772) 2024-04-27T07:35:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 -- 172.21.15.82:0/3364365766 learned_addr learned my addr 172.21.15.82:0/3364365766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492bfff700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fbcb0 0x7f492c110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 -- 172.21.15.82:0/3364365766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fbcb0 msgr2=0x7f492c110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fbcb0 0x7f492c110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 -- 172.21.15.82:0/3364365766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c005040 con 0x7f492c0fcf60 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f492b7fe700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f491400b790 tx=0x7f4914009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.436+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491400f770 con 0x7f492c0fcf60 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.437+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f491400fda0 con 0x7f492c0fcf60 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.437+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c1132b0 con 0x7f492c0fcf60 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.437+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491400d310 con 0x7f492c0fcf60 2024-04-27T07:35:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.437+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c113870 con 0x7f492c0fcf60 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.437+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c05f5c0 con 0x7f492c0fcf60 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.438+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4914010420 con 0x7f492c0fcf60 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.438+0000 7f4928ff9700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 0x7f49180711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.438+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f491408e9a0 con 0x7f492c0fcf60 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.439+0000 7f492bfff700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 0x7f49180711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.439+0000 7f492bfff700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 0x7f49180711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b970 tx=0x7f491c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.443+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4914057760 con 0x7f492c0fcf60 2024-04-27T07:35:59.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.669+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f492c101250 con 0x7f491806ed20 2024-04-27T07:35:59.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.670+0000 7f4928ff9700 1 -- 172.21.15.82:0/3364365766 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f492c101250 con 0x7f491806ed20 2024-04-27T07:35:59.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 msgr2=0x7f49180711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 0x7f49180711d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b970 tx=0x7f491c009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:59.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 msgr2=0x7f492c112cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f491400b790 tx=0x7f4914009250 comp rx=0 tx=0).stop 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 shutdown_connections 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f491806ed20 0x7f49180711d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f492c0fbcb0 0x7f492c110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 --2- 172.21.15.82:0/3364365766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f492c0fcf60 0x7f492c112cb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 >> 172.21.15.82:0/3364365766 conn(0x7f492c0f7430 msgr2=0x7f492c0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 shutdown_connections 2024-04-27T07:35:59.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.672+0000 7f49327f8700 1 -- 172.21.15.82:0/3364365766 wait complete. 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 -- 172.21.15.82:0/34227515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 msgr2=0x7f4d2c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 --2- 172.21.15.82:0/34227515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c0fe440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c004940 tx=0x7f4d1c009e30 comp rx=0 tx=0).stop 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 -- 172.21.15.82:0/34227515 shutdown_connections 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 --2- 172.21.15.82:0/34227515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c0fe440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 --2- 172.21.15.82:0/34227515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 -- 172.21.15.82:0/34227515 >> 172.21.15.82:0/34227515 conn(0x7f4d2c0f8540 msgr2=0x7f4d2c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:35:59.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 -- 172.21.15.82:0/34227515 shutdown_connections 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.774+0000 7f4d332e7700 1 -- 172.21.15.82:0/34227515 wait complete. 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 Processor -- start 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 -- start start 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c10d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c10e4f0 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d332e7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c112e90 con 0x7f4d2c0fce60 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d30882700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d30882700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43782/0 (socket says 172.21.15.82:43782) 2024-04-27T07:35:59.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.775+0000 7f4d30882700 1 -- 172.21.15.82:0/1597523855 learned_addr learned my addr 172.21.15.82:0/1597523855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d31083700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c10d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d30882700 1 -- 172.21.15.82:0/1597523855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 msgr2=0x7f4d2c10d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d30882700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c10d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d30882700 1 -- 172.21.15.82:0/1597523855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c005040 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d31083700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d30882700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009150 tx=0x7f4d1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c00e040 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d1c00bcc0 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c113090 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d1c01c630 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.776+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c113600 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.777+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c04c710 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.778+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f4d1c013420 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.778+0000 7f4d21ffb700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 0x7f4d180711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:35:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.778+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4d1c08f750 con 0x7f4d2c0fdfd0 2024-04-27T07:35:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.778+0000 7f4d31083700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 0x7f4d180711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:35:59.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.779+0000 7f4d31083700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 0x7f4d180711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009b10 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:35:59.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:35:59.783+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4d1c05bf30 con 0x7f4d2c0fdfd0 2024-04-27T07:36:00.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.003+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d2c1022f0 con 0x7f4d1806ed30 2024-04-27T07:36:00.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:59 smithi082 ceph-mon[91103]: Reconfiguring osd.2 (monmap changed)... 2024-04-27T07:36:00.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:59 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.2 on smithi082 2024-04-27T07:36:00.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:35:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:00.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.013+0000 7f4d21ffb700 1 -- 172.21.15.82:0/1597523855 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4d2c1022f0 con 0x7f4d1806ed30 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (2m) 28s ago 10m 25.7M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (11m) 28s ago 11m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 578304924e36 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (10m) 15s ago 10m 6660k - 17.2.7-907-g2be3efa9 1c5834633715 85176ec451bb 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (2m) 28s ago 10m 82.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:36:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (5m) 28s ago 5m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (5m) 28s ago 5m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (5m) 15s ago 5m 64.4M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (5m) 15s ago 5m 120M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (102s) 28s ago 12m 474M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (58s) 15s ago 9m 448M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (43s) 28s ago 12m 30.7M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (19s) 15s ago 9m 19.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (2m) 28s ago 11m 16.4M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 15s ago 10m 14.9M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:36:00.017 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (9m) 28s ago 9m 190M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (8m) 28s ago 8m 199M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (8m) 28s ago 8m 156M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (7m) 15s ago 7m 219M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (7m) 15s ago 7m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (6m) 15s ago 6m 187M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:36:00.018 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (64s) 28s ago 10m 47.6M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 msgr2=0x7f4d180711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 0x7f4d180711e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009b10 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 msgr2=0x7f4d2c10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009150 tx=0x7f4d1c009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 shutdown_connections 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4d1806ed30 0x7f4d180711e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0fce60 0x7f4d2c10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 --2- 172.21.15.82:0/1597523855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d2c0fdfd0 0x7f4d2c10de60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.015+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 >> 172.21.15.82:0/1597523855 conn(0x7f4d2c0f8540 msgr2=0x7f4d2c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.016+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 shutdown_connections 2024-04-27T07:36:00.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.016+0000 7f4d332e7700 1 -- 172.21.15.82:0/1597523855 wait complete. 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 -- 172.21.15.82:0/1650783769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 msgr2=0x7fb9b4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 --2- 172.21.15.82:0/1650783769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b4102320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4004940 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 -- 172.21.15.82:0/1650783769 shutdown_connections 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 --2- 172.21.15.82:0/1650783769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b4102320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 --2- 172.21.15.82:0/1650783769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 0x7fb9b40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 -- 172.21.15.82:0/1650783769 >> 172.21.15.82:0/1650783769 conn(0x7fb9b40f7430 msgr2=0x7fb9b40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 -- 172.21.15.82:0/1650783769 shutdown_connections 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.120+0000 7fb9b9542700 1 -- 172.21.15.82:0/1650783769 wait complete. 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 Processor -- start 2024-04-27T07:36:00.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 -- start start 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 0x7fb9b410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410e520 con 0x7fb9b40fff40 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b9542700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b410ed70 con 0x7fb9b4066260 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43800/0 (socket says 172.21.15.82:43800) 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 -- 172.21.15.82:0/677523522 learned_addr learned my addr 172.21.15.82:0/677523522 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b2ffd700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 0x7fb9b410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 -- 172.21.15.82:0/677523522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 msgr2=0x7fb9b410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 0x7fb9b410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.121+0000 7fb9b27fc700 1 -- 172.21.15.82:0/677523522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4005040 con 0x7fb9b40fff40 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb9b27fc700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400b3b0 tx=0x7fb9a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a400e040 con 0x7fb9b40fff40 2024-04-27T07:36:00.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9a4004290 con 0x7fb9b40fff40 2024-04-27T07:36:00.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b410eff0 con 0x7fb9b40fff40 2024-04-27T07:36:00.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a401c3f0 con 0x7fb9b40fff40 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.122+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b410f530 con 0x7fb9b40fff40 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.123+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b405f5c0 con 0x7fb9b40fff40 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.124+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fb9a400bbf0 con 0x7fb9b40fff40 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.124+0000 7fb99b7fe700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 0x7fb99c070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.124+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb9a408fa90 con 0x7fb9b40fff40 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.124+0000 7fb9b2ffd700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 0x7fb99c070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.125+0000 7fb9b2ffd700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 0x7fb99c070fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4065fa0 tx=0x7fb9a800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.129+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb9a405c270 con 0x7fb9b40fff40 2024-04-27T07:36:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:59 smithi100 ceph-mon[80397]: Reconfiguring osd.2 (monmap changed)... 2024-04-27T07:36:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:59 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.2 on smithi082 2024-04-27T07:36:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:35:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:00.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.430+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9b410f7a0 con 0x7fb9b40fff40 2024-04-27T07:36:00.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.430+0000 7fb99b7fe700 1 -- 172.21.15.82:0/677523522 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fb9a4004490 con 0x7fb9b40fff40 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:36:00.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:00.434 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:36:00.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 10, 2024-04-27T07:36:00.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:36:00.434 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:36:00.434 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 msgr2=0x7fb99c070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 0x7fb99c070fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4065fa0 tx=0x7fb9a800b040 comp rx=0 tx=0).stop 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 msgr2=0x7fb9b410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400b3b0 tx=0x7fb9a4009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 shutdown_connections 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb99c06eb10 0x7fb99c070fc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4066260 0x7fb9b410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 --2- 172.21.15.82:0/677523522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9b40fff40 0x7fb9b410df20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 >> 172.21.15.82:0/677523522 conn(0x7fb9b40f7430 msgr2=0x7fb9b40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 shutdown_connections 2024-04-27T07:36:00.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.433+0000 7fb9b9542700 1 -- 172.21.15.82:0/677523522 wait complete. 2024-04-27T07:36:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 -- 172.21.15.82:0/639209484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c0fffd0 msgr2=0x7f3b0c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 --2- 172.21.15.82:0/639209484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c1023b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3afc004940 tx=0x7f3afc009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 -- 172.21.15.82:0/639209484 shutdown_connections 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 --2- 172.21.15.82:0/639209484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c1023b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 --2- 172.21.15.82:0/639209484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c066e90 0x7f3b0c0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 -- 172.21.15.82:0/639209484 >> 172.21.15.82:0/639209484 conn(0x7f3b0c0f7480 msgr2=0x7f3b0c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 -- 172.21.15.82:0/639209484 shutdown_connections 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.535+0000 7f3b12512700 1 -- 172.21.15.82:0/639209484 wait complete. 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 Processor -- start 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 -- start start 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c10e4a0 con 0x7f3b0c066e90 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b12512700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c10e610 con 0x7f3b0c0fffd0 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43826/0 (socket says 172.21.15.82:43826) 2024-04-27T07:36:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 -- 172.21.15.82:0/265070454 learned_addr learned my addr 172.21.15.82:0/265070454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0b7fe700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 -- 172.21.15.82:0/265070454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c0fffd0 msgr2=0x7f3b0c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c10dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.536+0000 7f3b0bfff700 1 -- 172.21.15.82:0/265070454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc005040 con 0x7f3b0c066e90 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b0bfff700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b00002a50 tx=0x7f3b00004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b00007cc0 con 0x7f3b0c066e90 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c113070 con 0x7f3b0c066e90 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b0000f040 con 0x7f3b0c066e90 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0000da40 con 0x7f3b0c066e90 2024-04-27T07:36:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.537+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c113630 con 0x7f3b0c066e90 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.538+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c04c710 con 0x7f3b0c066e90 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.538+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f3b0000dcb0 con 0x7f3b0c066e90 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.539+0000 7f3b08ff9700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 0x7f3af40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.539+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3b0008e7b0 con 0x7f3b0c066e90 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.539+0000 7f3b0b7fe700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 0x7f3af40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.539+0000 7f3b0b7fe700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 0x7f3af40711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00b970 tx=0x7f3afc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.543+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3b0005af10 con 0x7f3b0c066e90 2024-04-27T07:36:00.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.801+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b0c1058f0 con 0x7f3b0c066e90 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.801+0000 7f3b08ff9700 1 -- 172.21.15.82:0/265070454 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1932 (secure 0 0 0) 0x7f3b0005aaa0 con 0x7f3b0c066e90 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:36:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:36:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:36:00.806 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:00.807 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 msgr2=0x7f3af40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 0x7f3af40711e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00b970 tx=0x7f3afc009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 msgr2=0x7f3b0c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b00002a50 tx=0x7f3b00004600 comp rx=0 tx=0).stop 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 shutdown_connections 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3af406ed30 0x7f3af40711e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b0c066e90 0x7f3b0c10d960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 --2- 172.21.15.82:0/265070454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b0c0fffd0 0x7f3b0c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.803+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 >> 172.21.15.82:0/265070454 conn(0x7f3b0c0f7480 msgr2=0x7f3b0c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.804+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 shutdown_connections 2024-04-27T07:36:00.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.804+0000 7f3b12512700 1 -- 172.21.15.82:0/265070454 wait complete. 2024-04-27T07:36:00.809 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 -- 172.21.15.82:0/4145214550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fcf70 msgr2=0x7f930c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 --2- 172.21.15.82:0/4145214550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fcf70 0x7f930c0fd3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9300004940 tx=0x7f9300009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 -- 172.21.15.82:0/4145214550 shutdown_connections 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 --2- 172.21.15.82:0/4145214550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fcf70 0x7f930c0fd3e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 --2- 172.21.15.82:0/4145214550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fbcc0 0x7f930c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 -- 172.21.15.82:0/4145214550 >> 172.21.15.82:0/4145214550 conn(0x7f930c0f7440 msgr2=0x7f930c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 -- 172.21.15.82:0/4145214550 shutdown_connections 2024-04-27T07:36:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.908+0000 7f931149a700 1 -- 172.21.15.82:0/4145214550 wait complete. 2024-04-27T07:36:00.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 Processor -- start 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 -- start start 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fcf70 0x7f930c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c112cc0 con 0x7f930c0fbcc0 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f931149a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c112e00 con 0x7f930c0fcf70 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.909+0000 7f930affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43842/0 (socket says 172.21.15.82:43842) 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 -- 172.21.15.82:0/3286948178 learned_addr learned my addr 172.21.15.82:0/3286948178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930a7fc700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fcf70 0x7f930c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 -- 172.21.15.82:0/3286948178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fcf70 msgr2=0x7f930c112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:00.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fcf70 0x7f930c112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 -- 172.21.15.82:0/3286948178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300005040 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f930affd700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92fc002a50 tx=0x7f92fc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc007cc0 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92fc00f040 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c113060 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc00da30 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.910+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c1135d0 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.911+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c04c710 con 0x7f930c0fbcc0 2024-04-27T07:36:00.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.912+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f92fc00db90 con 0x7f930c0fbcc0 2024-04-27T07:36:00.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.912+0000 7f92f37fe700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 0x7f92f40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:00.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.912+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f92fc08e800 con 0x7f930c0fbcc0 2024-04-27T07:36:00.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.912+0000 7f930a7fc700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 0x7f92f40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:00.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.913+0000 7f930a7fc700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 0x7f92f40711e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f930000b970 tx=0x7f9300009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:00.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:00.917+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92fc05af60 con 0x7f930c0fbcc0 2024-04-27T07:36:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: pgmap v20: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: Reconfiguring mds.cephfs.smithi082.vlqbei (monmap changed)... 2024-04-27T07:36:01.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:01.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:01.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: Reconfiguring daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:36:01.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/677523522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:01.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:00 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/265070454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: pgmap v20: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: Reconfiguring mds.cephfs.smithi082.vlqbei (monmap changed)... 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: Reconfiguring daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/677523522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:01.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:00 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/265070454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:36:01.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.140+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f930c1012e0 con 0x7f92f406ed30 2024-04-27T07:36:01.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.141+0000 7f92f37fe700 1 -- 172.21.15.82:0/3286948178 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f930c1012e0 con 0x7f92f406ed30 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:36:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "4/21 daemons upgraded", 2024-04-27T07:36:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mon daemons", 2024-04-27T07:36:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:36:01.145 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:36:01.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.143+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 msgr2=0x7f92f40711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.143+0000 7f931149a700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 0x7f92f40711e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f930000b970 tx=0x7f9300009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:01.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.143+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 msgr2=0x7f930c066c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.143+0000 7f931149a700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92fc002a50 tx=0x7f92fc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 shutdown_connections 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92f406ed30 0x7f92f40711e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f930c0fbcc0 0x7f930c066c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 --2- 172.21.15.82:0/3286948178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f930c0fcf70 0x7f930c112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 >> 172.21.15.82:0/3286948178 conn(0x7f930c0f7440 msgr2=0x7f930c0f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 shutdown_connections 2024-04-27T07:36:01.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.144+0000 7f931149a700 1 -- 172.21.15.82:0/3286948178 wait complete. 2024-04-27T07:36:01.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 -- 172.21.15.82:0/771258182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fbcb0 msgr2=0x7f6b2c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 --2- 172.21.15.82:0/771258182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c0fc0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b20004940 tx=0x7f6b20009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 -- 172.21.15.82:0/771258182 shutdown_connections 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 --2- 172.21.15.82:0/771258182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 --2- 172.21.15.82:0/771258182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c0fc0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 -- 172.21.15.82:0/771258182 >> 172.21.15.82:0/771258182 conn(0x7f6b2c0f7430 msgr2=0x7f6b2c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 -- 172.21.15.82:0/771258182 shutdown_connections 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 -- 172.21.15.82:0/771258182 wait complete. 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.245+0000 7f6b331dd700 1 Processor -- start 2024-04-27T07:36:01.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b331dd700 1 -- start start 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b331dd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c10c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b331dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b331dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c10d440 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b331dd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c10dc90 con 0x7f6b2c0fbcb0 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43862/0 (socket says 172.21.15.82:43862) 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 -- 172.21.15.82:0/3777571049 learned_addr learned my addr 172.21.15.82:0/3777571049 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b30f79700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c10c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 -- 172.21.15.82:0/3777571049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fbcb0 msgr2=0x7f6b2c10c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c10c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 -- 172.21.15.82:0/3777571049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20005040 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.246+0000 7f6b2bfff700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c830 tx=0x7f6b18004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.247+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b1800a760 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.247+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c10df70 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.247+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b1800ad90 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.247+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b180113a0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.247+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c10e4b0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.248+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c05f5c0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.248+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6b18012400 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.249+0000 7f6b297fa700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 0x7f6b1c0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.249+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6b1808e9c0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.249+0000 7f6b30f79700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 0x7f6b1c0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.249+0000 7f6b30f79700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 0x7f6b1c0711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b20000c00 tx=0x7f6b20009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:01.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.253+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6b1805b2b0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.540+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6b2c04bed0 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.541+0000 7f6b297fa700 1 -- 172.21.15.82:0/3777571049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6b1805ae40 con 0x7f6b2c0fcf60 2024-04-27T07:36:01.543 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:36:01.543 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:36:01.543 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 msgr2=0x7f6b1c0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 0x7f6b1c0711d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6b20000c00 tx=0x7f6b20009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 msgr2=0x7f6b2c10ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c830 tx=0x7f6b18004470 comp rx=0 tx=0).stop 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 shutdown_connections 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6b1c06ed20 0x7f6b1c0711d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b2c0fbcb0 0x7f6b2c10c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 --2- 172.21.15.82:0/3777571049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b2c0fcf60 0x7f6b2c10ce40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 >> 172.21.15.82:0/3777571049 conn(0x7f6b2c0f7430 msgr2=0x7f6b2c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 shutdown_connections 2024-04-27T07:36:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:01.543+0000 7f6b331dd700 1 -- 172.21.15.82:0/3777571049 wait complete. 2024-04-27T07:36:02.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:02.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3777571049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:36:02.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:02.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:02.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:02.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:01 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3777571049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:02.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:01 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:03.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:02 smithi100 ceph-mon[80397]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:03.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:02 smithi100 ceph-mon[80397]: Reconfiguring mds.cephfs.smithi082.bqtewe (monmap changed)... 2024-04-27T07:36:03.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:02 smithi100 ceph-mon[80397]: Reconfiguring daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:36:03.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:02 smithi100 ceph-mon[80397]: pgmap v21: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:03.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:02 smithi082 ceph-mon[91103]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:03.333 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:02 smithi082 ceph-mon[91103]: Reconfiguring mds.cephfs.smithi082.bqtewe (monmap changed)... 2024-04-27T07:36:03.333 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:02 smithi082 ceph-mon[91103]: Reconfiguring daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:36:03.333 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:02 smithi082 ceph-mon[91103]: pgmap v21: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: Reconfiguring crash.smithi100 (monmap changed)... 2024-04-27T07:36:04.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:04.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:04.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: Reconfiguring daemon crash.smithi100 on smithi100 2024-04-27T07:36:04.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:04 smithi082 ceph-mon[91103]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:36:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: Reconfiguring crash.smithi100 (monmap changed)... 2024-04-27T07:36:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:04.663 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:04.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: Reconfiguring daemon crash.smithi100 on smithi100 2024-04-27T07:36:04.664 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:04 smithi100 ceph-mon[80397]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:36:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: Reconfiguring mgr.smithi100.eparbe (monmap changed)... 2024-04-27T07:36:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:36:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:36:06.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:06.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: Reconfiguring daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:36:06.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:06 smithi082 ceph-mon[91103]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: Reconfiguring mgr.smithi100.eparbe (monmap changed)... 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi100.eparbe", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: Reconfiguring daemon mgr.smithi100.eparbe on smithi100 2024-04-27T07:36:06.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:06 smithi100 ceph-mon[80397]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: Reconfiguring mon.smithi100 (monmap changed)... 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:07 smithi100 ceph-mon[80397]: Reconfiguring daemon mon.smithi100 on smithi100 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: Reconfiguring mon.smithi100 (monmap changed)... 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:08.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:07 smithi082 ceph-mon[91103]: Reconfiguring daemon mon.smithi100 on smithi100 2024-04-27T07:36:08.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:08 smithi100 ceph-mon[80397]: pgmap v24: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:08.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:08.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:08.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:36:08.977 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:08 smithi082 ceph-mon[91103]: pgmap v24: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:36:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:09.968 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:09 smithi100 ceph-mon[80397]: Reconfiguring osd.3 (monmap changed)... 2024-04-27T07:36:09.968 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:09 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.3 on smithi100 2024-04-27T07:36:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:09 smithi082 ceph-mon[91103]: Reconfiguring osd.3 (monmap changed)... 2024-04-27T07:36:10.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:09 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.3 on smithi100 2024-04-27T07:36:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:10 smithi100 ceph-mon[80397]: pgmap v25: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:36:10.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:10 smithi082 ceph-mon[91103]: pgmap v25: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:36:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: Reconfiguring osd.4 (monmap changed)... 2024-04-27T07:36:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.4 on smithi100 2024-04-27T07:36:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:36:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: Reconfiguring osd.4 (monmap changed)... 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.4 on smithi100 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:36:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:12 smithi100 ceph-mon[80397]: Reconfiguring osd.5 (monmap changed)... 2024-04-27T07:36:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:12 smithi100 ceph-mon[80397]: Reconfiguring daemon osd.5 on smithi100 2024-04-27T07:36:12.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:12 smithi100 ceph-mon[80397]: pgmap v26: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:12 smithi082 ceph-mon[91103]: Reconfiguring osd.5 (monmap changed)... 2024-04-27T07:36:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:12 smithi082 ceph-mon[91103]: Reconfiguring daemon osd.5 on smithi100 2024-04-27T07:36:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:12 smithi082 ceph-mon[91103]: pgmap v26: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: Reconfiguring mds.cephfs.smithi100.udlhfn (monmap changed)... 2024-04-27T07:36:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:14.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: Reconfiguring daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:36:14.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:14 smithi100 ceph-mon[80397]: pgmap v27: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:14.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:14.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:14.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: Reconfiguring mds.cephfs.smithi100.udlhfn (monmap changed)... 2024-04-27T07:36:14.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:14.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:14.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: Reconfiguring daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:36:14.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:14 smithi082 ceph-mon[91103]: pgmap v27: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:16.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: Reconfiguring mds.cephfs.smithi100.kjopce (monmap changed)... 2024-04-27T07:36:16.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:16.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:16.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:15 smithi082 ceph-mon[91103]: Reconfiguring daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:36:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: Reconfiguring mds.cephfs.smithi100.kjopce (monmap changed)... 2024-04-27T07:36:16.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:36:16.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:16.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:15 smithi100 ceph-mon[80397]: Reconfiguring daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:36:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: pgmap v28: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]: dispatch 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2024-04-27T07:36:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2024-04-27T07:36:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: pgmap v28: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]: dispatch 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]: dispatch 2024-04-27T07:36:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi100"}]': finished 2024-04-27T07:36:18.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:17 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all mon 2024-04-27T07:36:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:17 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all mon 2024-04-27T07:36:18.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:18 smithi082 ceph-mon[91103]: pgmap v29: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:18.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:18.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:18.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:18 smithi100 ceph-mon[80397]: pgmap v29: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:20.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:19 smithi082 ceph-mon[91103]: Upgrade: Updating crash.smithi082 (1/2) 2024-04-27T07:36:20.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:19 smithi082 ceph-mon[91103]: Deploying daemon crash.smithi082 on smithi082 2024-04-27T07:36:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:19 smithi100 ceph-mon[80397]: Upgrade: Updating crash.smithi082 (1/2) 2024-04-27T07:36:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:19 smithi100 ceph-mon[80397]: Deploying daemon crash.smithi082 on smithi082 2024-04-27T07:36:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:20 smithi100 ceph-mon[80397]: pgmap v30: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:20 smithi082 ceph-mon[91103]: pgmap v30: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:22 smithi100 ceph-mon[80397]: pgmap v31: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:22 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:22 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:22 smithi082 ceph-mon[91103]: pgmap v31: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:22 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:22 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:24.905 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:24 smithi100 ceph-mon[80397]: pgmap v32: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:24.905 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:24 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:24.905 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:24 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:24.905 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:24 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:25.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:24 smithi082 ceph-mon[91103]: pgmap v32: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:25.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:24 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:25.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:24 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi100", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-27T07:36:25.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:24 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:26.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:25 smithi100 ceph-mon[80397]: Upgrade: Updating crash.smithi100 (2/2) 2024-04-27T07:36:26.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:25 smithi100 ceph-mon[80397]: Deploying daemon crash.smithi100 on smithi100 2024-04-27T07:36:26.131 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:25 smithi082 ceph-mon[91103]: Upgrade: Updating crash.smithi100 (2/2) 2024-04-27T07:36:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:25 smithi082 ceph-mon[91103]: Deploying daemon crash.smithi100 on smithi100 2024-04-27T07:36:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:27.080 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:26 smithi100 ceph-mon[80397]: pgmap v33: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:26 smithi082 ceph-mon[91103]: pgmap v33: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:28.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:28 smithi082 ceph-mon[91103]: pgmap v34: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:28 smithi100 ceph-mon[80397]: pgmap v34: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:30 smithi082 ceph-mon[91103]: pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:31.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:30 smithi100 ceph-mon[80397]: pgmap v35: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 -- 172.21.15.82:0/2644528915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fce60 msgr2=0x7f51980fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 --2- 172.21.15.82:0/2644528915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fce60 0x7f51980fd270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5194004940 tx=0x7f5194009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 -- 172.21.15.82:0/2644528915 shutdown_connections 2024-04-27T07:36:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 --2- 172.21.15.82:0/2644528915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fdfd0 0x7f51980fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 --2- 172.21.15.82:0/2644528915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fce60 0x7f51980fd270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 -- 172.21.15.82:0/2644528915 >> 172.21.15.82:0/2644528915 conn(0x7f51980f8540 msgr2=0x7f51980fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 -- 172.21.15.82:0/2644528915 shutdown_connections 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.648+0000 7f519f860700 1 -- 172.21.15.82:0/2644528915 wait complete. 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 Processor -- start 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 -- start start 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fce60 0x7f519810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519810e450 con 0x7f51980fdfd0 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519f860700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519810e5c0 con 0x7f51980fce60 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47012/0 (socket says 172.21.15.82:47012) 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 -- 172.21.15.82:0/776199373 learned_addr learned my addr 172.21.15.82:0/776199373 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519d5fc700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fce60 0x7f519810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 -- 172.21.15.82:0/776199373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fce60 msgr2=0x7f519810d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fce60 0x7f519810d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.649+0000 7f519cdfb700 1 -- 172.21.15.82:0/776199373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194005040 con 0x7f51980fdfd0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f519cdfb700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5188002a50 tx=0x7f51880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5188007cc0 con 0x7f51980fdfd0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5198113020 con 0x7f51980fdfd0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f518800f040 con 0x7f51980fdfd0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f518800da30 con 0x7f51980fdfd0 2024-04-27T07:36:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.650+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51981135b0 con 0x7f51980fdfd0 2024-04-27T07:36:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.651+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519804c710 con 0x7f51980fdfd0 2024-04-27T07:36:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.651+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f518800db90 con 0x7f51980fdfd0 2024-04-27T07:36:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.652+0000 7f518dffb700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 0x7f51840711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.652+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f518808e820 con 0x7f51980fdfd0 2024-04-27T07:36:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.652+0000 7f519d5fc700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 0x7f51840711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.652+0000 7f519d5fc700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 0x7f51840711e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5194009fd0 tx=0x7f5194009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.657+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f518805af80 con 0x7f51980fdfd0 2024-04-27T07:36:31.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.882+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5198102360 con 0x7f518406ed30 2024-04-27T07:36:31.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.883+0000 7f518dffb700 1 -- 172.21.15.82:0/776199373 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f5198102360 con 0x7f518406ed30 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 msgr2=0x7f51840711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 0x7f51840711e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5194009fd0 tx=0x7f5194009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 msgr2=0x7f519810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5188002a50 tx=0x7f51880046b0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 shutdown_connections 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f518406ed30 0x7f51840711e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51980fce60 0x7f519810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 --2- 172.21.15.82:0/776199373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51980fdfd0 0x7f519810de50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 >> 172.21.15.82:0/776199373 conn(0x7f51980f8540 msgr2=0x7f51980f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 shutdown_connections 2024-04-27T07:36:31.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.885+0000 7f519f860700 1 -- 172.21.15.82:0/776199373 wait complete. 2024-04-27T07:36:31.899 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/2102784218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fbce0 msgr2=0x7fc4b80fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/2102784218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fbce0 0x7fc4b80fc0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0004940 tx=0x7fc4b0009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/2102784218 shutdown_connections 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/2102784218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fcf90 0x7fc4b80fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/2102784218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fbce0 0x7fc4b80fc0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/2102784218 >> 172.21.15.82:0/2102784218 conn(0x7fc4b80f7420 msgr2=0x7fc4b80f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/2102784218 shutdown_connections 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/2102784218 wait complete. 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 Processor -- start 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.997+0000 7fc4bf8fc700 1 -- start start 2024-04-27T07:36:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bf8fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fbce0 0x7fc4b8066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bf8fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bf8fc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8112bc0 con 0x7fc4b80fcf90 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bf8fc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8112d00 con 0x7fc4b80fbce0 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47026/0 (socket says 172.21.15.82:47026) 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 -- 172.21.15.82:0/556807590 learned_addr learned my addr 172.21.15.82:0/556807590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bd698700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fbce0 0x7fc4b8066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 -- 172.21.15.82:0/556807590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fbce0 msgr2=0x7fc4b8066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fbce0 0x7fc4b8066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 -- 172.21.15.82:0/556807590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0005040 con 0x7fc4b80fcf90 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bce97700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac001db0 tx=0x7fc4ac009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac007d10 con 0x7fc4b80fcf90 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4ac007e70 con 0x7fc4b80fcf90 2024-04-27T07:36:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b8112f90 con 0x7fc4b80fcf90 2024-04-27T07:36:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.998+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ac014640 con 0x7fc4b80fcf90 2024-04-27T07:36:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:31.999+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b8113520 con 0x7fc4b80fcf90 2024-04-27T07:36:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.000+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b804c710 con 0x7fc4b80fcf90 2024-04-27T07:36:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.000+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fc4ac00e900 con 0x7fc4b80fcf90 2024-04-27T07:36:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.000+0000 7fc4b5ffb700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 0x7fc4a00711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.000+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc4ac08e710 con 0x7fc4b80fcf90 2024-04-27T07:36:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.000+0000 7fc4bd698700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 0x7fc4a00711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.001+0000 7fc4bd698700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 0x7fc4a00711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b3b0 tx=0x7fc4b0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.005+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc4ac05b030 con 0x7fc4b80fcf90 2024-04-27T07:36:32.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.227+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4b8101230 con 0x7fc4a006ed30 2024-04-27T07:36:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.228+0000 7fc4b5ffb700 1 -- 172.21.15.82:0/556807590 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc4b8101230 con 0x7fc4a006ed30 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 msgr2=0x7fc4a00711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 0x7fc4a00711e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b3b0 tx=0x7fc4b0009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 msgr2=0x7fc4b8112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac001db0 tx=0x7fc4ac009ee0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 shutdown_connections 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc4a006ed30 0x7fc4a00711e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b80fbce0 0x7fc4b8066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 --2- 172.21.15.82:0/556807590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b80fcf90 0x7fc4b8112680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 >> 172.21.15.82:0/556807590 conn(0x7fc4b80f7420 msgr2=0x7fc4b80f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 shutdown_connections 2024-04-27T07:36:32.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.231+0000 7fc4bf8fc700 1 -- 172.21.15.82:0/556807590 wait complete. 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/2339597298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 msgr2=0x7f6cd0070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/2339597298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd0070ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0004940 tx=0x7f6cc0009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/2339597298 shutdown_connections 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/2339597298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd0070ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/2339597298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 0x7f6cd00702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/2339597298 >> 172.21.15.82:0/2339597298 conn(0x7f6cd00f85c0 msgr2=0x7f6cd00fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/2339597298 shutdown_connections 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.336+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/2339597298 wait complete. 2024-04-27T07:36:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 Processor -- start 2024-04-27T07:36:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 -- start start 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 0x7f6cd01101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01107b0 con 0x7f6cd0070830 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd7ee4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0110fb0 con 0x7f6cd0071de0 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd5c80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd5c80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47054/0 (socket says 172.21.15.82:47054) 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.337+0000 7f6cd5c80700 1 -- 172.21.15.82:0/3243586301 learned_addr learned my addr 172.21.15.82:0/3243586301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd547f700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 0x7f6cd01101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd5c80700 1 -- 172.21.15.82:0/3243586301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 msgr2=0x7f6cd01101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd5c80700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 0x7f6cd01101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd5c80700 1 -- 172.21.15.82:0/3243586301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0005040 con 0x7f6cd0070830 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd5c80700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c8b0 tx=0x7f6ccc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc00a760 con 0x7f6cd0070830 2024-04-27T07:36:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ccc00ad90 con 0x7f6cd0070830 2024-04-27T07:36:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd0111290 con 0x7f6cd0070830 2024-04-27T07:36:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc0113a0 con 0x7f6cd0070830 2024-04-27T07:36:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.338+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd01117d0 con 0x7f6cd0070830 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.339+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd005f5c0 con 0x7f6cd0070830 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.340+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6ccc012400 con 0x7f6cd0070830 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.340+0000 7f6cc67fc700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 0x7f6cbc0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.340+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6ccc08e960 con 0x7f6cd0070830 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.340+0000 7f6cd547f700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 0x7f6cbc0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.341+0000 7f6cd547f700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 0x7f6cbc0711d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000b3b0 tx=0x7f6cc0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.345+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6ccc05b250 con 0x7f6cd0070830 2024-04-27T07:36:32.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.565+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd0111bc0 con 0x7f6cbc06ed20 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.575+0000 7f6cc67fc700 1 -- 172.21.15.82:0/3243586301 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6cd0111bc0 con 0x7f6cbc06ed20 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (2m) 61s ago 11m 25.7M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 starting - - - - 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (5s) 1s ago 10m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (2m) 61s ago 11m 82.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:36:32.577 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (5m) 61s ago 5m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (6m) 61s ago 6m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (5m) 1s ago 5m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (6m) 1s ago 6m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (2m) 61s ago 12m 474M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (90s) 1s ago 10m 450M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (75s) 61s ago 13m 30.7M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (51s) 1s ago 10m 31.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (3m) 61s ago 11m 16.4M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 1s ago 10m 15.2M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (9m) 61s ago 9m 190M 1557M 17.2.7-907-g2be3efa9 1c5834633715 80e184a1e848 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (9m) 61s ago 9m 199M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (8m) 61s ago 8m 156M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:36:32.578 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (8m) 1s ago 8m 220M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:36:32.579 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (7m) 1s ago 7m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:36:32.579 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (7m) 1s ago 7m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:36:32.579 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (97s) 61s ago 11m 47.6M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:36:32.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.576+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 msgr2=0x7f6cbc0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.576+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 0x7f6cbc0711d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000b3b0 tx=0x7f6cc0009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.576+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 msgr2=0x7f6cd010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.576+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c8b0 tx=0x7f6ccc004470 comp rx=0 tx=0).stop 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 shutdown_connections 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6cbc06ed20 0x7f6cbc0711d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cd0070830 0x7f6cd010fc70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 --2- 172.21.15.82:0/3243586301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd0071de0 0x7f6cd01101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 >> 172.21.15.82:0/3243586301 conn(0x7f6cd00f85c0 msgr2=0x7f6cd00f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 shutdown_connections 2024-04-27T07:36:32.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.577+0000 7f6cd7ee4700 1 -- 172.21.15.82:0/3243586301 wait complete. 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 -- 172.21.15.82:0/3562298536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 msgr2=0x7f48100fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 --2- 172.21.15.82:0/3562298536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f48100fd3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47fc004940 tx=0x7f47fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 -- 172.21.15.82:0/3562298536 shutdown_connections 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 --2- 172.21.15.82:0/3562298536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f48100fd3d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 --2- 172.21.15.82:0/3562298536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f48100fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 -- 172.21.15.82:0/3562298536 >> 172.21.15.82:0/3562298536 conn(0x7f48100f7430 msgr2=0x7f48100f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 -- 172.21.15.82:0/3562298536 shutdown_connections 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 -- 172.21.15.82:0/3562298536 wait complete. 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.678+0000 7f4816de2700 1 Processor -- start 2024-04-27T07:36:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4816de2700 1 -- start start 2024-04-27T07:36:32.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4816de2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4816de2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f481010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4816de2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481010e5c0 con 0x7f48100fcf60 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4816de2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481010ed70 con 0x7f48100fbcb0 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f480ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f481010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:46440/0 (socket says 172.21.15.82:46440) 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 -- 172.21.15.82:0/1535655553 learned_addr learned my addr 172.21.15.82:0/1535655553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 -- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 msgr2=0x7f481010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f481010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f4814b7e700 1 -- 172.21.15.82:0/1535655553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc005040 con 0x7f48100fbcb0 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.679+0000 7f480ffff700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f481010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f4814b7e700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f480400eb70 tx=0x7f480400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4804007cc0 con 0x7f48100fbcb0 2024-04-27T07:36:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481010eff0 con 0x7f48100fbcb0 2024-04-27T07:36:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f480400f040 con 0x7f48100fbcb0 2024-04-27T07:36:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480400ca90 con 0x7f48100fbcb0 2024-04-27T07:36:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.680+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481010f530 con 0x7f48100fbcb0 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.681+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810101af0 con 0x7f48100fbcb0 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.682+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f480400cbf0 con 0x7f48100fbcb0 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.682+0000 7f480d7fa700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 0x7f48000711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.682+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f480408e690 con 0x7f48100fbcb0 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.682+0000 7f480ffff700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 0x7f48000711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.683+0000 7f480ffff700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 0x7f48000711d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009b30 tx=0x7f47fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:32.687+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f480405ad50 con 0x7f48100fbcb0 2024-04-27T07:36:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:32 smithi100 ceph-mon[80397]: pgmap v36: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:32 smithi100 ceph-mon[80397]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:33.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.018+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f481005f5f0 con 0x7f48100fbcb0 2024-04-27T07:36:33.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.019+0000 7f480d7fa700 1 -- 172.21.15.82:0/1535655553 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f480405a8e0 con 0x7f48100fbcb0 2024-04-27T07:36:33.021 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:36:33.021 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:36:33.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:36:33.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 10, 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:36:33.022 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:36:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 msgr2=0x7f48000711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 0x7f48000711d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009b30 tx=0x7f47fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 msgr2=0x7f481010da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f480400eb70 tx=0x7f480400b040 comp rx=0 tx=0).stop 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 shutdown_connections 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f480006ed20 0x7f48000711d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48100fbcb0 0x7f481010da80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 --2- 172.21.15.82:0/1535655553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48100fcf60 0x7f481010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 >> 172.21.15.82:0/1535655553 conn(0x7f48100f7430 msgr2=0x7f4810065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 shutdown_connections 2024-04-27T07:36:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.021+0000 7f4816de2700 1 -- 172.21.15.82:0/1535655553 wait complete. 2024-04-27T07:36:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:32 smithi082 ceph-mon[91103]: pgmap v36: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:32 smithi082 ceph-mon[91103]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:33.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.126+0000 7fc49463b700 1 -- 172.21.15.82:0/1793836703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 msgr2=0x7fc48c102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.126+0000 7fc49463b700 1 --2- 172.21.15.82:0/1793836703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c102350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc47c004940 tx=0x7fc47c009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- 172.21.15.82:0/1793836703 shutdown_connections 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 --2- 172.21.15.82:0/1793836703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c102350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 --2- 172.21.15.82:0/1793836703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- 172.21.15.82:0/1793836703 >> 172.21.15.82:0/1793836703 conn(0x7fc48c0f7420 msgr2=0x7fc48c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- 172.21.15.82:0/1793836703 shutdown_connections 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- 172.21.15.82:0/1793836703 wait complete. 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 Processor -- start 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- start start 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0fd830 con 0x7fc48c0fff70 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc49463b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0fbe70 con 0x7fc48c066e70 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.127+0000 7fc491bd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:46450/0 (socket says 172.21.15.82:46450) 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc491bd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47102/0 (socket says 172.21.15.82:47102) 2024-04-27T07:36:33.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 -- 172.21.15.82:0/1291735683 learned_addr learned my addr 172.21.15.82:0/1291735683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 -- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 msgr2=0x7fc48c0fb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 -- 172.21.15.82:0/1291735683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c005040 con 0x7fc48c066e70 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc491bd6700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc4923d7700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc48800eb70 tx=0x7fc48800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc488007cc0 con 0x7fc48c066e70 2024-04-27T07:36:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc48800f040 con 0x7fc48c066e70 2024-04-27T07:36:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0fc0f0 con 0x7fc48c066e70 2024-04-27T07:36:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc48800cb20 con 0x7fc48c066e70 2024-04-27T07:36:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.128+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0fc630 con 0x7fc48c066e70 2024-04-27T07:36:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.129+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c04c710 con 0x7fc48c066e70 2024-04-27T07:36:33.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.130+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7fc48800cc80 con 0x7fc48c066e70 2024-04-27T07:36:33.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.130+0000 7fc482ffd700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 0x7fc4780711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.130+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc48808e3d0 con 0x7fc48c066e70 2024-04-27T07:36:33.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.131+0000 7fc491bd6700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 0x7fc4780711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.131+0000 7fc491bd6700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 0x7fc4780711e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b0d0 tx=0x7fc47c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.136+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc48805ac60 con 0x7fc48c066e70 2024-04-27T07:36:33.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.410+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc48c115c20 con 0x7fc48c066e70 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.410+0000 7fc482ffd700 1 -- 172.21.15.82:0/1291735683 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1932 (secure 0 0 0) 0x7fc48805a7f0 con 0x7fc48c066e70 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:36:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:36:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:33.416 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:36:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.412+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 msgr2=0x7fc4780711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.412+0000 7fc49463b700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 0x7fc4780711e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b0d0 tx=0x7fc47c009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.412+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 msgr2=0x7fc48c0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.412+0000 7fc49463b700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc48800eb70 tx=0x7fc48800b040 comp rx=0 tx=0).stop 2024-04-27T07:36:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 shutdown_connections 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc47806ed30 0x7fc4780711e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc48c066e70 0x7fc48c0fd230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 --2- 172.21.15.82:0/1291735683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc48c0fff70 0x7fc48c0fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 >> 172.21.15.82:0/1291735683 conn(0x7fc48c0f7420 msgr2=0x7fc48c0f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 shutdown_connections 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.413+0000 7fc49463b700 1 -- 172.21.15.82:0/1291735683 wait complete. 2024-04-27T07:36:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:36:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- 172.21.15.82:0/2984860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 msgr2=0x7f24e4070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 --2- 172.21.15.82:0/2984860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e4070ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24d4004940 tx=0x7f24d4009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- 172.21.15.82:0/2984860856 shutdown_connections 2024-04-27T07:36:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 --2- 172.21.15.82:0/2984860856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e4070ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 --2- 172.21.15.82:0/2984860856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e40702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- 172.21.15.82:0/2984860856 >> 172.21.15.82:0/2984860856 conn(0x7f24e40f85c0 msgr2=0x7f24e40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- 172.21.15.82:0/2984860856 shutdown_connections 2024-04-27T07:36:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- 172.21.15.82:0/2984860856 wait complete. 2024-04-27T07:36:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 Processor -- start 2024-04-27T07:36:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.521+0000 7f24e9866700 1 -- start start 2024-04-27T07:36:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e9866700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e9866700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e41100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e9866700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41106e0 con 0x7f24e4070830 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e9866700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4110f30 con 0x7f24e4071de0 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47134/0 (socket says 172.21.15.82:47134) 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 -- 172.21.15.82:0/2682570994 learned_addr learned my addr 172.21.15.82:0/2682570994 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e27fc700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e41100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 -- 172.21.15.82:0/2682570994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 msgr2=0x7f24e41100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e41100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 -- 172.21.15.82:0/2682570994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4005040 con 0x7f24e4070830 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e27fc700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24e2ffd700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24d800eb70 tx=0x7f24d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.522+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24d8007cc0 con 0x7f24e4070830 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.523+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24d800f040 con 0x7f24e4070830 2024-04-27T07:36:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.523+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e41111b0 con 0x7f24e4070830 2024-04-27T07:36:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.523+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24d800cbd0 con 0x7f24e4070830 2024-04-27T07:36:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.523+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e41116f0 con 0x7f24e4070830 2024-04-27T07:36:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.524+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e405f5c0 con 0x7f24e4070830 2024-04-27T07:36:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.524+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f24d800cd30 con 0x7f24e4070830 2024-04-27T07:36:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.525+0000 7f24cb7fe700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 0x7f24cc0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.525+0000 7f24e27fc700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 0x7f24cc0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.525+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f24d808e4e0 con 0x7f24e4070830 2024-04-27T07:36:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.525+0000 7f24e27fc700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 0x7f24cc0711d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24d4000c00 tx=0x7f24d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.529+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f24d805ad10 con 0x7f24e4070830 2024-04-27T07:36:33.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.776+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24e4111a20 con 0x7f24cc06ed20 2024-04-27T07:36:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.777+0000 7f24cb7fe700 1 -- 172.21.15.82:0/2682570994 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f24e4111a20 con 0x7f24cc06ed20 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "6/21 daemons upgraded", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading crash daemons", 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:36:33.780 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.779+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 msgr2=0x7f24cc0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.779+0000 7f24e9866700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 0x7f24cc0711d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24d4000c00 tx=0x7f24d4009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.779+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 msgr2=0x7f24e410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.779+0000 7f24e9866700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24d800eb70 tx=0x7f24d800b040 comp rx=0 tx=0).stop 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 shutdown_connections 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f24cc06ed20 0x7f24cc0711d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e4070830 0x7f24e410fba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 --2- 172.21.15.82:0/2682570994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24e4071de0 0x7f24e41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 >> 172.21.15.82:0/2682570994 conn(0x7f24e40f85c0 msgr2=0x7f24e40f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 shutdown_connections 2024-04-27T07:36:33.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.780+0000 7f24e9866700 1 -- 172.21.15.82:0/2682570994 wait complete. 2024-04-27T07:36:33.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 -- 172.21.15.82:0/733784177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fbe30 msgr2=0x7f6d500fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 --2- 172.21.15.82:0/733784177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fbe30 0x7f6d500fc240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d44004940 tx=0x7f6d44009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 -- 172.21.15.82:0/733784177 shutdown_connections 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 --2- 172.21.15.82:0/733784177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fcfa0 0x7f6d500fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 --2- 172.21.15.82:0/733784177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fbe30 0x7f6d500fc240 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 -- 172.21.15.82:0/733784177 >> 172.21.15.82:0/733784177 conn(0x7f6d500f7440 msgr2=0x7f6d500f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 -- 172.21.15.82:0/733784177 shutdown_connections 2024-04-27T07:36:33.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.884+0000 7f6d551f5700 1 -- 172.21.15.82:0/733784177 wait complete. 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 Processor -- start 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 -- start start 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 0x7f6d50110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50066b90 con 0x7f6d500fcfa0 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d551f5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50066cd0 con 0x7f6d500fbe30 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47158/0 (socket says 172.21.15.82:47158) 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4e59c700 1 -- 172.21.15.82:0/3522836926 learned_addr learned my addr 172.21.15.82:0/3522836926 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4ed9d700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 0x7f6d50110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4ed9d700 1 -- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 msgr2=0x7f6d50112c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4ed9d700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4ed9d700 1 -- 172.21.15.82:0/3522836926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44005040 con 0x7f6d500fbe30 2024-04-27T07:36:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.885+0000 7f6d4e59c700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d4ed9d700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 0x7f6d50110700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d44009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4400e030 con 0x7f6d500fbe30 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d44013de0 con 0x7f6d500fbe30 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d50113190 con 0x7f6d500fbe30 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d4401ce50 con 0x7f6d500fbe30 2024-04-27T07:36:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.886+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d501136a0 con 0x7f6d500fbe30 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.887+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5005f5c0 con 0x7f6d500fbe30 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.887+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 38) v1 ==== 92847+0+0 (secure 0 0 0) 0x7f6d4400b460 con 0x7f6d500fbe30 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.888+0000 7f6d377fe700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 0x7f6d380711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.888+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6d440902a0 con 0x7f6d500fbe30 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.888+0000 7f6d4e59c700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 0x7f6d380711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:36:33.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.888+0000 7f6d4e59c700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 0x7f6d380711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d400041d0 tx=0x7f6d4000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:36:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:33.893+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6d44058eb0 con 0x7f6d500fbe30 2024-04-27T07:36:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:34.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1535655553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:34.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:33 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1291735683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1535655553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:33 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1291735683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:36:34.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.194+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6d5004bed0 con 0x7f6d500fbe30 2024-04-27T07:36:34.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.195+0000 7f6d377fe700 1 -- 172.21.15.82:0/3522836926 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6d4405c570 con 0x7f6d500fbe30 2024-04-27T07:36:34.197 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:36:34.197 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:36:34.197 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:36:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 msgr2=0x7f6d380711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 0x7f6d380711d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d400041d0 tx=0x7f6d4000b040 comp rx=0 tx=0).stop 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 msgr2=0x7f6d50110700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 0x7f6d50110700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6d44000c00 tx=0x7f6d44009e30 comp rx=0 tx=0).stop 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 shutdown_connections 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6d3806ed20 0x7f6d380711d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d500fbe30 0x7f6d50110700 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 --2- 172.21.15.82:0/3522836926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d500fcfa0 0x7f6d50112c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 >> 172.21.15.82:0/3522836926 conn(0x7f6d500f7440 msgr2=0x7f6d500f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 shutdown_connections 2024-04-27T07:36:34.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:36:34.198+0000 7f6d551f5700 1 -- 172.21.15.82:0/3522836926 wait complete. 2024-04-27T07:36:35.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:34 smithi082 ceph-mon[91103]: pgmap v37: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:35.002 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:34 smithi082 ceph-mon[91103]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:35.002 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:34 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:35.002 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:34 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:35.002 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:34 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3522836926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:36:35.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:34 smithi100 ceph-mon[80397]: pgmap v37: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:35.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:34 smithi100 ceph-mon[80397]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:36:35.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:34 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:35.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:34 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:35.152 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:34 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3522836926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:36:36.301 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:36.301 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:36.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:36 smithi082 ceph-mon[91103]: pgmap v38: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:36.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:36.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:36.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:36 smithi100 ceph-mon[80397]: pgmap v38: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: pgmap v39: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all crash 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]: dispatch 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-04-27T07:36:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2024-04-27T07:36:39.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2024-04-27T07:36:39.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-27T07:36:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: pgmap v39: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all crash 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]: dispatch 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi100"}]': finished 2024-04-27T07:36:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-27T07:36:40.021 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:39 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-27T07:36:40.021 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:39 smithi100 ceph-mon[80397]: Upgrade: osd.0 is safe to restart 2024-04-27T07:36:40.021 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:39 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:40.021 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:39 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:36:40.021 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:39 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:40.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:39 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-27T07:36:40.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:39 smithi082 ceph-mon[91103]: Upgrade: osd.0 is safe to restart 2024-04-27T07:36:40.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:39 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:40.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:39 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-27T07:36:40.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:39 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:36:40.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:40 smithi100 ceph-mon[80397]: Upgrade: Updating osd.0 2024-04-27T07:36:40.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:40 smithi100 ceph-mon[80397]: Deploying daemon osd.0 on smithi082 2024-04-27T07:36:40.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:40 smithi100 ceph-mon[80397]: pgmap v40: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:41.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:40 smithi082 ceph-mon[91103]: Upgrade: Updating osd.0 2024-04-27T07:36:41.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:40 smithi082 ceph-mon[91103]: Deploying daemon osd.0 on smithi082 2024-04-27T07:36:41.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:40 smithi082 ceph-mon[91103]: pgmap v40: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:42 smithi082 ceph-mon[91103]: pgmap v41: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:42 smithi100 ceph-mon[80397]: pgmap v41: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:36:43.167 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:42 smithi082 systemd[1]: Stopping Ceph osd.0 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:36:43.507 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:43 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[45063]: 2024-04-27T07:36:43.164+0000 7f789f577700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:36:43.507 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:43 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[45063]: 2024-04-27T07:36:43.164+0000 7f789f577700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-27T07:36:43.507 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:43 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[45063]: 2024-04-27T07:36:43.164+0000 7f789f577700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:36:44.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:43 smithi082 ceph-mon[91103]: osd.0 marked itself down and dead 2024-04-27T07:36:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:43 smithi100 ceph-mon[80397]: osd.0 marked itself down and dead 2024-04-27T07:36:44.534 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:44 smithi082 podman[99489]: 2024-04-27 07:36:44.259758263 +0000 UTC m=+1.215624761 container died 80e184a1e84821f46a4eb46adeb5fd500cdf9c02a6c8eef004abce770f99a396 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-27T07:36:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:44 smithi082 ceph-mon[91103]: pgmap v42: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:44 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:36:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:44 smithi082 ceph-mon[91103]: osdmap e50: 6 total, 5 up, 6 in 2024-04-27T07:36:44.844 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:44 smithi082 podman[99489]: 2024-04-27 07:36:44.62543949 +0000 UTC m=+1.581305941 container cleanup 80e184a1e84821f46a4eb46adeb5fd500cdf9c02a6c8eef004abce770f99a396 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=quincy-2be3efa, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-04-27T07:36:44.844 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:44 smithi082 bash[99489]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0 2024-04-27T07:36:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:44 smithi100 ceph-mon[80397]: pgmap v42: 65 pgs: 65 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:36:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:44 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:36:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:44 smithi100 ceph-mon[80397]: osdmap e50: 6 total, 5 up, 6 in 2024-04-27T07:36:45.248 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:44 smithi082 podman[99506]: 2024-04-27 07:36:44.916871083 +0000 UTC m=+0.649701933 container remove 80e184a1e84821f46a4eb46adeb5fd500cdf9c02a6c8eef004abce770f99a396 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=) 2024-04-27T07:36:45.506 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.149836645 +0000 UTC m=+0.018031622 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:36:45.506 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.276174416 +0000 UTC m=+0.144369392 container create 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-27T07:36:45.506 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.50404179 +0000 UTC m=+0.372236778 container init 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, GIT_BRANCH=HEAD) 2024-04-27T07:36:45.784 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.507705415 +0000 UTC m=+0.375900394 container start 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:36:45.785 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.603881204 +0000 UTC m=+0.472076181 container attach 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-27T07:36:46.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:45 smithi082 ceph-mon[91103]: osdmap e51: 6 total, 5 up, 6 in 2024-04-27T07:36:46.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:45 smithi082 podman[99599]: 2024-04-27 07:36:45.808941278 +0000 UTC m=+0.677136255 container died 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:36:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:45 smithi100 ceph-mon[80397]: osdmap e51: 6 total, 5 up, 6 in 2024-04-27T07:36:46.786 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 podman[99625]: 2024-04-27 07:36:46.416565198 +0000 UTC m=+0.602434449 container remove 5e3c06340664793cd076bf4eedae59bf6bcc2a377b7d101a0354134e7f939971 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-27T07:36:46.786 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-27T07:36:46.786 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 systemd[1]: Stopped Ceph osd.0 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:36:46.786 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.0.service: Consumed 48.291s CPU time. 2024-04-27T07:36:46.786 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 systemd[1]: Starting Ceph osd.0 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:36:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:46 smithi082 ceph-mon[91103]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T07:36:47.094 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 podman[99725]: 2024-04-27 07:36:46.767549487 +0000 UTC m=+0.018555578 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:36:47.094 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:46 smithi082 podman[99725]: 2024-04-27 07:36:46.88441646 +0000 UTC m=+0.135422583 container create c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-27T07:36:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:46 smithi100 ceph-mon[80397]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T07:36:47.593 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 podman[99725]: 2024-04-27 07:36:47.145400301 +0000 UTC m=+0.396406377 container init c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-27T07:36:47.593 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 podman[99725]: 2024-04-27 07:36:47.148829335 +0000 UTC m=+0.399835420 container start c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-27T07:36:47.593 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 podman[99725]: 2024-04-27 07:36:47.245406921 +0000 UTC m=+0.496412999 container attach c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b) 2024-04-27T07:36:47.984 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 75/384 objects degraded (19.531%), 20 pgs degraded (PG_DEGRADED) 2024-04-27T07:36:47.984 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:36:47.984 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:36:47.984 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 bash[99725]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-27T07:36:47.985 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate[99741]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-27T07:36:47.986 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:47 smithi082 podman[99725]: 2024-04-27 07:36:47.650552046 +0000 UTC m=+0.901558124 container died c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-c37f63b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-27T07:36:48.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:47 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 75/384 objects degraded (19.531%), 20 pgs degraded (PG_DEGRADED) 2024-04-27T07:36:48.543 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 podman[99871]: 2024-04-27 07:36:48.266158534 +0000 UTC m=+0.610709604 container remove c2580bd2a15017c48402629d44d163f0c318702df553d42be75e7bcd223132c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-27T07:36:48.543 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 podman[99933]: 2024-04-27 07:36:48.383205547 +0000 UTC m=+0.017775844 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:36:48.544 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 podman[99933]: 2024-04-27 07:36:48.542207054 +0000 UTC m=+0.176777326 container create 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-c37f63b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:36:48.839 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 podman[99933]: 2024-04-27 07:36:48.752906458 +0000 UTC m=+0.387476731 container init 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-c37f63b, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:36:48.839 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 podman[99933]: 2024-04-27 07:36:48.756053028 +0000 UTC m=+0.390623304 container start 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-27T07:36:48.839 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 ceph-osd[99952]: -- 172.21.15.82:0/3839627002 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5579701fb680 con 0x5579701c4c00 2024-04-27T07:36:49.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:48 smithi082 ceph-mon[91103]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:49.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 bash[99933]: 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 2024-04-27T07:36:49.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:48 smithi082 systemd[1]: Started Ceph osd.0 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:36:49.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:48 smithi100 ceph-mon[80397]: pgmap v46: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:49.593 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:49 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:36:49.307+0000 7f0ecfad57c0 -1 Falling back to public interface 2024-04-27T07:36:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:49 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:49 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:49 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:50.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:49 smithi082 ceph-mon[91103]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 75/384 objects degraded (19.531%) 2024-04-27T07:36:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:49 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:49 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:50.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:49 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:36:50.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:49 smithi100 ceph-mon[80397]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 75/384 objects degraded (19.531%) 2024-04-27T07:36:52.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:52 smithi082 ceph-mon[91103]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:52 smithi100 ceph-mon[80397]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:53.777 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:53 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:36:53.597+0000 7f0ecfad57c0 -1 osd.0 49 log_to_monitors true 2024-04-27T07:36:54.046 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:53 smithi082 ceph-mon[91103]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-27T07:36:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:53 smithi100 ceph-mon[80397]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-27T07:36:55.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:36:54.758+0000 7f0ebcf25700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:36:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-27T07:36:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: osdmap e52: 6 total, 5 up, 6 in 2024-04-27T07:36:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:36:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:55.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:54 smithi082 ceph-mon[91103]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' 2024-04-27T07:36:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: pgmap v49: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-27T07:36:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: osdmap e52: 6 total, 5 up, 6 in 2024-04-27T07:36:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:36:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:55.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:54 smithi100 ceph-mon[80397]: from='osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965]' entity='osd.0' 2024-04-27T07:36:56.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965] boot 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: osdmap e53: 6 total, 6 up, 6 in 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:56.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:36:56.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: osd.0 [v2:172.21.15.82:6802/1477776965,v1:172.21.15.82:6803/1477776965] boot 2024-04-27T07:36:56.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: osdmap e53: 6 total, 6 up, 6 in 2024-04-27T07:36:56.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-27T07:36:56.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: pgmap v52: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 75/384 objects degraded (19.531%) 2024-04-27T07:36:56.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:36:56.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:36:58.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:57 smithi082 ceph-mon[91103]: osdmap e54: 6 total, 6 up, 6 in 2024-04-27T07:36:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:57 smithi100 ceph-mon[80397]: osdmap e54: 6 total, 6 up, 6 in 2024-04-27T07:36:58.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:58 smithi082 ceph-mon[91103]: pgmap v54: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s; 14/384 objects degraded (3.646%) 2024-04-27T07:36:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:58 smithi100 ceph-mon[80397]: pgmap v54: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s; 14/384 objects degraded (3.646%) 2024-04-27T07:37:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: mgrmap e39: smithi082.hhlhmf(active, since 93s), standbys: smithi100.eparbe 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:36:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: mgrmap e39: smithi082.hhlhmf(active, since 93s), standbys: smithi100.eparbe 2024-04-27T07:37:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:00.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:36:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:00 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:00 smithi082 ceph-mon[91103]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-27T07:37:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:00 smithi082 ceph-mon[91103]: pgmap v55: 65 pgs: 25 peering, 40 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-27T07:37:01.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:00 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:01.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:00 smithi100 ceph-mon[80397]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-27T07:37:01.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:00 smithi100 ceph-mon[80397]: pgmap v55: 65 pgs: 25 peering, 40 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-27T07:37:02.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:01 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded) 2024-04-27T07:37:02.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:01 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded) 2024-04-27T07:37:03.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:02 smithi082 ceph-mon[91103]: pgmap v56: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 773 B/s wr, 5 op/s 2024-04-27T07:37:03.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:02 smithi100 ceph-mon[80397]: pgmap v56: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 773 B/s wr, 5 op/s 2024-04-27T07:37:04.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3454879835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fce60 msgr2=0x7f57c40fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3454879835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fce60 0x7f57c40fd270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57b4004940 tx=0x7f57b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3454879835 shutdown_connections 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3454879835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fdfd0 0x7f57c40fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3454879835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fce60 0x7f57c40fd270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3454879835 >> 172.21.15.82:0/3454879835 conn(0x7f57c40f8520 msgr2=0x7f57c40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3454879835 shutdown_connections 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.313+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3454879835 wait complete. 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 Processor -- start 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 -- start start 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 0x7f57c410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c410e4b0 con 0x7f57c40fdfd0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57c9dd1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c410e620 con 0x7f57c40fce60 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42550/0 (socket says 172.21.15.82:42550) 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.314+0000 7f57baffd700 1 -- 172.21.15.82:0/3871986822 learned_addr learned my addr 172.21.15.82:0/3871986822 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c37fe700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 0x7f57c410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57baffd700 1 -- 172.21.15.82:0/3871986822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 msgr2=0x7f57c410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57baffd700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 0x7f57c410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57baffd700 1 -- 172.21.15.82:0/3871986822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4005040 con 0x7f57c40fdfd0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c37fe700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 0x7f57c410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57baffd700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c830 tx=0x7f57ac004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac00a760 con 0x7f57c40fdfd0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c4113080 con 0x7f57c40fdfd0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57ac00ad90 con 0x7f57c40fdfd0 2024-04-27T07:37:04.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac0113a0 con 0x7f57c40fdfd0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.315+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c4113640 con 0x7f57c40fdfd0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.316+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c404c710 con 0x7f57c40fdfd0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.317+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f57ac012400 con 0x7f57c40fdfd0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.317+0000 7f57c0ff9700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 0x7f57b00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.317+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f57ac08e700 con 0x7f57c40fdfd0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.317+0000 7f57c37fe700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 0x7f57b00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.317+0000 7f57c37fe700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 0x7f57b00710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57b400b970 tx=0x7f57b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.322+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f57ac05b1a0 con 0x7f57c40fdfd0 2024-04-27T07:37:04.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.543+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c41023b0 con 0x7f57b006ec00 2024-04-27T07:37:04.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.544+0000 7f57c0ff9700 1 -- 172.21.15.82:0/3871986822 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f57c41023b0 con 0x7f57b006ec00 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 msgr2=0x7f57b00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 0x7f57b00710b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57b400b970 tx=0x7f57b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 msgr2=0x7f57c410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c830 tx=0x7f57ac004470 comp rx=0 tx=0).stop 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 shutdown_connections 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f57b006ec00 0x7f57b00710b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57c40fce60 0x7f57c410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 --2- 172.21.15.82:0/3871986822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c40fdfd0 0x7f57c410deb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 >> 172.21.15.82:0/3871986822 conn(0x7f57c40f8520 msgr2=0x7f57c40f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:04.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 shutdown_connections 2024-04-27T07:37:04.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.547+0000 7f57c9dd1700 1 -- 172.21.15.82:0/3871986822 wait complete. 2024-04-27T07:37:04.560 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 -- 172.21.15.82:0/818404829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 msgr2=0x7f7ee00faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 --2- 172.21.15.82:0/818404829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00faec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4004940 tx=0x7f7ed4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 -- 172.21.15.82:0/818404829 shutdown_connections 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 --2- 172.21.15.82:0/818404829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00faec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 --2- 172.21.15.82:0/818404829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 -- 172.21.15.82:0/818404829 >> 172.21.15.82:0/818404829 conn(0x7f7ee00f6bd0 msgr2=0x7f7ee00f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 -- 172.21.15.82:0/818404829 shutdown_connections 2024-04-27T07:37:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.649+0000 7f7ee690b700 1 -- 172.21.15.82:0/818404829 wait complete. 2024-04-27T07:37:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 Processor -- start 2024-04-27T07:37:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 -- start start 2024-04-27T07:37:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00fe040 con 0x7f7ee00fed80 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7ee690b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00fc630 con 0x7f7ee00fe430 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7edf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7edf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42568/0 (socket says 172.21.15.82:42568) 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7edf7fe700 1 -- 172.21.15.82:0/4276295856 learned_addr learned my addr 172.21.15.82:0/4276295856 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.650+0000 7f7edffff700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edf7fe700 1 -- 172.21.15.82:0/4276295856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 msgr2=0x7f7ee00fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edf7fe700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edf7fe700 1 -- 172.21.15.82:0/4276295856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4005040 con 0x7f7ee00fed80 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edffff700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edf7fe700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400b3b0 tx=0x7f7ed4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ed400e040 con 0x7f7ee00fed80 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ed4004290 con 0x7f7ee00fed80 2024-04-27T07:37:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee00fc880 con 0x7f7ee00fed80 2024-04-27T07:37:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ed401c630 con 0x7f7ee00fed80 2024-04-27T07:37:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.651+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee00fce40 con 0x7f7ee00fed80 2024-04-27T07:37:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.652+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee004c710 con 0x7f7ee00fed80 2024-04-27T07:37:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.652+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7ed4013420 con 0x7f7ee00fed80 2024-04-27T07:37:04.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.653+0000 7f7edcff9700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 0x7f7ec80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.653+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7ed408fc40 con 0x7f7ee00fed80 2024-04-27T07:37:04.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.653+0000 7f7edffff700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 0x7f7ec80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.653+0000 7f7edffff700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 0x7f7ec80710b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.658+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7ed405c640 con 0x7f7ee00fed80 2024-04-27T07:37:04.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.882+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee0102550 con 0x7f7ec806ec00 2024-04-27T07:37:04.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.883+0000 7f7edcff9700 1 -- 172.21.15.82:0/4276295856 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7ee0102550 con 0x7f7ec806ec00 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 msgr2=0x7f7ec80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 0x7f7ec80710b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 msgr2=0x7f7ee00fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400b3b0 tx=0x7f7ed4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 shutdown_connections 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7ec806ec00 0x7f7ec80710b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ee00fe430 0x7f7ee00fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 --2- 172.21.15.82:0/4276295856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00fed80 0x7f7ee00fc0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.885+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 >> 172.21.15.82:0/4276295856 conn(0x7f7ee00f6bd0 msgr2=0x7f7ee00f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.886+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 shutdown_connections 2024-04-27T07:37:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.886+0000 7f7ee690b700 1 -- 172.21.15.82:0/4276295856 wait complete. 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 -- 172.21.15.82:0/2947212892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fcf60 msgr2=0x7facc80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 --2- 172.21.15.82:0/2947212892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fcf60 0x7facc80fd3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7facc4004940 tx=0x7facc4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 -- 172.21.15.82:0/2947212892 shutdown_connections 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 --2- 172.21.15.82:0/2947212892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fcf60 0x7facc80fd3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 --2- 172.21.15.82:0/2947212892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fbcb0 0x7facc80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 -- 172.21.15.82:0/2947212892 >> 172.21.15.82:0/2947212892 conn(0x7facc80f7430 msgr2=0x7facc80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:04.990 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:04 smithi082 ceph-mon[91103]: pgmap v57: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 766 B/s wr, 5 op/s 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 -- 172.21.15.82:0/2947212892 shutdown_connections 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.987+0000 7faccf287700 1 -- 172.21.15.82:0/2947212892 wait complete. 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 Processor -- start 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 -- start start 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fcf60 0x7facc8112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8066330 con 0x7facc80fbcb0 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccf287700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc8066470 con 0x7facc80fcf60 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42582/0 (socket says 172.21.15.82:42582) 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 -- 172.21.15.82:0/4161969632 learned_addr learned my addr 172.21.15.82:0/4161969632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccc822700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fcf60 0x7facc8112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 -- 172.21.15.82:0/4161969632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fcf60 msgr2=0x7facc8112ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fcf60 0x7facc8112ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.988+0000 7faccd023700 1 -- 172.21.15.82:0/4161969632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4005040 con 0x7facc80fbcb0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7faccd023700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facb8002a50 tx=0x7facb80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb8007cc0 con 0x7facc80fbcb0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facb800f040 con 0x7facc80fbcb0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc8113240 con 0x7facc80fbcb0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb8009640 con 0x7facc80fbcb0 2024-04-27T07:37:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.989+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8113800 con 0x7facc80fbcb0 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.990+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7facb80097a0 con 0x7facc80fbcb0 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.990+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc805f5c0 con 0x7facc80fbcb0 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.991+0000 7facbdffb700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 0x7facb40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.991+0000 7faccc822700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 0x7facb40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.991+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7facb808e5e0 con 0x7facc80fbcb0 2024-04-27T07:37:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.991+0000 7faccc822700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 0x7facb40710b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3b0 tx=0x7facc4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:04.996+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7facb8057430 con 0x7facc80fbcb0 2024-04-27T07:37:05.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:04 smithi100 ceph-mon[80397]: pgmap v57: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 766 B/s wr, 5 op/s 2024-04-27T07:37:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.202+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7facc81012c0 con 0x7facb406ec00 2024-04-27T07:37:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.213+0000 7facbdffb700 1 -- 172.21.15.82:0/4161969632 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7facc81012c0 con 0x7facb406ec00 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (3m) 10s ago 11m 25.7M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (43s) 10s ago 12m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (38s) 34s ago 11m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (3m) 10s ago 11m 85.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (6m) 10s ago 6m 64.5M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (6m) 10s ago 6m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (6m) 34s ago 6m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:37:05.216 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (6m) 34s ago 6m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:37:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (2m) 10s ago 13m 499M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:37:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (2m) 34s ago 11m 450M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:37:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (108s) 10s ago 13m 45.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:37:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (84s) 34s ago 10m 31.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:37:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (3m) 10s ago 12m 16.0M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 34s ago 11m 15.2M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (16s) 10s ago 10m 15.0M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (9m) 10s ago 9m 200M 1557M 17.2.7-907-g2be3efa9 1c5834633715 caa0d8b94ded 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (9m) 10s ago 9m 157M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (8m) 34s ago 8m 220M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (8m) 34s ago 8m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (8m) 34s ago 8m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:37:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 10s ago 11m 54.1M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:37:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 msgr2=0x7facb40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 0x7facb40710b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3b0 tx=0x7facc4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 msgr2=0x7facc8110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7facb8002a50 tx=0x7facb80046b0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 shutdown_connections 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7facb406ec00 0x7facb40710b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc80fbcb0 0x7facc8110750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 --2- 172.21.15.82:0/4161969632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facc80fcf60 0x7facc8112ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 >> 172.21.15.82:0/4161969632 conn(0x7facc80f7430 msgr2=0x7facc80f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 shutdown_connections 2024-04-27T07:37:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.215+0000 7faccf287700 1 -- 172.21.15.82:0/4161969632 wait complete. 2024-04-27T07:37:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- 172.21.15.82:0/2142898888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fdfd0 msgr2=0x7fcf380fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 --2- 172.21.15.82:0/2142898888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fdfd0 0x7fcf380fe440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf28004940 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- 172.21.15.82:0/2142898888 shutdown_connections 2024-04-27T07:37:05.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 --2- 172.21.15.82:0/2142898888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fdfd0 0x7fcf380fe440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 --2- 172.21.15.82:0/2142898888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fce60 0x7fcf380fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- 172.21.15.82:0/2142898888 >> 172.21.15.82:0/2142898888 conn(0x7fcf380f8540 msgr2=0x7fcf380fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- 172.21.15.82:0/2142898888 shutdown_connections 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- 172.21.15.82:0/2142898888 wait complete. 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 Processor -- start 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.315+0000 7fcf3f648700 1 -- start start 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3f648700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3f648700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fdfd0 0x7fcf3810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3f648700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3810e4f0 con 0x7fcf380fce60 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3f648700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38112e90 con 0x7fcf380fdfd0 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42608/0 (socket says 172.21.15.82:42608) 2024-04-27T07:37:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 -- 172.21.15.82:0/3074772369 learned_addr learned my addr 172.21.15.82:0/3074772369 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3cbe3700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fdfd0 0x7fcf3810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 -- 172.21.15.82:0/3074772369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fdfd0 msgr2=0x7fcf3810de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fdfd0 0x7fcf3810de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 -- 172.21.15.82:0/3074772369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28005040 con 0x7fcf380fce60 2024-04-27T07:37:05.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3d3e4700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b790 tx=0x7fcf34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3400f6f0 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf381130f0 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.316+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf3400fd20 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.317+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf340103a0 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.317+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf38113660 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.318+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3804c710 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.318+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcf34011400 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.318+0000 7fcf2dffb700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 0x7fcf240710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.319+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcf3408e610 con 0x7fcf380fce60 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.319+0000 7fcf3cbe3700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 0x7fcf240710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.319+0000 7fcf3cbe3700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 0x7fcf240710b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b970 tx=0x7fcf28009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:05.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.323+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcf3405b010 con 0x7fcf380fce60 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.608+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf38113ac0 con 0x7fcf380fce60 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.608+0000 7fcf2dffb700 1 -- 172.21.15.82:0/3074772369 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fcf3405aba0 con 0x7fcf380fce60 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:05.611 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 5, 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 9, 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 5 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:37:05.612 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:37:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 msgr2=0x7fcf240710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 0x7fcf240710b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b970 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 msgr2=0x7fcf3810d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b790 tx=0x7fcf34009250 comp rx=0 tx=0).stop 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 shutdown_connections 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf2406ec00 0x7fcf240710b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf380fce60 0x7fcf3810d920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 --2- 172.21.15.82:0/3074772369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf380fdfd0 0x7fcf3810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 >> 172.21.15.82:0/3074772369 conn(0x7fcf380f8540 msgr2=0x7fcf380f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 shutdown_connections 2024-04-27T07:37:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.611+0000 7fcf3f648700 1 -- 172.21.15.82:0/3074772369 wait complete. 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 -- 172.21.15.82:0/2762646635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3188066f50 msgr2=0x7f31880ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2762646635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3188066f50 0x7f31880ff9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3184004940 tx=0x7f3184009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 -- 172.21.15.82:0/2762646635 shutdown_connections 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2762646635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31880fff10 0x7f3188102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2762646635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3188066f50 0x7f31880ff9d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.711+0000 7f318fd4b700 1 -- 172.21.15.82:0/2762646635 >> 172.21.15.82:0/2762646635 conn(0x7f31880f7480 msgr2=0x7f31880f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 -- 172.21.15.82:0/2762646635 shutdown_connections 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 -- 172.21.15.82:0/2762646635 wait complete. 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 Processor -- start 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 -- start start 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3188066f50 0x7f318810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318810e400 con 0x7f31880fff10 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318fd4b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318810e570 con 0x7f3188066f50 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318d2e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318d2e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49998/0 (socket says 172.21.15.82:49998) 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318d2e6700 1 -- 172.21.15.82:0/2564409307 learned_addr learned my addr 172.21.15.82:0/2564409307 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.712+0000 7f318dae7700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3188066f50 0x7f318810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318d2e6700 1 -- 172.21.15.82:0/2564409307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3188066f50 msgr2=0x7f318810d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318d2e6700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3188066f50 0x7f318810d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318d2e6700 1 -- 172.21.15.82:0/2564409307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184005040 con 0x7f31880fff10 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318d2e6700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f317800eb40 tx=0x7f317800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3178007cc0 con 0x7f31880fff10 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f317800f040 con 0x7f31880fff10 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3188112f70 con 0x7f31880fff10 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317800ca10 con 0x7f31880fff10 2024-04-27T07:37:05.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.713+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3188113480 con 0x7f31880fff10 2024-04-27T07:37:05.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.714+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318804c710 con 0x7f31880fff10 2024-04-27T07:37:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.714+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f317800cc80 con 0x7f31880fff10 2024-04-27T07:37:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.715+0000 7f317e7fc700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 0x7f31740710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.715+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f317808e3d0 con 0x7f31880fff10 2024-04-27T07:37:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.715+0000 7f318dae7700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 0x7f31740710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.715+0000 7f318dae7700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 0x7f31740710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3184004890 tx=0x7f3184009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.720+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f317805ae00 con 0x7f31880fff10 2024-04-27T07:37:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.965+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3188113940 con 0x7f31880fff10 2024-04-27T07:37:05.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:05 smithi082 ceph-mon[91103]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:05.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:05 smithi082 ceph-mon[91103]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:05.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:05 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3074772369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.965+0000 7f317e7fc700 1 -- 172.21.15.82:0/2564409307 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1932 (secure 0 0 0) 0x7f317805a990 con 0x7f31880fff10 2024-04-27T07:37:05.968 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:37:05.968 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:37:05.969 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:37:05.970 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 msgr2=0x7f31740710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 0x7f31740710b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3184004890 tx=0x7f3184009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 msgr2=0x7f318810de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f317800eb40 tx=0x7f317800b040 comp rx=0 tx=0).stop 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 shutdown_connections 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f317406ec00 0x7f31740710b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3188066f50 0x7f318810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 --2- 172.21.15.82:0/2564409307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31880fff10 0x7f318810de00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 >> 172.21.15.82:0/2564409307 conn(0x7f31880f7480 msgr2=0x7f31880f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 shutdown_connections 2024-04-27T07:37:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:05.967+0000 7f318fd4b700 1 -- 172.21.15.82:0/2564409307 wait complete. 2024-04-27T07:37:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:37:06.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 -- 172.21.15.82:0/3094487021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 msgr2=0x7ff6d40fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 --2- 172.21.15.82:0/3094487021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d40fe440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0004940 tx=0x7ff6d0009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 -- 172.21.15.82:0/3094487021 shutdown_connections 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 --2- 172.21.15.82:0/3094487021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d40fe440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 --2- 172.21.15.82:0/3094487021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 0x7ff6d40fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 -- 172.21.15.82:0/3094487021 >> 172.21.15.82:0/3094487021 conn(0x7ff6d40f8520 msgr2=0x7ff6d40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 -- 172.21.15.82:0/3094487021 shutdown_connections 2024-04-27T07:37:06.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.071+0000 7ff6db767700 1 -- 172.21.15.82:0/3094487021 wait complete. 2024-04-27T07:37:06.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 Processor -- start 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 -- start start 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 0x7ff6d410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d410e430 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6db767700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d410e5a0 con 0x7ff6d40fce60 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50012/0 (socket says 172.21.15.82:50012) 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 -- 172.21.15.82:0/471147194 learned_addr learned my addr 172.21.15.82:0/471147194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d9503700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 0x7ff6d410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 -- 172.21.15.82:0/471147194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 msgr2=0x7ff6d410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 0x7ff6d410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 -- 172.21.15.82:0/471147194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0005040 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.072+0000 7ff6d8d02700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b3b0 tx=0x7ff6d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:06.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.073+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d000e040 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.073+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6d000bbf0 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.073+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d001c630 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.073+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4112fa0 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.073+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4113530 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.074+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d404c710 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.074+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff6d000bd60 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.075+0000 7ff6c9ffb700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 0x7ff6c00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.075+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff6d008f3b0 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.075+0000 7ff6d9503700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 0x7ff6c00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.075+0000 7ff6d9503700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 0x7ff6c00710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4004f40 tx=0x7ff6c400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:06.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.079+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff6d005bdb0 con 0x7ff6d40fdfd0 2024-04-27T07:37:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:05 smithi100 ceph-mon[80397]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:05 smithi100 ceph-mon[80397]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:05 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3074772369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.300+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d4102380 con 0x7ff6c006ec00 2024-04-27T07:37:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.301+0000 7ff6c9ffb700 1 -- 172.21.15.82:0/471147194 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff6d4102380 con 0x7ff6c006ec00 2024-04-27T07:37:06.303 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:37:06.303 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:37:06.303 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "7/21 daemons upgraded", 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:37:06.304 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:37:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 msgr2=0x7ff6c00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 0x7ff6c00710b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4004f40 tx=0x7ff6c400b040 comp rx=0 tx=0).stop 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 msgr2=0x7ff6d410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b3b0 tx=0x7ff6d0009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 shutdown_connections 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff6c006ec00 0x7ff6c00710b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6d40fce60 0x7ff6d410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 --2- 172.21.15.82:0/471147194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d40fdfd0 0x7ff6d410de30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.304+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 >> 172.21.15.82:0/471147194 conn(0x7ff6d40f8520 msgr2=0x7ff6d40f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.305+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 shutdown_connections 2024-04-27T07:37:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.305+0000 7ff6db767700 1 -- 172.21.15.82:0/471147194 wait complete. 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.405+0000 7f500b092700 1 -- 172.21.15.82:0/357536100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 msgr2=0x7f50040fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 --2- 172.21.15.82:0/357536100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f50040fe3a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0004940 tx=0x7f4ff0009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 -- 172.21.15.82:0/357536100 shutdown_connections 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 --2- 172.21.15.82:0/357536100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f50040fe3a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 --2- 172.21.15.82:0/357536100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 0x7f50040fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 -- 172.21.15.82:0/357536100 >> 172.21.15.82:0/357536100 conn(0x7f50040f6bd0 msgr2=0x7f50040f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 -- 172.21.15.82:0/357536100 shutdown_connections 2024-04-27T07:37:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 -- 172.21.15.82:0/357536100 wait complete. 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 Processor -- start 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.406+0000 7f500b092700 1 -- start start 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 0x7f500410db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500410e6b0 con 0x7f50040fbb40 2024-04-27T07:37:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500410e820 con 0x7f50040fb1f0 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50036/0 (socket says 172.21.15.82:50036) 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 -- 172.21.15.82:0/2138344234 learned_addr learned my addr 172.21.15.82:0/2138344234 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5008e2e700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 0x7f500410db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 -- 172.21.15.82:0/2138344234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 msgr2=0x7f500410db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 0x7f500410db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 -- 172.21.15.82:0/2138344234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0005040 con 0x7f50040fbb40 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f5003fff700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000b3b0 tx=0x7f4ff0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff000e040 con 0x7f50040fbb40 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5004113220 con 0x7f50040fbb40 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ff000bbf0 con 0x7f50040fbb40 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff001c630 con 0x7f50040fbb40 2024-04-27T07:37:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.407+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50041137e0 con 0x7f50040fbb40 2024-04-27T07:37:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.408+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500404c710 con 0x7f50040fbb40 2024-04-27T07:37:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.409+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4ff000bd60 con 0x7f50040fbb40 2024-04-27T07:37:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.409+0000 7f50017fa700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 0x7f4ff40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.409+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4ff008f3b0 con 0x7f50040fbb40 2024-04-27T07:37:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.409+0000 7f5008e2e700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 0x7f4ff40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.410+0000 7f5008e2e700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 0x7f4ff40710b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8004f60 tx=0x7f4ff800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:06.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.414+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4ff005bdb0 con 0x7f50040fbb40 2024-04-27T07:37:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.695+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5004113ac0 con 0x7f50040fbb40 2024-04-27T07:37:06.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.695+0000 7f50017fa700 1 -- 172.21.15.82:0/2138344234 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4ff005b940 con 0x7f50040fbb40 2024-04-27T07:37:06.698 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:37:06.698 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:37:06.698 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.697+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 msgr2=0x7f4ff40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.697+0000 7f500b092700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 0x7f4ff40710b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8004f60 tx=0x7f4ff800b040 comp rx=0 tx=0).stop 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.697+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 msgr2=0x7f500410e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.697+0000 7f500b092700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000b3b0 tx=0x7f4ff0009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 shutdown_connections 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4ff406ec00 0x7f4ff40710b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50040fb1f0 0x7f500410db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 --2- 172.21.15.82:0/2138344234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50040fbb40 0x7f500410e0b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:06.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 >> 172.21.15.82:0/2138344234 conn(0x7f50040f6bd0 msgr2=0x7f50040f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:06.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 shutdown_connections 2024-04-27T07:37:06.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:06.698+0000 7f500b092700 1 -- 172.21.15.82:0/2138344234 wait complete. 2024-04-27T07:37:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:06 smithi082 ceph-mon[91103]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:06 smithi082 ceph-mon[91103]: pgmap v58: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s 2024-04-27T07:37:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:06 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2564409307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:37:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:06 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2138344234' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:37:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:06 smithi100 ceph-mon[80397]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:06 smithi100 ceph-mon[80397]: pgmap v58: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 614 B/s wr, 4 op/s 2024-04-27T07:37:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:06 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2564409307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:37:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:06 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2138344234' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:37:08.061 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:07 smithi082 ceph-mon[91103]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:07 smithi100 ceph-mon[80397]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:08 smithi082 ceph-mon[91103]: pgmap v59: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 557 B/s wr, 5 op/s 2024-04-27T07:37:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:08 smithi100 ceph-mon[80397]: pgmap v59: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 557 B/s wr, 5 op/s 2024-04-27T07:37:11.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:10 smithi082 ceph-mon[91103]: pgmap v60: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T07:37:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:10 smithi100 ceph-mon[80397]: pgmap v60: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T07:37:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:12 smithi082 ceph-mon[91103]: pgmap v61: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T07:37:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:12 smithi100 ceph-mon[80397]: pgmap v61: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T07:37:15.085 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:14 smithi082 ceph-mon[91103]: pgmap v62: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:15.085 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:15.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:14 smithi100 ceph-mon[80397]: pgmap v62: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:15.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:16.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:15 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:16.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:15 smithi082 ceph-mon[91103]: Upgrade: osd.1 is safe to restart 2024-04-27T07:37:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:15 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-27T07:37:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:15 smithi100 ceph-mon[80397]: Upgrade: osd.1 is safe to restart 2024-04-27T07:37:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:16 smithi082 ceph-mon[91103]: pgmap v63: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:37:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:16 smithi100 ceph-mon[80397]: pgmap v63: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-27T07:37:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:17 smithi082 ceph-mon[91103]: Upgrade: Updating osd.1 2024-04-27T07:37:17.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:17 smithi082 ceph-mon[91103]: Deploying daemon osd.1 on smithi082 2024-04-27T07:37:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:17 smithi100 ceph-mon[80397]: Upgrade: Updating osd.1 2024-04-27T07:37:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:17 smithi100 ceph-mon[80397]: Deploying daemon osd.1 on smithi082 2024-04-27T07:37:18.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:18 smithi082 ceph-mon[91103]: pgmap v64: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:37:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:18 smithi100 ceph-mon[80397]: pgmap v64: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:37:19.505 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:19 smithi082 systemd[1]: Stopping Ceph osd.1 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:37:19.840 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:19 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[52173]: 2024-04-27T07:37:19.503+0000 7f309e8ca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:37:19.840 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:19 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[52173]: 2024-04-27T07:37:19.503+0000 7f309e8ca700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-27T07:37:19.841 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:19 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[52173]: 2024-04-27T07:37:19.503+0000 7f309e8ca700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:37:20.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:19 smithi082 ceph-mon[91103]: osd.1 marked itself down and dead 2024-04-27T07:37:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:19 smithi100 ceph-mon[80397]: osd.1 marked itself down and dead 2024-04-27T07:37:20.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:20 smithi082 podman[105152]: 2024-04-27 07:37:20.34060312 +0000 UTC m=+0.949858322 container died caa0d8b94dedf44b4dc639cf10739b4c020e76cd3a389b2c385a36b7b715bf1b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-27T07:37:20.990 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:20 smithi082 ceph-mon[91103]: pgmap v65: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:20.990 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:20 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:37:20.990 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:20 smithi082 ceph-mon[91103]: osdmap e55: 6 total, 5 up, 6 in 2024-04-27T07:37:20.990 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:20 smithi082 podman[105152]: 2024-04-27 07:37:20.695399907 +0000 UTC m=+1.304655099 container cleanup caa0d8b94dedf44b4dc639cf10739b4c020e76cd3a389b2c385a36b7b715bf1b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, RELEASE=quincy-2be3efa, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-27T07:37:20.990 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:20 smithi082 bash[105152]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1 2024-04-27T07:37:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:20 smithi100 ceph-mon[80397]: pgmap v65: 65 pgs: 65 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:20 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:37:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:20 smithi100 ceph-mon[80397]: osdmap e55: 6 total, 5 up, 6 in 2024-04-27T07:37:21.321 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:20 smithi082 podman[105170]: 2024-04-27 07:37:20.988435095 +0000 UTC m=+0.645446205 container remove caa0d8b94dedf44b4dc639cf10739b4c020e76cd3a389b2c385a36b7b715bf1b (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-27T07:37:21.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.223661893 +0000 UTC m=+0.018328825 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:37:21.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.331106678 +0000 UTC m=+0.125773650 container create eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:37:21.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.566911103 +0000 UTC m=+0.361578012 container init eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:37:21.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.57009887 +0000 UTC m=+0.364765787 container start eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-27T07:37:22.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:21 smithi082 ceph-mon[91103]: osdmap e56: 6 total, 5 up, 6 in 2024-04-27T07:37:22.093 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.650223703 +0000 UTC m=+0.444890625 container attach eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-27T07:37:22.093 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:21 smithi082 podman[105259]: 2024-04-27 07:37:21.864309458 +0000 UTC m=+0.658976388 container died eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, ceph=True) 2024-04-27T07:37:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:21 smithi100 ceph-mon[80397]: osdmap e56: 6 total, 5 up, 6 in 2024-04-27T07:37:22.843 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 podman[105285]: 2024-04-27 07:37:22.487928192 +0000 UTC m=+0.618469239 container remove eba84049ba55472f4cf1b3c8e02c5b6d9139637f7b5370dcfde727c95a52173c (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:37:22.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-27T07:37:22.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 systemd[1]: Stopped Ceph osd.1 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:37:22.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.1.service: Consumed 53.146s CPU time. 2024-04-27T07:37:22.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 systemd[1]: Starting Ceph osd.1 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:37:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:22 smithi100 ceph-mon[80397]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/384 objects degraded (13.021%) 2024-04-27T07:37:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:22 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 50/384 objects degraded (13.021%), 14 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:23.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:22 smithi082 ceph-mon[91103]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/384 objects degraded (13.021%) 2024-04-27T07:37:23.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:22 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 50/384 objects degraded (13.021%), 14 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:23.202 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 podman[105386]: 2024-04-27 07:37:22.854601862 +0000 UTC m=+0.018926882 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:37:23.202 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:22 smithi082 podman[105386]: 2024-04-27 07:37:22.955887468 +0000 UTC m=+0.120212518 container create 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-27T07:37:23.203 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 podman[105386]: 2024-04-27 07:37:23.200908425 +0000 UTC m=+0.365233432 container init 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:37:23.490 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 podman[105386]: 2024-04-27 07:37:23.204427906 +0000 UTC m=+0.368752920 container start 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-27T07:37:23.490 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 podman[105386]: 2024-04-27 07:37:23.300043134 +0000 UTC m=+0.464368149 container attach 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-27T07:37:23.843 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 bash[105386]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-27T07:37:23.844 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate[105402]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-27T07:37:23.845 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:23 smithi082 podman[105386]: 2024-04-27 07:37:23.73567119 +0000 UTC m=+0.899996186 container died 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-27T07:37:24.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 podman[105545]: 2024-04-27 07:37:24.337460582 +0000 UTC m=+0.592907611 container remove 83f1442a1727b32332c4123085d93dc7e1ab6a94c63c34c9a306c675461ba19e (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-27T07:37:24.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 podman[105613]: 2024-04-27 07:37:24.452163243 +0000 UTC m=+0.018022927 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:37:24.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 podman[105613]: 2024-04-27 07:37:24.555207453 +0000 UTC m=+0.121067170 container create 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b) 2024-04-27T07:37:24.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:24 smithi082 ceph-mon[91103]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/384 objects degraded (13.021%) 2024-04-27T07:37:24.920 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 podman[105613]: 2024-04-27 07:37:24.799883805 +0000 UTC m=+0.365743489 container init 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-27T07:37:24.921 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 podman[105613]: 2024-04-27 07:37:24.803427882 +0000 UTC m=+0.369287557 container start 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:37:24.921 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 ceph-osd[105632]: -- 172.21.15.82:0/359859179 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56230061f680 con 0x5623005e8c00 2024-04-27T07:37:24.921 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 bash[105613]: 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b 2024-04-27T07:37:24.921 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:24 smithi082 systemd[1]: Started Ceph osd.1 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:37:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:24 smithi100 ceph-mon[80397]: pgmap v69: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/384 objects degraded (13.021%) 2024-04-27T07:37:25.805 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:37:25.347+0000 7f4ee0c9e7c0 -1 Falling back to public interface 2024-04-27T07:37:26.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:26.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:26.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:26.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:27.628 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:27 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 59/384 objects degraded (15.365%), 16 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:27.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:27 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 59/384 objects degraded (15.365%), 16 pgs degraded (PG_DEGRADED) 2024-04-27T07:37:28.826 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:28 smithi082 ceph-mon[91103]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:28 smithi100 ceph-mon[80397]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:30.343 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:29 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:37:29.998+0000 7f4ee0c9e7c0 -1 osd.1 54 log_to_monitors true 2024-04-27T07:37:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:30 smithi082 ceph-mon[91103]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:30 smithi082 ceph-mon[91103]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-27T07:37:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:30 smithi100 ceph-mon[80397]: pgmap v72: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:30 smithi100 ceph-mon[80397]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-27T07:37:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:32.093 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:37:31.810+0000 7f4ece0ee700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:37:32.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-27T07:37:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: osdmap e57: 6 total, 5 up, 6 in 2024-04-27T07:37:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:37:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:32.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:31 smithi082 ceph-mon[91103]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' 2024-04-27T07:37:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-27T07:37:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: osdmap e57: 6 total, 5 up, 6 in 2024-04-27T07:37:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:37:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:32.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:31 smithi100 ceph-mon[80397]: from='osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686]' entity='osd.1' 2024-04-27T07:37:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:32 smithi082 ceph-mon[91103]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:32 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:37:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:32 smithi082 ceph-mon[91103]: osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686] boot 2024-04-27T07:37:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:32 smithi082 ceph-mon[91103]: osdmap e58: 6 total, 6 up, 6 in 2024-04-27T07:37:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:37:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:32 smithi100 ceph-mon[80397]: pgmap v74: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 59/384 objects degraded (15.365%) 2024-04-27T07:37:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:32 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:37:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:32 smithi100 ceph-mon[80397]: osd.1 [v2:172.21.15.82:6810/247193686,v1:172.21.15.82:6811/247193686] boot 2024-04-27T07:37:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:32 smithi100 ceph-mon[80397]: osdmap e58: 6 total, 6 up, 6 in 2024-04-27T07:37:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-27T07:37:34.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:34 smithi082 ceph-mon[91103]: pgmap v76: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 59/384 objects degraded (15.365%) 2024-04-27T07:37:34.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:34 smithi082 ceph-mon[91103]: osdmap e59: 6 total, 6 up, 6 in 2024-04-27T07:37:35.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:34 smithi100 ceph-mon[80397]: pgmap v76: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 59/384 objects degraded (15.365%) 2024-04-27T07:37:35.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:34 smithi100 ceph-mon[80397]: osdmap e59: 6 total, 6 up, 6 in 2024-04-27T07:37:36.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-27T07:37:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:35 smithi082 ceph-mon[91103]: pgmap v78: 65 pgs: 1 active, 16 active+undersized+degraded, 16 active+undersized, 32 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 59/384 objects degraded (15.365%) 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-27T07:37:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:35 smithi100 ceph-mon[80397]: pgmap v78: 65 pgs: 1 active, 16 active+undersized+degraded, 16 active+undersized, 32 active+clean; 337 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 59/384 objects degraded (15.365%) 2024-04-27T07:37:36.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 -- 172.21.15.82:0/4033858119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 msgr2=0x7fd754102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:36.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 --2- 172.21.15.82:0/4033858119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd754102390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd744004940 tx=0x7fd744009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 -- 172.21.15.82:0/4033858119 shutdown_connections 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 --2- 172.21.15.82:0/4033858119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd754102390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 --2- 172.21.15.82:0/4033858119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 0x7fd7540ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 -- 172.21.15.82:0/4033858119 >> 172.21.15.82:0/4033858119 conn(0x7fd7540f7440 msgr2=0x7fd7540f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 -- 172.21.15.82:0/4033858119 shutdown_connections 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.815+0000 7fd75ba67700 1 -- 172.21.15.82:0/4033858119 wait complete. 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 Processor -- start 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 -- start start 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 0x7fd7540fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540fd8c0 con 0x7fd7540fffb0 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd75ba67700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd754111650 con 0x7fd754066e70 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52360/0 (socket says 172.21.15.82:52360) 2024-04-27T07:37:36.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 -- 172.21.15.82:0/873614463 learned_addr learned my addr 172.21.15.82:0/873614463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759803700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 0x7fd7540fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 -- 172.21.15.82:0/873614463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 msgr2=0x7fd7540fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 0x7fd7540fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 -- 172.21.15.82:0/873614463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744005040 con 0x7fd7540fffb0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.816+0000 7fd759002700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd74400b970 tx=0x7fd744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.817+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74400e040 con 0x7fd7540fffb0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.817+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7541118a0 con 0x7fd7540fffb0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.817+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd744004290 con 0x7fd7540fffb0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.817+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74401c630 con 0x7fd7540fffb0 2024-04-27T07:37:36.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.817+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7540fc2e0 con 0x7fd7540fffb0 2024-04-27T07:37:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.818+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75404c710 con 0x7fd7540fffb0 2024-04-27T07:37:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.818+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd74400bbf0 con 0x7fd7540fffb0 2024-04-27T07:37:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.819+0000 7fd74a7fc700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 0x7fd7400710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.819+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd74408f9f0 con 0x7fd7540fffb0 2024-04-27T07:37:36.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.819+0000 7fd759803700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 0x7fd7400710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:36.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.819+0000 7fd759803700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 0x7fd7400710b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd750009fd0 tx=0x7fd750009f00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:36.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:36.824+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd744091e60 con 0x7fd7540fffb0 2024-04-27T07:37:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.044+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7541117e0 con 0x7fd74006ec00 2024-04-27T07:37:37.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.046+0000 7fd74a7fc700 1 -- 172.21.15.82:0/873614463 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd7541117e0 con 0x7fd74006ec00 2024-04-27T07:37:37.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 msgr2=0x7fd7400710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 0x7fd7400710b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd750009fd0 tx=0x7fd750009f00 comp rx=0 tx=0).stop 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 msgr2=0x7fd7540fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd74400b970 tx=0x7fd744009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 shutdown_connections 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd74006ec00 0x7fd7400710b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd754066e70 0x7fd7540fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 --2- 172.21.15.82:0/873614463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7540fffb0 0x7fd7540fb970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 >> 172.21.15.82:0/873614463 conn(0x7fd7540f7440 msgr2=0x7fd7540f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 shutdown_connections 2024-04-27T07:37:37.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.048+0000 7fd75ba67700 1 -- 172.21.15.82:0/873614463 wait complete. 2024-04-27T07:37:37.061 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 -- 172.21.15.82:0/2456461499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 msgr2=0x7f30bc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/2456461499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc0fd3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30ac004940 tx=0x7f30ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 -- 172.21.15.82:0/2456461499 shutdown_connections 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/2456461499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc0fd3d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/2456461499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 -- 172.21.15.82:0/2456461499 >> 172.21.15.82:0/2456461499 conn(0x7f30bc0f7430 msgr2=0x7f30bc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 -- 172.21.15.82:0/2456461499 shutdown_connections 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.151+0000 7f30c1ffb700 1 -- 172.21.15.82:0/2456461499 wait complete. 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 Processor -- start 2024-04-27T07:37:37.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 -- start start 2024-04-27T07:37:37.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc066350 con 0x7f30bc0fcf60 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30c1ffb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc066490 con 0x7f30bc0fbcb0 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52382/0 (socket says 172.21.15.82:52382) 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 -- 172.21.15.82:0/1885399085 learned_addr learned my addr 172.21.15.82:0/1885399085 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30bb7fe700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 -- 172.21.15.82:0/1885399085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 msgr2=0x7f30bc110700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc110700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.152+0000 7f30baffd700 1 -- 172.21.15.82:0/1885399085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac005040 con 0x7f30bc0fcf60 2024-04-27T07:37:37.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30bb7fe700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30baffd700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b3b0 tx=0x7f30ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30ac00e040 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30ac00bcc0 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30ac01c630 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc1131f0 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.153+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc113730 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.154+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc05f5c0 con 0x7f30bc0fcf60 2024-04-27T07:37:37.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.154+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f30ac013980 con 0x7f30bc0fcf60 2024-04-27T07:37:37.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.155+0000 7f30a3fff700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 0x7f30a40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.155+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f30ac08f4f0 con 0x7f30bc0fcf60 2024-04-27T07:37:37.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.155+0000 7f30bb7fe700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 0x7f30a40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.155+0000 7f30bb7fe700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 0x7f30a40710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009fd0 tx=0x7f30b000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.160+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f30ac058340 con 0x7f30bc0fcf60 2024-04-27T07:37:37.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.377+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30bc1012c0 con 0x7f30a406ec00 2024-04-27T07:37:37.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.378+0000 7f30a3fff700 1 -- 172.21.15.82:0/1885399085 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f30bc1012c0 con 0x7f30a406ec00 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 msgr2=0x7f30a40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 0x7f30a40710b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009fd0 tx=0x7f30b000b040 comp rx=0 tx=0).stop 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 msgr2=0x7f30bc112c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b3b0 tx=0x7f30ac009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 shutdown_connections 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30a406ec00 0x7f30a40710b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30bc0fbcb0 0x7f30bc110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 --2- 172.21.15.82:0/1885399085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30bc0fcf60 0x7f30bc112c50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.380+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 >> 172.21.15.82:0/1885399085 conn(0x7f30bc0f7430 msgr2=0x7f30bc0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.381+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 shutdown_connections 2024-04-27T07:37:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.381+0000 7f30c1ffb700 1 -- 172.21.15.82:0/1885399085 wait complete. 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 -- 172.21.15.82:0/1254324875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 msgr2=0x7fe8780fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 --2- 172.21.15.82:0/1254324875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe8780fd270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe868004940 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 -- 172.21.15.82:0/1254324875 shutdown_connections 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 --2- 172.21.15.82:0/1254324875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 0x7fe8780fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 --2- 172.21.15.82:0/1254324875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe8780fd270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 -- 172.21.15.82:0/1254324875 >> 172.21.15.82:0/1254324875 conn(0x7fe8780f8540 msgr2=0x7fe8780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 -- 172.21.15.82:0/1254324875 shutdown_connections 2024-04-27T07:37:37.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.481+0000 7fe880744700 1 -- 172.21.15.82:0/1254324875 wait complete. 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 Processor -- start 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 -- start start 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 0x7fe8780702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878072200 con 0x7fe8780fce60 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe880744700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780707f0 con 0x7fe8780fdfd0 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe87e4e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe87e4e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52398/0 (socket says 172.21.15.82:52398) 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe87e4e0700 1 -- 172.21.15.82:0/48066104 learned_addr learned my addr 172.21.15.82:0/48066104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:37.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.482+0000 7fe87dcdf700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 0x7fe8780702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe87e4e0700 1 -- 172.21.15.82:0/48066104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 msgr2=0x7fe8780702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe87e4e0700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 0x7fe8780702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe87e4e0700 1 -- 172.21.15.82:0/48066104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868005040 con 0x7fe8780fce60 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe87e4e0700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe86800b3b0 tx=0x7fe868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86800e040 con 0x7fe8780fce60 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe86800bbf0 con 0x7fe8780fce60 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878070a40 con 0x7fe8780fce60 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe878071000 con 0x7fe8780fce60 2024-04-27T07:37:37.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.483+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86801c630 con 0x7fe8780fce60 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.484+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c0052e0 con 0x7fe8780fce60 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.485+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe86800bd60 con 0x7fe8780fce60 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.485+0000 7fe86effd700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 0x7fe8640710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.485+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe86808f1e0 con 0x7fe8780fce60 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.485+0000 7fe87dcdf700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 0x7fe8640710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.485+0000 7fe87dcdf700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 0x7fe8640710b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8740041d0 tx=0x7fe8740043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.491+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe86805bc80 con 0x7fe8780fce60 2024-04-27T07:37:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.700+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe85c000bf0 con 0x7fe86406ec00 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.711+0000 7fe86effd700 1 -- 172.21.15.82:0/48066104 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe85c000bf0 con 0x7fe86406ec00 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (3m) 7s ago 12m 25.7M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (75s) 7s ago 12m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (70s) 66s ago 11m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (3m) 7s ago 12m 85.2M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (7m) 7s ago 7m 64.5M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:37:37.713 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (7m) 7s ago 7m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (7m) 66s ago 7m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (7m) 66s ago 7m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (3m) 7s ago 13m 501M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (2m) 66s ago 11m 450M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (2m) 7s ago 14m 47.6M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (117s) 66s ago 11m 31.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (4m) 7s ago 12m 16.1M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (3m) 66s ago 11m 15.2M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (49s) 7s ago 10m 86.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (13s) 7s ago 10m 15.1M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:37:37.714 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (9m) 7s ago 9m 156M 1557M 17.2.7-907-g2be3efa9 1c5834633715 e4546fa1a384 2024-04-27T07:37:37.715 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (9m) 66s ago 9m 220M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:37:37.715 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (8m) 66s ago 8m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:37:37.715 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (8m) 66s ago 8m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:37:37.715 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 7s ago 12m 59.0M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:37:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 msgr2=0x7fe8640710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 0x7fe8640710b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8740041d0 tx=0x7fe8740043c0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 msgr2=0x7fe878071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe86800b3b0 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 shutdown_connections 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe86406ec00 0x7fe8640710b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8780fce60 0x7fe878071c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 --2- 172.21.15.82:0/48066104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8780fdfd0 0x7fe8780702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 >> 172.21.15.82:0/48066104 conn(0x7fe8780f8540 msgr2=0x7fe8780f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 shutdown_connections 2024-04-27T07:37:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.713+0000 7fe880744700 1 -- 172.21.15.82:0/48066104 wait complete. 2024-04-27T07:37:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 -- 172.21.15.82:0/353029575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fcff0 msgr2=0x7fd3940fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 --2- 172.21.15.82:0/353029575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fcff0 0x7fd3940fd460 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd388004940 tx=0x7fd388009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 -- 172.21.15.82:0/353029575 shutdown_connections 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 --2- 172.21.15.82:0/353029575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fcff0 0x7fd3940fd460 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 --2- 172.21.15.82:0/353029575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fbd40 0x7fd3940fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 -- 172.21.15.82:0/353029575 >> 172.21.15.82:0/353029575 conn(0x7fd3940f74c0 msgr2=0x7fd3940f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 -- 172.21.15.82:0/353029575 shutdown_connections 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.813+0000 7fd399f7b700 1 -- 172.21.15.82:0/353029575 wait complete. 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 Processor -- start 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 -- start start 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fcff0 0x7fd394110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394110790 con 0x7fd3940fbd40 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd399f7b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd394110f90 con 0x7fd3940fcff0 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd3937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52408/0 (socket says 172.21.15.82:52408) 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.814+0000 7fd3937fe700 1 -- 172.21.15.82:0/4212939330 learned_addr learned my addr 172.21.15.82:0/4212939330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd392ffd700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fcff0 0x7fd394110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd3937fe700 1 -- 172.21.15.82:0/4212939330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fcff0 msgr2=0x7fd394110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd3937fe700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fcff0 0x7fd394110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd3937fe700 1 -- 172.21.15.82:0/4212939330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388005040 con 0x7fd3940fbd40 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd3937fe700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd384002a50 tx=0x7fd3840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd384007cc0 con 0x7fd3940fbd40 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd38400f040 con 0x7fd3940fbd40 2024-04-27T07:37:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd394111270 con 0x7fd3940fbd40 2024-04-27T07:37:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd38400da30 con 0x7fd3940fbd40 2024-04-27T07:37:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.815+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3941117b0 con 0x7fd3940fbd40 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.816+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd394101980 con 0x7fd3940fbd40 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.817+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd38400db90 con 0x7fd3940fbd40 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.817+0000 7fd37bfff700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 0x7fd37c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.817+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd38408e580 con 0x7fd3940fbd40 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.817+0000 7fd392ffd700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 0x7fd37c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.818+0000 7fd392ffd700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 0x7fd37c0710b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b970 tx=0x7fd388009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:37.822+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd38405af00 con 0x7fd3940fbd40 2024-04-27T07:37:38.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:37 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/384 objects degraded (15.365%), 16 pgs degraded) 2024-04-27T07:37:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.107+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3941048e0 con 0x7fd3940fbd40 2024-04-27T07:37:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.107+0000 7fd37bfff700 1 -- 172.21.15.82:0/4212939330 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fd38405aa90 con 0x7fd3940fbd40 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-27T07:37:38.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 8, 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:37:38.111 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 msgr2=0x7fd37c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 0x7fd37c0710b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b970 tx=0x7fd388009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 msgr2=0x7fd39410fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd384002a50 tx=0x7fd3840046b0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 shutdown_connections 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd37c06ec00 0x7fd37c0710b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3940fbd40 0x7fd39410fc50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 --2- 172.21.15.82:0/4212939330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3940fcff0 0x7fd394110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 >> 172.21.15.82:0/4212939330 conn(0x7fd3940f74c0 msgr2=0x7fd394066410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 shutdown_connections 2024-04-27T07:37:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.110+0000 7fd399f7b700 1 -- 172.21.15.82:0/4212939330 wait complete. 2024-04-27T07:37:38.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:37 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/384 objects degraded (15.365%), 16 pgs degraded) 2024-04-27T07:37:38.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 -- 172.21.15.82:0/2458212903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 msgr2=0x7fa29c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 --2- 172.21.15.82:0/2458212903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c0fd3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa298004940 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 -- 172.21.15.82:0/2458212903 shutdown_connections 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 --2- 172.21.15.82:0/2458212903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c0fd3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 --2- 172.21.15.82:0/2458212903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 0x7fa29c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 -- 172.21.15.82:0/2458212903 >> 172.21.15.82:0/2458212903 conn(0x7fa29c0f7430 msgr2=0x7fa29c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 -- 172.21.15.82:0/2458212903 shutdown_connections 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.212+0000 7fa2a341f700 1 -- 172.21.15.82:0/2458212903 wait complete. 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 Processor -- start 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 -- start start 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 0x7fa29c110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c066350 con 0x7fa29c0fcf60 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c066490 con 0x7fa29c0fbcb0 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52418/0 (socket says 172.21.15.82:52418) 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 -- 172.21.15.82:0/560972406 learned_addr learned my addr 172.21.15.82:0/560972406 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a11bb700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 0x7fa29c110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 -- 172.21.15.82:0/560972406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 msgr2=0x7fa29c110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 0x7fa29c110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 -- 172.21.15.82:0/560972406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298005040 con 0x7fa29c0fcf60 2024-04-27T07:37:38.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a09ba700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b3b0 tx=0x7fa298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29800e040 con 0x7fa29c0fcf60 2024-04-27T07:37:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa29800bcc0 con 0x7fa29c0fcf60 2024-04-27T07:37:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c113220 con 0x7fa29c0fcf60 2024-04-27T07:37:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.213+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29801c630 con 0x7fa29c0fcf60 2024-04-27T07:37:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.214+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c1137b0 con 0x7fa29c0fcf60 2024-04-27T07:37:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.215+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c05f5c0 con 0x7fa29c0fcf60 2024-04-27T07:37:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.215+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa298013980 con 0x7fa29c0fcf60 2024-04-27T07:37:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.216+0000 7fa291ffb700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 0x7fa2880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.216+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa29808f500 con 0x7fa29c0fcf60 2024-04-27T07:37:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.216+0000 7fa2a11bb700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 0x7fa2880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.216+0000 7fa2a11bb700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 0x7fa2880710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0041d0 tx=0x7fa28c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.220+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa298058350 con 0x7fa29c0fcf60 2024-04-27T07:37:38.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.460+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa29c04bed0 con 0x7fa29c0fcf60 2024-04-27T07:37:38.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.461+0000 7fa291ffb700 1 -- 172.21.15.82:0/560972406 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1932 (secure 0 0 0) 0x7fa29805ba10 con 0x7fa29c0fcf60 2024-04-27T07:37:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:e17 2024-04-27T07:37:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 17 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:34:07.591618+0000 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:37:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:37:38.465 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 msgr2=0x7fa2880710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 0x7fa2880710b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0041d0 tx=0x7fa28c009040 comp rx=0 tx=0).stop 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 msgr2=0x7fa29c112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa29800b3b0 tx=0x7fa298009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 shutdown_connections 2024-04-27T07:37:38.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa28806ec00 0x7fa2880710b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa29c0fbcb0 0x7fa29c110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 --2- 172.21.15.82:0/560972406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c0fcf60 0x7fa29c112c80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.463+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 >> 172.21.15.82:0/560972406 conn(0x7fa29c0f7430 msgr2=0x7fa29c0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.464+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 shutdown_connections 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.464+0000 7fa2a341f700 1 -- 172.21.15.82:0/560972406 wait complete. 2024-04-27T07:37:38.468 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 -- 172.21.15.82:0/1769004017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fbcc0 msgr2=0x7f45c40fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1769004017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fbcc0 0x7f45c40fc0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45b4004940 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 -- 172.21.15.82:0/1769004017 shutdown_connections 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1769004017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fcf70 0x7f45c40fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1769004017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fbcc0 0x7f45c40fc0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 -- 172.21.15.82:0/1769004017 >> 172.21.15.82:0/1769004017 conn(0x7f45c40f7440 msgr2=0x7f45c40f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 -- 172.21.15.82:0/1769004017 shutdown_connections 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.565+0000 7f45cb44b700 1 -- 172.21.15.82:0/1769004017 wait complete. 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 Processor -- start 2024-04-27T07:37:38.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 -- start start 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fbcc0 0x7f45c410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c410e570 con 0x7f45c40fcf70 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45cb44b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c410e6e0 con 0x7f45c40fbcc0 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52440/0 (socket says 172.21.15.82:52440) 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 -- 172.21.15.82:0/1094826515 learned_addr learned my addr 172.21.15.82:0/1094826515 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c91e7700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fbcc0 0x7f45c410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 -- 172.21.15.82:0/1094826515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fbcc0 msgr2=0x7f45c410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fbcc0 0x7f45c410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.566+0000 7f45c89e6700 1 -- 172.21.15.82:0/1094826515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4005040 con 0x7f45c40fcf70 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45c89e6700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45c0002a50 tx=0x7f45c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c0007cc0 con 0x7f45c40fcf70 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c41130a0 con 0x7f45c40fcf70 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45c000f040 con 0x7f45c40fcf70 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c000da30 con 0x7f45c40fcf70 2024-04-27T07:37:38.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.567+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4113660 con 0x7f45c40fcf70 2024-04-27T07:37:38.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.568+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4101b00 con 0x7f45c40fcf70 2024-04-27T07:37:38.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.568+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f45c000db90 con 0x7f45c40fcf70 2024-04-27T07:37:38.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.569+0000 7f45b9ffb700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 0x7f45b00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.569+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f45c008e580 con 0x7f45c40fcf70 2024-04-27T07:37:38.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.569+0000 7f45c91e7700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 0x7f45b00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.569+0000 7f45c91e7700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 0x7f45b00710b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45b400b970 tx=0x7f45b4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.573+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f45c005af00 con 0x7f45c40fcf70 2024-04-27T07:37:38.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.793+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45c402b310 con 0x7f45b006ec00 2024-04-27T07:37:38.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.794+0000 7f45b9ffb700 1 -- 172.21.15.82:0/1094826515 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f45c402b310 con 0x7f45b006ec00 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:37:38.797 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:37:38.798 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:37:38.798 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "8/21 daemons upgraded", 2024-04-27T07:37:38.798 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:37:38.798 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:37:38.798 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:37:38.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.797+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 msgr2=0x7f45b00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.797+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 0x7f45b00710b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45b400b970 tx=0x7f45b4009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 msgr2=0x7f45c410df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f45c0002a50 tx=0x7f45c00046b0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 shutdown_connections 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45b006ec00 0x7f45b00710b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45c40fbcc0 0x7f45c410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 --2- 172.21.15.82:0/1094826515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c40fcf70 0x7f45c410df70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 >> 172.21.15.82:0/1094826515 conn(0x7f45c40f7440 msgr2=0x7f45c4066880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 shutdown_connections 2024-04-27T07:37:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.798+0000 7f45cb44b700 1 -- 172.21.15.82:0/1094826515 wait complete. 2024-04-27T07:37:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 -- 172.21.15.82:0/507708618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 msgr2=0x7f9e20102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 --2- 172.21.15.82:0/507708618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20102390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9e14004940 tx=0x7f9e14009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 -- 172.21.15.82:0/507708618 shutdown_connections 2024-04-27T07:37:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 --2- 172.21.15.82:0/507708618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20102390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 --2- 172.21.15.82:0/507708618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e200ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 -- 172.21.15.82:0/507708618 >> 172.21.15.82:0/507708618 conn(0x7f9e200f7420 msgr2=0x7f9e200f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 -- 172.21.15.82:0/507708618 shutdown_connections 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 -- 172.21.15.82:0/507708618 wait complete. 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.899+0000 7f9e27335700 1 Processor -- start 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 -- start start 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e2010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20110790 con 0x7f9e200fffb0 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20110f90 con 0x7f9e20066a90 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52452/0 (socket says 172.21.15.82:52452) 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 -- 172.21.15.82:0/780543759 learned_addr learned my addr 172.21.15.82:0/780543759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 -- 172.21.15.82:0/780543759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 msgr2=0x7f9e2010fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e250d1700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e2010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e2010fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 -- 172.21.15.82:0/780543759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14005040 con 0x7f9e200fffb0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e250d1700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e2010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e248d0700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000c00 tx=0x7f9e14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1400e030 con 0x7f9e200fffb0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e1401c400 con 0x7f9e200fffb0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.900+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20111210 con 0x7f9e200fffb0 2024-04-27T07:37:38.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.901+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1400b650 con 0x7f9e200fffb0 2024-04-27T07:37:38.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.901+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20111750 con 0x7f9e200fffb0 2024-04-27T07:37:38.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.902+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2005f5c0 con 0x7f9e200fffb0 2024-04-27T07:37:38.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.902+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9e1401ca90 con 0x7f9e200fffb0 2024-04-27T07:37:38.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.903+0000 7f9e1dffb700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 0x7f9e080710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:37:38.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.903+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9e14090170 con 0x7f9e200fffb0 2024-04-27T07:37:38.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.903+0000 7f9e250d1700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 0x7f9e080710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:37:38.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.903+0000 7f9e250d1700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 0x7f9e080710b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009f10 tx=0x7f9e1800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:37:38.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:38.907+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9e1405cb70 con 0x7f9e200fffb0 2024-04-27T07:37:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: pgmap v79: 65 pgs: 1 active, 64 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T07:37:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/4212939330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:39.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:38 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/560972406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:37:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: pgmap v79: 65 pgs: 1 active, 64 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T07:37:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/4212939330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:37:39.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:38 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/560972406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:37:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.190+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9e2004bed0 con 0x7f9e200fffb0 2024-04-27T07:37:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.190+0000 7f9e1dffb700 1 -- 172.21.15.82:0/780543759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f9e1405c700 con 0x7f9e200fffb0 2024-04-27T07:37:39.193 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:37:39.193 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:37:39.193 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.192+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 msgr2=0x7f9e080710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.192+0000 7f9e27335700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 0x7f9e080710b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009f10 tx=0x7f9e1800b040 comp rx=0 tx=0).stop 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.192+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 msgr2=0x7f9e20110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e14000c00 tx=0x7f9e14009e30 comp rx=0 tx=0).stop 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 shutdown_connections 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9e0806ec00 0x7f9e080710b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e20066a90 0x7f9e2010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 --2- 172.21.15.82:0/780543759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e200fffb0 0x7f9e20110190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 >> 172.21.15.82:0/780543759 conn(0x7f9e200f7420 msgr2=0x7f9e200fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:37:39.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 shutdown_connections 2024-04-27T07:37:39.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:37:39.193+0000 7f9e27335700 1 -- 172.21.15.82:0/780543759 wait complete. 2024-04-27T07:37:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:39 smithi100 ceph-mon[80397]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:39 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/780543759' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:37:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:39 smithi082 ceph-mon[91103]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:37:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:39 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/780543759' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:37:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:40 smithi100 ceph-mon[80397]: pgmap v80: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-04-27T07:37:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:40 smithi082 ceph-mon[91103]: pgmap v80: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-04-27T07:37:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:42 smithi100 ceph-mon[80397]: pgmap v81: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-27T07:37:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:42 smithi082 ceph-mon[91103]: pgmap v81: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-27T07:37:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:44 smithi100 ceph-mon[80397]: pgmap v82: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-27T07:37:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:44 smithi082 ceph-mon[91103]: pgmap v82: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-27T07:37:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:46 smithi082 ceph-mon[91103]: pgmap v83: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-27T07:37:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:46 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:37:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:46 smithi100 ceph-mon[80397]: pgmap v83: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-04-27T07:37:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:46 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:37:49.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:48 smithi082 ceph-mon[91103]: pgmap v84: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-04-27T07:37:49.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:48 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:37:49.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:48 smithi100 ceph-mon[80397]: pgmap v84: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-04-27T07:37:49.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:48 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby-replay 2024-04-27T07:37:51.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:50 smithi082 ceph-mon[91103]: pgmap v85: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:51.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:50 smithi100 ceph-mon[80397]: pgmap v85: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:51 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:51 smithi082 ceph-mon[91103]: Upgrade: osd.2 is safe to restart 2024-04-27T07:37:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:51 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-27T07:37:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:51 smithi100 ceph-mon[80397]: Upgrade: osd.2 is safe to restart 2024-04-27T07:37:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:52 smithi100 ceph-mon[80397]: pgmap v86: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:37:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:37:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:53.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:52 smithi082 ceph-mon[91103]: pgmap v86: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:37:53.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:37:53.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-27T07:37:53.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:37:54.033 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:53 smithi082 ceph-mon[91103]: Upgrade: Updating osd.2 2024-04-27T07:37:54.033 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:53 smithi082 ceph-mon[91103]: Deploying daemon osd.2 on smithi082 2024-04-27T07:37:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:53 smithi100 ceph-mon[80397]: Upgrade: Updating osd.2 2024-04-27T07:37:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:53 smithi100 ceph-mon[80397]: Deploying daemon osd.2 on smithi082 2024-04-27T07:37:54.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:54 smithi082 ceph-mon[91103]: pgmap v87: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:54 smithi100 ceph-mon[80397]: pgmap v87: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:55.593 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:55 smithi082 systemd[1]: Stopping Ceph osd.2 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:37:55.861 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[59969]: 2024-04-27T07:37:55.593+0000 7f59cb270700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:37:55.861 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[59969]: 2024-04-27T07:37:55.593+0000 7f59cb270700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-27T07:37:55.861 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[59969]: 2024-04-27T07:37:55.593+0000 7f59cb270700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:37:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:55 smithi100 ceph-mon[80397]: osd.2 marked itself down and dead 2024-04-27T07:37:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:55 smithi082 ceph-mon[91103]: osd.2 marked itself down and dead 2024-04-27T07:37:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:37:56.726 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:56 smithi082 podman[110531]: 2024-04-27 07:37:56.40053494 +0000 UTC m=+0.932743748 container died e4546fa1a384293ada34f1c4f91409984f153daf96ceddbf45fb88225b77b79e (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-27T07:37:57.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:56 smithi082 ceph-mon[91103]: pgmap v88: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:57.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:56 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:37:57.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:56 smithi082 ceph-mon[91103]: osdmap e60: 6 total, 5 up, 6 in 2024-04-27T07:37:57.035 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:56 smithi082 podman[110531]: 2024-04-27 07:37:56.832171462 +0000 UTC m=+1.364380269 container cleanup e4546fa1a384293ada34f1c4f91409984f153daf96ceddbf45fb88225b77b79e (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-27T07:37:57.035 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:56 smithi082 bash[110531]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2 2024-04-27T07:37:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:56 smithi100 ceph-mon[80397]: pgmap v88: 65 pgs: 65 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:37:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:56 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:37:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:56 smithi100 ceph-mon[80397]: osdmap e60: 6 total, 5 up, 6 in 2024-04-27T07:37:57.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110549]: 2024-04-27 07:37:57.033765972 +0000 UTC m=+0.631420321 container remove e4546fa1a384293ada34f1c4f91409984f153daf96ceddbf45fb88225b77b79e (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-27T07:37:57.747 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110638]: 2024-04-27 07:37:57.358617965 +0000 UTC m=+0.017807924 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:37:57.747 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110638]: 2024-04-27 07:37:57.476322532 +0000 UTC m=+0.135512477 container create 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-27T07:37:57.747 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110638]: 2024-04-27 07:37:57.745609001 +0000 UTC m=+0.404798945 container init 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:37:58.053 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:57 smithi082 ceph-mon[91103]: osdmap e61: 6 total, 5 up, 6 in 2024-04-27T07:37:58.053 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110638]: 2024-04-27 07:37:57.749035052 +0000 UTC m=+0.408224999 container start 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-27T07:37:58.053 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:57 smithi082 podman[110638]: 2024-04-27 07:37:57.828908414 +0000 UTC m=+0.488098376 container attach 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-27T07:37:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:57 smithi100 ceph-mon[80397]: osdmap e61: 6 total, 5 up, 6 in 2024-04-27T07:37:58.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 podman[110638]: 2024-04-27 07:37:58.051999604 +0000 UTC m=+0.711189542 container died 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0) 2024-04-27T07:37:59.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:58 smithi082 ceph-mon[91103]: pgmap v91: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-04-27T07:37:59.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:58 smithi082 ceph-mon[91103]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-27T07:37:59.094 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 podman[110664]: 2024-04-27 07:37:58.682748224 +0000 UTC m=+0.625307855 container remove 38ddfbccc6fddc437550dd69f3bdb99f27b7f784c7b1a591f6222f88fa0f99b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-27T07:37:59.094 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-27T07:37:59.094 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 systemd[1]: Stopped Ceph osd.2 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:37:59.094 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.2.service: Consumed 41.345s CPU time. 2024-04-27T07:37:59.094 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:58 smithi082 systemd[1]: Starting Ceph osd.2 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:37:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:58 smithi100 ceph-mon[80397]: pgmap v91: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-04-27T07:37:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:58 smithi100 ceph-mon[80397]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-27T07:37:59.388 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.027341729 +0000 UTC m=+0.018116379 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:37:59.388 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.150920205 +0000 UTC m=+0.141694837 container create 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-27T07:37:59.388 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.386906413 +0000 UTC m=+0.377681041 container init 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:37:59.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.390216307 +0000 UTC m=+0.380990935 container start 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0) 2024-04-27T07:37:59.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.487049972 +0000 UTC m=+0.477824602 container attach 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-27T07:38:00.188 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-mon[91103]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15/384 objects degraded (3.906%) 2024-04-27T07:38:00.188 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 15/384 objects degraded (3.906%), 4 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:00.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:00.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:00.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 bash[110764]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-27T07:38:00.189 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-27T07:38:00.190 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate[110780]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-27T07:38:00.190 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:37:59 smithi082 podman[110764]: 2024-04-27 07:37:59.89525978 +0000 UTC m=+0.886034413 container died 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-27T07:38:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:59 smithi100 ceph-mon[80397]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 15/384 objects degraded (3.906%) 2024-04-27T07:38:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:37:59 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 15/384 objects degraded (3.906%), 4 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:00.824 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 podman[110925]: 2024-04-27 07:38:00.474504966 +0000 UTC m=+0.574148015 container remove 6bc3341236b7702328072c40a3d36e6d83a71736767696924bcb7c545dcb80a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-27T07:38:00.824 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 podman[110988]: 2024-04-27 07:38:00.590331396 +0000 UTC m=+0.017941242 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:38:00.824 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 podman[110988]: 2024-04-27 07:38:00.708796919 +0000 UTC m=+0.136406749 container create 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux ) 2024-04-27T07:38:01.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 podman[110988]: 2024-04-27 07:38:00.969840693 +0000 UTC m=+0.397450521 container init 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=) 2024-04-27T07:38:01.344 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 podman[110988]: 2024-04-27 07:38:00.973003649 +0000 UTC m=+0.400613478 container start 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-27T07:38:01.344 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:00 smithi082 ceph-osd[111007]: -- 172.21.15.82:0/708415678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555849c45680 con 0x555849c0ec00 2024-04-27T07:38:01.344 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:01 smithi082 bash[110988]: 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 2024-04-27T07:38:01.344 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:01 smithi082 systemd[1]: Started Ceph osd.2 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:38:01.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:01 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:38:01.509+0000 7f1e3e7597c0 -1 Falling back to public interface 2024-04-27T07:38:02.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:02.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:02.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:02.316 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:02 smithi082 ceph-mon[91103]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:02.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:02.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:02.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:02 smithi100 ceph-mon[80397]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:03 smithi100 ceph-mon[80397]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-27T07:38:03.506 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:03 smithi082 ceph-mon[91103]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-27T07:38:04.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:04 smithi100 ceph-mon[80397]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:04.490 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:04 smithi082 ceph-mon[91103]: pgmap v94: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:05.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:05 smithi082 ceph-mon[91103]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-27T07:38:05.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:05 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:38:05.404+0000 7f1e3e7597c0 -1 osd.2 59 log_to_monitors true 2024-04-27T07:38:05.844 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:38:05 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:38:05.478+0000 7f1e2fbb1700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:38:05.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:05 smithi100 ceph-mon[80397]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-27T07:38:06.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:06 smithi082 ceph-mon[91103]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-27T07:38:06.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:06 smithi082 ceph-mon[91103]: osdmap e62: 6 total, 5 up, 6 in 2024-04-27T07:38:06.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:06 smithi082 ceph-mon[91103]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:38:06.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:06 smithi082 ceph-mon[91103]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:06 smithi100 ceph-mon[80397]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-27T07:38:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:06 smithi100 ceph-mon[80397]: osdmap e62: 6 total, 5 up, 6 in 2024-04-27T07:38:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:06 smithi100 ceph-mon[80397]: from='osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-04-27T07:38:06.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:06 smithi100 ceph-mon[80397]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 46/384 objects degraded (11.979%) 2024-04-27T07:38:07.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:38:07.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577] boot 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: osdmap e63: 6 total, 6 up, 6 in 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 46/384 objects degraded (11.979%), 13 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:07.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:07 smithi082 ceph-mon[91103]: osdmap e64: 6 total, 6 up, 6 in 2024-04-27T07:38:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:38:07.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: osd.2 [v2:172.21.15.82:6818/240501577,v1:172.21.15.82:6819/240501577] boot 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: osdmap e63: 6 total, 6 up, 6 in 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 46/384 objects degraded (11.979%), 13 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:07.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:07 smithi100 ceph-mon[80397]: osdmap e64: 6 total, 6 up, 6 in 2024-04-27T07:38:09.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:09.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:09.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:08 smithi082 ceph-mon[91103]: pgmap v99: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 29/384 objects degraded (7.552%) 2024-04-27T07:38:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:08 smithi100 ceph-mon[80397]: pgmap v99: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 29/384 objects degraded (7.552%) 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 -- 172.21.15.82:0/4139118675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 msgr2=0x7f39740fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 --2- 172.21.15.82:0/4139118675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f39740fd400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3970004940 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 -- 172.21.15.82:0/4139118675 shutdown_connections 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 --2- 172.21.15.82:0/4139118675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f39740fd400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 --2- 172.21.15.82:0/4139118675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 0x7f39740fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 -- 172.21.15.82:0/4139118675 >> 172.21.15.82:0/4139118675 conn(0x7f39740f7440 msgr2=0x7f39740f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 -- 172.21.15.82:0/4139118675 shutdown_connections 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.303+0000 7f397c644700 1 -- 172.21.15.82:0/4139118675 wait complete. 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 Processor -- start 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 -- start start 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 0x7f397410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397410e530 con 0x7f39740fcf90 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397c644700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397410ed80 con 0x7f39740fbce0 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45960/0 (socket says 172.21.15.82:45960) 2024-04-27T07:38:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 -- 172.21.15.82:0/2060704170 learned_addr learned my addr 172.21.15.82:0/2060704170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f397a3e0700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 0x7f397410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 -- 172.21.15.82:0/2060704170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 msgr2=0x7f397410d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 0x7f397410d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.304+0000 7f3979bdf700 1 -- 172.21.15.82:0/2060704170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005040 con 0x7f39740fcf90 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f3979bdf700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3970009150 tx=0x7f3970009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397000e040 con 0x7f39740fcf90 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397410f000 con 0x7f39740fcf90 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f397000bbf0 con 0x7f39740fcf90 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397001c630 con 0x7f39740fcf90 2024-04-27T07:38:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.305+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397410f540 con 0x7f39740fcf90 2024-04-27T07:38:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.306+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397405f5c0 con 0x7f39740fcf90 2024-04-27T07:38:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.306+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f397000bd60 con 0x7f39740fcf90 2024-04-27T07:38:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.307+0000 7f396affd700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 0x7f39600710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.307+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f397008fb20 con 0x7f39740fcf90 2024-04-27T07:38:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.307+0000 7f397a3e0700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 0x7f39600710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.307+0000 7f397a3e0700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 0x7f39600710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3964004f40 tx=0x7f396400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:09.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.312+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f397005c520 con 0x7f39740fcf90 2024-04-27T07:38:09.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.543+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f397410f870 con 0x7f396006ec10 2024-04-27T07:38:09.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.544+0000 7f396affd700 1 -- 172.21.15.82:0/2060704170 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f397410f870 con 0x7f396006ec10 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 msgr2=0x7f39600710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 0x7f39600710c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3964004f40 tx=0x7f396400b040 comp rx=0 tx=0).stop 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 msgr2=0x7f397410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3970009150 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 shutdown_connections 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f396006ec10 0x7f39600710c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39740fbce0 0x7f397410d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 --2- 172.21.15.82:0/2060704170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39740fcf90 0x7f397410df30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 >> 172.21.15.82:0/2060704170 conn(0x7f39740f7440 msgr2=0x7f39740f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 shutdown_connections 2024-04-27T07:38:09.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.546+0000 7f397c644700 1 -- 172.21.15.82:0/2060704170 wait complete. 2024-04-27T07:38:09.559 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 -- 172.21.15.82:0/4170632280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 msgr2=0x7fe4640fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 --2- 172.21.15.82:0/4170632280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe4640fd460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe460004940 tx=0x7fe460009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 -- 172.21.15.82:0/4170632280 shutdown_connections 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 --2- 172.21.15.82:0/4170632280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe4640fd460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 --2- 172.21.15.82:0/4170632280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe4640fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.652+0000 7fe46c157700 1 -- 172.21.15.82:0/4170632280 >> 172.21.15.82:0/4170632280 conn(0x7fe4640f74c0 msgr2=0x7fe4640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 -- 172.21.15.82:0/4170632280 shutdown_connections 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 -- 172.21.15.82:0/4170632280 wait complete. 2024-04-27T07:38:09.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 Processor -- start 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 -- start start 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe46410c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46410d430 con 0x7fe4640fcff0 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.653+0000 7fe46c157700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46410dc80 con 0x7fe4640fbd40 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45974/0 (socket says 172.21.15.82:45974) 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 -- 172.21.15.82:0/852913465 learned_addr learned my addr 172.21.15.82:0/852913465 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe469ef3700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe46410c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 -- 172.21.15.82:0/852913465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 msgr2=0x7fe46410c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe46410c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 -- 172.21.15.82:0/852913465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460005040 con 0x7fe4640fcff0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe469ef3700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe46410c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe4696f2700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b3b0 tx=0x7fe460009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe46000e040 con 0x7fe4640fcff0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe46000bcc0 con 0x7fe4640fcff0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46410df00 con 0x7fe4640fcff0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe46001c630 con 0x7fe4640fcff0 2024-04-27T07:38:09.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.654+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46410e440 con 0x7fe4640fcff0 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.655+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46405f5c0 con 0x7fe4640fcff0 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.656+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe460013980 con 0x7fe4640fcff0 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.656+0000 7fe45a7fc700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 0x7fe4500710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.656+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe46008f450 con 0x7fe4640fcff0 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.656+0000 7fe469ef3700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 0x7fe4500710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:09.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.656+0000 7fe469ef3700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 0x7fe4500710b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4540041d0 tx=0x7fe454009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:09.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.661+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe46005be50 con 0x7fe4640fcff0 2024-04-27T07:38:09.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.887+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe46410e770 con 0x7fe45006ec00 2024-04-27T07:38:09.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.888+0000 7fe45a7fc700 1 -- 172.21.15.82:0/852913465 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe46410e770 con 0x7fe45006ec00 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 msgr2=0x7fe4500710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 0x7fe4500710b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4540041d0 tx=0x7fe454009040 comp rx=0 tx=0).stop 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 msgr2=0x7fe46410ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b3b0 tx=0x7fe460009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 shutdown_connections 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe45006ec00 0x7fe4500710b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4640fbd40 0x7fe46410c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 --2- 172.21.15.82:0/852913465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4640fcff0 0x7fe46410ce30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 >> 172.21.15.82:0/852913465 conn(0x7fe4640f74c0 msgr2=0x7fe4640f8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:09.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 shutdown_connections 2024-04-27T07:38:09.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.891+0000 7fe46c157700 1 -- 172.21.15.82:0/852913465 wait complete. 2024-04-27T07:38:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 -- 172.21.15.82:0/2578723328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fce80 msgr2=0x7f3af40fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 --2- 172.21.15.82:0/2578723328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fce80 0x7f3af40fd290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4004940 tx=0x7f3ae4009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 -- 172.21.15.82:0/2578723328 shutdown_connections 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 --2- 172.21.15.82:0/2578723328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fdff0 0x7f3af40fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 --2- 172.21.15.82:0/2578723328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fce80 0x7f3af40fd290 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 -- 172.21.15.82:0/2578723328 >> 172.21.15.82:0/2578723328 conn(0x7f3af40f8520 msgr2=0x7f3af40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 -- 172.21.15.82:0/2578723328 shutdown_connections 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 -- 172.21.15.82:0/2578723328 wait complete. 2024-04-27T07:38:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.997+0000 7f3af945d700 1 Processor -- start 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af945d700 1 -- start start 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af945d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fce80 0x7f3af410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af945d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af945d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af410e4c0 con 0x7f3af40fdff0 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af945d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af410ed10 con 0x7f3af40fce80 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45990/0 (socket says 172.21.15.82:45990) 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 -- 172.21.15.82:0/3278807763 learned_addr learned my addr 172.21.15.82:0/3278807763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3af2ffd700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fce80 0x7f3af410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 -- 172.21.15.82:0/3278807763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fce80 msgr2=0x7f3af410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fce80 0x7f3af410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 -- 172.21.15.82:0/3278807763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4005040 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.998+0000 7f3aea7fc700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3adc002a80 tx=0x7f3adc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.999+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3adc007cc0 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.999+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af410eff0 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.999+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3adc00f040 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.999+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3adc0096f0 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:09.999+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af410f530 con 0x7f3af40fdff0 2024-04-27T07:38:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.000+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af405f5c0 con 0x7f3af40fdff0 2024-04-27T07:38:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.000+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3adc00d690 con 0x7f3af40fdff0 2024-04-27T07:38:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.001+0000 7f3aebfff700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 0x7f3ae00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.001+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3adc08dfb0 con 0x7f3af40fdff0 2024-04-27T07:38:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.001+0000 7f3af2ffd700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 0x7f3ae00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.001+0000 7f3af2ffd700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 0x7f3ae00710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4004f90 tx=0x7f3ae4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.006+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3adc05a930 con 0x7f3af40fdff0 2024-04-27T07:38:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.225+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3af410f860 con 0x7f3ae006ec10 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.236+0000 7f3aebfff700 1 -- 172.21.15.82:0/3278807763 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3af410f860 con 0x7f3ae006ec10 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (4m) 3s ago 13m 25.0M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (108s) 3s ago 13m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (103s) 99s ago 12m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (4m) 3s ago 12m 87.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (7m) 3s ago 7m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:38:10.238 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (7m) 3s ago 7m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (7m) 99s ago 7m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (7m) 99s ago 7m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (3m) 3s ago 14m 506M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (3m) 99s ago 12m 450M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (2m) 3s ago 14m 49.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (2m) 99s ago 12m 31.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (4m) 3s ago 13m 16.5M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 99s ago 12m 15.2M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (81s) 3s ago 11m 88.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (45s) 3s ago 10m 89.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (9s) 3s ago 10m 12.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (9m) 99s ago 9m 220M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c4c9ca4a076a 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (9m) 99s ago 9m 205M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (9m) 99s ago 9m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:38:10.239 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 3s ago 12m 63.2M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 msgr2=0x7f3ae00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 0x7f3ae00710c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4004f90 tx=0x7f3ae4009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 msgr2=0x7f3af410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3adc002a80 tx=0x7f3adc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 shutdown_connections 2024-04-27T07:38:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f3ae006ec10 0x7f3ae00710c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3af40fce80 0x7f3af410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 --2- 172.21.15.82:0/3278807763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3af40fdff0 0x7f3af410dec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 >> 172.21.15.82:0/3278807763 conn(0x7f3af40f8520 msgr2=0x7f3af40f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 shutdown_connections 2024-04-27T07:38:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.238+0000 7f3af945d700 1 -- 172.21.15.82:0/3278807763 wait complete. 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 -- 172.21.15.82:0/494907706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f80ffef0 msgr2=0x7f00f8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/494907706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f80ffef0 0x7f00f8102310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f00e8004940 tx=0x7f00e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 -- 172.21.15.82:0/494907706 shutdown_connections 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/494907706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f80ffef0 0x7f00f8102310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/494907706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f8066f50 0x7f00f80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 -- 172.21.15.82:0/494907706 >> 172.21.15.82:0/494907706 conn(0x7f00f80f7440 msgr2=0x7f00f80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 -- 172.21.15.82:0/494907706 shutdown_connections 2024-04-27T07:38:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.342+0000 7f00ff3d3700 1 -- 172.21.15.82:0/494907706 wait complete. 2024-04-27T07:38:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 Processor -- start 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 -- start start 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 0x7f00f810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f810e4f0 con 0x7f00f8066f50 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00ff3d3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f810e660 con 0x7f00f80ffef0 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00fd16f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00fd16f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46004/0 (socket says 172.21.15.82:46004) 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.343+0000 7f00fd16f700 1 -- 172.21.15.82:0/247610985 learned_addr learned my addr 172.21.15.82:0/247610985 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fc96e700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 0x7f00f810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fd16f700 1 -- 172.21.15.82:0/247610985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 msgr2=0x7f00f810def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fd16f700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 0x7f00f810def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fd16f700 1 -- 172.21.15.82:0/247610985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8005040 con 0x7f00f8066f50 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fc96e700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 0x7f00f810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:38:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00fd16f700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c890 tx=0x7f00f40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f400a7d0 con 0x7f00f8066f50 2024-04-27T07:38:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00f400ae00 con 0x7f00f8066f50 2024-04-27T07:38:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f81130c0 con 0x7f00f8066f50 2024-04-27T07:38:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f40113a0 con 0x7f00f8066f50 2024-04-27T07:38:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.344+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f8113680 con 0x7f00f8066f50 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.345+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f804c710 con 0x7f00f8066f50 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.346+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00f4012400 con 0x7f00f8066f50 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.346+0000 7f00edffb700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 0x7f00e40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.347+0000 7f00fc96e700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 0x7f00e40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.347+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f00f408e8c0 con 0x7f00f8066f50 2024-04-27T07:38:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.347+0000 7f00fc96e700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 0x7f00e40710b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00e800b020 tx=0x7f00e8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.351+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f00f405b2c0 con 0x7f00f8066f50 2024-04-27T07:38:10.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.667+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00f8113ae0 con 0x7f00f8066f50 2024-04-27T07:38:10.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.668+0000 7f00edffb700 1 -- 172.21.15.82:0/247610985 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f00f405ae50 con 0x7f00f8066f50 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 3, 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 3 2024-04-27T07:38:10.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 7, 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 7 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:38:10.672 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 msgr2=0x7f00e40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 0x7f00e40710b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00e800b020 tx=0x7f00e8009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 msgr2=0x7f00f810d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c890 tx=0x7f00f40044c0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 shutdown_connections 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.670+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00e406ec00 0x7f00e40710b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.671+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00f8066f50 0x7f00f810d9b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.671+0000 7f00ff3d3700 1 --2- 172.21.15.82:0/247610985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00f80ffef0 0x7f00f810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.671+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 >> 172.21.15.82:0/247610985 conn(0x7f00f80f7440 msgr2=0x7f00f80f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:10.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.671+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 shutdown_connections 2024-04-27T07:38:10.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.671+0000 7f00ff3d3700 1 -- 172.21.15.82:0/247610985 wait complete. 2024-04-27T07:38:10.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 -- 172.21.15.82:0/1315888106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 msgr2=0x7f08980fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 --2- 172.21.15.82:0/1315888106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f08980fd270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f088c004940 tx=0x7f088c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:10.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 -- 172.21.15.82:0/1315888106 shutdown_connections 2024-04-27T07:38:10.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 --2- 172.21.15.82:0/1315888106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f08980fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 --2- 172.21.15.82:0/1315888106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f08980fd270 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 -- 172.21.15.82:0/1315888106 >> 172.21.15.82:0/1315888106 conn(0x7f08980f8540 msgr2=0x7f08980fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 -- 172.21.15.82:0/1315888106 shutdown_connections 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.776+0000 7f089eff8700 1 -- 172.21.15.82:0/1315888106 wait complete. 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 Processor -- start 2024-04-27T07:38:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 -- start start 2024-04-27T07:38:10.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f089810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089810e4d0 con 0x7f08980fce60 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089eff8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089810ed20 con 0x7f08980fdfd0 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089cd94700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089cd94700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46014/0 (socket says 172.21.15.82:46014) 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.777+0000 7f089cd94700 1 -- 172.21.15.82:0/1612091955 learned_addr learned my addr 172.21.15.82:0/1612091955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f0897fff700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f089810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089cd94700 1 -- 172.21.15.82:0/1612091955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 msgr2=0x7f089810ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089cd94700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f089810ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089cd94700 1 -- 172.21.15.82:0/1612091955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c005040 con 0x7f08980fce60 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f0897fff700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f089810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089cd94700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f088c009150 tx=0x7f088c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f088c00e040 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089810efa0 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f088c00bcc0 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f088c01c630 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.778+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089810f4e0 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.779+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089805f5c0 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.780+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f088c026440 con 0x7f08980fce60 2024-04-27T07:38:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.780+0000 7f08957fa700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 0x7f08880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:10.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.780+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f088c08f3a0 con 0x7f08980fce60 2024-04-27T07:38:10.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.780+0000 7f0897fff700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 0x7f08880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:10.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.781+0000 7f0897fff700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 0x7f08880710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0884009b80 tx=0x7f088400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:10.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:10.785+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f088c05beb0 con 0x7f08980fce60 2024-04-27T07:38:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.055+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f08981058c0 con 0x7f08980fce60 2024-04-27T07:38:11.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:11.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: pgmap v100: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 19/384 objects degraded (4.948%) 2024-04-27T07:38:11.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:11.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/247610985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:11.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:11.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:11.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.056+0000 7f08957fa700 1 -- 172.21.15.82:0/1612091955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1913 (secure 0 0 0) 0x7f088c05ba40 con 0x7f08980fce60 2024-04-27T07:38:11.059 INFO:teuthology.orchestra.run.smithi082.stdout:e19 2024-04-27T07:38:11.059 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:38:11.059 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 19 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:37:47.445128+0000 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:38:11.060 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:38:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:11.062 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 msgr2=0x7f08880710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 0x7f08880710b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0884009b80 tx=0x7f088400b040 comp rx=0 tx=0).stop 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 msgr2=0x7f089810d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f088c009150 tx=0x7f088c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 shutdown_connections 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f088806ec00 0x7f08880710b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08980fce60 0x7f089810d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 --2- 172.21.15.82:0/1612091955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08980fdfd0 0x7f089810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.059+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 >> 172.21.15.82:0/1612091955 conn(0x7f08980f8540 msgr2=0x7f08980f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.060+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 shutdown_connections 2024-04-27T07:38:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.060+0000 7f089eff8700 1 -- 172.21.15.82:0/1612091955 wait complete. 2024-04-27T07:38:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: pgmap v100: 65 pgs: 10 peering, 6 active+undersized+degraded, 6 active+undersized, 43 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 19/384 objects degraded (4.948%) 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/247610985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:11.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 -- 172.21.15.82:0/3518562859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fed30 msgr2=0x7efd700fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3518562859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fed30 0x7efd700fae70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004940 tx=0x7efd6c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:11.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 -- 172.21.15.82:0/3518562859 shutdown_connections 2024-04-27T07:38:11.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3518562859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fed30 0x7efd700fae70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3518562859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fe3e0 0x7efd700fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 -- 172.21.15.82:0/3518562859 >> 172.21.15.82:0/3518562859 conn(0x7efd700f6b80 msgr2=0x7efd700f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 -- 172.21.15.82:0/3518562859 shutdown_connections 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 -- 172.21.15.82:0/3518562859 wait complete. 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.170+0000 7efd77dbd700 1 Processor -- start 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd77dbd700 1 -- start start 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd77dbd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd77dbd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fed30 0x7efd7010df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd77dbd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7010e500 con 0x7efd700fe3e0 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd77dbd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7010ed50 con 0x7efd700fed30 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46040/0 (socket says 172.21.15.82:46040) 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 -- 172.21.15.82:0/3588248483 learned_addr learned my addr 172.21.15.82:0/3588248483 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75358700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fed30 0x7efd7010df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 -- 172.21.15.82:0/3588248483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fed30 msgr2=0x7efd7010df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fed30 0x7efd7010df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 -- 172.21.15.82:0/3588248483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c005040 con 0x7efd700fe3e0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd75b59700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd60002a50 tx=0x7efd600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.171+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd60007cc0 con 0x7efd700fe3e0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.172+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd6000f040 con 0x7efd700fe3e0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.172+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7010f030 con 0x7efd700fe3e0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.172+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7010f570 con 0x7efd700fe3e0 2024-04-27T07:38:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.172+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd60009640 con 0x7efd700fe3e0 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.173+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd540052e0 con 0x7efd700fe3e0 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.173+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efd600097a0 con 0x7efd700fe3e0 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.174+0000 7efd667fc700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 0x7efd5c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.174+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efd6008e590 con 0x7efd700fe3e0 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.174+0000 7efd75358700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 0x7efd5c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.174+0000 7efd75358700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 0x7efd5c0710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00b3b0 tx=0x7efd6c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.179+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efd6005af10 con 0x7efd700fe3e0 2024-04-27T07:38:11.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.426+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd54000bf0 con 0x7efd5c06ec00 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.428+0000 7efd667fc700 1 -- 172.21.15.82:0/3588248483 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efd54000bf0 con 0x7efd5c06ec00 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "9/21 daemons upgraded", 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:38:11.431 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 msgr2=0x7efd5c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 0x7efd5c0710b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00b3b0 tx=0x7efd6c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 msgr2=0x7efd7010d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd60002a50 tx=0x7efd600046b0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 shutdown_connections 2024-04-27T07:38:11.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd5c06ec00 0x7efd5c0710b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd700fe3e0 0x7efd7010d9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 --2- 172.21.15.82:0/3588248483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd700fed30 0x7efd7010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 >> 172.21.15.82:0/3588248483 conn(0x7efd700f6b80 msgr2=0x7efd700f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 shutdown_connections 2024-04-27T07:38:11.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.430+0000 7efd77dbd700 1 -- 172.21.15.82:0/3588248483 wait complete. 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.535+0000 7fae61fe5700 1 -- 172.21.15.82:0/234593943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 msgr2=0x7fae5c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.535+0000 7fae61fe5700 1 --2- 172.21.15.82:0/234593943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c102370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fae4c004940 tx=0x7fae4c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- 172.21.15.82:0/234593943 shutdown_connections 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 --2- 172.21.15.82:0/234593943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c102370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 --2- 172.21.15.82:0/234593943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- 172.21.15.82:0/234593943 >> 172.21.15.82:0/234593943 conn(0x7fae5c0f7440 msgr2=0x7fae5c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- 172.21.15.82:0/234593943 shutdown_connections 2024-04-27T07:38:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- 172.21.15.82:0/234593943 wait complete. 2024-04-27T07:38:11.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 Processor -- start 2024-04-27T07:38:11.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- start start 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c110800 con 0x7fae5c0fff90 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.536+0000 7fae61fe5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c110ff0 con 0x7fae5c066ad0 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46058/0 (socket says 172.21.15.82:46058) 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 -- 172.21.15.82:0/2282021514 learned_addr learned my addr 172.21.15.82:0/2282021514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5b7fe700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 -- 172.21.15.82:0/2282021514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 msgr2=0x7fae5c10fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c10fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 -- 172.21.15.82:0/2282021514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c005040 con 0x7fae5c0fff90 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5b7fe700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae5affd700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00b3b0 tx=0x7fae4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4c00e040 con 0x7fae5c0fff90 2024-04-27T07:38:11.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae4c00bcc0 con 0x7fae5c0fff90 2024-04-27T07:38:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae4c01c630 con 0x7fae5c0fff90 2024-04-27T07:38:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c111270 con 0x7fae5c0fff90 2024-04-27T07:38:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.537+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c111830 con 0x7fae5c0fff90 2024-04-27T07:38:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.538+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c05f5c0 con 0x7fae5c0fff90 2024-04-27T07:38:11.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.539+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fae4c013980 con 0x7fae5c0fff90 2024-04-27T07:38:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.539+0000 7fae43fff700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 0x7fae440710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.540+0000 7fae5b7fe700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 0x7fae440710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.540+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fae4c08f450 con 0x7fae5c0fff90 2024-04-27T07:38:11.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.540+0000 7fae5b7fe700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 0x7fae440710b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae5c066810 tx=0x7fae50008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:11.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.544+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fae4c05be50 con 0x7fae5c0fff90 2024-04-27T07:38:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.839+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fae5c04bed0 con 0x7fae5c0fff90 2024-04-27T07:38:11.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.839+0000 7fae43fff700 1 -- 172.21.15.82:0/2282021514 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+703 (secure 0 0 0) 0x7fae4c05b9e0 con 0x7fae5c0fff90 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 19/384 objects degraded (4.948%), 6 pgs degraded 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 19/384 objects degraded (4.948%), 6 pgs degraded 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-27T07:38:11.842 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 msgr2=0x7fae440710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 0x7fae440710b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae5c066810 tx=0x7fae50008040 comp rx=0 tx=0).stop 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 msgr2=0x7fae5c110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00b3b0 tx=0x7fae4c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 shutdown_connections 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fae4406ec00 0x7fae440710b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae5c066ad0 0x7fae5c10fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 --2- 172.21.15.82:0/2282021514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c0fff90 0x7fae5c110170 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:11.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 >> 172.21.15.82:0/2282021514 conn(0x7fae5c0f7440 msgr2=0x7fae5c0fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 shutdown_connections 2024-04-27T07:38:11.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:11.841+0000 7fae61fe5700 1 -- 172.21.15.82:0/2282021514 wait complete. 2024-04-27T07:38:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1612091955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:38:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1612091955' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:38:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:12.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-27T07:38:13.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: pgmap v101: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s 2024-04-27T07:38:13.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2282021514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:38:13.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:12 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/384 objects degraded (4.948%), 6 pgs degraded) 2024-04-27T07:38:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-04-27T07:38:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: pgmap v101: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s 2024-04-27T07:38:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2282021514' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:38:13.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:12 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/384 objects degraded (4.948%), 6 pgs degraded) 2024-04-27T07:38:15.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:14 smithi082 ceph-mon[91103]: pgmap v102: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:38:15.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:14 smithi100 ceph-mon[80397]: pgmap v102: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:38:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:16 smithi100 ceph-mon[80397]: pgmap v103: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:38:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:16 smithi082 ceph-mon[91103]: pgmap v103: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:38:19.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:18 smithi082 ceph-mon[91103]: pgmap v104: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:38:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:18 smithi100 ceph-mon[80397]: pgmap v104: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:38:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:20 smithi100 ceph-mon[80397]: pgmap v105: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:20 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:21.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:20 smithi082 ceph-mon[91103]: pgmap v105: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:21.251 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:20 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:23.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:22 smithi082 ceph-mon[91103]: pgmap v106: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:22 smithi100 ceph-mon[80397]: pgmap v106: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:24 smithi100 ceph-mon[80397]: pgmap v107: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:24 smithi082 ceph-mon[91103]: pgmap v107: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:26 smithi082 ceph-mon[91103]: pgmap v108: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:27.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:27.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:27.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:26 smithi100 ceph-mon[80397]: pgmap v108: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:27.114 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:27.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:27.115 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:27 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:28.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:27 smithi082 ceph-mon[91103]: Upgrade: osd.3 is safe to restart 2024-04-27T07:38:28.118 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:27 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-27T07:38:28.118 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:27 smithi100 ceph-mon[80397]: Upgrade: osd.3 is safe to restart 2024-04-27T07:38:29.090 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:28 smithi100 ceph-mon[80397]: pgmap v109: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:29.090 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:29.090 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:38:29.090 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:28 smithi082 ceph-mon[91103]: pgmap v109: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-27T07:38:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:30.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:29 smithi100 ceph-mon[80397]: Upgrade: Updating osd.3 2024-04-27T07:38:30.063 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:29 smithi100 ceph-mon[80397]: Deploying daemon osd.3 on smithi100 2024-04-27T07:38:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:29 smithi082 ceph-mon[91103]: Upgrade: Updating osd.3 2024-04-27T07:38:30.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:29 smithi082 ceph-mon[91103]: Deploying daemon osd.3 on smithi100 2024-04-27T07:38:31.050 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:30 smithi100 ceph-mon[80397]: pgmap v110: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:30 smithi082 ceph-mon[91103]: pgmap v110: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:38:31.659 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:31 smithi100 systemd[1]: Stopping Ceph osd.3 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:38:31.659 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:31 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[39614]: 2024-04-27T07:38:31.644+0000 7f1ac8986700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:38:31.659 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:31 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[39614]: 2024-04-27T07:38:31.644+0000 7f1ac8986700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-27T07:38:31.659 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:31 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[39614]: 2024-04-27T07:38:31.644+0000 7f1ac8986700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:38:31.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:31 smithi100 ceph-mon[80397]: osd.3 marked itself down and dead 2024-04-27T07:38:32.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:31 smithi082 ceph-mon[91103]: osd.3 marked itself down and dead 2024-04-27T07:38:32.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:32 smithi100 podman[89144]: 2024-04-27 07:38:32.39713446 +0000 UTC m=+0.845277751 container died c4c9ca4a076a54f42752ec5b16ac30f5a99788f1905d326cf871d46e3f3c1c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-2be3efa, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True) 2024-04-27T07:38:33.056 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:32 smithi100 ceph-mon[80397]: pgmap v111: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:33.057 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:32 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:38:33.057 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:32 smithi100 ceph-mon[80397]: osdmap e65: 6 total, 5 up, 6 in 2024-04-27T07:38:33.057 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:32 smithi100 podman[89144]: 2024-04-27 07:38:32.761712293 +0000 UTC m=+1.209855624 container cleanup c4c9ca4a076a54f42752ec5b16ac30f5a99788f1905d326cf871d46e3f3c1c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=quincy-2be3efa, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-27T07:38:33.057 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:32 smithi100 bash[89144]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3 2024-04-27T07:38:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:32 smithi082 ceph-mon[91103]: pgmap v111: 65 pgs: 65 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:32 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:38:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:32 smithi082 ceph-mon[91103]: osdmap e65: 6 total, 5 up, 6 in 2024-04-27T07:38:33.380 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89173]: 2024-04-27 07:38:33.054817796 +0000 UTC m=+0.654036627 container remove c4c9ca4a076a54f42752ec5b16ac30f5a99788f1905d326cf871d46e3f3c1c9d (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-27T07:38:33.668 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.281969292 +0000 UTC m=+0.018004738 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:38:33.668 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.380631399 +0000 UTC m=+0.116666881 container create 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True) 2024-04-27T07:38:33.669 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.599626131 +0000 UTC m=+0.335661566 container init 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-27T07:38:33.669 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.602682141 +0000 UTC m=+0.338717589 container start 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:38:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:33 smithi100 ceph-mon[80397]: osdmap e66: 6 total, 5 up, 6 in 2024-04-27T07:38:34.168 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.6915111 +0000 UTC m=+0.427546556 container attach 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-27T07:38:34.168 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:33 smithi100 podman[89266]: 2024-04-27 07:38:33.891738776 +0000 UTC m=+0.627774221 container died 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:38:34.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:33 smithi082 ceph-mon[91103]: osdmap e66: 6 total, 5 up, 6 in 2024-04-27T07:38:34.847 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 podman[89291]: 2024-04-27 07:38:34.461427759 +0000 UTC m=+0.564115084 container remove 5ab51191d3881832db661eda3d89f2de0e32fc4f0140bc1ddcf2220bd13fe8eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-27T07:38:34.847 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-27T07:38:34.847 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 systemd[1]: Stopped Ceph osd.3 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:38:34.847 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.3.service: Consumed 59.007s CPU time. 2024-04-27T07:38:34.847 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 systemd[1]: Starting Ceph osd.3 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:38:35.158 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:34 smithi100 ceph-mon[80397]: pgmap v114: 65 pgs: 16 stale+active+clean, 49 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:35.158 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 podman[89396]: 2024-04-27 07:38:34.805462605 +0000 UTC m=+0.018492244 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:38:35.158 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:34 smithi100 podman[89396]: 2024-04-27 07:38:34.937808273 +0000 UTC m=+0.150837900 container create 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-27T07:38:35.158 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 podman[89396]: 2024-04-27 07:38:35.156779799 +0000 UTC m=+0.369809422 container init 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-27T07:38:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:34 smithi082 ceph-mon[91103]: pgmap v114: 65 pgs: 16 stale+active+clean, 49 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:38:35.417 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 podman[89396]: 2024-04-27 07:38:35.160025976 +0000 UTC m=+0.373055614 container start 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-27T07:38:35.417 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 podman[89396]: 2024-04-27 07:38:35.223268125 +0000 UTC m=+0.436297757 container attach 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-27T07:38:35.900 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 bash[89396]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-27T07:38:35.901 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate[89411]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-27T07:38:35.902 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:35 smithi100 podman[89396]: 2024-04-27 07:38:35.656221757 +0000 UTC m=+0.869251375 container died 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:38:36.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:35 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 13/384 objects degraded (3.385%), 5 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:36.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:35 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 13/384 objects degraded (3.385%), 5 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:36.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 podman[89542]: 2024-04-27 07:38:36.360465924 +0000 UTC m=+0.698858239 container remove 143977d392029c09d8e49cc67aa5364dc39580d619b28596c8ff52d2687521da (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-27T07:38:36.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 podman[89603]: 2024-04-27 07:38:36.476060963 +0000 UTC m=+0.018268824 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:38:36.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 podman[89603]: 2024-04-27 07:38:36.594573637 +0000 UTC m=+0.136781497 container create bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:38:36.969 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:36 smithi100 ceph-mon[80397]: pgmap v115: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 13/384 objects degraded (3.385%) 2024-04-27T07:38:36.970 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 podman[89603]: 2024-04-27 07:38:36.847155345 +0000 UTC m=+0.389363207 container init bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=main-c37f63b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-27T07:38:36.970 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 podman[89603]: 2024-04-27 07:38:36.850220068 +0000 UTC m=+0.392427930 container start bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-27T07:38:36.970 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 ceph-osd[89622]: -- 172.21.15.100:0/2774647523 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574e28c1680 con 0x5574e288ac00 2024-04-27T07:38:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:36 smithi082 ceph-mon[91103]: pgmap v115: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 13/384 objects degraded (3.385%) 2024-04-27T07:38:37.394 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 bash[89603]: bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 2024-04-27T07:38:37.395 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:36 smithi100 systemd[1]: Started Ceph osd.3 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:38:37.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:37 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:38:37.392+0000 7f4e2db777c0 -1 Falling back to public interface 2024-04-27T07:38:38.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:38.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:38.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:38 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:38.171 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:38 smithi100 ceph-mon[80397]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:38 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:38 smithi082 ceph-mon[91103]: pgmap v116: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:40 smithi100 ceph-mon[80397]: pgmap v117: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:40 smithi082 ceph-mon[91103]: pgmap v117: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 -- 172.21.15.82:0/2499645094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c0fff70 msgr2=0x7fd64c102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2499645094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c0fff70 0x7fd64c102350 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd63c004940 tx=0x7fd63c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 -- 172.21.15.82:0/2499645094 shutdown_connections 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2499645094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c0fff70 0x7fd64c102350 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2499645094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c066ed0 0x7fd64c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 -- 172.21.15.82:0/2499645094 >> 172.21.15.82:0/2499645094 conn(0x7fd64c0f7440 msgr2=0x7fd64c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 -- 172.21.15.82:0/2499645094 shutdown_connections 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.956+0000 7fd6527c2700 1 -- 172.21.15.82:0/2499645094 wait complete. 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.957+0000 7fd6527c2700 1 Processor -- start 2024-04-27T07:38:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.957+0000 7fd6527c2700 1 -- start start 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.957+0000 7fd6527c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.957+0000 7fd6527c2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c0fff70 0x7fd64c10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd6527c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c10e470 con 0x7fd64c066ed0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd6527c2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c10e5e0 con 0x7fd64c0fff70 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44064/0 (socket says 172.21.15.82:44064) 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 -- 172.21.15.82:0/2343918669 learned_addr learned my addr 172.21.15.82:0/2343918669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64b7fe700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c0fff70 0x7fd64c10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 -- 172.21.15.82:0/2343918669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c0fff70 msgr2=0x7fd64c10de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c0fff70 0x7fd64c10de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 -- 172.21.15.82:0/2343918669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c005040 con 0x7fd64c066ed0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd64bfff700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd64000eb40 tx=0x7fd64000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd640007cc0 con 0x7fd64c066ed0 2024-04-27T07:38:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd64000f040 con 0x7fd64c066ed0 2024-04-27T07:38:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c112fe0 con 0x7fd64c066ed0 2024-04-27T07:38:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64000caa0 con 0x7fd64c066ed0 2024-04-27T07:38:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.958+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c113490 con 0x7fd64c066ed0 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.959+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c04c710 con 0x7fd64c066ed0 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.960+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd64000cc00 con 0x7fd64c066ed0 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.961+0000 7fd648ff9700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 0x7fd6340710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.961+0000 7fd64b7fe700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 0x7fd6340710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.961+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd64008e330 con 0x7fd64c066ed0 2024-04-27T07:38:41.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.961+0000 7fd64b7fe700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 0x7fd6340710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd63c013870 tx=0x7fd63c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:41.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:41.966+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd64005acb0 con 0x7fd64c066ed0 2024-04-27T07:38:42.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.185+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd64c113680 con 0x7fd63406ec00 2024-04-27T07:38:42.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.186+0000 7fd648ff9700 1 -- 172.21.15.82:0/2343918669 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd64c113680 con 0x7fd63406ec00 2024-04-27T07:38:42.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 msgr2=0x7fd6340710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 0x7fd6340710b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd63c013870 tx=0x7fd63c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 msgr2=0x7fd64c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd64000eb40 tx=0x7fd64000b040 comp rx=0 tx=0).stop 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 shutdown_connections 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd63406ec00 0x7fd6340710b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c066ed0 0x7fd64c10d930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 --2- 172.21.15.82:0/2343918669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd64c0fff70 0x7fd64c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 >> 172.21.15.82:0/2343918669 conn(0x7fd64c0f7440 msgr2=0x7fd64c0f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 shutdown_connections 2024-04-27T07:38:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.188+0000 7fd6527c2700 1 -- 172.21.15.82:0/2343918669 wait complete. 2024-04-27T07:38:42.201 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:38:42.276 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:42.277 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:42 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:42.277 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:42 smithi100 ceph-mon[80397]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 -- 172.21.15.82:0/453716164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 msgr2=0x7f87c00ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 --2- 172.21.15.82:0/453716164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00ff9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009ce0 tx=0x7f87b0004d10 comp rx=0 tx=0).stop 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 -- 172.21.15.82:0/453716164 shutdown_connections 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 --2- 172.21.15.82:0/453716164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 0x7f87c0102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 --2- 172.21.15.82:0/453716164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00ff9d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 -- 172.21.15.82:0/453716164 >> 172.21.15.82:0/453716164 conn(0x7f87c00f7440 msgr2=0x7f87c00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.294 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:42.295 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:42 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:42.295 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:42 smithi082 ceph-mon[91103]: pgmap v118: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.291+0000 7f87c72fc700 1 -- 172.21.15.82:0/453716164 shutdown_connections 2024-04-27T07:38:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 -- 172.21.15.82:0/453716164 wait complete. 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 Processor -- start 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 -- start start 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 0x7f87c00fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00fd860 con 0x7f87c0066f70 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c72fc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00fbe40 con 0x7f87c00fff10 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c5098700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c5098700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44076/0 (socket says 172.21.15.82:44076) 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c5098700 1 -- 172.21.15.82:0/2185061544 learned_addr learned my addr 172.21.15.82:0/2185061544 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.292+0000 7f87c4897700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 0x7f87c00fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c5098700 1 -- 172.21.15.82:0/2185061544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 msgr2=0x7f87c00fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c5098700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 0x7f87c00fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c5098700 1 -- 172.21.15.82:0/2185061544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0009940 con 0x7f87c0066f70 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c5098700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009910 tx=0x7f87b0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b000e040 con 0x7f87c0066f70 2024-04-27T07:38:42.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87b0008e20 con 0x7f87c0066f70 2024-04-27T07:38:42.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00fc0c0 con 0x7f87c0066f70 2024-04-27T07:38:42.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b001c740 con 0x7f87c0066f70 2024-04-27T07:38:42.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.293+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00fc680 con 0x7f87c0066f70 2024-04-27T07:38:42.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.294+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c004c710 con 0x7f87c0066f70 2024-04-27T07:38:42.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.295+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f87b0012b70 con 0x7f87c0066f70 2024-04-27T07:38:42.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.295+0000 7f87bdffb700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 0x7f87a80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.295+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f87b00903a0 con 0x7f87c0066f70 2024-04-27T07:38:42.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.295+0000 7f87c4897700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 0x7f87a80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.295+0000 7f87c4897700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 0x7f87a80710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009bf0 tx=0x7f87b40091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.300+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f87b005cd20 con 0x7f87c0066f70 2024-04-27T07:38:42.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.516+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87c00f8f80 con 0x7f87a806ec00 2024-04-27T07:38:42.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.517+0000 7f87bdffb700 1 -- 172.21.15.82:0/2185061544 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f87c00f8f80 con 0x7f87a806ec00 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.519+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 msgr2=0x7f87a80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.519+0000 7f87c72fc700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 0x7f87a80710b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009bf0 tx=0x7f87b40091a0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.519+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 msgr2=0x7f87c00fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.519+0000 7f87c72fc700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009910 tx=0x7f87b0004d10 comp rx=0 tx=0).stop 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 shutdown_connections 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f87a806ec00 0x7f87a80710b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87c0066f70 0x7f87c00fd1d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 --2- 172.21.15.82:0/2185061544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87c00fff10 0x7f87c00fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 >> 172.21.15.82:0/2185061544 conn(0x7f87c00f7440 msgr2=0x7f87c00f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 shutdown_connections 2024-04-27T07:38:42.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.520+0000 7f87c72fc700 1 -- 172.21.15.82:0/2185061544 wait complete. 2024-04-27T07:38:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 -- 172.21.15.82:0/589801129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 msgr2=0x7ff19c0fd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/589801129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fd0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff18c004940 tx=0x7ff18c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 -- 172.21.15.82:0/589801129 shutdown_connections 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/589801129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fd0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/589801129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 0x7ff19c0fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 -- 172.21.15.82:0/589801129 >> 172.21.15.82:0/589801129 conn(0x7ff19c0f6bb0 msgr2=0x7ff19c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 -- 172.21.15.82:0/589801129 shutdown_connections 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.620+0000 7ff1a27e1700 1 -- 172.21.15.82:0/589801129 wait complete. 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 Processor -- start 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 -- start start 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 0x7ff19c0ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c1002e0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff1a27e1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0fe920 con 0x7ff19c0fc2e0 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff19b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44096/0 (socket says 172.21.15.82:44096) 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff19b7fe700 1 -- 172.21.15.82:0/3431311035 learned_addr learned my addr 172.21.15.82:0/3431311035 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.621+0000 7ff19bfff700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 0x7ff19c0ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff19b7fe700 1 -- 172.21.15.82:0/3431311035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 msgr2=0x7ff19c0ffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff19b7fe700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 0x7ff19c0ffce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff19b7fe700 1 -- 172.21.15.82:0/3431311035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c005040 con 0x7ff19c0fcc30 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff19b7fe700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b3b0 tx=0x7ff18c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c00e040 con 0x7ff19c0fcc30 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c0feba0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff18c00bbf0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff18c01c630 con 0x7ff19c0fcc30 2024-04-27T07:38:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.622+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c0ff0e0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.623+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c101c30 con 0x7ff19c0fcc30 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.623+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff18c00bd60 con 0x7ff19c0fcc30 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.624+0000 7ff198ff9700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 0x7ff1840710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.624+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff18c08f3b0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.624+0000 7ff19bfff700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 0x7ff1840710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.624+0000 7ff19bfff700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 0x7ff1840710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff190004f40 tx=0x7ff19000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.629+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff18c05bdb0 con 0x7ff19c0fcc30 2024-04-27T07:38:42.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:42 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:38:42.273+0000 7f4e2db777c0 -1 osd.3 64 log_to_monitors true 2024-04-27T07:38:42.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.841+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff19c05e3a0 con 0x7ff18406ec00 2024-04-27T07:38:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.851+0000 7ff198ff9700 1 -- 172.21.15.82:0/3431311035 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff19c05e3a0 con 0x7ff18406ec00 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (5m) 36s ago 13m 25.0M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (2m) 36s ago 13m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (2m) 2s ago 12m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (4m) 36s ago 13m 87.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (8m) 36s ago 8m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (8m) 36s ago 8m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (8m) 2s ago 8m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (8m) 2s ago 8m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (4m) 36s ago 14m 506M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (3m) 2s ago 12m 451M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:38:42.854 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (3m) 36s ago 15m 49.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (3m) 2s ago 12m 36.8M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 36s ago 13m 16.5M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (4m) 2s ago 12m 15.6M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (114s) 36s ago 11m 88.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (78s) 36s ago 11m 89.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (42s) 36s ago 10m 12.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (6s) 2s ago 10m 14.0M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (10m) 2s ago 10m 207M 2581M 17.2.7-907-g2be3efa9 1c5834633715 c2c98538e840 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (9m) 2s ago 9m 188M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:38:42.855 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 36s ago 13m 63.2M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 msgr2=0x7ff1840710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 0x7ff1840710b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff190004f40 tx=0x7ff19000b040 comp rx=0 tx=0).stop 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 msgr2=0x7ff19c0fe3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00b3b0 tx=0x7ff18c009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 shutdown_connections 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff18406ec00 0x7ff1840710b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff19c0fc2e0 0x7ff19c0ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 --2- 172.21.15.82:0/3431311035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff19c0fcc30 0x7ff19c0fe3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.853+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 >> 172.21.15.82:0/3431311035 conn(0x7ff19c0f6bb0 msgr2=0x7ff19c0fb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.854+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 shutdown_connections 2024-04-27T07:38:42.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.854+0000 7ff1a27e1700 1 -- 172.21.15.82:0/3431311035 wait complete. 2024-04-27T07:38:42.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.953+0000 7f8552293700 1 -- 172.21.15.82:0/643543948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 msgr2=0x7f854c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.953+0000 7f8552293700 1 --2- 172.21.15.82:0/643543948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fd3d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8540004940 tx=0x7f8540009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- 172.21.15.82:0/643543948 shutdown_connections 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 --2- 172.21.15.82:0/643543948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fd3d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 --2- 172.21.15.82:0/643543948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 0x7f854c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- 172.21.15.82:0/643543948 >> 172.21.15.82:0/643543948 conn(0x7f854c0f7430 msgr2=0x7f854c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- 172.21.15.82:0/643543948 shutdown_connections 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- 172.21.15.82:0/643543948 wait complete. 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 Processor -- start 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- start start 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 0x7f854c0ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0fe870 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.954+0000 7f8552293700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0fe9b0 con 0x7f854c0fbcb0 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44122/0 (socket says 172.21.15.82:44122) 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 -- 172.21.15.82:0/3013577983 learned_addr learned my addr 172.21.15.82:0/3013577983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854bfff700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 0x7f854c0ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 -- 172.21.15.82:0/3013577983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 msgr2=0x7f854c0ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 0x7f854c0ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 -- 172.21.15.82:0/3013577983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8540005040 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f854b7fe700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8540004f90 tx=0x7f8540009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854000e040 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0fec30 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c115b60 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.955+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f854000bcc0 con 0x7f854c0fcf60 2024-04-27T07:38:42.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.956+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854001c630 con 0x7f854c0fcf60 2024-04-27T07:38:42.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.956+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85380052b0 con 0x7f854c0fcf60 2024-04-27T07:38:42.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.957+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8540013420 con 0x7f854c0fcf60 2024-04-27T07:38:42.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.957+0000 7f8548ff9700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 0x7f85340710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:42.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.957+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f854008f9f0 con 0x7f854c0fcf60 2024-04-27T07:38:42.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.958+0000 7f854bfff700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 0x7f85340710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:42.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.958+0000 7f854bfff700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 0x7f85340710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f853c006fd0 tx=0x7f853c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:42.962+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8540091e60 con 0x7f854c0fcf60 2024-04-27T07:38:43.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.251+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8538005d70 con 0x7f854c0fcf60 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: from='osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 78/384 objects degraded (20.312%), 20 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:43 smithi082 ceph-mon[91103]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.251+0000 7f8548ff9700 1 -- 172.21.15.82:0/3013577983 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f8540058960 con 0x7f854c0fcf60 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:43.255 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 2, 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 3 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 6, 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 7 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:38:43.256 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 msgr2=0x7f85340710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 0x7f85340710b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f853c006fd0 tx=0x7f853c008040 comp rx=0 tx=0).stop 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 msgr2=0x7f854c0fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8540004f90 tx=0x7f8540009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 shutdown_connections 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f853406ec00 0x7f85340710b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0fbcb0 0x7f854c0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 --2- 172.21.15.82:0/3013577983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f854c0fcf60 0x7f854c0fe2a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 >> 172.21.15.82:0/3013577983 conn(0x7f854c0f7430 msgr2=0x7f854c065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:43.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 shutdown_connections 2024-04-27T07:38:43.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.254+0000 7f8552293700 1 -- 172.21.15.82:0/3013577983 wait complete. 2024-04-27T07:38:43.312 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:38:43.099+0000 7f4e1efcf700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: from='osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 78/384 objects degraded (20.312%), 20 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.312 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:43 smithi100 ceph-mon[80397]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- 172.21.15.82:0/608665701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 msgr2=0x7fe4cc0fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/608665701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fe8b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0004940 tx=0x7fe4c0009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:43.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- 172.21.15.82:0/608665701 shutdown_connections 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/608665701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/608665701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fe8b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- 172.21.15.82:0/608665701 >> 172.21.15.82:0/608665701 conn(0x7fe4cc0f6b80 msgr2=0x7fe4cc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- 172.21.15.82:0/608665701 shutdown_connections 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- 172.21.15.82:0/608665701 wait complete. 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 Processor -- start 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- start start 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0fc710 con 0x7fe4cc0fe4a0 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.355+0000 7fe4d23e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0fc880 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44148/0 (socket says 172.21.15.82:44148) 2024-04-27T07:38:43.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cbfff700 1 -- 172.21.15.82:0/3440183151 learned_addr learned my addr 172.21.15.82:0/3440183151 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cb7fe700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cb7fe700 1 -- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 msgr2=0x7fe4cc0fdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cb7fe700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cb7fe700 1 -- 172.21.15.82:0/3440183151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0005040 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cbfff700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4cb7fe700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0fc160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fd0 tx=0x7fe4bc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4bc004e90 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4bc00f040 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc0fcb00 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4bc00ca50 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.356+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc1159b0 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.357+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc05f5c0 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.358+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe4bc007cc0 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.358+0000 7fe4c8ff9700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 0x7fe4b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.358+0000 7fe4cbfff700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 0x7fe4b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.358+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe4bc08e200 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.359+0000 7fe4cbfff700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 0x7fe4b40710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009b30 tx=0x7fe4c0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.363+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe4bc057100 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.604+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4cc115c00 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.605+0000 7fe4c8ff9700 1 -- 172.21.15.82:0/3440183151 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1913 (secure 0 0 0) 0x7fe4bc05a7c0 con 0x7fe4cc0fedf0 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:e19 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 19 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:38:43.608 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:37:47.445128+0000 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:38:43.609 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:38:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.607+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 msgr2=0x7fe4b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.607+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 0x7fe4b40710b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009b30 tx=0x7fe4c0009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.607+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 msgr2=0x7fe4cc0fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.607+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0fc160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fd0 tx=0x7fe4bc00b040 comp rx=0 tx=0).stop 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 shutdown_connections 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe4b406ec00 0x7fe4b40710b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4cc0fe4a0 0x7fe4cc0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 --2- 172.21.15.82:0/3440183151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4cc0fedf0 0x7fe4cc0fc160 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 >> 172.21.15.82:0/3440183151 conn(0x7fe4cc0f6b80 msgr2=0x7fe4cc0f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 shutdown_connections 2024-04-27T07:38:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.608+0000 7fe4d23e5700 1 -- 172.21.15.82:0/3440183151 wait complete. 2024-04-27T07:38:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-04-27T07:38:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- 172.21.15.82:0/871064684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 msgr2=0x7faaa0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/871064684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa0070350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa90004940 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- 172.21.15.82:0/871064684 shutdown_connections 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/871064684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 0x7faaa0070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/871064684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa0070350 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- 172.21.15.82:0/871064684 >> 172.21.15.82:0/871064684 conn(0x7faaa00f8520 msgr2=0x7faaa00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- 172.21.15.82:0/871064684 shutdown_connections 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- 172.21.15.82:0/871064684 wait complete. 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 Processor -- start 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.710+0000 7faaa5c5c700 1 -- start start 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 0x7faaa0113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0114af0 con 0x7faaa0071e40 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0115340 con 0x7faaa0070890 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44162/0 (socket says 172.21.15.82:44162) 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 -- 172.21.15.82:0/823915643 learned_addr learned my addr 172.21.15.82:0/823915643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9f7fe700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 0x7faaa0113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 -- 172.21.15.82:0/823915643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 msgr2=0x7faaa0113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 0x7faaa0113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 -- 172.21.15.82:0/823915643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90005040 con 0x7faaa0071e40 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa9effd700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa94002a80 tx=0x7faa940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa94007cc0 con 0x7faaa0071e40 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa9400f040 con 0x7faaa0071e40 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa0115620 con 0x7faaa0071e40 2024-04-27T07:38:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9400dac0 con 0x7faaa0071e40 2024-04-27T07:38:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.711+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa0115b60 con 0x7faaa0071e40 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.713+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa005f5c0 con 0x7faaa0071e40 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.713+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faa9400dc20 con 0x7faaa0071e40 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.713+0000 7faa87fff700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 0x7faa880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.713+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7faa9408e490 con 0x7faaa0071e40 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.713+0000 7faa9f7fe700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 0x7faa880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.714+0000 7faa9f7fe700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 0x7faa880710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa90004890 tx=0x7faa90009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.718+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7faa9405ae10 con 0x7faaa0071e40 2024-04-27T07:38:43.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.940+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faaa0115e90 con 0x7faa8806ec00 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.941+0000 7faa87fff700 1 -- 172.21.15.82:0/823915643 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7faaa0115e90 con 0x7faa8806ec00 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:38:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "10/21 daemons upgraded", 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:38:43.944 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:38:43.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 msgr2=0x7faa880710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 0x7faa880710b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa90004890 tx=0x7faa90009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:43.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 msgr2=0x7faaa01144f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa94002a80 tx=0x7faa940046b0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 shutdown_connections 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa8806ec00 0x7faa880710b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa0070890 0x7faaa0113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 --2- 172.21.15.82:0/823915643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaa0071e40 0x7faaa01144f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 >> 172.21.15.82:0/823915643 conn(0x7faaa00f8520 msgr2=0x7faaa00f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 shutdown_connections 2024-04-27T07:38:43.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:43.943+0000 7faaa5c5c700 1 -- 172.21.15.82:0/823915643 wait complete. 2024-04-27T07:38:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- 172.21.15.82:0/3337408930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fed70 msgr2=0x7fa8a00faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/3337408930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fed70 0x7fa8a00faeb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa890004940 tx=0x7fa890009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- 172.21.15.82:0/3337408930 shutdown_connections 2024-04-27T07:38:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/3337408930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fed70 0x7fa8a00faeb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/3337408930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fe420 0x7fa8a00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- 172.21.15.82:0/3337408930 >> 172.21.15.82:0/3337408930 conn(0x7fa8a00f6be0 msgr2=0x7fa8a00f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- 172.21.15.82:0/3337408930 shutdown_connections 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- 172.21.15.82:0/3337408930 wait complete. 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 Processor -- start 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.044+0000 7fa8a84a4700 1 -- start start 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fed70 0x7fa8a010de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a010e440 con 0x7fa8a00fe420 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a010e5b0 con 0x7fa8a00fed70 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44172/0 (socket says 172.21.15.82:44172) 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 -- 172.21.15.82:0/1775560538 learned_addr learned my addr 172.21.15.82:0/1775560538 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:38:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a5a3f700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fed70 0x7fa8a010de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 -- 172.21.15.82:0/1775560538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fed70 msgr2=0x7fa8a010de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fed70 0x7fa8a010de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 -- 172.21.15.82:0/1775560538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890005040 con 0x7fa8a00fe420 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a6240700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00c830 tx=0x7fa89c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c00a760 con 0x7fa8a00fe420 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa89c00ad90 con 0x7fa8a00fe420 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a0112fb0 con 0x7fa8a00fe420 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89c0113a0 con 0x7fa8a00fe420 2024-04-27T07:38:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.045+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0113540 con 0x7fa8a00fe420 2024-04-27T07:38:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.046+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a004c710 con 0x7fa8a00fe420 2024-04-27T07:38:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.047+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa89c012400 con 0x7fa8a00fe420 2024-04-27T07:38:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.047+0000 7fa896ffd700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 0x7fa88c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:38:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.047+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa89c08e7f0 con 0x7fa8a00fe420 2024-04-27T07:38:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.047+0000 7fa8a5a3f700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 0x7fa88c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:38:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.048+0000 7fa8a5a3f700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 0x7fa88c0710b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa890009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:38:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.052+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa89c05b1f0 con 0x7fa8a00fe420 2024-04-27T07:38:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-27T07:38:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: from='osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:38:44.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: osdmap e67: 6 total, 5 up, 6 in 2024-04-27T07:38:44.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:38:44.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3013577983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:44.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3440183151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:38:44.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:44 smithi100 ceph-mon[80397]: pgmap v120: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: from='osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: osdmap e67: 6 total, 5 up, 6 in 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3013577983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3440183151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:38:44.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:44 smithi082 ceph-mon[91103]: pgmap v120: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 78/384 objects degraded (20.312%) 2024-04-27T07:38:44.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.347+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa8a01058d0 con 0x7fa8a00fe420 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.347+0000 7fa896ffd700 1 -- 172.21.15.82:0/1775560538 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1484 (secure 0 0 0) 0x7fa89c05ad80 con 0x7fa8a00fe420 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 78/384 objects degraded (20.312%), 20 pgs degraded 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 78/384 objects degraded (20.312%), 20 pgs degraded 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-27T07:38:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-04-27T07:38:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 msgr2=0x7fa88c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 0x7fa88c0710b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa890009e30 comp rx=0 tx=0).stop 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 msgr2=0x7fa8a010d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00c830 tx=0x7fa89c004470 comp rx=0 tx=0).stop 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 shutdown_connections 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa88c06ec00 0x7fa88c0710b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a00fe420 0x7fa8a010d900 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 --2- 172.21.15.82:0/1775560538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00fed70 0x7fa8a010de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 >> 172.21.15.82:0/1775560538 conn(0x7fa8a00f6be0 msgr2=0x7fa8a00f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 shutdown_connections 2024-04-27T07:38:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:38:44.350+0000 7fa8a84a4700 1 -- 172.21.15.82:0/1775560538 wait complete. 2024-04-27T07:38:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765] boot 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: osdmap e68: 6 total, 6 up, 6 in 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1775560538' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:38:45.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:38:45.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:45 smithi082 ceph-mon[91103]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-27T07:38:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: osd.3 [v2:172.21.15.100:6800/2753948765,v1:172.21.15.100:6801/2753948765] boot 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: osdmap e68: 6 total, 6 up, 6 in 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1775560538' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:38:45.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:38:45.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:38:45.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:45 smithi100 ceph-mon[80397]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-27T07:38:46.405 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:46 smithi082 ceph-mon[91103]: osdmap e69: 6 total, 6 up, 6 in 2024-04-27T07:38:46.405 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:46 smithi082 ceph-mon[91103]: pgmap v123: 65 pgs: 18 active+undersized+degraded, 17 active+undersized, 30 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 74/384 objects degraded (19.271%) 2024-04-27T07:38:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:46 smithi100 ceph-mon[80397]: osdmap e69: 6 total, 6 up, 6 in 2024-04-27T07:38:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:46 smithi100 ceph-mon[80397]: pgmap v123: 65 pgs: 18 active+undersized+degraded, 17 active+undersized, 30 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 74/384 objects degraded (19.271%) 2024-04-27T07:38:47.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:47 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 74/384 objects degraded (19.271%), 18 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:47.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:47 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 74/384 objects degraded (19.271%), 18 pgs degraded (PG_DEGRADED) 2024-04-27T07:38:48.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:48 smithi082 ceph-mon[91103]: pgmap v124: 65 pgs: 11 active+undersized+degraded, 9 active+undersized, 45 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 50/384 objects degraded (13.021%) 2024-04-27T07:38:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:48 smithi100 ceph-mon[80397]: pgmap v124: 65 pgs: 11 active+undersized+degraded, 9 active+undersized, 45 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 50/384 objects degraded (13.021%) 2024-04-27T07:38:50.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:49 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/384 objects degraded (13.021%), 11 pgs degraded) 2024-04-27T07:38:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:49 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/384 objects degraded (13.021%), 11 pgs degraded) 2024-04-27T07:38:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:50 smithi100 ceph-mon[80397]: pgmap v125: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T07:38:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:50 smithi082 ceph-mon[91103]: pgmap v125: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T07:38:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:52 smithi100 ceph-mon[80397]: pgmap v126: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T07:38:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:52 smithi082 ceph-mon[91103]: pgmap v126: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T07:38:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:54 smithi100 ceph-mon[80397]: pgmap v127: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:38:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:54 smithi082 ceph-mon[91103]: pgmap v127: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:38:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:56 smithi082 ceph-mon[91103]: pgmap v128: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:38:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:56 smithi100 ceph-mon[80397]: pgmap v128: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:38:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:38:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:38:59.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:58 smithi082 ceph-mon[91103]: pgmap v129: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:38:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:58 smithi100 ceph-mon[80397]: pgmap v129: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:39:00.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:38:59 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:39:00.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:38:59 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:39:00.852 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:00 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:39:00.852 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:00 smithi100 ceph-mon[80397]: Upgrade: osd.4 is safe to restart 2024-04-27T07:39:00.852 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:00 smithi100 ceph-mon[80397]: pgmap v130: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:39:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:00 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-27T07:39:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:00 smithi082 ceph-mon[91103]: Upgrade: osd.4 is safe to restart 2024-04-27T07:39:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:00 smithi082 ceph-mon[91103]: pgmap v130: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:39:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: Upgrade: Updating osd.4 2024-04-27T07:39:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:39:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: Deploying daemon osd.4 on smithi100 2024-04-27T07:39:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:02 smithi100 ceph-mon[80397]: pgmap v131: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:39:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: Upgrade: Updating osd.4 2024-04-27T07:39:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:02.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-27T07:39:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: Deploying daemon osd.4 on smithi100 2024-04-27T07:39:02.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:02 smithi082 ceph-mon[91103]: pgmap v131: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:39:04.983 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:04 smithi100 ceph-mon[80397]: pgmap v132: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:39:04.983 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:04 smithi100 systemd[1]: Stopping Ceph osd.4 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:39:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:04 smithi082 ceph-mon[91103]: pgmap v132: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:39:05.417 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:04 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[46177]: 2024-04-27T07:39:04.980+0000 7fb675498700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:39:05.417 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:04 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[46177]: 2024-04-27T07:39:04.980+0000 7fb675498700 -1 osd.4 69 *** Got signal Terminated *** 2024-04-27T07:39:05.418 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:04 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[46177]: 2024-04-27T07:39:04.980+0000 7fb675498700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:39:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:05 smithi100 ceph-mon[80397]: osd.4 marked itself down and dead 2024-04-27T07:39:06.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:05 smithi082 ceph-mon[91103]: osd.4 marked itself down and dead 2024-04-27T07:39:06.626 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:06 smithi100 podman[94178]: 2024-04-27 07:39:06.354153073 +0000 UTC m=+1.474232311 container died c2c98538e84039599428d7f03a35a0e1dc8e7de25f55e6dbffbe28d5d2c5e0fb (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-2be3efa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0) 2024-04-27T07:39:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:06 smithi100 ceph-mon[80397]: pgmap v133: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:39:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:06 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:39:06.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:06 smithi100 ceph-mon[80397]: osdmap e70: 6 total, 5 up, 6 in 2024-04-27T07:39:06.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:06 smithi100 podman[94178]: 2024-04-27 07:39:06.730901959 +0000 UTC m=+1.850981196 container cleanup c2c98538e84039599428d7f03a35a0e1dc8e7de25f55e6dbffbe28d5d2c5e0fb (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-2be3efa, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-27T07:39:06.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:06 smithi100 bash[94178]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4 2024-04-27T07:39:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:06 smithi082 ceph-mon[91103]: pgmap v133: 65 pgs: 65 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:39:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:06 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:39:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:06 smithi082 ceph-mon[91103]: osdmap e70: 6 total, 5 up, 6 in 2024-04-27T07:39:07.351 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94206]: 2024-04-27 07:39:07.015678933 +0000 UTC m=+0.656331944 container remove c2c98538e84039599428d7f03a35a0e1dc8e7de25f55e6dbffbe28d5d2c5e0fb (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-27T07:39:07.604 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.252626062 +0000 UTC m=+0.018016970 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:07.604 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.376309414 +0000 UTC m=+0.141700369 container create dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:39:07.873 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.60302743 +0000 UTC m=+0.368418344 container init dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-27T07:39:07.873 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.606678056 +0000 UTC m=+0.372068972 container start dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=main-c37f63b, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-27T07:39:07.873 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.727808586 +0000 UTC m=+0.493199501 container attach dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-27T07:39:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:07 smithi100 ceph-mon[80397]: osdmap e71: 6 total, 5 up, 6 in 2024-04-27T07:39:08.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:07 smithi100 podman[94297]: 2024-04-27 07:39:07.901046596 +0000 UTC m=+0.666437497 container died dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-27T07:39:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:07 smithi082 ceph-mon[91103]: osdmap e71: 6 total, 5 up, 6 in 2024-04-27T07:39:08.874 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 podman[94323]: 2024-04-27 07:39:08.464486189 +0000 UTC m=+0.552952655 container remove dffe91d3a0953087f310ba63344bbb5eb2e73b88661fcb50584dc8671a6f5607 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-27T07:39:08.874 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-27T07:39:08.874 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 systemd[1]: Stopped Ceph osd.4 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:39:08.875 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.4.service: Consumed 51.346s CPU time. 2024-04-27T07:39:08.875 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 systemd[1]: Starting Ceph osd.4 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:39:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:08 smithi100 ceph-mon[80397]: pgmap v136: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-04-27T07:39:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:08 smithi100 ceph-mon[80397]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-27T07:39:09.167 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 podman[94426]: 2024-04-27 07:39:08.803345039 +0000 UTC m=+0.017806978 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:09.167 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:08 smithi100 podman[94426]: 2024-04-27 07:39:08.91144454 +0000 UTC m=+0.125906469 container create f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-27T07:39:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:08 smithi082 ceph-mon[91103]: pgmap v136: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-04-27T07:39:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:08 smithi082 ceph-mon[91103]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-27T07:39:09.665 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 podman[94426]: 2024-04-27 07:39:09.186827631 +0000 UTC m=+0.401289561 container init f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:39:09.665 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 podman[94426]: 2024-04-27 07:39:09.189967841 +0000 UTC m=+0.404429775 container start f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:09.665 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 podman[94426]: 2024-04-27 07:39:09.261750394 +0000 UTC m=+0.476212327 container attach f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b) 2024-04-27T07:39:09.917 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 bash[94426]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-27T07:39:09.918 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate[94441]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-27T07:39:09.919 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:09 smithi100 podman[94426]: 2024-04-27 07:39:09.688350858 +0000 UTC m=+0.902812786 container died f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-04-27T07:39:10.317 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:09 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 47/384 objects degraded (12.240%), 10 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:09 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 47/384 objects degraded (12.240%), 10 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:10.634 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 podman[94577]: 2024-04-27 07:39:10.316080556 +0000 UTC m=+0.617863564 container remove f99dc4fb154351f29e6a9e12caaa522575fecbf8d36aa1cd66b285b3f024d25b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-27T07:39:10.634 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 podman[94638]: 2024-04-27 07:39:10.533615375 +0000 UTC m=+0.114830385 container create bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-27T07:39:10.634 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 podman[94638]: 2024-04-27 07:39:10.436695806 +0000 UTC m=+0.017910800 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-mon[80397]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 5 peering, 2 stale+active+clean, 9 active+undersized, 39 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 47/384 objects degraded (12.240%) 2024-04-27T07:39:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 podman[94638]: 2024-04-27 07:39:10.761469592 +0000 UTC m=+0.342684562 container init bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-c37f63b, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:11.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 podman[94638]: 2024-04-27 07:39:10.76444063 +0000 UTC m=+0.345655596 container start bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-27T07:39:11.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 ceph-osd[94657]: -- 172.21.15.100:0/3852801527 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55945398d680 con 0x559453956c00 2024-04-27T07:39:11.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 bash[94638]: bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 2024-04-27T07:39:11.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:10 smithi100 systemd[1]: Started Ceph osd.4 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:39:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:10 smithi082 ceph-mon[91103]: pgmap v137: 65 pgs: 10 active+undersized+degraded, 5 peering, 2 stale+active+clean, 9 active+undersized, 39 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 47/384 objects degraded (12.240%) 2024-04-27T07:39:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:11.667 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:11 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:39:11.311+0000 7fcb22c037c0 -1 Falling back to public interface 2024-04-27T07:39:12.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:12 smithi082 ceph-mon[91103]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:12 smithi082 ceph-mon[91103]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-27T07:39:13.371 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:12 smithi100 ceph-mon[80397]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:13.372 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:12 smithi100 ceph-mon[80397]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-27T07:39:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 -- 172.21.15.82:0/1365397265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 msgr2=0x7f9a8c0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 --2- 172.21.15.82:0/1365397265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c0fc0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a88004940 tx=0x7f9a88009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 -- 172.21.15.82:0/1365397265 shutdown_connections 2024-04-27T07:39:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 --2- 172.21.15.82:0/1365397265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 0x7f9a8c0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 --2- 172.21.15.82:0/1365397265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c0fc0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 -- 172.21.15.82:0/1365397265 >> 172.21.15.82:0/1365397265 conn(0x7f9a8c0f7440 msgr2=0x7f9a8c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 -- 172.21.15.82:0/1365397265 shutdown_connections 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.466+0000 7f9a94566700 1 -- 172.21.15.82:0/1365397265 wait complete. 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 Processor -- start 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 -- start start 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 0x7f9a8c112670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c112bb0 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a94566700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c112cf0 con 0x7f9a8c0fcf90 2024-04-27T07:39:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53962/0 (socket says 172.21.15.82:53962) 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 -- 172.21.15.82:0/1264732241 learned_addr learned my addr 172.21.15.82:0/1264732241 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a91b01700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 0x7f9a8c112670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 -- 172.21.15.82:0/1264732241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 msgr2=0x7f9a8c112670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 0x7f9a8c112670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 -- 172.21.15.82:0/1264732241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a88005040 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.467+0000 7f9a92302700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a88013870 tx=0x7f9a88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.468+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a88021070 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.468+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a88009430 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.468+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c112f70 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.468+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8800e070 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.468+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c113420 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.469+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c04c710 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.469+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9a8801c750 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.470+0000 7f9a82ffd700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 0x7f9a78071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.470+0000 7f9a91b01700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 0x7f9a78071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.470+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9a8808f920 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.470+0000 7f9a91b01700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 0x7f9a78071050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009b80 tx=0x7f9a7c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.475+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9a8805c320 con 0x7f9a8c0fbce0 2024-04-27T07:39:14.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.698+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8c113690 con 0x7f9a7806eba0 2024-04-27T07:39:14.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.699+0000 7f9a82ffd700 1 -- 172.21.15.82:0/1264732241 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9a8c113690 con 0x7f9a7806eba0 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 msgr2=0x7f9a78071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 0x7f9a78071050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009b80 tx=0x7f9a7c00b040 comp rx=0 tx=0).stop 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 msgr2=0x7f9a8c066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a88013870 tx=0x7f9a88009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 shutdown_connections 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9a7806eba0 0x7f9a78071050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a8c0fbce0 0x7f9a8c066d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 --2- 172.21.15.82:0/1264732241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c0fcf90 0x7f9a8c112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 >> 172.21.15.82:0/1264732241 conn(0x7f9a8c0f7440 msgr2=0x7f9a8c0f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.701+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 shutdown_connections 2024-04-27T07:39:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.702+0000 7f9a94566700 1 -- 172.21.15.82:0/1264732241 wait complete. 2024-04-27T07:39:14.714 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:39:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 -- 172.21.15.82:0/2761690353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 msgr2=0x7f07f80fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/2761690353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f80fd280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f07f0004940 tx=0x7f07f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 -- 172.21.15.82:0/2761690353 shutdown_connections 2024-04-27T07:39:14.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/2761690353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 0x7f07f80fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/2761690353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f80fd280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 -- 172.21.15.82:0/2761690353 >> 172.21.15.82:0/2761690353 conn(0x7f07f80f8550 msgr2=0x7f07f80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 -- 172.21.15.82:0/2761690353 shutdown_connections 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.803+0000 7f07ffbd2700 1 -- 172.21.15.82:0/2761690353 wait complete. 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 Processor -- start 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 -- start start 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 0x7f07f81100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81106a0 con 0x7f07f80fce70 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07ffbd2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8110810 con 0x7f07f80fdfe0 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd96e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd96e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53980/0 (socket says 172.21.15.82:53980) 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd96e700 1 -- 172.21.15.82:0/3585914383 learned_addr learned my addr 172.21.15.82:0/3585914383 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd16d700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 0x7f07f81100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd96e700 1 -- 172.21.15.82:0/3585914383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 msgr2=0x7f07f81100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.804+0000 7f07fd96e700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 0x7f07f81100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07fd96e700 1 -- 172.21.15.82:0/3585914383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0005040 con 0x7f07f80fce70 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07fd96e700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07f000b3b0 tx=0x7f07f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f000e040 con 0x7f07f80fce70 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f8115210 con 0x7f07f80fce70 2024-04-27T07:39:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07f000bbf0 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f001c630 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.805+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f81157d0 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.806+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8101970 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.807+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f07f000bd60 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.807+0000 7f07ee7fc700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 0x7f07e40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.807+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f07f008f390 con 0x7f07f80fce70 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.807+0000 7f07fd16d700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 0x7f07e40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.808+0000 7f07fd16d700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 0x7f07e40710b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07e8004f60 tx=0x7f07e800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:14.812+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f07f005bd90 con 0x7f07f80fce70 2024-04-27T07:39:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.036+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f802b340 con 0x7f07e406ec00 2024-04-27T07:39:15.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.037+0000 7f07ee7fc700 1 -- 172.21.15.82:0/3585914383 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f07f802b340 con 0x7f07e406ec00 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 msgr2=0x7f07e40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 0x7f07e40710b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f07e8004f60 tx=0x7f07e800b040 comp rx=0 tx=0).stop 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 msgr2=0x7f07f810fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07f000b3b0 tx=0x7f07f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 shutdown_connections 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f07e406ec00 0x7f07e40710b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f80fce70 0x7f07f810fb60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 --2- 172.21.15.82:0/3585914383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07f80fdfe0 0x7f07f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 >> 172.21.15.82:0/3585914383 conn(0x7f07f80f8550 msgr2=0x7f07f80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 shutdown_connections 2024-04-27T07:39:15.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.040+0000 7f07ffbd2700 1 -- 172.21.15.82:0/3585914383 wait complete. 2024-04-27T07:39:15.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:14 smithi082 ceph-mon[91103]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:15.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 -- 172.21.15.82:0/3434520646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fdfd0 msgr2=0x7f241c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 --2- 172.21.15.82:0/3434520646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fdfd0 0x7f241c0fe440 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2410004940 tx=0x7f2410009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 -- 172.21.15.82:0/3434520646 shutdown_connections 2024-04-27T07:39:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 --2- 172.21.15.82:0/3434520646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fdfd0 0x7f241c0fe440 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 --2- 172.21.15.82:0/3434520646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fce60 0x7f241c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 -- 172.21.15.82:0/3434520646 >> 172.21.15.82:0/3434520646 conn(0x7f241c0f8540 msgr2=0x7f241c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 -- 172.21.15.82:0/3434520646 shutdown_connections 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.149+0000 7f2424694700 1 -- 172.21.15.82:0/3434520646 wait complete. 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 Processor -- start 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 -- start start 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fdfd0 0x7f241c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c072200 con 0x7f241c0fce60 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2424694700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0707f0 con 0x7f241c0fdfd0 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53990/0 (socket says 172.21.15.82:53990) 2024-04-27T07:39:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 -- 172.21.15.82:0/2136027080 learned_addr learned my addr 172.21.15.82:0/2136027080 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2421c2f700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fdfd0 0x7f241c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 -- 172.21.15.82:0/2136027080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fdfd0 msgr2=0x7f241c0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fdfd0 0x7f241c0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 -- 172.21.15.82:0/2136027080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410005040 con 0x7f241c0fce60 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.150+0000 7f2422430700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2414001d80 tx=0x7f2414009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.151+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2414007d10 con 0x7f241c0fce60 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.151+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2414001e80 con 0x7f241c0fce60 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.151+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c070aa0 con 0x7f241c0fce60 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.151+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2414014640 con 0x7f241c0fce60 2024-04-27T07:39:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.151+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c071060 con 0x7f241c0fce60 2024-04-27T07:39:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.152+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c04c710 con 0x7f241c0fce60 2024-04-27T07:39:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.152+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f241400e960 con 0x7f241c0fce60 2024-04-27T07:39:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.152+0000 7f241affd700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 0x7f24040710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.153+0000 7f2421c2f700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 0x7f24040710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.153+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f241408e4b0 con 0x7f241c0fce60 2024-04-27T07:39:15.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.153+0000 7f2421c2f700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 0x7f24040710b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2410009fd0 tx=0x7f2410009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.157+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f241405af60 con 0x7f241c0fce60 2024-04-27T07:39:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.371+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f241c1023e0 con 0x7f240406ec00 2024-04-27T07:39:15.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.381+0000 7f241affd700 1 -- 172.21.15.82:0/2136027080 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f241c1023e0 con 0x7f240406ec00 2024-04-27T07:39:15.383 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:39:15.383 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (5m) 68s ago 14m 25.0M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (2m) 68s ago 14m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (2m) 1s ago 13m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (5m) 68s ago 13m 87.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (8m) 68s ago 8m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (8m) 68s ago 8m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (8m) 1s ago 8m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (8m) 1s ago 8m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (4m) 68s ago 15m 506M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (4m) 1s ago 13m 451M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (3m) 68s ago 15m 49.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (3m) 1s ago 13m 37.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 68s ago 14m 16.5M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 1s ago 13m 14.9M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (2m) 68s ago 12m 88.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:39:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (110s) 68s ago 11m 89.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:39:15.385 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (74s) 68s ago 11m 12.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:39:15.385 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (38s) 1s ago 11m 86.2M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:39:15.385 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (4s) 1s ago 10m 12.7M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:39:15.385 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (10m) 1s ago 10m 189M 2581M 17.2.7-907-g2be3efa9 1c5834633715 3b88486e6c2f 2024-04-27T07:39:15.385 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 68s ago 13m 63.2M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 msgr2=0x7f24040710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 0x7f24040710b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2410009fd0 tx=0x7f2410009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 msgr2=0x7f241c071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2414001d80 tx=0x7f2414009ec0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 shutdown_connections 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f240406ec00 0x7f24040710b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f241c0fce60 0x7f241c071c00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 --2- 172.21.15.82:0/2136027080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f241c0fdfd0 0x7f241c0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 >> 172.21.15.82:0/2136027080 conn(0x7f241c0f8540 msgr2=0x7f241c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 shutdown_connections 2024-04-27T07:39:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.383+0000 7f2424694700 1 -- 172.21.15.82:0/2136027080 wait complete. 2024-04-27T07:39:15.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:14 smithi100 ceph-mon[80397]: pgmap v139: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:15.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.405 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.482+0000 7f7c3575c700 1 -- 172.21.15.82:0/2949586467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fed80 msgr2=0x7f7c300faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.482+0000 7f7c3575c700 1 --2- 172.21.15.82:0/2949586467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fed80 0x7f7c300faec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c24004940 tx=0x7f7c24009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 -- 172.21.15.82:0/2949586467 shutdown_connections 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 --2- 172.21.15.82:0/2949586467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fed80 0x7f7c300faec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 --2- 172.21.15.82:0/2949586467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fe430 0x7f7c300fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 -- 172.21.15.82:0/2949586467 >> 172.21.15.82:0/2949586467 conn(0x7f7c300f6bd0 msgr2=0x7f7c300f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 -- 172.21.15.82:0/2949586467 shutdown_connections 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 -- 172.21.15.82:0/2949586467 wait complete. 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 Processor -- start 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.483+0000 7f7c3575c700 1 -- start start 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c3575c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c3575c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fed80 0x7f7c30110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c3575c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30110650 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c3575c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c301107c0 con 0x7f7c300fed80 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49584/0 (socket says 172.21.15.82:49584) 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 -- 172.21.15.82:0/3162875712 learned_addr learned my addr 172.21.15.82:0/3162875712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2e7fc700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fed80 0x7f7c30110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 -- 172.21.15.82:0/3162875712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fed80 msgr2=0x7f7c30110050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fed80 0x7f7c30110050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 -- 172.21.15.82:0/3162875712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24005040 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c2effd700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c20002a50 tx=0x7f7c200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c20007cc0 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c30115220 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c2000f040 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.484+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c2000da30 con 0x7f7c300fe430 2024-04-27T07:39:15.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.485+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c301157e0 con 0x7f7c300fe430 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.485+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c30101b70 con 0x7f7c300fe430 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.486+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7c2000db90 con 0x7f7c300fe430 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.486+0000 7f7c177fe700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 0x7f7c180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.487+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7c2008e580 con 0x7f7c300fe430 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.487+0000 7f7c2e7fc700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 0x7f7c180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.487+0000 7f7c2e7fc700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 0x7f7c180710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b3b0 tx=0x7f7c24009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.491+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7c2005af00 con 0x7f7c300fe430 2024-04-27T07:39:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.776+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7c3004c710 con 0x7f7c300fe430 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.776+0000 7f7c177fe700 1 -- 172.21.15.82:0/3162875712 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f7c2005aa90 con 0x7f7c300fe430 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:39:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 5, 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 8 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:39:15.780 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 msgr2=0x7f7c180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 0x7f7c180710b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b3b0 tx=0x7f7c24009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 msgr2=0x7f7c3010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7c20002a50 tx=0x7f7c200046b0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 shutdown_connections 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c1806ec00 0x7f7c180710b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c300fe430 0x7f7c3010fb10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 --2- 172.21.15.82:0/3162875712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c300fed80 0x7f7c30110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.778+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 >> 172.21.15.82:0/3162875712 conn(0x7f7c300f6bd0 msgr2=0x7f7c300f8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.779+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 shutdown_connections 2024-04-27T07:39:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.779+0000 7f7c3575c700 1 -- 172.21.15.82:0/3162875712 wait complete. 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 -- 172.21.15.82:0/1125118460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fbcc0 msgr2=0x7f997c0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1125118460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fbcc0 0x7f997c0fc0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9970004940 tx=0x7f9970009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 -- 172.21.15.82:0/1125118460 shutdown_connections 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1125118460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fcf70 0x7f997c0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1125118460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fbcc0 0x7f997c0fc0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 -- 172.21.15.82:0/1125118460 >> 172.21.15.82:0/1125118460 conn(0x7f997c0f7440 msgr2=0x7f997c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 -- 172.21.15.82:0/1125118460 shutdown_connections 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.881+0000 7f9982d4b700 1 -- 172.21.15.82:0/1125118460 wait complete. 2024-04-27T07:39:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 Processor -- start 2024-04-27T07:39:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 -- start start 2024-04-27T07:39:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fbcc0 0x7f997c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c10e4c0 con 0x7f997c0fcf70 2024-04-27T07:39:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9982d4b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c10e630 con 0x7f997c0fbcc0 2024-04-27T07:39:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49606/0 (socket says 172.21.15.82:49606) 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 -- 172.21.15.82:0/1927162766 learned_addr learned my addr 172.21.15.82:0/1927162766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f9980ae7700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fbcc0 0x7f997c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 -- 172.21.15.82:0/1927162766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fbcc0 msgr2=0x7f997c10d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fbcc0 0x7f997c10d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.882+0000 7f997bfff700 1 -- 172.21.15.82:0/1927162766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970005040 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f997bfff700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9968002a50 tx=0x7f99680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9968007cc0 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f996800f040 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c113040 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996800da30 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.883+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c1135d0 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.884+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c101b00 con 0x7f997c0fcf70 2024-04-27T07:39:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.884+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f996800dbb0 con 0x7f997c0fcf70 2024-04-27T07:39:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.885+0000 7f99797fa700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 0x7f996c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.885+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f996808e570 con 0x7f997c0fcf70 2024-04-27T07:39:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.885+0000 7f9980ae7700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 0x7f996c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.885+0000 7f9980ae7700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 0x7f996c0710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f997000b970 tx=0x7f9970009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:15.889+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f996805aef0 con 0x7f997c0fcf70 2024-04-27T07:39:15.981 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:15 smithi100 ceph-mon[80397]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:15.981 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.981 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:15.981 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:15 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3162875712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:15 smithi082 ceph-mon[91103]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:16.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:15 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3162875712' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:16.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.138+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f997c02b2a0 con 0x7f997c0fcf70 2024-04-27T07:39:16.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.138+0000 7f99797fa700 1 -- 172.21.15.82:0/1927162766 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1913 (secure 0 0 0) 0x7f996805aa80 con 0x7f997c0fcf70 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:e19 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 19 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:37:47.445128+0000 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:39:16.141 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:39:16.142 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:16.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 msgr2=0x7f996c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 0x7f996c0710b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f997000b970 tx=0x7f9970009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 msgr2=0x7f997c10dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9968002a50 tx=0x7f99680046b0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 shutdown_connections 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f996c06ec00 0x7f996c0710b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f997c0fbcc0 0x7f997c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 --2- 172.21.15.82:0/1927162766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f997c0fcf70 0x7f997c10dec0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 >> 172.21.15.82:0/1927162766 conn(0x7f997c0f7440 msgr2=0x7f997c0667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 shutdown_connections 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.140+0000 7f9982d4b700 1 -- 172.21.15.82:0/1927162766 wait complete. 2024-04-27T07:39:16.145 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-04-27T07:39:16.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- 172.21.15.82:0/770524621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc066f30 msgr2=0x7fbdcc0fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/770524621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc066f30 0x7fbdcc0fd7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8004940 tx=0x7fbdc8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- 172.21.15.82:0/770524621 shutdown_connections 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/770524621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/770524621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc066f30 0x7fbdcc0fd7a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- 172.21.15.82:0/770524621 >> 172.21.15.82:0/770524621 conn(0x7fbdcc0f7440 msgr2=0x7fbdcc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- 172.21.15.82:0/770524621 shutdown_connections 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- 172.21.15.82:0/770524621 wait complete. 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 Processor -- start 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- start start 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 0x7fbdcc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc114ae0 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.244+0000 7fbdd3e61700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc114c50 con 0x7fbdcc066f30 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd1bfd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 0x7fbdcc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49610/0 (socket says 172.21.15.82:49610) 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 -- 172.21.15.82:0/3622894420 learned_addr learned my addr 172.21.15.82:0/3622894420 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 -- 172.21.15.82:0/3622894420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 msgr2=0x7fbdcc113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 0x7fbdcc113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 -- 172.21.15.82:0/3622894420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc8005040 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd1bfd700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 0x7fbdcc113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd13fc700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c830 tx=0x7fbdbc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc0106f0 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdbc010d20 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc1196b0 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdbc0113a0 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.245+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc119c70 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.246+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc04c710 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.247+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbdbc012400 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.247+0000 7fbdc27fc700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 0x7fbdb80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.247+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fbdbc08e770 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.247+0000 7fbdd1bfd700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 0x7fbdb80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.248+0000 7fbdd1bfd700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 0x7fbdb80710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8004890 tx=0x7fbdc8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:16.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.252+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbdbc05b170 con 0x7fbdcc0fdce0 2024-04-27T07:39:16.417 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:39:16.196+0000 7fcb22c037c0 -1 osd.4 69 log_to_monitors true 2024-04-27T07:39:16.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.473+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdcc0f8f30 con 0x7fbdb806ec00 2024-04-27T07:39:16.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.474+0000 7fbdc27fc700 1 -- 172.21.15.82:0/3622894420 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbdcc0f8f30 con 0x7fbdb806ec00 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "11/21 daemons upgraded", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:39:16.477 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.476+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 msgr2=0x7fbdb80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.476+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 0x7fbdb80710b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8004890 tx=0x7fbdc8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.476+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 msgr2=0x7fbdcc1144e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.476+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c830 tx=0x7fbdbc004470 comp rx=0 tx=0).stop 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.476+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 shutdown_connections 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbdb806ec00 0x7fbdb80710b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdcc066f30 0x7fbdcc113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 --2- 172.21.15.82:0/3622894420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdcc0fdce0 0x7fbdcc1144e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 >> 172.21.15.82:0/3622894420 conn(0x7fbdcc0f7440 msgr2=0x7fbdcc0f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 shutdown_connections 2024-04-27T07:39:16.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.477+0000 7fbdd3e61700 1 -- 172.21.15.82:0/3622894420 wait complete. 2024-04-27T07:39:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- 172.21.15.82:0/2644972887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fe420 msgr2=0x7f33940fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 --2- 172.21.15.82:0/2644972887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fe420 0x7f33940fe830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3384004940 tx=0x7f3384009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- 172.21.15.82:0/2644972887 shutdown_connections 2024-04-27T07:39:16.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 --2- 172.21.15.82:0/2644972887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fed70 0x7f33940faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 --2- 172.21.15.82:0/2644972887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fe420 0x7f33940fe830 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- 172.21.15.82:0/2644972887 >> 172.21.15.82:0/2644972887 conn(0x7f33940f6be0 msgr2=0x7f33940f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- 172.21.15.82:0/2644972887 shutdown_connections 2024-04-27T07:39:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- 172.21.15.82:0/2644972887 wait complete. 2024-04-27T07:39:16.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 Processor -- start 2024-04-27T07:39:16.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.578+0000 7f3399ed7700 1 -- start start 2024-04-27T07:39:16.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3399ed7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fe420 0x7f33940fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3399ed7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3399ed7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940fe030 con 0x7f33940fed70 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3399ed7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940fc620 con 0x7f33940fe420 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49624/0 (socket says 172.21.15.82:49624) 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 -- 172.21.15.82:0/4177135471 learned_addr learned my addr 172.21.15.82:0/4177135471 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f33937fe700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fe420 0x7f33940fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 -- 172.21.15.82:0/4177135471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fe420 msgr2=0x7f33940fda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fe420 0x7f33940fda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 -- 172.21.15.82:0/4177135471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384005040 con 0x7f33940fed70 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f3392ffd700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3388002a50 tx=0x7f33880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.579+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3388007cc0 con 0x7f33940fed70 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.580+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f338800f040 con 0x7f33940fed70 2024-04-27T07:39:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.580+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940fc8d0 con 0x7f33940fed70 2024-04-27T07:39:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.580+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3388009640 con 0x7f33940fed70 2024-04-27T07:39:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.580+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33940fce90 con 0x7f33940fed70 2024-04-27T07:39:16.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.581+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339404c710 con 0x7f33940fed70 2024-04-27T07:39:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.581+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f33880097a0 con 0x7f33940fed70 2024-04-27T07:39:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.581+0000 7f337bfff700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 0x7f337c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.582+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f338808e5e0 con 0x7f33940fed70 2024-04-27T07:39:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.582+0000 7f33937fe700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 0x7f337c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.582+0000 7f33937fe700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 0x7f337c0710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f338400b3b0 tx=0x7f3384009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.586+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f338805af60 con 0x7f33940fed70 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.869+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3394115be0 con 0x7f33940fed70 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.869+0000 7f337bfff700 1 -- 172.21.15.82:0/4177135471 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1352 (secure 0 0 0) 0x7f338805aaf0 con 0x7f33940fed70 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 68/384 objects degraded (17.708%), 16 pgs degraded 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout: osd.4 (root=default,host=smithi100) is down 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 68/384 objects degraded (17.708%), 16 pgs degraded 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-27T07:39:16.872 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-27T07:39:16.873 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 msgr2=0x7f337c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 0x7f337c0710b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f338400b3b0 tx=0x7f3384009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 msgr2=0x7f33940fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3388002a50 tx=0x7f33880046b0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 shutdown_connections 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.871+0000 7f3399ed7700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f337c06ec00 0x7f337c0710b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.872+0000 7f3399ed7700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33940fe420 0x7f33940fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.872+0000 7f3399ed7700 1 --2- 172.21.15.82:0/4177135471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33940fed70 0x7f33940fc0e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.872+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 >> 172.21.15.82:0/4177135471 conn(0x7f33940f6be0 msgr2=0x7f33940f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.872+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 shutdown_connections 2024-04-27T07:39:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:16.872+0000 7f3399ed7700 1 -- 172.21.15.82:0/4177135471 wait complete. 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1927162766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:16 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/4177135471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:39:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1927162766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:39:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:39:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-27T07:39:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:16 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/4177135471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:39:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-27T07:39:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: osdmap e72: 6 total, 5 up, 6 in 2024-04-27T07:39:18.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: from='osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:18.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:18.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 68/384 objects degraded (17.708%), 16 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:18.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:18.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-mon[80397]: from='osd.4 ' entity='osd.4' 2024-04-27T07:39:18.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:39:18 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:39:18.048+0000 7fcb10053700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:39:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-27T07:39:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: osdmap e72: 6 total, 5 up, 6 in 2024-04-27T07:39:18.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: from='osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:18.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:18.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 68/384 objects degraded (17.708%), 16 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:18.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: pgmap v142: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68/384 objects degraded (17.708%) 2024-04-27T07:39:18.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:18 smithi082 ceph-mon[91103]: from='osd.4 ' entity='osd.4' 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:19.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-27T07:39:19.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:39:19.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297] boot 2024-04-27T07:39:19.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: osdmap e73: 6 total, 6 up, 6 in 2024-04-27T07:39:19.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:39:19.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:39:19.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: osd.4 [v2:172.21.15.100:6808/1234887297,v1:172.21.15.100:6809/1234887297] boot 2024-04-27T07:39:19.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: osdmap e73: 6 total, 6 up, 6 in 2024-04-27T07:39:19.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-27T07:39:20.818 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:20 smithi100 ceph-mon[80397]: pgmap v144: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 68/384 objects degraded (17.708%) 2024-04-27T07:39:20.819 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:20 smithi100 ceph-mon[80397]: osdmap e74: 6 total, 6 up, 6 in 2024-04-27T07:39:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:20 smithi082 ceph-mon[91103]: pgmap v144: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 68/384 objects degraded (17.708%) 2024-04-27T07:39:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:20 smithi082 ceph-mon[91103]: osdmap e74: 6 total, 6 up, 6 in 2024-04-27T07:39:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:22 smithi100 ceph-mon[80397]: pgmap v146: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 49/384 objects degraded (12.760%) 2024-04-27T07:39:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:22 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 49/384 objects degraded (12.760%), 11 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:22 smithi082 ceph-mon[91103]: pgmap v146: 65 pgs: 11 active+undersized+degraded, 11 active+undersized, 43 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 49/384 objects degraded (12.760%) 2024-04-27T07:39:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:22 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 49/384 objects degraded (12.760%), 11 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:24 smithi100 ceph-mon[80397]: pgmap v147: 65 pgs: 3 active+undersized+degraded, 3 active+undersized, 59 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 14/384 objects degraded (3.646%) 2024-04-27T07:39:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:24 smithi082 ceph-mon[91103]: pgmap v147: 65 pgs: 3 active+undersized+degraded, 3 active+undersized, 59 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 14/384 objects degraded (3.646%) 2024-04-27T07:39:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:26 smithi082 ceph-mon[91103]: pgmap v148: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-27T07:39:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:26 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded) 2024-04-27T07:39:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:26 smithi100 ceph-mon[80397]: pgmap v148: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-27T07:39:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:26 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/384 objects degraded (3.646%), 3 pgs degraded) 2024-04-27T07:39:29.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:28 smithi082 ceph-mon[91103]: pgmap v149: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-27T07:39:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:28 smithi100 ceph-mon[80397]: pgmap v149: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-27T07:39:31.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:30 smithi082 ceph-mon[91103]: pgmap v150: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T07:39:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:30 smithi100 ceph-mon[80397]: pgmap v150: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T07:39:32.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:32.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:32 smithi100 ceph-mon[80397]: pgmap v151: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:39:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:32.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:32 smithi082 ceph-mon[91103]: pgmap v151: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:39:34.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:33 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:34.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:33 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:34.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:34 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:34.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:34 smithi100 ceph-mon[80397]: Upgrade: osd.5 is safe to restart 2024-04-27T07:39:34.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:34 smithi100 ceph-mon[80397]: pgmap v152: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:39:35.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:34 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-27T07:39:35.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:34 smithi082 ceph-mon[91103]: Upgrade: osd.5 is safe to restart 2024-04-27T07:39:35.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:34 smithi082 ceph-mon[91103]: pgmap v152: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: Upgrade: Updating osd.5 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: Deploying daemon osd.5 on smithi100 2024-04-27T07:39:36.537 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:36 smithi100 ceph-mon[80397]: pgmap v153: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:39:36.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: Upgrade: Updating osd.5 2024-04-27T07:39:36.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:36.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-27T07:39:36.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:36.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: Deploying daemon osd.5 on smithi100 2024-04-27T07:39:36.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:36 smithi082 ceph-mon[91103]: pgmap v153: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:39:38.586 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:38 smithi100 ceph-mon[80397]: pgmap v154: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:39:38.842 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:38 smithi100 systemd[1]: Stopping Ceph osd.5 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:39:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:38 smithi082 ceph-mon[91103]: pgmap v154: 65 pgs: 65 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:39:39.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:38 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[53116]: 2024-04-27T07:39:38.864+0000 7f7c71b2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:39:39.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:38 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[53116]: 2024-04-27T07:39:38.864+0000 7f7c71b2f700 -1 osd.5 74 *** Got signal Terminated *** 2024-04-27T07:39:39.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:38 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[53116]: 2024-04-27T07:39:38.864+0000 7f7c71b2f700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:39:39.775 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:39 smithi100 ceph-mon[80397]: osd.5 marked itself down and dead 2024-04-27T07:39:39.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:39 smithi082 ceph-mon[91103]: osd.5 marked itself down and dead 2024-04-27T07:39:40.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:40 smithi100 podman[99043]: 2024-04-27 07:39:40.015044787 +0000 UTC m=+1.280138590 container died 3b88486e6c2f1bf8f3e1bd57f5e3a494953ef75acf0a89444b80c1efacb93063 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=quincy-2be3efa, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-27T07:39:40.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:40 smithi100 ceph-mon[80397]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:39:40.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:40 smithi100 ceph-mon[80397]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-27T07:39:40.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:40 smithi100 ceph-mon[80397]: osdmap e75: 6 total, 5 up, 6 in 2024-04-27T07:39:40.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:40 smithi100 ceph-mon[80397]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:39:40.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:40 smithi100 podman[99043]: 2024-04-27 07:39:40.397675497 +0000 UTC m=+1.662769311 container cleanup 3b88486e6c2f1bf8f3e1bd57f5e3a494953ef75acf0a89444b80c1efacb93063 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-2be3efa, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:40.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:40 smithi100 bash[99043]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5 2024-04-27T07:39:40.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:40 smithi082 ceph-mon[91103]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-27T07:39:40.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:40 smithi082 ceph-mon[91103]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-27T07:39:40.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:40 smithi082 ceph-mon[91103]: osdmap e75: 6 total, 5 up, 6 in 2024-04-27T07:39:40.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:40 smithi082 ceph-mon[91103]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T07:39:41.018 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:40 smithi100 podman[99072]: 2024-04-27 07:39:40.674428364 +0000 UTC m=+0.655252279 container remove 3b88486e6c2f1bf8f3e1bd57f5e3a494953ef75acf0a89444b80c1efacb93063 (image=quay.ceph.io/ceph-ci/ceph@sha256:d31f278ece6dbd17d1fa5e598f509017f54b76fafe1c4416391fcc51b9718ee9, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-2be3efa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-27T07:39:41.346 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:41.017088356 +0000 UTC m=+0.106103548 container create ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-27T07:39:41.346 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:40.928860074 +0000 UTC m=+0.017875282 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:41.346 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:41.24471217 +0000 UTC m=+0.333727364 container init ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=main-c37f63b, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:41.346 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:41.247853836 +0000 UTC m=+0.336869034 container start ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-27T07:39:41.346 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:41.344716767 +0000 UTC m=+0.433731976 container attach ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-27T07:39:41.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:41 smithi100 podman[99168]: 2024-04-27 07:39:41.560542482 +0000 UTC m=+0.649557683 container died ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=main-c37f63b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-27T07:39:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:41 smithi100 ceph-mon[80397]: osdmap e76: 6 total, 5 up, 6 in 2024-04-27T07:39:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:41.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:41 smithi082 ceph-mon[91103]: osdmap e76: 6 total, 5 up, 6 in 2024-04-27T07:39:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:41.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:42.485 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99195]: 2024-04-27 07:39:42.198842367 +0000 UTC m=+0.632888605 container remove ae4980641e760ddaef799726bca21f670ce65778eb62031a7763693f32a23be7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=main-c37f63b) 2024-04-27T07:39:42.485 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-27T07:39:42.485 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 systemd[1]: Stopped Ceph osd.5 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:39:42.486 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 systemd[1]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.5.service: Consumed 50.361s CPU time. 2024-04-27T07:39:42.486 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 systemd[1]: Starting Ceph osd.5 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:39:42.753 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:42 smithi100 ceph-mon[80397]: pgmap v158: 65 pgs: 3 activating+undersized, 2 activating+undersized+degraded, 2 active+undersized+degraded, 9 stale+active+clean, 1 active+undersized, 48 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 16/384 objects degraded (4.167%) 2024-04-27T07:39:42.754 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99296]: 2024-04-27 07:39:42.538913607 +0000 UTC m=+0.017624060 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:42.754 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99296]: 2024-04-27 07:39:42.641747016 +0000 UTC m=+0.120457458 container create 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:42.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:42 smithi082 ceph-mon[91103]: pgmap v158: 65 pgs: 3 activating+undersized, 2 activating+undersized+degraded, 2 active+undersized+degraded, 9 stale+active+clean, 1 active+undersized, 48 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 16/384 objects degraded (4.167%) 2024-04-27T07:39:43.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99296]: 2024-04-27 07:39:42.860908539 +0000 UTC m=+0.339618980 container init 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-27T07:39:43.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99296]: 2024-04-27 07:39:42.864206602 +0000 UTC m=+0.342917046 container start 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-27T07:39:43.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:42 smithi100 podman[99296]: 2024-04-27 07:39:42.944242833 +0000 UTC m=+0.422953283 container attach 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b) 2024-04-27T07:39:43.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-mon[80397]: Health check failed: Degraded data redundancy: 16/384 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:43.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:43.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:43.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 bash[99296]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-27T07:39:43.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate[99311]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-27T07:39:43.669 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 podman[99296]: 2024-04-27 07:39:43.368993583 +0000 UTC m=+0.847704032 container died 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b) 2024-04-27T07:39:43.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:43 smithi082 ceph-mon[91103]: Health check failed: Degraded data redundancy: 16/384 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:44.319 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:43 smithi100 podman[99452]: 2024-04-27 07:39:43.981688112 +0000 UTC m=+0.604797564 container remove 0d29825c2a5fc832aeb77b704a54ecb828c10442041256e551daafe654e8022f (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-27T07:39:44.319 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 podman[99516]: 2024-04-27 07:39:44.097112334 +0000 UTC m=+0.017697450 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:39:44.319 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 podman[99516]: 2024-04-27 07:39:44.207874713 +0000 UTC m=+0.128459814 container create a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:44.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:44 smithi100 ceph-mon[80397]: pgmap v159: 65 pgs: 3 activating+undersized, 2 activating+undersized+degraded, 11 active+undersized+degraded, 2 stale+active+clean, 9 active+undersized, 38 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:44.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 podman[99516]: 2024-04-27 07:39:44.427037298 +0000 UTC m=+0.347622400 container init a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:39:44.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 podman[99516]: 2024-04-27 07:39:44.430231188 +0000 UTC m=+0.350816289 container start a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:39:44.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 ceph-osd[99536]: -- 172.21.15.100:0/2057841473 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8c4c2b680 con 0x55b8c4bf5000 2024-04-27T07:39:44.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 bash[99516]: a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 2024-04-27T07:39:44.668 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 systemd[1]: Started Ceph osd.5 for ebadc0d6-0466-11ef-bc93-c7b262605968. 2024-04-27T07:39:44.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:44 smithi082 ceph-mon[91103]: pgmap v159: 65 pgs: 3 activating+undersized, 2 activating+undersized+degraded, 11 active+undersized+degraded, 2 stale+active+clean, 9 active+undersized, 38 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:45.409 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:44 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:39:44.971+0000 7fa4283ab7c0 -1 Falling back to public interface 2024-04-27T07:39:45.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:45.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:45.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:45.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:46.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:46 smithi082 ceph-mon[91103]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:46.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:46 smithi100 ceph-mon[80397]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 -- 172.21.15.82:0/2020100357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 msgr2=0x7fedd80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 --2- 172.21.15.82:0/2020100357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd80fd270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fedc8004940 tx=0x7fedc8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 -- 172.21.15.82:0/2020100357 shutdown_connections 2024-04-27T07:39:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 --2- 172.21.15.82:0/2020100357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 0x7fedd80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 --2- 172.21.15.82:0/2020100357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd80fd270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 -- 172.21.15.82:0/2020100357 >> 172.21.15.82:0/2020100357 conn(0x7fedd80f8540 msgr2=0x7fedd80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 -- 172.21.15.82:0/2020100357 shutdown_connections 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.985+0000 7feddd51c700 1 -- 172.21.15.82:0/2020100357 wait complete. 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 Processor -- start 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 -- start start 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 0x7fedd810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd810e400 con 0x7fedd80fce60 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7feddd51c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd810e570 con 0x7fedd80fdfd0 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42392/0 (socket says 172.21.15.82:42392) 2024-04-27T07:39:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 -- 172.21.15.82:0/1157090258 learned_addr learned my addr 172.21.15.82:0/1157090258 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedcffff700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 0x7fedd810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 -- 172.21.15.82:0/1157090258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 msgr2=0x7fedd810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 0x7fedd810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.986+0000 7fedd6ffd700 1 -- 172.21.15.82:0/1157090258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8005040 con 0x7fedd80fce60 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7fedd6ffd700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fedc8013870 tx=0x7fedc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc8021070 con 0x7fedd80fce60 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd8112f70 con 0x7fedd80fce60 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedc8009430 con 0x7fedd80fce60 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc800e070 con 0x7fedd80fce60 2024-04-27T07:39:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.987+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd8113420 con 0x7fedd80fce60 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.988+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd804c710 con 0x7fedd80fce60 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.989+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fedc801c750 con 0x7fedd80fce60 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.989+0000 7fedcf7fe700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 0x7fedc4071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.989+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fedc808f920 con 0x7fedd80fce60 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.989+0000 7fedcffff700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 0x7fedc4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.989+0000 7fedcffff700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 0x7fedc4071050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009b80 tx=0x7fedc000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:46.994+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fedc805c320 con 0x7fedd80fce60 2024-04-27T07:39:47.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.214+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedd8113690 con 0x7fedc406eba0 2024-04-27T07:39:47.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.215+0000 7fedcf7fe700 1 -- 172.21.15.82:0/1157090258 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fedd8113690 con 0x7fedc406eba0 2024-04-27T07:39:47.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 msgr2=0x7fedc4071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 0x7fedc4071050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009b80 tx=0x7fedc000b040 comp rx=0 tx=0).stop 2024-04-27T07:39:47.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 msgr2=0x7fedd810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fedc8013870 tx=0x7fedc8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 shutdown_connections 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fedc406eba0 0x7fedc4071050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd80fce60 0x7fedd810d8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 --2- 172.21.15.82:0/1157090258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd80fdfd0 0x7fedd810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 >> 172.21.15.82:0/1157090258 conn(0x7fedd80f8540 msgr2=0x7fedd80f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 shutdown_connections 2024-04-27T07:39:47.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.217+0000 7feddd51c700 1 -- 172.21.15.82:0/1157090258 wait complete. 2024-04-27T07:39:47.230 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 -- 172.21.15.82:0/877770544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fe430 msgr2=0x7f709c0fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 --2- 172.21.15.82:0/877770544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fe430 0x7f709c0fe840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7090004940 tx=0x7f7090009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 -- 172.21.15.82:0/877770544 shutdown_connections 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 --2- 172.21.15.82:0/877770544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fed80 0x7f709c0faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 --2- 172.21.15.82:0/877770544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fe430 0x7f709c0fe840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.319+0000 7f70a31c1700 1 -- 172.21.15.82:0/877770544 >> 172.21.15.82:0/877770544 conn(0x7f709c0f6bd0 msgr2=0x7f709c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 -- 172.21.15.82:0/877770544 shutdown_connections 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 -- 172.21.15.82:0/877770544 wait complete. 2024-04-27T07:39:47.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 Processor -- start 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 -- start start 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fe430 0x7f709c10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c10e470 con 0x7f709c0fed80 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.320+0000 7f70a31c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c10e5e0 con 0x7f709c0fe430 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42406/0 (socket says 172.21.15.82:42406) 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70a0f5d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fe430 0x7f709c10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 -- 172.21.15.82:0/2435150004 learned_addr learned my addr 172.21.15.82:0/2435150004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 -- 172.21.15.82:0/2435150004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fe430 msgr2=0x7f709c10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fe430 0x7f709c10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 -- 172.21.15.82:0/2435150004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090005040 con 0x7f709c0fed80 2024-04-27T07:39:47.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f709bfff700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7088002a50 tx=0x7f70880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7088007cc0 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c113040 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f708800f040 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f708800da30 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.321+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c1135d0 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.322+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c04c710 con 0x7f709c0fed80 2024-04-27T07:39:47.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.323+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f708800db90 con 0x7f709c0fed80 2024-04-27T07:39:47.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.324+0000 7f70997fa700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 0x7f708c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.324+0000 7f70a0f5d700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 0x7f708c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.324+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f708808e5a0 con 0x7f709c0fed80 2024-04-27T07:39:47.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.324+0000 7f70a0f5d700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 0x7f708c0710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f709000b970 tx=0x7f7090009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.328+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f708805af20 con 0x7f709c0fed80 2024-04-27T07:39:47.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.548+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f709c102570 con 0x7f708c06ec00 2024-04-27T07:39:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.550+0000 7f70997fa700 1 -- 172.21.15.82:0/2435150004 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f709c102570 con 0x7f708c06ec00 2024-04-27T07:39:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 msgr2=0x7f708c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 0x7f708c0710b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f709000b970 tx=0x7f7090009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 msgr2=0x7f709c10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7088002a50 tx=0x7f70880046b0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 shutdown_connections 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f708c06ec00 0x7f708c0710b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f709c0fe430 0x7f709c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 --2- 172.21.15.82:0/2435150004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f709c0fed80 0x7f709c10de70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 >> 172.21.15.82:0/2435150004 conn(0x7f709c0f6bd0 msgr2=0x7f709c0f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 shutdown_connections 2024-04-27T07:39:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.552+0000 7f70a31c1700 1 -- 172.21.15.82:0/2435150004 wait complete. 2024-04-27T07:39:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 -- 172.21.15.82:0/659156747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 msgr2=0x7f4c6c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/659156747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c0fe440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c58004940 tx=0x7f4c58009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 -- 172.21.15.82:0/659156747 shutdown_connections 2024-04-27T07:39:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/659156747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c0fe440 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/659156747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 0x7f4c6c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 -- 172.21.15.82:0/659156747 >> 172.21.15.82:0/659156747 conn(0x7f4c6c0f8540 msgr2=0x7f4c6c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 -- 172.21.15.82:0/659156747 shutdown_connections 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.653+0000 7f4c72ca4700 1 -- 172.21.15.82:0/659156747 wait complete. 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 Processor -- start 2024-04-27T07:39:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 -- start start 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 0x7f4c6c10d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c10e450 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c72ca4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c10e5c0 con 0x7f4c6c0fce60 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c6bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42418/0 (socket says 172.21.15.82:42418) 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c6bfff700 1 -- 172.21.15.82:0/3469239423 learned_addr learned my addr 172.21.15.82:0/3469239423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.654+0000 7f4c70a40700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 0x7f4c6c10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c6bfff700 1 -- 172.21.15.82:0/3469239423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 msgr2=0x7f4c6c10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c6bfff700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 0x7f4c6c10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c6bfff700 1 -- 172.21.15.82:0/3469239423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58005040 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c6bfff700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009150 tx=0x7f4c58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c5800e040 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c5800bbf0 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c5801c630 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c112fc0 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.655+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c113550 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.656+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c04c710 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.657+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4c5800bd60 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.657+0000 7f4c697fa700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 0x7f4c5c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.657+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4c5808faf0 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.657+0000 7f4c70a40700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 0x7f4c5c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.658+0000 7f4c70a40700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 0x7f4c5c0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c60004f40 tx=0x7f4c6000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.662+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4c5805c4f0 con 0x7f4c6c0fdfd0 2024-04-27T07:39:47.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.870+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c6c1023e0 con 0x7f4c5c06ec00 2024-04-27T07:39:47.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.880+0000 7f4c697fa700 1 -- 172.21.15.82:0/3469239423 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4c6c1023e0 con 0x7f4c5c06ec00 2024-04-27T07:39:47.883 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:39:47.883 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (6m) 101s ago 14m 25.0M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:39:47.883 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (3m) 101s ago 14m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:39:47.883 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (3m) 0s ago 13m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (6m) 101s ago 14m 87.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (9m) 101s ago 9m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (9m) 101s ago 9m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (9m) 0s ago 9m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (9m) 0s ago 9m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:39:47.884 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (5m) 101s ago 16m 506M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (4m) 0s ago 13m 452M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (4m) 101s ago 16m 49.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (4m) 0s ago 13m 39.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 101s ago 14m 16.5M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (5m) 0s ago 13m 15.1M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:39:47.885 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (2m) 101s ago 12m 88.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:39:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 101s ago 12m 89.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:39:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (107s) 101s ago 11m 12.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:39:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (71s) 0s ago 11m 88.4M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:39:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (37s) 0s ago 11m 90.5M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:39:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (3s) 0s ago 10m 15.1M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:39:47.887 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 101s ago 14m 63.2M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:39:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.882+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 msgr2=0x7f4c5c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.882+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 0x7f4c5c0710b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c60004f40 tx=0x7f4c6000b040 comp rx=0 tx=0).stop 2024-04-27T07:39:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.882+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 msgr2=0x7f4c6c10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.882+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009150 tx=0x7f4c58009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 shutdown_connections 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c5c06ec00 0x7f4c5c0710b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c6c0fce60 0x7f4c6c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 --2- 172.21.15.82:0/3469239423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c6c0fdfd0 0x7f4c6c10de50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 >> 172.21.15.82:0/3469239423 conn(0x7f4c6c0f8540 msgr2=0x7f4c6c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 shutdown_connections 2024-04-27T07:39:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.883+0000 7f4c72ca4700 1 -- 172.21.15.82:0/3469239423 wait complete. 2024-04-27T07:39:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 -- 172.21.15.82:0/1155075020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 msgr2=0x7f30e00fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/1155075020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e00fe440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f30c8004940 tx=0x7f30c8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 -- 172.21.15.82:0/1155075020 shutdown_connections 2024-04-27T07:39:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/1155075020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e00fe440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/1155075020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e00fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 -- 172.21.15.82:0/1155075020 >> 172.21.15.82:0/1155075020 conn(0x7f30e00f8540 msgr2=0x7f30e00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 -- 172.21.15.82:0/1155075020 shutdown_connections 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.982+0000 7f30e5dfe700 1 -- 172.21.15.82:0/1155075020 wait complete. 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 Processor -- start 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 -- start start 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e010e400 con 0x7f30e00fdfd0 2024-04-27T07:39:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30e5dfe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e010e570 con 0x7f30e00fce60 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30df7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.82:36990/0 (socket says 172.21.15.82:36990) 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.983+0000 7f30df7fe700 1 -- 172.21.15.82:0/146157611 learned_addr learned my addr 172.21.15.82:0/146157611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30df7fe700 1 -- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 msgr2=0x7f30e010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30df7fe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30df7fe700 1 -- 172.21.15.82:0/146157611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8005040 con 0x7f30e00fce60 2024-04-27T07:39:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30d7fff700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30df7fe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f30d000eb40 tx=0x7f30d000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d0007cc0 con 0x7f30e00fce60 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30d000f040 con 0x7f30e00fce60 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e0112f70 con 0x7f30e00fce60 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d000ca10 con 0x7f30e00fce60 2024-04-27T07:39:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.984+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e0113420 con 0x7f30e00fce60 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.985+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e004c710 con 0x7f30e00fce60 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.986+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f30d000cc80 con 0x7f30e00fce60 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.986+0000 7f30dcff9700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 0x7f30cc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.986+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f30d008e3d0 con 0x7f30e00fce60 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.986+0000 7f30d7fff700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 0x7f30cc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.986+0000 7f30d7fff700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 0x7f30cc0710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009b30 tx=0x7f30c8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:47.991+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f30d005ae00 con 0x7f30e00fce60 2024-04-27T07:39:48.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.277+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f30e0113950 con 0x7f30e00fce60 2024-04-27T07:39:48.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.278+0000 7f30dcff9700 1 -- 172.21.15.82:0/146157611 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f30d005a990 con 0x7f30e00fce60 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 5 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:39:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 9 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:39:48.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 msgr2=0x7f30cc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 0x7f30cc0710b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009b30 tx=0x7f30c8009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 msgr2=0x7f30e010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f30d000eb40 tx=0x7f30d000b040 comp rx=0 tx=0).stop 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 shutdown_connections 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f30cc06ec00 0x7f30cc0710b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30e00fce60 0x7f30e010d8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 --2- 172.21.15.82:0/146157611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e00fdfd0 0x7f30e010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 >> 172.21.15.82:0/146157611 conn(0x7f30e00f8540 msgr2=0x7f30e00f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 shutdown_connections 2024-04-27T07:39:48.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.280+0000 7f30e5dfe700 1 -- 172.21.15.82:0/146157611 wait complete. 2024-04-27T07:39:48.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 -- 172.21.15.82:0/1768158608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 msgr2=0x7fb7000faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 --2- 172.21.15.82:0/1768158608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000faea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc004940 tx=0x7fb6fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 -- 172.21.15.82:0/1768158608 shutdown_connections 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 --2- 172.21.15.82:0/1768158608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000faea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 --2- 172.21.15.82:0/1768158608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 -- 172.21.15.82:0/1768158608 >> 172.21.15.82:0/1768158608 conn(0x7fb7000f6bd0 msgr2=0x7fb7000f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 -- 172.21.15.82:0/1768158608 shutdown_connections 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.380+0000 7fb7084f6700 1 -- 172.21.15.82:0/1768158608 wait complete. 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 Processor -- start 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 -- start start 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000fe020 con 0x7fb7000fed60 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb7084f6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000fc610 con 0x7fb7000fe410 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42444/0 (socket says 172.21.15.82:42444) 2024-04-27T07:39:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 -- 172.21.15.82:0/3055752175 learned_addr learned my addr 172.21.15.82:0/3055752175 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb706292700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 -- 172.21.15.82:0/3055752175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 msgr2=0x7fb7000fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb705a91700 1 -- 172.21.15.82:0/3055752175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc005040 con 0x7fb7000fed60 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.381+0000 7fb706292700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb705a91700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009150 tx=0x7fb6fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc00e040 con 0x7fb7000fed60 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6fc00bbf0 con 0x7fb7000fed60 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7000fc860 con 0x7fb7000fed60 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc01c630 con 0x7fb7000fed60 2024-04-27T07:39:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.382+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7000fce20 con 0x7fb7000fed60 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.383+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70004c710 con 0x7fb7000fed60 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.383+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb6fc00bd60 con 0x7fb7000fed60 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.384+0000 7fb6f6ffd700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 0x7fb6ec0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.384+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb6fc08fbf0 con 0x7fb7000fed60 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.384+0000 7fb706292700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 0x7fb6ec0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.384+0000 7fb706292700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 0x7fb6ec0710b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009fd0 tx=0x7fb6f0009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:48.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.388+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb6fc05c590 con 0x7fb7000fed60 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:48 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/146157611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.643+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb7001058c0 con 0x7fb7000fed60 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.644+0000 7fb6f6ffd700 1 -- 172.21.15.82:0/3055752175 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1913 (secure 0 0 0) 0x7fb6fc05c120 con 0x7fb7000fed60 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stdout:e19 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:39:48.646 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 19 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:37:47.445128+0000 2024-04-27T07:39:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:39:48.648 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464,1=24269} 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:39:48.649 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:14476} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/450518230,v1:172.21.15.82:6829/450518230] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:48.650 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:48.651 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:24285} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.100:6826/398524698,v1:172.21.15.100:6827/398524698] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:39:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 msgr2=0x7fb6ec0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 0x7fb6ec0710b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009fd0 tx=0x7fb6f0009ee0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 msgr2=0x7fb7000fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009150 tx=0x7fb6fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 shutdown_connections 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb6ec06ec00 0x7fb6ec0710b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000fe410 0x7fb7000fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 --2- 172.21.15.82:0/3055752175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7000fed60 0x7fb7000fc0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 >> 172.21.15.82:0/3055752175 conn(0x7fb7000f6bd0 msgr2=0x7fb7000f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 shutdown_connections 2024-04-27T07:39:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.646+0000 7fb7084f6700 1 -- 172.21.15.82:0/3055752175 wait complete. 2024-04-27T07:39:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1819294629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a80fff60 msgr2=0x7ff3a8102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1819294629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a80fff60 0x7ff3a8102340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff398004940 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1819294629 shutdown_connections 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1819294629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a80fff60 0x7ff3a8102340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1819294629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a8066240 0x7ff3a80ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1819294629 >> 172.21.15.82:0/1819294629 conn(0x7ff3a80f7430 msgr2=0x7ff3a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:48.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1819294629 shutdown_connections 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1819294629 wait complete. 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 Processor -- start 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.755+0000 7ff3aebaa700 1 -- start start 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3aebaa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3aebaa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a80fff60 0x7ff3a80fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3aebaa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80fbed0 con 0x7ff3a8066240 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3aebaa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80fc040 con 0x7ff3a80fff60 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42474/0 (socket says 172.21.15.82:42474) 2024-04-27T07:39:48.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 -- 172.21.15.82:0/1158822476 learned_addr learned my addr 172.21.15.82:0/1158822476 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3a7fff700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a80fff60 0x7ff3a80fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 -- 172.21.15.82:0/1158822476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a80fff60 msgr2=0x7ff3a80fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a80fff60 0x7ff3a80fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 -- 172.21.15.82:0/1158822476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398005040 con 0x7ff3a8066240 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.756+0000 7ff3ac946700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0001ce0 tx=0x7ff3a0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.757+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a0007b30 con 0x7ff3a8066240 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.757+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3a000f040 con 0x7ff3a8066240 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.757+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a00096d0 con 0x7ff3a8066240 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.757+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a80fc320 con 0x7ff3a8066240 2024-04-27T07:39:48.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.757+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8115a50 con 0x7ff3a8066240 2024-04-27T07:39:48.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.758+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a805f5c0 con 0x7ff3a8066240 2024-04-27T07:39:48.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.758+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7ff3a0007c90 con 0x7ff3a8066240 2024-04-27T07:39:48.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.759+0000 7ff3a57fa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 0x7ff3940710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:48.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.759+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff3a008e1a0 con 0x7ff3a8066240 2024-04-27T07:39:48.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.759+0000 7ff3a7fff700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 0x7ff3940710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:48.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.759+0000 7ff3a7fff700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 0x7ff3940710b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff39800b970 tx=0x7ff398009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:48.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.763+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff3a00570a0 con 0x7ff3a8066240 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:48.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:48 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/146157611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.981+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3a80f8f20 con 0x7ff39406ec00 2024-04-27T07:39:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.982+0000 7ff3a57fa700 1 -- 172.21.15.82:0/1158822476 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff3a80f8f20 con 0x7ff39406ec00 2024-04-27T07:39:48.985 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:39:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:39:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:39:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:39:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:39:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "12/21 daemons upgraded", 2024-04-27T07:39:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:39:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:39:48.987 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:39:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 msgr2=0x7ff3940710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 0x7ff3940710b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff39800b970 tx=0x7ff398009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 msgr2=0x7ff3a80fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0001ce0 tx=0x7ff3a0009e60 comp rx=0 tx=0).stop 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 shutdown_connections 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7ff39406ec00 0x7ff3940710b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a8066240 0x7ff3a80fd450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 --2- 172.21.15.82:0/1158822476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3a80fff60 0x7ff3a80fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 >> 172.21.15.82:0/1158822476 conn(0x7ff3a80f7430 msgr2=0x7ff3a80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 shutdown_connections 2024-04-27T07:39:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:48.985+0000 7ff3aebaa700 1 -- 172.21.15.82:0/1158822476 wait complete. 2024-04-27T07:39:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- 172.21.15.82:0/3605975845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684071dc0 msgr2=0x7f16840702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 --2- 172.21.15.82:0/3605975845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684071dc0 0x7f16840702d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1674004940 tx=0x7f1674009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- 172.21.15.82:0/3605975845 shutdown_connections 2024-04-27T07:39:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 --2- 172.21.15.82:0/3605975845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684070810 0x7f1684070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 --2- 172.21.15.82:0/3605975845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684071dc0 0x7f16840702d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- 172.21.15.82:0/3605975845 >> 172.21.15.82:0/3605975845 conn(0x7f16840f8590 msgr2=0x7f16840fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- 172.21.15.82:0/3605975845 shutdown_connections 2024-04-27T07:39:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- 172.21.15.82:0/3605975845 wait complete. 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 Processor -- start 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.087+0000 7f1688b43700 1 -- start start 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684071dc0 0x7f1684110110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1684110710 con 0x7f1684070810 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1684110f60 con 0x7f1684071dc0 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42500/0 (socket says 172.21.15.82:42500) 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 -- 172.21.15.82:0/2149766570 learned_addr learned my addr 172.21.15.82:0/2149766570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1679d9b700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684071dc0 0x7f1684110110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 -- 172.21.15.82:0/2149766570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684071dc0 msgr2=0x7f1684110110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684071dc0 0x7f1684110110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 -- 172.21.15.82:0/2149766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674005040 con 0x7f1684070810 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f168259c700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1674000c00 tx=0x7f1674009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167400e040 con 0x7f1684070810 2024-04-27T07:39:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f167400bbf0 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16841111e0 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167401c630 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.088+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1684111720 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.089+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168405f5c0 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.090+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f167400bd60 con 0x7f1684070810 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.090+0000 7f167b7fe700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 0x7f16700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:39:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.090+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f167408f9c0 con 0x7f1684070810 2024-04-27T07:39:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.090+0000 7f1679d9b700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 0x7f16700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:39:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.091+0000 7f1679d9b700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 0x7f16700710b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f166c009fd0 tx=0x7f166c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:39:49.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.095+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f167405c460 con 0x7f1684070810 2024-04-27T07:39:49.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.390+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f168404bed0 con 0x7f1684070810 2024-04-27T07:39:49.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.390+0000 7f167b7fe700 1 -- 172.21.15.82:0/2149766570 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1480 (secure 0 0 0) 0x7f167405bff0 con 0x7f1684070810 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 58/384 objects degraded (15.104%), 14 pgs degraded 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: osd.5 (root=default,host=smithi100) is down 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 58/384 objects degraded (15.104%), 14 pgs degraded 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-04-27T07:39:49.393 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-04-27T07:39:49.394 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 msgr2=0x7f16700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 0x7f16700710b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f166c009fd0 tx=0x7f166c00b040 comp rx=0 tx=0).stop 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 msgr2=0x7f168410fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1674000c00 tx=0x7f1674009e30 comp rx=0 tx=0).stop 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 shutdown_connections 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f167006ec00 0x7f16700710b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1684070810 0x7f168410fbd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 --2- 172.21.15.82:0/2149766570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1684071dc0 0x7f1684110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:39:49.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 >> 172.21.15.82:0/2149766570 conn(0x7f16840f8590 msgr2=0x7f16840f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:39:49.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 shutdown_connections 2024-04-27T07:39:49.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:39:49.392+0000 7f1688b43700 1 -- 172.21.15.82:0/2149766570 wait complete. 2024-04-27T07:39:49.441 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:39:49.166+0000 7fa4283ab7c0 -1 osd.5 74 log_to_monitors true 2024-04-27T07:39:49.743 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:39:49.687+0000 7fa419803700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3055752175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:39:49.743 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:49 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2149766570' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:39:49.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3055752175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:39:49.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:49.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:49.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:39:49.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-27T07:39:49.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:49 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2149766570' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:39:50.706 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:50.706 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-27T07:39:50.706 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: osdmap e77: 6 total, 5 up, 6 in 2024-04-27T07:39:50.707 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: from='osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:50.707 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:50.707 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:50 smithi100 ceph-mon[80397]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:51.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:39:51.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-27T07:39:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: osdmap e77: 6 total, 5 up, 6 in 2024-04-27T07:39:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: from='osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-04-27T07:39:51.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:50 smithi082 ceph-mon[91103]: pgmap v163: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 58/384 objects degraded (15.104%) 2024-04-27T07:39:51.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:51 smithi100 ceph-mon[80397]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:39:51.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:51 smithi100 ceph-mon[80397]: osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958] boot 2024-04-27T07:39:51.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:51 smithi100 ceph-mon[80397]: osdmap e78: 6 total, 6 up, 6 in 2024-04-27T07:39:51.815 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:39:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:51 smithi082 ceph-mon[91103]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-27T07:39:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:51 smithi082 ceph-mon[91103]: osd.5 [v2:172.21.15.100:6816/4221202958,v1:172.21.15.100:6817/4221202958] boot 2024-04-27T07:39:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:51 smithi082 ceph-mon[91103]: osdmap e78: 6 total, 6 up, 6 in 2024-04-27T07:39:52.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-27T07:39:53.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: osdmap e79: 6 total, 6 up, 6 in 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: pgmap v166: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 54/384 objects degraded (14.062%) 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-27T07:39:53.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:52 smithi082 ceph-mon[91103]: Health check update: Degraded data redundancy: 58/384 objects degraded (15.104%), 14 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: osdmap e79: 6 total, 6 up, 6 in 2024-04-27T07:39:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: pgmap v166: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 54/384 objects degraded (14.062%) 2024-04-27T07:39:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-27T07:39:53.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-27T07:39:53.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:52 smithi100 ceph-mon[80397]: Health check update: Degraded data redundancy: 58/384 objects degraded (15.104%), 14 pgs degraded (PG_DEGRADED) 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all osd 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: Upgrade: Setting require_osd_release to 19 squid 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: osdmap e80: 6 total, 6 up, 6 in 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:53.995 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:53 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-27T07:39:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all osd 2024-04-27T07:39:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: Upgrade: Setting require_osd_release to 19 squid 2024-04-27T07:39:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-27T07:39:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-27T07:39:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: osdmap e80: 6 total, 6 up, 6 in 2024-04-27T07:39:54.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:54.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:53 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-27T07:39:54.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: osdmap e81: 6 total, 6 up, 6 in 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: pgmap v169: 65 pgs: 2 peering, 6 active+undersized+degraded, 10 active+undersized, 47 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 20/384 objects degraded (5.208%) 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:54.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:54 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-27T07:39:54.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: osdmap e81: 6 total, 6 up, 6 in 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: pgmap v169: 65 pgs: 2 peering, 6 active+undersized+degraded, 10 active+undersized, 47 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 20/384 objects degraded (5.208%) 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:54.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:54.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:54.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:54 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-27T07:39:56.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: Upgrade: Scaling down filesystem cephfs 2024-04-27T07:39:56.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.100:6826/733762917,v1:172.21.15.100:6827/733762917] up:boot 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:boot 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: stopping daemon mds.cephfs.smithi100.udlhfn 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:stopping} 2 up:standby 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:56.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:56.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.095 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: Upgrade: Scaling down filesystem cephfs 2024-04-27T07:39:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.100:6826/733762917,v1:172.21.15.100:6827/733762917] up:boot 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:boot 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: stopping daemon mds.cephfs.smithi100.udlhfn 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:active} 2 up:standby 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi100.udlhfn=up:stopping} 2 up:standby 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:39:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:56.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:39:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:56 smithi082 ceph-mon[91103]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:39:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:56 smithi082 ceph-mon[91103]: pgmap v170: 65 pgs: 2 peering, 63 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-27T07:39:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:56 smithi082 ceph-mon[91103]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/384 objects degraded (5.208%), 6 pgs degraded) 2024-04-27T07:39:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:56 smithi100 ceph-mon[80397]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:39:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:56 smithi100 ceph-mon[80397]: pgmap v170: 65 pgs: 2 peering, 63 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-04-27T07:39:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:39:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:39:57.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:56 smithi100 ceph-mon[80397]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/384 objects degraded (5.208%), 6 pgs degraded) 2024-04-27T07:39:59.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:39:58 smithi082 ceph-mon[91103]: pgmap v171: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-27T07:39:59.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:39:58 smithi100 ceph-mon[80397]: pgmap v171: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-04-27T07:40:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:00 smithi082 ceph-mon[91103]: pgmap v172: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 127 B/s wr, 0 op/s 2024-04-27T07:40:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:00 smithi082 ceph-mon[91103]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:01.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:00 smithi100 ceph-mon[80397]: pgmap v172: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 127 B/s wr, 0 op/s 2024-04-27T07:40:01.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:00 smithi100 ceph-mon[80397]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:03.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:02 smithi082 ceph-mon[91103]: pgmap v173: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 122 B/s wr, 0 op/s 2024-04-27T07:40:03.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:02 smithi100 ceph-mon[80397]: pgmap v173: 65 pgs: 65 active+clean; 337 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 122 B/s wr, 0 op/s 2024-04-27T07:40:05.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:04 smithi082 ceph-mon[91103]: pgmap v174: 65 pgs: 65 active+clean; 321 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 404 B/s wr, 3 op/s 2024-04-27T07:40:05.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:04 smithi100 ceph-mon[80397]: pgmap v174: 65 pgs: 65 active+clean; 321 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 404 B/s wr, 3 op/s 2024-04-27T07:40:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:06.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:06.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:06 smithi082 ceph-mon[91103]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:40:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:06 smithi082 ceph-mon[91103]: pgmap v175: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 5 op/s 2024-04-27T07:40:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:06 smithi100 ceph-mon[80397]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:40:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:06 smithi100 ceph-mon[80397]: pgmap v175: 65 pgs: 65 active+clean; 305 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 5 op/s 2024-04-27T07:40:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:09.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:08 smithi082 ceph-mon[91103]: pgmap v176: 65 pgs: 65 active+clean; 285 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1023 B/s wr, 6 op/s 2024-04-27T07:40:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:08 smithi100 ceph-mon[80397]: pgmap v176: 65 pgs: 65 active+clean; 285 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1023 B/s wr, 6 op/s 2024-04-27T07:40:11.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:10 smithi100 ceph-mon[80397]: pgmap v177: 65 pgs: 65 active+clean; 225 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-27T07:40:11.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:11.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:10 smithi082 ceph-mon[91103]: pgmap v177: 65 pgs: 65 active+clean; 225 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-27T07:40:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:12 smithi100 ceph-mon[80397]: pgmap v178: 65 pgs: 65 active+clean; 185 MiB data, 942 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-27T07:40:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:12 smithi082 ceph-mon[91103]: pgmap v178: 65 pgs: 65 active+clean; 185 MiB data, 942 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-27T07:40:15.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:14 smithi100 ceph-mon[80397]: pgmap v179: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-27T07:40:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:14 smithi082 ceph-mon[91103]: pgmap v179: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-27T07:40:16.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: pgmap v180: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-27T07:40:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: pgmap v180: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-27T07:40:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:17 smithi100 ceph-mon[80397]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:40:18.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:17 smithi100 ceph-mon[80397]: daemon mds.cephfs.smithi100.udlhfn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-27T07:40:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:17 smithi082 ceph-mon[91103]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-27T07:40:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:17 smithi082 ceph-mon[91103]: daemon mds.cephfs.smithi100.udlhfn finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-27T07:40:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:18 smithi100 ceph-mon[80397]: pgmap v181: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 3 op/s 2024-04-27T07:40:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:18 smithi100 ceph-mon[80397]: mds.1 [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] down:stopped 2024-04-27T07:40:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:18 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:40:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:18 smithi082 ceph-mon[91103]: pgmap v181: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 3 op/s 2024-04-27T07:40:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:18 smithi082 ceph-mon[91103]: mds.1 [v2:172.21.15.100:6824/1114832337,v1:172.21.15.100:6825/1114832337] down:stopped 2024-04-27T07:40:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:18 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:40:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- 172.21.15.82:0/444967938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040662c0 msgr2=0x7f47040ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 --2- 172.21.15.82:0/444967938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040662c0 0x7f47040ff9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004940 tx=0x7f46f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- 172.21.15.82:0/444967938 shutdown_connections 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 --2- 172.21.15.82:0/444967938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040ffee0 0x7f4704102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 --2- 172.21.15.82:0/444967938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040662c0 0x7f47040ff9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- 172.21.15.82:0/444967938 >> 172.21.15.82:0/444967938 conn(0x7f47040f7430 msgr2=0x7f47040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- 172.21.15.82:0/444967938 shutdown_connections 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- 172.21.15.82:0/444967938 wait complete. 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 Processor -- start 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.507+0000 7f470953b700 1 -- start start 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f470953b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040662c0 0x7f470410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f470953b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f470953b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47041106f0 con 0x7f47040ffee0 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f470953b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704110f40 con 0x7f47040662c0 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58732/0 (socket says 172.21.15.82:58732) 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 -- 172.21.15.82:0/818025825 learned_addr learned my addr 172.21.15.82:0/818025825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f4702ffd700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040662c0 0x7f470410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 -- 172.21.15.82:0/818025825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040662c0 msgr2=0x7f470410fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040662c0 0x7f470410fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 -- 172.21.15.82:0/818025825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f4005040 con 0x7f47040ffee0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f47027fc700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eb40 tx=0x7f46f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f8007cc0 con 0x7f47040ffee0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46f800f040 con 0x7f47040ffee0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47041111c0 con 0x7f47040ffee0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.508+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f8009620 con 0x7f47040ffee0 2024-04-27T07:40:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.509+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4704111700 con 0x7f47040ffee0 2024-04-27T07:40:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.510+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470405f5c0 con 0x7f47040ffee0 2024-04-27T07:40:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.510+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f46f8009780 con 0x7f47040ffee0 2024-04-27T07:40:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.510+0000 7f46eb7fe700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 0x7f46ec0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.510+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f46f808e3d0 con 0x7f47040ffee0 2024-04-27T07:40:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.510+0000 7f4702ffd700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 0x7f46ec0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.511+0000 7f4702ffd700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 0x7f46ec0710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004890 tx=0x7f46f4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.515+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f46f805ae80 con 0x7f47040ffee0 2024-04-27T07:40:19.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.731+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4704111a30 con 0x7f46ec06ec00 2024-04-27T07:40:19.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.733+0000 7f46eb7fe700 1 -- 172.21.15.82:0/818025825 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4704111a30 con 0x7f46ec06ec00 2024-04-27T07:40:19.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 msgr2=0x7f46ec0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 0x7f46ec0710b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004890 tx=0x7f46f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:19.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 msgr2=0x7f47041100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46f800eb40 tx=0x7f46f800b040 comp rx=0 tx=0).stop 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 shutdown_connections 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46ec06ec00 0x7f46ec0710b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47040662c0 0x7f470410fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 --2- 172.21.15.82:0/818025825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47040ffee0 0x7f47041100f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 >> 172.21.15.82:0/818025825 conn(0x7f47040f7430 msgr2=0x7f47041002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 shutdown_connections 2024-04-27T07:40:19.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.735+0000 7f470953b700 1 -- 172.21.15.82:0/818025825 wait complete. 2024-04-27T07:40:19.748 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:40:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 -- 172.21.15.82:0/3361106990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fcf60 msgr2=0x7f18f40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 --2- 172.21.15.82:0/3361106990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fcf60 0x7f18f40fd3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004940 tx=0x7f18dc009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 -- 172.21.15.82:0/3361106990 shutdown_connections 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 --2- 172.21.15.82:0/3361106990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fcf60 0x7f18f40fd3d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 --2- 172.21.15.82:0/3361106990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fbcb0 0x7f18f40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 -- 172.21.15.82:0/3361106990 >> 172.21.15.82:0/3361106990 conn(0x7f18f40f7430 msgr2=0x7f18f40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:19.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 -- 172.21.15.82:0/3361106990 shutdown_connections 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.837+0000 7f18fa43a700 1 -- 172.21.15.82:0/3361106990 wait complete. 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 Processor -- start 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 -- start start 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 0x7f18f4110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4110780 con 0x7f18f40fbcb0 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18fa43a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4110fd0 con 0x7f18f40fcf60 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58762/0 (socket says 172.21.15.82:58762) 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 -- 172.21.15.82:0/93768721 learned_addr learned my addr 172.21.15.82:0/93768721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f37fe700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 0x7f18f4110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 -- 172.21.15.82:0/93768721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 msgr2=0x7f18f4110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 0x7f18f4110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f3fff700 1 -- 172.21.15.82:0/93768721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc005040 con 0x7f18f40fbcb0 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.838+0000 7f18f37fe700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 0x7f18f4110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18f3fff700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18e4002a50 tx=0x7f18e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e4007cc0 con 0x7f18f40fbcb0 2024-04-27T07:40:19.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f41112b0 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18e400f040 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e4009640 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.839+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f41117f0 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.840+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f41018f0 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.840+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f18e400d690 con 0x7f18f40fbcb0 2024-04-27T07:40:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.841+0000 7f18f0ff9700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 0x7f18e00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.841+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f18e408e5e0 con 0x7f18f40fbcb0 2024-04-27T07:40:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.841+0000 7f18f37fe700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 0x7f18e00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.841+0000 7f18f37fe700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 0x7f18e00710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b970 tx=0x7f18dc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:19.846+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f18e405af60 con 0x7f18f40fbcb0 2024-04-27T07:40:20.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.066+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f41048b0 con 0x7f18e006ec00 2024-04-27T07:40:20.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.068+0000 7f18f0ff9700 1 -- 172.21.15.82:0/93768721 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f18f41048b0 con 0x7f18e006ec00 2024-04-27T07:40:20.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 msgr2=0x7f18e00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 0x7f18e00710b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b970 tx=0x7f18dc009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 msgr2=0x7f18f410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f18e4002a50 tx=0x7f18e40046b0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 shutdown_connections 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f18e006ec00 0x7f18e00710b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f40fbcb0 0x7f18f410fc40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 --2- 172.21.15.82:0/93768721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18f40fcf60 0x7f18f4110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 >> 172.21.15.82:0/93768721 conn(0x7f18f40f7430 msgr2=0x7f18f4065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 shutdown_connections 2024-04-27T07:40:20.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.070+0000 7f18fa43a700 1 -- 172.21.15.82:0/93768721 wait complete. 2024-04-27T07:40:20.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:19 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.100:6824/2686792360,v1:172.21.15.100:6825/2686792360] up:boot 2024-04-27T07:40:20.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:19 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:40:20.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:40:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:19 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.100:6824/2686792360,v1:172.21.15.100:6825/2686792360] up:boot 2024-04-27T07:40:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:19 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:40:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 -- 172.21.15.82:0/861473783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 msgr2=0x7f23a00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 --2- 172.21.15.82:0/861473783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a00fd270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f239c004940 tx=0x7f239c009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 -- 172.21.15.82:0/861473783 shutdown_connections 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 --2- 172.21.15.82:0/861473783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 0x7f23a00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 --2- 172.21.15.82:0/861473783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a00fd270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 -- 172.21.15.82:0/861473783 >> 172.21.15.82:0/861473783 conn(0x7f23a00f8540 msgr2=0x7f23a00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 -- 172.21.15.82:0/861473783 shutdown_connections 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.171+0000 7f23a8202700 1 -- 172.21.15.82:0/861473783 wait complete. 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 Processor -- start 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 -- start start 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 0x7f23a010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a010e450 con 0x7f23a00fce60 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a8202700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a010e5c0 con 0x7f23a00fdfd0 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a5f9e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a5f9e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58786/0 (socket says 172.21.15.82:58786) 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a5f9e700 1 -- 172.21.15.82:0/1691819036 learned_addr learned my addr 172.21.15.82:0/1691819036 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.172+0000 7f23a579d700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 0x7f23a010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a5f9e700 1 -- 172.21.15.82:0/1691819036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 msgr2=0x7f23a010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a5f9e700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 0x7f23a010de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a5f9e700 1 -- 172.21.15.82:0/1691819036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c005040 con 0x7f23a00fce60 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a5f9e700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f239c009150 tx=0x7f239c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239c00e040 con 0x7f23a00fce60 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f239c00bbf0 con 0x7f23a00fce60 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a0112fc0 con 0x7f23a00fce60 2024-04-27T07:40:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f239c01c630 con 0x7f23a00fce60 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.173+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a01134f0 con 0x7f23a00fce60 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.174+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a004c710 con 0x7f23a00fce60 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.174+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f239c00bd60 con 0x7f23a00fce60 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.175+0000 7f23967fc700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 0x7f238c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.175+0000 7f23a579d700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 0x7f238c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.175+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f239c08fb00 con 0x7f23a00fce60 2024-04-27T07:40:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.175+0000 7f23a579d700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 0x7f238c0710b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2390004f40 tx=0x7f239000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.180+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f239c05c500 con 0x7f23a00fce60 2024-04-27T07:40:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.387+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a0102360 con 0x7f238c06ec00 2024-04-27T07:40:20.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.397+0000 7f23967fc700 1 -- 172.21.15.82:0/1691819036 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f23a0102360 con 0x7f238c06ec00 2024-04-27T07:40:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:40:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (6m) 2m ago 15m 25.0M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:40:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (3m) 2m ago 15m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:40:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (3m) 32s ago 14m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:40:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (6m) 2m ago 14m 87.4M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (9m) 2m ago 9m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (9m) 2m ago 9m 126M - 17.2.7-907-g2be3efa9 1c5834633715 2c3a60b718d4 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (9m) 32s ago 9m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (9m) 32s ago 9m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (6m) 2m ago 16m 506M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (5m) 32s ago 14m 452M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (5m) 2m ago 16m 49.4M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (4m) 32s ago 14m 39.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:40:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 2m ago 15m 16.5M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 32s ago 14m 15.1M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 2m ago 13m 88.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 2m ago 12m 89.3M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 2m ago 12m 12.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (103s) 32s ago 12m 88.4M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (69s) 32s ago 11m 90.5M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (36s) 32s ago 11m 15.1M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:40:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 2m ago 14m 63.2M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:40:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 msgr2=0x7f238c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 0x7f238c0710b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2390004f40 tx=0x7f239000b040 comp rx=0 tx=0).stop 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 msgr2=0x7f23a010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f239c009150 tx=0x7f239c009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 shutdown_connections 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f238c06ec00 0x7f238c0710b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23a00fce60 0x7f23a010d910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 --2- 172.21.15.82:0/1691819036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a00fdfd0 0x7f23a010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 >> 172.21.15.82:0/1691819036 conn(0x7f23a00f8540 msgr2=0x7f23a00f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 shutdown_connections 2024-04-27T07:40:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.400+0000 7f23a8202700 1 -- 172.21.15.82:0/1691819036 wait complete. 2024-04-27T07:40:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.499+0000 7f8facc3a700 1 -- 172.21.15.82:0/4058873849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 msgr2=0x7f8fa80fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.499+0000 7f8facc3a700 1 --2- 172.21.15.82:0/4058873849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa80fe7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8f98004940 tx=0x7f8f98009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 -- 172.21.15.82:0/4058873849 shutdown_connections 2024-04-27T07:40:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 --2- 172.21.15.82:0/4058873849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 0x7f8fa80fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 --2- 172.21.15.82:0/4058873849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa80fe7f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 -- 172.21.15.82:0/4058873849 >> 172.21.15.82:0/4058873849 conn(0x7f8fa80f6b80 msgr2=0x7f8fa80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 -- 172.21.15.82:0/4058873849 shutdown_connections 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 -- 172.21.15.82:0/4058873849 wait complete. 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 Processor -- start 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.500+0000 7f8facc3a700 1 -- start start 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8facc3a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8facc3a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 0x7f8fa810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8facc3a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810e560 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8facc3a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810edb0 con 0x7f8fa80fed30 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58800/0 (socket says 172.21.15.82:58800) 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 -- 172.21.15.82:0/2433963100 learned_addr learned my addr 172.21.15.82:0/2433963100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa5d9b700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 0x7f8fa810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 -- 172.21.15.82:0/2433963100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 msgr2=0x7f8fa810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 0x7f8fa810df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 -- 172.21.15.82:0/2433963100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98005040 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8fa659c700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800b3b0 tx=0x7f8f98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9800e040 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f9800bbf0 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f9801c630 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.501+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa810f030 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.502+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa810f570 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.503+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa805f5c0 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.503+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8f9800bd60 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.504+0000 7f8f96ffd700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 0x7f8f900710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.504+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8f9808f380 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.504+0000 7f8fa5d9b700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 0x7f8f900710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.504+0000 7f8fa5d9b700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 0x7f8f900710b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c004f40 tx=0x7f8f9c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.508+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8f9805bd80 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.793+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8fa810f8f0 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.793+0000 7f8f96ffd700 1 -- 172.21.15.82:0/2433963100 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8f9805b910 con 0x7f8fa80fe3e0 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:20.796 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:40:20.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 4, 2024-04-27T07:40:20.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 10 2024-04-27T07:40:20.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:40:20.797 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:40:20.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 msgr2=0x7f8f900710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 0x7f8f900710b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c004f40 tx=0x7f8f9c00b040 comp rx=0 tx=0).stop 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 msgr2=0x7f8fa810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800b3b0 tx=0x7f8f98009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 shutdown_connections 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8f9006ec00 0x7f8f900710b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fa80fe3e0 0x7f8fa810da20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 --2- 172.21.15.82:0/2433963100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fa80fed30 0x7f8fa810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 >> 172.21.15.82:0/2433963100 conn(0x7f8fa80f6b80 msgr2=0x7f8fa80f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 shutdown_connections 2024-04-27T07:40:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.795+0000 7f8facc3a700 1 -- 172.21.15.82:0/2433963100 wait complete. 2024-04-27T07:40:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 -- 172.21.15.82:0/1070516610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fce60 msgr2=0x7fbebc0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 --2- 172.21.15.82:0/1070516610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fce60 0x7fbebc0fd270 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbeac004940 tx=0x7fbeac009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 -- 172.21.15.82:0/1070516610 shutdown_connections 2024-04-27T07:40:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 --2- 172.21.15.82:0/1070516610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 --2- 172.21.15.82:0/1070516610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fce60 0x7fbebc0fd270 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 -- 172.21.15.82:0/1070516610 >> 172.21.15.82:0/1070516610 conn(0x7fbebc0f8540 msgr2=0x7fbebc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 -- 172.21.15.82:0/1070516610 shutdown_connections 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.896+0000 7fbec29f7700 1 -- 172.21.15.82:0/1070516610 wait complete. 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 Processor -- start 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 -- start start 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fce60 0x7fbebc10fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc110660 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbec29f7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc1107d0 con 0x7fbebc0fce60 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbebb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbebb7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58822/0 (socket says 172.21.15.82:58822) 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbebb7fe700 1 -- 172.21.15.82:0/3083164219 learned_addr learned my addr 172.21.15.82:0/3083164219 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.897+0000 7fbebbfff700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fce60 0x7fbebc10fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbebb7fe700 1 -- 172.21.15.82:0/3083164219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fce60 msgr2=0x7fbebc10fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbebb7fe700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fce60 0x7fbebc10fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbebb7fe700 1 -- 172.21.15.82:0/3083164219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac005040 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbebb7fe700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000eb40 tx=0x7fbeb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb0007cc0 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc1151d0 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbeb000f040 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb000ca10 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.898+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc115710 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.899+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc101960 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.899+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbeb000cc80 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.900+0000 7fbeb8ff9700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 0x7fbea40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.900+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fbeb008e470 con 0x7fbebc0fdfd0 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.900+0000 7fbebbfff700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 0x7fbea40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.900+0000 7fbebbfff700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 0x7fbea40710b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00b0d0 tx=0x7fbeac009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:20.905+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbeb005ae00 con 0x7fbebc0fdfd0 2024-04-27T07:40:21.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:20 smithi082 ceph-mon[91103]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:21.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:20 smithi082 ceph-mon[91103]: pgmap v182: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-04-27T07:40:21.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:20 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2433963100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:21.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.152+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbebc1058c0 con 0x7fbebc0fdfd0 2024-04-27T07:40:21.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.153+0000 7fbeb8ff9700 1 -- 172.21.15.82:0/3083164219 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1888 (secure 0 0 0) 0x7fbeb005a990 con 0x7fbebc0fdfd0 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:e24 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 23 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:40:17.448847+0000 2024-04-27T07:40:21.156 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:40:21.157 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14464} 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:40:21.158 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14464 members: 14464 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/2940930803,v1:172.21.15.82:6827/2940930803] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/733762917,v1:172.21.15.100:6827/733762917] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:21.159 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/2686792360,v1:172.21.15.100:6825/2686792360] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 msgr2=0x7fbea40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 0x7fbea40710b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00b0d0 tx=0x7fbeac009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 msgr2=0x7fbebc110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000eb40 tx=0x7fbeb000b040 comp rx=0 tx=0).stop 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 shutdown_connections 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbea406ec00 0x7fbea40710b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbebc0fce60 0x7fbebc10fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 --2- 172.21.15.82:0/3083164219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbebc0fdfd0 0x7fbebc110060 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 >> 172.21.15.82:0/3083164219 conn(0x7fbebc0f8540 msgr2=0x7fbebc0f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 shutdown_connections 2024-04-27T07:40:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.155+0000 7fbec29f7700 1 -- 172.21.15.82:0/3083164219 wait complete. 2024-04-27T07:40:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2024-04-27T07:40:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:20 smithi100 ceph-mon[80397]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:20 smithi100 ceph-mon[80397]: pgmap v182: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-04-27T07:40:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:20 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2433963100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 -- 172.21.15.82:0/398185144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 msgr2=0x7f303c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 --2- 172.21.15.82:0/398185144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c0fd270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3030004940 tx=0x7f3030009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 -- 172.21.15.82:0/398185144 shutdown_connections 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 --2- 172.21.15.82:0/398185144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 0x7f303c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 --2- 172.21.15.82:0/398185144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c0fd270 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 -- 172.21.15.82:0/398185144 >> 172.21.15.82:0/398185144 conn(0x7f303c0f8540 msgr2=0x7f303c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 -- 172.21.15.82:0/398185144 shutdown_connections 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.257+0000 7f304088a700 1 -- 172.21.15.82:0/398185144 wait complete. 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 Processor -- start 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 -- start start 2024-04-27T07:40:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 0x7f303c10de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c10e400 con 0x7f303c0fce60 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f304088a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c10e570 con 0x7f303c0fdfd0 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f303a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f303a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58838/0 (socket says 172.21.15.82:58838) 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f303a59c700 1 -- 172.21.15.82:0/434922377 learned_addr learned my addr 172.21.15.82:0/434922377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.258+0000 7f3039d9b700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 0x7f303c10de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f303a59c700 1 -- 172.21.15.82:0/434922377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 msgr2=0x7f303c10de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f303a59c700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 0x7f303c10de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f303a59c700 1 -- 172.21.15.82:0/434922377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030005040 con 0x7f303c0fce60 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f303a59c700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3030013870 tx=0x7f3030009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3030021070 con 0x7f303c0fce60 2024-04-27T07:40:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3030009430 con 0x7f303c0fce60 2024-04-27T07:40:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c112f70 con 0x7f303c0fce60 2024-04-27T07:40:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f303000e070 con 0x7f303c0fce60 2024-04-27T07:40:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.259+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c113420 con 0x7f303c0fce60 2024-04-27T07:40:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.260+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c04c710 con 0x7f303c0fce60 2024-04-27T07:40:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.260+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f303001c750 con 0x7f303c0fce60 2024-04-27T07:40:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.261+0000 7f302affd700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 0x7f3024071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.261+0000 7f3039d9b700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 0x7f3024071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.261+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f303008f9b0 con 0x7f303c0fce60 2024-04-27T07:40:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.261+0000 7f3039d9b700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 0x7f3024071050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f302c009b80 tx=0x7f302c00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.266+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f303005c3b0 con 0x7f303c0fce60 2024-04-27T07:40:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.483+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f303c1022a0 con 0x7f302406eba0 2024-04-27T07:40:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.484+0000 7f302affd700 1 -- 172.21.15.82:0/434922377 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f303c1022a0 con 0x7f302406eba0 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "12/21 daemons upgraded", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:40:21.487 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 msgr2=0x7f3024071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 0x7f3024071050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f302c009b80 tx=0x7f302c00b040 comp rx=0 tx=0).stop 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 msgr2=0x7f303c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3030013870 tx=0x7f3030009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 shutdown_connections 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f302406eba0 0x7f3024071050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f303c0fce60 0x7f303c10d8c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 --2- 172.21.15.82:0/434922377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f303c0fdfd0 0x7f303c10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.486+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 >> 172.21.15.82:0/434922377 conn(0x7f303c0f8540 msgr2=0x7f303c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.487+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 shutdown_connections 2024-04-27T07:40:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.487+0000 7f304088a700 1 -- 172.21.15.82:0/434922377 wait complete. 2024-04-27T07:40:21.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 -- 172.21.15.82:0/3020581341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fbcc0 msgr2=0x7fb38c0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 --2- 172.21.15.82:0/3020581341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c0fc0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb388004940 tx=0x7fb388009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 -- 172.21.15.82:0/3020581341 shutdown_connections 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 --2- 172.21.15.82:0/3020581341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fcf70 0x7fb38c0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 --2- 172.21.15.82:0/3020581341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c0fc0d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 -- 172.21.15.82:0/3020581341 >> 172.21.15.82:0/3020581341 conn(0x7fb38c0f7440 msgr2=0x7fb38c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 -- 172.21.15.82:0/3020581341 shutdown_connections 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.586+0000 7fb394417700 1 -- 172.21.15.82:0/3020581341 wait complete. 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 Processor -- start 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 -- start start 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c112c20 con 0x7fb38c0fcf70 2024-04-27T07:40:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb394417700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c112d60 con 0x7fb38c0fbcc0 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb3919b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb3919b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58864/0 (socket says 172.21.15.82:58864) 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb3919b2700 1 -- 172.21.15.82:0/3922501962 learned_addr learned my addr 172.21.15.82:0/3922501962 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.587+0000 7fb3921b3700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb3919b2700 1 -- 172.21.15.82:0/3922501962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 msgr2=0x7fb38c066d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb3919b2700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c066d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb3919b2700 1 -- 172.21.15.82:0/3922501962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388005040 con 0x7fb38c0fcf70 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb3921b3700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb3919b2700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00c830 tx=0x7fb37c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb37c00a760 con 0x7fb38c0fcf70 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb37c00ad90 con 0x7fb38c0fcf70 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb37c0113a0 con 0x7fb38c0fcf70 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c113040 con 0x7fb38c0fcf70 2024-04-27T07:40:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.588+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c1135d0 con 0x7fb38c0fcf70 2024-04-27T07:40:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.589+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c04c710 con 0x7fb38c0fcf70 2024-04-27T07:40:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.589+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb37c012400 con 0x7fb38c0fcf70 2024-04-27T07:40:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.590+0000 7fb382ffd700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 0x7fb3780710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.590+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb37c08e750 con 0x7fb38c0fcf70 2024-04-27T07:40:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.590+0000 7fb3921b3700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 0x7fb3780710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:21.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.590+0000 7fb3921b3700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 0x7fb3780710b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb38800b970 tx=0x7fb388009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.595+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb37c05b1f0 con 0x7fb38c0fcf70 2024-04-27T07:40:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.880+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb38c1047b0 con 0x7fb38c0fcf70 2024-04-27T07:40:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.880+0000 7fb382ffd700 1 -- 172.21.15.82:0/3922501962 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb37c05ad80 con 0x7fb38c0fcf70 2024-04-27T07:40:21.883 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:21.883 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:21.884 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:40:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 msgr2=0x7fb3780710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 0x7fb3780710b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb38800b970 tx=0x7fb388009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 msgr2=0x7fb38c1126e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00c830 tx=0x7fb37c004470 comp rx=0 tx=0).stop 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 shutdown_connections 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb37806ec00 0x7fb3780710b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb38c0fbcc0 0x7fb38c066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 --2- 172.21.15.82:0/3922501962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38c0fcf70 0x7fb38c1126e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 >> 172.21.15.82:0/3922501962 conn(0x7fb38c0f7440 msgr2=0x7fb38c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 shutdown_connections 2024-04-27T07:40:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:21.882+0000 7fb394417700 1 -- 172.21.15.82:0/3922501962 wait complete. 2024-04-27T07:40:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:21 smithi100 ceph-mon[80397]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:21 smithi100 ceph-mon[80397]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:21 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3083164219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:40:22.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:21 smithi082 ceph-mon[91103]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:22.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:21 smithi082 ceph-mon[91103]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:22.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:21 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3083164219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:40:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:22 smithi100 ceph-mon[80397]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:22 smithi100 ceph-mon[80397]: pgmap v183: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-27T07:40:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:22 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3922501962' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:40:23.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:22 smithi082 ceph-mon[91103]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:23.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:22 smithi082 ceph-mon[91103]: pgmap v183: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-27T07:40:23.246 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:22 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3922501962' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:40:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:24 smithi100 ceph-mon[80397]: pgmap v184: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-27T07:40:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:24 smithi082 ceph-mon[91103]: pgmap v184: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-27T07:40:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: pgmap v185: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-27T07:40:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.vlqbei"]}]: dispatch 2024-04-27T07:40:27.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: pgmap v185: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-27T07:40:27.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:27.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:27.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:27.283 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.vlqbei"]}]: dispatch 2024-04-27T07:40:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:27 smithi100 ceph-mon[80397]: Upgrade: It appears safe to stop mds.cephfs.smithi082.vlqbei 2024-04-27T07:40:28.285 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:27 smithi082 ceph-mon[91103]: Upgrade: It appears safe to stop mds.cephfs.smithi082.vlqbei 2024-04-27T07:40:29.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:28 smithi082 ceph-mon[91103]: pgmap v186: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:40:29.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:29.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:40:29.153 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:28 smithi100 ceph-mon[80397]: pgmap v186: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:40:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.vlqbei", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:40:29.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:30.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:29 smithi100 ceph-mon[80397]: Upgrade: Updating mds.cephfs.smithi082.vlqbei 2024-04-27T07:40:30.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:29 smithi100 ceph-mon[80397]: Deploying daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:40:30.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:29 smithi082 ceph-mon[91103]: Upgrade: Updating mds.cephfs.smithi082.vlqbei 2024-04-27T07:40:30.195 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:29 smithi082 ceph-mon[91103]: Deploying daemon mds.cephfs.smithi082.vlqbei on smithi082 2024-04-27T07:40:30.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[91099]: 2024-04-27T07:40:30.473+0000 7fbbf4c61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: pgmap v187: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:40:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-27T07:40:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: osdmap e82: 6 total, 6 up, 6 in 2024-04-27T07:40:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: Standby daemon mds.cephfs.smithi082.bqtewe assigned to filesystem cephfs as rank 0 2024-04-27T07:40:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:40:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-27T07:40:31.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:30 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:replay} 2 up:standby 2024-04-27T07:40:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: pgmap v187: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:40:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-27T07:40:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: osdmap e82: 6 total, 6 up, 6 in 2024-04-27T07:40:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: Standby daemon mds.cephfs.smithi082.bqtewe assigned to filesystem cephfs as rank 0 2024-04-27T07:40:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:40:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-27T07:40:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:30 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:replay} 2 up:standby 2024-04-27T07:40:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:31 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:40:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:31 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:40:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:32 smithi100 ceph-mon[80397]: pgmap v189: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-04-27T07:40:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:32 smithi082 ceph-mon[91103]: pgmap v189: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-04-27T07:40:35.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:34 smithi100 ceph-mon[80397]: pgmap v190: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-04-27T07:40:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:34 smithi082 ceph-mon[91103]: pgmap v190: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-04-27T07:40:37.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:36 smithi082 ceph-mon[91103]: pgmap v191: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-27T07:40:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:36 smithi100 ceph-mon[80397]: pgmap v191: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-27T07:40:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:37 smithi082 ceph-mon[91103]: reconnect by client.14526 192.168.0.1:0/88217351 after 0.000999981 2024-04-27T07:40:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:37 smithi082 ceph-mon[91103]: reconnect by client.24319 192.168.0.1:0/160342664 after 0.000999981 2024-04-27T07:40:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:37 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:reconnect 2024-04-27T07:40:38.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:37 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:reconnect} 2 up:standby 2024-04-27T07:40:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:37 smithi100 ceph-mon[80397]: reconnect by client.14526 192.168.0.1:0/88217351 after 0.000999981 2024-04-27T07:40:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:37 smithi100 ceph-mon[80397]: reconnect by client.24319 192.168.0.1:0/160342664 after 0.000999981 2024-04-27T07:40:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:37 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:reconnect 2024-04-27T07:40:38.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:37 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:reconnect} 2 up:standby 2024-04-27T07:40:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:38 smithi082 ceph-mon[91103]: pgmap v192: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-27T07:40:39.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:38 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:rejoin 2024-04-27T07:40:39.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:38 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:rejoin} 2 up:standby 2024-04-27T07:40:39.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:38 smithi082 ceph-mon[91103]: daemon mds.cephfs.smithi082.bqtewe is now active in filesystem cephfs as rank 0 2024-04-27T07:40:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:38 smithi100 ceph-mon[80397]: pgmap v192: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-27T07:40:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:38 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:rejoin 2024-04-27T07:40:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:38 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.bqtewe=up:rejoin} 2 up:standby 2024-04-27T07:40:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:38 smithi100 ceph-mon[80397]: daemon mds.cephfs.smithi082.bqtewe is now active in filesystem cephfs as rank 0 2024-04-27T07:40:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:39 smithi082 ceph-mon[91103]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-27T07:40:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:39 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:active 2024-04-27T07:40:40.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:39 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.bqtewe=up:active} 2 up:standby 2024-04-27T07:40:40.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:39 smithi100 ceph-mon[80397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-27T07:40:40.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:39 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] up:active 2024-04-27T07:40:40.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:39 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.bqtewe=up:active} 2 up:standby 2024-04-27T07:40:41.016 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:40 smithi082 ceph-mon[91103]: pgmap v193: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 102 B/s wr, 5 op/s 2024-04-27T07:40:41.017 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:41.017 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:41.017 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:41.017 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:40 smithi100 ceph-mon[80397]: pgmap v193: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 102 B/s wr, 5 op/s 2024-04-27T07:40:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:41.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:41 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:boot 2024-04-27T07:40:41.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:41 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.bqtewe=up:active} 3 up:standby 2024-04-27T07:40:41.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:40:41.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:41 smithi082 ceph-mon[91103]: pgmap v194: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-04-27T07:40:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:41 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:boot 2024-04-27T07:40:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:41 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.bqtewe=up:active} 3 up:standby 2024-04-27T07:40:42.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:40:42.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:41 smithi100 ceph-mon[80397]: pgmap v194: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-04-27T07:40:45.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:44 smithi100 ceph-mon[80397]: pgmap v195: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-04-27T07:40:45.190 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:44 smithi082 ceph-mon[91103]: pgmap v195: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-04-27T07:40:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:46 smithi100 ceph-mon[80397]: pgmap v196: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-04-27T07:40:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:46 smithi082 ceph-mon[91103]: pgmap v196: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-04-27T07:40:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:48.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:48 smithi082 ceph-mon[91103]: pgmap v197: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-27T07:40:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:48 smithi100 ceph-mon[80397]: pgmap v197: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-27T07:40:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:50 smithi100 ceph-mon[80397]: pgmap v198: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-27T07:40:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:50 smithi082 ceph-mon[91103]: pgmap v198: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-27T07:40:51.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- 172.21.15.82:0/3232151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fce60 msgr2=0x7fcf240fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/3232151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fce60 0x7fcf240fd270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf18004940 tx=0x7fcf18009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- 172.21.15.82:0/3232151082 shutdown_connections 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/3232151082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fdfd0 0x7fcf240fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/3232151082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fce60 0x7fcf240fd270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- 172.21.15.82:0/3232151082 >> 172.21.15.82:0/3232151082 conn(0x7fcf240f8540 msgr2=0x7fcf240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- 172.21.15.82:0/3232151082 shutdown_connections 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- 172.21.15.82:0/3232151082 wait complete. 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 Processor -- start 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.992+0000 7fcf2ab12700 1 -- start start 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf2ab12700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fce60 0x7fcf2410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf2ab12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf2ab12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2410e450 con 0x7fcf240fdfd0 2024-04-27T07:40:51.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf2ab12700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2410e5c0 con 0x7fcf240fce60 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43494/0 (socket says 172.21.15.82:43494) 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 -- 172.21.15.82:0/2928212989 learned_addr learned my addr 172.21.15.82:0/2928212989 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf288ae700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fce60 0x7fcf2410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 -- 172.21.15.82:0/2928212989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fce60 msgr2=0x7fcf2410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fce60 0x7fcf2410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 -- 172.21.15.82:0/2928212989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18005040 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.993+0000 7fcf23fff700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c8c0 tx=0x7fcf100044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.994+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1000a760 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.994+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24113020 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.994+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf1000ad90 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.994+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf100113a0 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.994+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf241135b0 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.995+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2404c710 con 0x7fcf240fdfd0 2024-04-27T07:40:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.995+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcf10012400 con 0x7fcf240fdfd0 2024-04-27T07:40:52.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.996+0000 7fcf217fa700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.996+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcf1008e890 con 0x7fcf240fdfd0 2024-04-27T07:40:52.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.996+0000 7fcf288ae700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:51.996+0000 7fcf288ae700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 0x7fcf140710b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b3b0 tx=0x7fcf18009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:52.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.001+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcf1005b240 con 0x7fcf240fdfd0 2024-04-27T07:40:52.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: Detected new or changed devices on smithi082 2024-04-27T07:40:52.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:52.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.068 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.bqtewe"]}]: dispatch 2024-04-27T07:40:52.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.238+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf24102360 con 0x7fcf1406ec00 2024-04-27T07:40:52.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.239+0000 7fcf217fa700 1 -- 172.21.15.82:0/2928212989 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf24102360 con 0x7fcf1406ec00 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 msgr2=0x7fcf140710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 0x7fcf140710b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b3b0 tx=0x7fcf18009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 msgr2=0x7fcf2410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c8c0 tx=0x7fcf100044c0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 shutdown_connections 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcf1406ec00 0x7fcf140710b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf240fce60 0x7fcf2410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 --2- 172.21.15.82:0/2928212989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf240fdfd0 0x7fcf2410de50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 >> 172.21.15.82:0/2928212989 conn(0x7fcf240f8540 msgr2=0x7fcf240f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:52.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 shutdown_connections 2024-04-27T07:40:52.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.241+0000 7fcf2ab12700 1 -- 172.21.15.82:0/2928212989 wait complete. 2024-04-27T07:40:52.254 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:40:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 -- 172.21.15.82:0/407881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fcf60 msgr2=0x7fb5080fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 --2- 172.21.15.82:0/407881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fcf60 0x7fb5080fd3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc004940 tx=0x7fb4fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:52.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 -- 172.21.15.82:0/407881003 shutdown_connections 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 --2- 172.21.15.82:0/407881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fcf60 0x7fb5080fd3d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 --2- 172.21.15.82:0/407881003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fbcb0 0x7fb5080fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 -- 172.21.15.82:0/407881003 >> 172.21.15.82:0/407881003 conn(0x7fb5080f7430 msgr2=0x7fb5080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 -- 172.21.15.82:0/407881003 shutdown_connections 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.345+0000 7fb50dced700 1 -- 172.21.15.82:0/407881003 wait complete. 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 Processor -- start 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 -- start start 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fcf60 0x7fb50810df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50810e590 con 0x7fb5080fbcb0 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb50dced700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50810ed90 con 0x7fb5080fcf60 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43512/0 (socket says 172.21.15.82:43512) 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb5077fe700 1 -- 172.21.15.82:0/2384939084 learned_addr learned my addr 172.21.15.82:0/2384939084 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb506ffd700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fcf60 0x7fb50810df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb5077fe700 1 -- 172.21.15.82:0/2384939084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fcf60 msgr2=0x7fb50810df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.346+0000 7fb5077fe700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fcf60 0x7fb50810df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb5077fe700 1 -- 172.21.15.82:0/2384939084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc005040 con 0x7fb5080fbcb0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb5077fe700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c830 tx=0x7fb4f8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f800a760 con 0x7fb5080fbcb0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50810f070 con 0x7fb5080fbcb0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4f800ad90 con 0x7fb5080fbcb0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f80113a0 con 0x7fb5080fbcb0 2024-04-27T07:40:52.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.347+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50810f5b0 con 0x7fb5080fbcb0 2024-04-27T07:40:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.348+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508101af0 con 0x7fb5080fbcb0 2024-04-27T07:40:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.348+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fb4f8012400 con 0x7fb5080fbcb0 2024-04-27T07:40:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.349+0000 7fb4effff700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 0x7fb4f00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.349+0000 7fb506ffd700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 0x7fb4f00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.349+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb4f808e880 con 0x7fb5080fbcb0 2024-04-27T07:40:52.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.349+0000 7fb506ffd700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 0x7fb4f00710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b3b0 tx=0x7fb4fc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:52.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.354+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb4f805b230 con 0x7fb5080fbcb0 2024-04-27T07:40:52.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: Detected new or changed devices on smithi082 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:52.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.bqtewe"]}]: dispatch 2024-04-27T07:40:52.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.576+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb50810f890 con 0x7fb4f006ec10 2024-04-27T07:40:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.578+0000 7fb4effff700 1 -- 172.21.15.82:0/2384939084 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb50810f890 con 0x7fb4f006ec10 2024-04-27T07:40:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 msgr2=0x7fb4f00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 0x7fb4f00710c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b3b0 tx=0x7fb4fc009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 msgr2=0x7fb50810da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c830 tx=0x7fb4f8004470 comp rx=0 tx=0).stop 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 shutdown_connections 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fb4f006ec10 0x7fb4f00710c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5080fbcb0 0x7fb50810da50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 --2- 172.21.15.82:0/2384939084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5080fcf60 0x7fb50810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 >> 172.21.15.82:0/2384939084 conn(0x7fb5080f7430 msgr2=0x7fb508065c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 shutdown_connections 2024-04-27T07:40:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.580+0000 7fb50dced700 1 -- 172.21.15.82:0/2384939084 wait complete. 2024-04-27T07:40:52.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- 172.21.15.82:0/2330648798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 msgr2=0x7f716c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 --2- 172.21.15.82:0/2330648798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fd3d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7160004940 tx=0x7f7160009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:52.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- 172.21.15.82:0/2330648798 shutdown_connections 2024-04-27T07:40:52.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 --2- 172.21.15.82:0/2330648798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fd3d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 --2- 172.21.15.82:0/2330648798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 0x7f716c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- 172.21.15.82:0/2330648798 >> 172.21.15.82:0/2330648798 conn(0x7f716c0f7430 msgr2=0x7f716c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:52.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- 172.21.15.82:0/2330648798 shutdown_connections 2024-04-27T07:40:52.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- 172.21.15.82:0/2330648798 wait complete. 2024-04-27T07:40:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 Processor -- start 2024-04-27T07:40:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.682+0000 7f71714dd700 1 -- start start 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 0x7f716c0ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0fe7e0 con 0x7f716c0fcf60 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0fe920 con 0x7f716c0fbcb0 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43528/0 (socket says 172.21.15.82:43528) 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 -- 172.21.15.82:0/1389464135 learned_addr learned my addr 172.21.15.82:0/1389464135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716affd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 0x7f716c0ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 -- 172.21.15.82:0/1389464135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 msgr2=0x7f716c0ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 0x7f716c0ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 -- 172.21.15.82:0/1389464135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160005040 con 0x7f716c0fcf60 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f716a7fc700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7160013870 tx=0x7f7160009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7160021070 con 0x7f716c0fcf60 2024-04-27T07:40:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7160009430 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716000e070 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c0feba0 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.683+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0ff0e0 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.684+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c101af0 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.685+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f716001c750 con 0x7f716c0fcf60 2024-04-27T07:40:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.685+0000 7f71537fe700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 0x7f71540710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.685+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f716008f890 con 0x7f716c0fcf60 2024-04-27T07:40:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.685+0000 7f716affd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 0x7f71540710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.686+0000 7f716affd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 0x7f71540710b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ffac0 tx=0x7f716400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.691+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f71600587b0 con 0x7f716c0fcf60 2024-04-27T07:40:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.906+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f716c05e3a0 con 0x7f715406ec00 2024-04-27T07:40:52.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.916+0000 7f71537fe700 1 -- 172.21.15.82:0/1389464135 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f716c05e3a0 con 0x7f715406ec00 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (7m) 6s ago 15m 25.1M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (4m) 6s ago 16m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (4m) 65s ago 14m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (7m) 6s ago 15m 86.5M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (10m) 6s ago 10m 62.9M - 17.2.7-907-g2be3efa9 1c5834633715 dc67b52bfac2 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (14s) 6s ago 10m 15.1M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (10m) 65s ago 10m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (10m) 65s ago 10m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (6m) 6s ago 17m 508M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:40:52.919 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (5m) 65s ago 14m 452M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (5m) 6s ago 17m 53.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (5m) 65s ago 14m 39.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 6s ago 15m 16.2M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (6m) 65s ago 14m 15.1M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 6s ago 13m 97.8M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (3m) 6s ago 13m 101M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 6s ago 13m 78.9M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (2m) 65s ago 12m 88.4M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (102s) 65s ago 12m 90.5M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (68s) 65s ago 11m 15.1M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:40:52.920 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 6s ago 15m 65.5M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:40:52.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 msgr2=0x7f71540710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 0x7f71540710b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ffac0 tx=0x7f716400b040 comp rx=0 tx=0).stop 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 msgr2=0x7f716c0fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7160013870 tx=0x7f7160009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 shutdown_connections 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f715406ec00 0x7f71540710b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f716c0fbcb0 0x7f716c0ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 --2- 172.21.15.82:0/1389464135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f716c0fcf60 0x7f716c0fe2a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.918+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 >> 172.21.15.82:0/1389464135 conn(0x7f716c0f7430 msgr2=0x7f716c065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.919+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 shutdown_connections 2024-04-27T07:40:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:52.919+0000 7f71714dd700 1 -- 172.21.15.82:0/1389464135 wait complete. 2024-04-27T07:40:53.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- 172.21.15.82:0/952845952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3164066ad0 msgr2=0x7f31640ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 --2- 172.21.15.82:0/952845952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3164066ad0 0x7f31640ffa50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3158004940 tx=0x7f3158009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- 172.21.15.82:0/952845952 shutdown_connections 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 --2- 172.21.15.82:0/952845952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31640fff90 0x7f3164102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 --2- 172.21.15.82:0/952845952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3164066ad0 0x7f31640ffa50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- 172.21.15.82:0/952845952 >> 172.21.15.82:0/952845952 conn(0x7f31640f7440 msgr2=0x7f31640f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- 172.21.15.82:0/952845952 shutdown_connections 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- 172.21.15.82:0/952845952 wait complete. 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 Processor -- start 2024-04-27T07:40:53.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.024+0000 7f316ace8700 1 -- start start 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f316ace8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164066ad0 0x7f316410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f316ace8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f316ace8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316410e5c0 con 0x7f31640fff90 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f316ace8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316410edc0 con 0x7f3164066ad0 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43550/0 (socket says 172.21.15.82:43550) 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 -- 172.21.15.82:0/2259115274 learned_addr learned my addr 172.21.15.82:0/2259115274 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3168a84700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164066ad0 0x7f316410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 -- 172.21.15.82:0/2259115274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164066ad0 msgr2=0x7f316410da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164066ad0 0x7f316410da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 -- 172.21.15.82:0/2259115274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158005040 con 0x7f31640fff90 2024-04-27T07:40:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f3163fff700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3150002a50 tx=0x7f31500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150007cc0 con 0x7f31640fff90 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f315000f040 con 0x7f31640fff90 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.025+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316410f0a0 con 0x7f31640fff90 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.026+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315000da30 con 0x7f31640fff90 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.026+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316410f5e0 con 0x7f31640fff90 2024-04-27T07:40:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.027+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316405f5c0 con 0x7f31640fff90 2024-04-27T07:40:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.027+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f315000db90 con 0x7f31640fff90 2024-04-27T07:40:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.028+0000 7f31617fa700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 0x7f31540710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.028+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f315008e5d0 con 0x7f31640fff90 2024-04-27T07:40:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.028+0000 7f3168a84700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 0x7f31540710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.028+0000 7f3168a84700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 0x7f31540710b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3158004890 tx=0x7f3158009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.033+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f315005af00 con 0x7f31640fff90 2024-04-27T07:40:53.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.329+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f316410f8a0 con 0x7f31640fff90 2024-04-27T07:40:53.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:52 smithi082 ceph-mon[91103]: Upgrade: It appears safe to stop mds.cephfs.smithi082.bqtewe 2024-04-27T07:40:53.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:52 smithi082 ceph-mon[91103]: pgmap v199: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-27T07:40:53.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:53.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:40:53.332 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.330+0000 7f31617fa700 1 -- 172.21.15.82:0/2259115274 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f315005aa90 con 0x7f31640fff90 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:40:53.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 3, 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 1 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 3, 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 11 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:40:53.334 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.332+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 msgr2=0x7f31540710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.332+0000 7f316ace8700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 0x7f31540710b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3158004890 tx=0x7f3158009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.332+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 msgr2=0x7f316410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.332+0000 7f316ace8700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3150002a50 tx=0x7f31500046b0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 shutdown_connections 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f315406ec00 0x7f31540710b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164066ad0 0x7f316410da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 --2- 172.21.15.82:0/2259115274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31640fff90 0x7f316410dfc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 >> 172.21.15.82:0/2259115274 conn(0x7f31640f7440 msgr2=0x7f31640f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:53.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 shutdown_connections 2024-04-27T07:40:53.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.333+0000 7f316ace8700 1 -- 172.21.15.82:0/2259115274 wait complete. 2024-04-27T07:40:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:52 smithi100 ceph-mon[80397]: Upgrade: It appears safe to stop mds.cephfs.smithi082.bqtewe 2024-04-27T07:40:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:52 smithi100 ceph-mon[80397]: pgmap v199: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-27T07:40:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:53.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.bqtewe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:40:53.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 -- 172.21.15.82:0/1126111343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 msgr2=0x7f95800fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 --2- 172.21.15.82:0/1126111343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f95800fc0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9578004940 tx=0x7f9578009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 -- 172.21.15.82:0/1126111343 shutdown_connections 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 --2- 172.21.15.82:0/1126111343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 0x7f95800fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 --2- 172.21.15.82:0/1126111343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f95800fc0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 -- 172.21.15.82:0/1126111343 >> 172.21.15.82:0/1126111343 conn(0x7f95800f7440 msgr2=0x7f95800f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 -- 172.21.15.82:0/1126111343 shutdown_connections 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.436+0000 7f9587b6c700 1 -- 172.21.15.82:0/1126111343 wait complete. 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 Processor -- start 2024-04-27T07:40:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 -- start start 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 0x7f9580114aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958010e480 con 0x7f95800fbcc0 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9587b6c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580114fe0 con 0x7f95800fcf70 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43570/0 (socket says 172.21.15.82:43570) 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 -- 172.21.15.82:0/761387492 learned_addr learned my addr 172.21.15.82:0/761387492 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585107700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 0x7f9580114aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 -- 172.21.15.82:0/761387492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 msgr2=0x7f9580114aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 0x7f9580114aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 -- 172.21.15.82:0/761387492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578005040 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.437+0000 7f9585908700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9578009150 tx=0x7f9578009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.438+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957800e040 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.438+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9578004290 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.438+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9580115180 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.438+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957801c630 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.438+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95801156f0 con 0x7f95800fbcc0 2024-04-27T07:40:53.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.439+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958004c710 con 0x7f95800fbcc0 2024-04-27T07:40:53.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.439+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f957800bbf0 con 0x7f95800fbcc0 2024-04-27T07:40:53.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.439+0000 7f95767fc700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 0x7f956c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.440+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f957808fcb0 con 0x7f95800fbcc0 2024-04-27T07:40:53.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.440+0000 7f9585107700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 0x7f956c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.440+0000 7f9585107700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 0x7f956c0710b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9570009fd0 tx=0x7f9570009f60 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.444+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f957805c660 con 0x7f95800fbcc0 2024-04-27T07:40:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.700+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9580115ba0 con 0x7f95800fbcc0 2024-04-27T07:40:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.701+0000 7f95767fc700 1 -- 172.21.15.82:0/761387492 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1891 (secure 0 0 0) 0x7f957805c1f0 con 0x7f95800fbcc0 2024-04-27T07:40:53.703 INFO:teuthology.orchestra.run.smithi082.stdout:e30 2024-04-27T07:40:53.703 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 29 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:40:38.931587+0000 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:40:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34410} 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:40:53.705 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34410 members: 34410 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{0:34410} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.82:6828/3714048367,v1:172.21.15.82:6829/3714048367] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/733762917,v1:172.21.15.100:6827/733762917] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:53.706 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/2686792360,v1:172.21.15.100:6825/2686792360] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 msgr2=0x7f956c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 0x7f956c0710b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9570009fd0 tx=0x7f9570009f60 comp rx=0 tx=0).stop 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 msgr2=0x7f9580066cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9578009150 tx=0x7f9578009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 shutdown_connections 2024-04-27T07:40:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f956c06ec00 0x7f956c0710b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95800fbcc0 0x7f9580066cb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 --2- 172.21.15.82:0/761387492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95800fcf70 0x7f9580114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 >> 172.21.15.82:0/761387492 conn(0x7f95800f7440 msgr2=0x7f95800f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 shutdown_connections 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.703+0000 7f9587b6c700 1 -- 172.21.15.82:0/761387492 wait complete. 2024-04-27T07:40:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-04-27T07:40:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.810+0000 7f5c547a2700 1 -- 172.21.15.82:0/3093154778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fcf70 msgr2=0x7f5c4c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.810+0000 7f5c547a2700 1 --2- 172.21.15.82:0/3093154778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fcf70 0x7f5c4c0fd3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c004940 tx=0x7f5c3c009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:53.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.810+0000 7f5c547a2700 1 -- 172.21.15.82:0/3093154778 shutdown_connections 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 --2- 172.21.15.82:0/3093154778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fcf70 0x7f5c4c0fd3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 --2- 172.21.15.82:0/3093154778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- 172.21.15.82:0/3093154778 >> 172.21.15.82:0/3093154778 conn(0x7f5c4c0f7420 msgr2=0x7f5c4c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- 172.21.15.82:0/3093154778 shutdown_connections 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- 172.21.15.82:0/3093154778 wait complete. 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 Processor -- start 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- start start 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4c0fcf70 0x7f5c4c0fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c100200 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c547a2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0fe7f0 con 0x7f5c4c0fcf70 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c5253e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c5253e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43584/0 (socket says 172.21.15.82:43584) 2024-04-27T07:40:53.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.811+0000 7f5c5253e700 1 -- 172.21.15.82:0/779494707 learned_addr learned my addr 172.21.15.82:0/779494707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c5253e700 1 -- 172.21.15.82:0/779494707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4c0fcf70 msgr2=0x7f5c4c0fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c5253e700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4c0fcf70 0x7f5c4c0fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c5253e700 1 -- 172.21.15.82:0/779494707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c005040 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c5253e700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c48002a50 tx=0x7f5c480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c48007cc0 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0feaa0 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c4800f040 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0ff060 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.812+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c48009640 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.813+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c101b00 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.813+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5c4800d690 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.814+0000 7f5c42ffd700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 0x7f5c380710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.814+0000 7f5c51d3d700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 0x7f5c380710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.814+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5c4808e610 con 0x7f5c4c0fbcc0 2024-04-27T07:40:53.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.814+0000 7f5c51d3d700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 0x7f5c380710b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c004f90 tx=0x7f5c3c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:53.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:53.819+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5c4805af40 con 0x7f5c4c0fbcc0 2024-04-27T07:40:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.047+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c4c02b310 con 0x7f5c3806ec00 2024-04-27T07:40:54.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.048+0000 7f5c42ffd700 1 -- 172.21.15.82:0/779494707 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5c4c02b310 con 0x7f5c3806ec00 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:40:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "13/21 daemons upgraded", 2024-04-27T07:40:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mds daemons", 2024-04-27T07:40:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:40:54.052 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 msgr2=0x7f5c380710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 0x7f5c380710b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c004f90 tx=0x7f5c3c009e30 comp rx=0 tx=0).stop 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 msgr2=0x7f5c4c0ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c48002a50 tx=0x7f5c480046b0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 shutdown_connections 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c3806ec00 0x7f5c380710b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0fbcc0 0x7f5c4c0ffc00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.050+0000 7f5c547a2700 1 --2- 172.21.15.82:0/779494707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4c0fcf70 0x7f5c4c0fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.051+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 >> 172.21.15.82:0/779494707 conn(0x7f5c4c0f7420 msgr2=0x7f5c4c066b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.051+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 shutdown_connections 2024-04-27T07:40:54.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.051+0000 7f5c547a2700 1 -- 172.21.15.82:0/779494707 wait complete. 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 -- 172.21.15.82:0/1010552864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fcf10 msgr2=0x7f05cc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/1010552864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fcf10 0x7f05cc0fd320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009ce0 tx=0x7f05c8004d10 comp rx=0 tx=0).stop 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 -- 172.21.15.82:0/1010552864 shutdown_connections 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/1010552864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fe080 0x7f05cc0fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/1010552864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fcf10 0x7f05cc0fd320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 -- 172.21.15.82:0/1010552864 >> 172.21.15.82:0/1010552864 conn(0x7f05cc0f8560 msgr2=0x7f05cc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 -- 172.21.15.82:0/1010552864 shutdown_connections 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.154+0000 7f05d2e2e700 1 -- 172.21.15.82:0/1010552864 wait complete. 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 Processor -- start 2024-04-27T07:40:54.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 -- start start 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fcf10 0x7f05cc10db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc10e690 con 0x7f05cc0fe080 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d2e2e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc10eee0 con 0x7f05cc0fcf10 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43602/0 (socket says 172.21.15.82:43602) 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05c3fff700 1 -- 172.21.15.82:0/2428841870 learned_addr learned my addr 172.21.15.82:0/2428841870 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.155+0000 7f05d0bca700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fcf10 0x7f05cc10db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c3fff700 1 -- 172.21.15.82:0/2428841870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fcf10 msgr2=0x7f05cc10db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c3fff700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fcf10 0x7f05cc10db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c3fff700 1 -- 172.21.15.82:0/2428841870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009940 con 0x7f05cc0fe080 2024-04-27T07:40:54.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c3fff700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05bc002a50 tx=0x7f05bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:54.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05bc007cc0 con 0x7f05cc0fe080 2024-04-27T07:40:54.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05bc00f040 con 0x7f05cc0fe080 2024-04-27T07:40:54.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc10f1c0 con 0x7f05cc0fe080 2024-04-27T07:40:54.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05bc00da30 con 0x7f05cc0fe080 2024-04-27T07:40:54.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.156+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc10f700 con 0x7f05cc0fe080 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.157+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc05f5c0 con 0x7f05cc0fe080 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.158+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f05bc00db90 con 0x7f05cc0fe080 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.158+0000 7f05c17fa700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 0x7f05b40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.158+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f05bc08e5d0 con 0x7f05cc0fe080 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.158+0000 7f05d0bca700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 0x7f05b40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:40:54.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.158+0000 7f05d0bca700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 0x7f05b40710b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05c8015040 tx=0x7f05c8004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:40:54.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.163+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f05bc05af00 con 0x7f05cc0fe080 2024-04-27T07:40:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: Upgrade: Updating mds.cephfs.smithi082.bqtewe 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: Deploying daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2259115274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:54.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:53 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/761387492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: Upgrade: Updating mds.cephfs.smithi082.bqtewe 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: Deploying daemon mds.cephfs.smithi082.bqtewe on smithi082 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2259115274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:40:54.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:53 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/761387492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:40:54.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.450+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f05cc10fa10 con 0x7f05cc0fe080 2024-04-27T07:40:54.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.450+0000 7f05c17fa700 1 -- 172.21.15.82:0/2428841870 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f05bc05aa90 con 0x7f05cc0fe080 2024-04-27T07:40:54.453 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:54.453 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:40:54.453 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:40:54.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.452+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 msgr2=0x7f05b40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.452+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 0x7f05b40710b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05c8015040 tx=0x7f05c8004d10 comp rx=0 tx=0).stop 2024-04-27T07:40:54.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.452+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 msgr2=0x7f05cc10e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:40:54.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.452+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05bc002a50 tx=0x7f05bc0046b0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 shutdown_connections 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f05b406ec00 0x7f05b40710b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05cc0fcf10 0x7f05cc10db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 --2- 172.21.15.82:0/2428841870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05cc0fe080 0x7f05cc10e090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 >> 172.21.15.82:0/2428841870 conn(0x7f05cc0f8560 msgr2=0x7f05cc0f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 shutdown_connections 2024-04-27T07:40:54.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:40:54.453+0000 7f05d2e2e700 1 -- 172.21.15.82:0/2428841870 wait complete. 2024-04-27T07:40:55.143 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:54 smithi082 ceph-mon[91103]: pgmap v200: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-27T07:40:55.144 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:54 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2428841870' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:40:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:54 smithi100 ceph-mon[80397]: pgmap v200: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-04-27T07:40:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:54 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2428841870' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:40:55.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[91099]: 2024-04-27T07:40:55.149+0000 7fbbf4c61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-27T07:40:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: osdmap e83: 6 total, 6 up, 6 in 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: Standby daemon mds.cephfs.smithi082.vlqbei assigned to filesystem cephfs as rank 0 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:replay} 2 up:standby 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:56.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:40:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-27T07:40:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-27T07:40:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: osdmap e83: 6 total, 6 up, 6 in 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: Standby daemon mds.cephfs.smithi082.vlqbei assigned to filesystem cephfs as rank 0 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:replay} 2 up:standby 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:40:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:40:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:56 smithi082 ceph-mon[91103]: pgmap v202: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-04-27T07:40:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:56 smithi100 ceph-mon[80397]: pgmap v202: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 410 KiB/s rd, 0 op/s 2024-04-27T07:40:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:58 smithi082 ceph-mon[91103]: pgmap v203: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-27T07:40:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:40:58 smithi100 ceph-mon[80397]: pgmap v203: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-27T07:41:00.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:40:59 smithi082 ceph-mon[91103]: pgmap v204: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-27T07:41:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:00 smithi100 ceph-mon[80397]: pgmap v204: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-27T07:41:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:02 smithi082 ceph-mon[91103]: reconnect by client.14526 192.168.0.1:0/88217351 after 0 2024-04-27T07:41:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:02 smithi082 ceph-mon[91103]: reconnect by client.24319 192.168.0.1:0/160342664 after 0 2024-04-27T07:41:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:02 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:reconnect 2024-04-27T07:41:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:02 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:reconnect} 2 up:standby 2024-04-27T07:41:02.595 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:02 smithi082 ceph-mon[91103]: pgmap v205: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-27T07:41:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:02 smithi100 ceph-mon[80397]: reconnect by client.14526 192.168.0.1:0/88217351 after 0 2024-04-27T07:41:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:02 smithi100 ceph-mon[80397]: reconnect by client.24319 192.168.0.1:0/160342664 after 0 2024-04-27T07:41:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:02 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:reconnect 2024-04-27T07:41:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:02 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:reconnect} 2 up:standby 2024-04-27T07:41:02.668 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:02 smithi100 ceph-mon[80397]: pgmap v205: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-27T07:41:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:03 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:rejoin 2024-04-27T07:41:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:03 smithi082 ceph-mon[91103]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:rejoin} 2 up:standby 2024-04-27T07:41:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:03 smithi082 ceph-mon[91103]: daemon mds.cephfs.smithi082.vlqbei is now active in filesystem cephfs as rank 0 2024-04-27T07:41:03.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:03 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:rejoin 2024-04-27T07:41:03.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:03 smithi100 ceph-mon[80397]: fsmap cephfs:1/1 {0=cephfs.smithi082.vlqbei=up:rejoin} 2 up:standby 2024-04-27T07:41:03.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:03 smithi100 ceph-mon[80397]: daemon mds.cephfs.smithi082.vlqbei is now active in filesystem cephfs as rank 0 2024-04-27T07:41:04.443 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:04 smithi082 ceph-mon[91103]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-27T07:41:04.443 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:04 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:active 2024-04-27T07:41:04.443 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:04 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:04.443 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:04 smithi082 ceph-mon[91103]: pgmap v206: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 102 B/s wr, 5 op/s 2024-04-27T07:41:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:04 smithi100 ceph-mon[80397]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-27T07:41:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:04 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] up:active 2024-04-27T07:41:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:04 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:04 smithi100 ceph-mon[80397]: pgmap v206: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 102 B/s wr, 5 op/s 2024-04-27T07:41:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:06 smithi100 ceph-mon[80397]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 95 B/s wr, 7 op/s 2024-04-27T07:41:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:07.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:07.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:07.253 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:06 smithi082 ceph-mon[91103]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 95 B/s wr, 7 op/s 2024-04-27T07:41:07.253 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:07.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:07.254 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:07 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] up:boot 2024-04-27T07:41:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:07 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:07 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:41:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:07 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] up:boot 2024-04-27T07:41:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:07 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:07 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:41:09.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:08 smithi100 ceph-mon[80397]: pgmap v208: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-27T07:41:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:08 smithi082 ceph-mon[91103]: pgmap v208: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-27T07:41:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:10 smithi100 ceph-mon[80397]: pgmap v209: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-27T07:41:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:11.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:10 smithi082 ceph-mon[91103]: pgmap v209: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-27T07:41:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:13.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:12 smithi082 ceph-mon[91103]: pgmap v210: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-27T07:41:13.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:12 smithi100 ceph-mon[80397]: pgmap v210: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-27T07:41:14.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:14.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:14.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:14 smithi082 ceph-mon[91103]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-27T07:41:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:14 smithi100 ceph-mon[80397]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-27T07:41:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:15.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:15.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:15.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:16.668 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:16 smithi082 ceph-mon[91103]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-27T07:41:16.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:16 smithi100 ceph-mon[80397]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:19.106 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.107 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.107 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.107 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.107 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.udlhfn"]}]: dispatch 2024-04-27T07:41:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-04-27T07:41:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:19.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.udlhfn"]}]: dispatch 2024-04-27T07:41:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:19 smithi100 ceph-mon[80397]: Upgrade: It appears safe to stop mds.cephfs.smithi100.udlhfn 2024-04-27T07:41:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:41:20.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:19 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:19 smithi082 ceph-mon[91103]: Upgrade: It appears safe to stop mds.cephfs.smithi100.udlhfn 2024-04-27T07:41:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.udlhfn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:41:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:19 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:20 smithi100 ceph-mon[80397]: pgmap v214: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-04-27T07:41:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:20 smithi100 ceph-mon[80397]: Upgrade: Updating mds.cephfs.smithi100.udlhfn 2024-04-27T07:41:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:20 smithi100 ceph-mon[80397]: Deploying daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:41:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:20 smithi082 ceph-mon[91103]: pgmap v214: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-04-27T07:41:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:20 smithi082 ceph-mon[91103]: Upgrade: Updating mds.cephfs.smithi100.udlhfn 2024-04-27T07:41:21.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:20 smithi082 ceph-mon[91103]: Deploying daemon mds.cephfs.smithi100.udlhfn on smithi100 2024-04-27T07:41:23.112 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:22 smithi100 ceph-mon[80397]: pgmap v215: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:22 smithi082 ceph-mon[91103]: pgmap v215: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:24.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:23 smithi100 ceph-mon[80397]: osdmap e84: 6 total, 6 up, 6 in 2024-04-27T07:41:24.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:23 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:24.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:23 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:23 smithi082 ceph-mon[91103]: osdmap e84: 6 total, 6 up, 6 in 2024-04-27T07:41:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:23 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:23 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 -- 172.21.15.82:0/3213299882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 msgr2=0x7f0af00fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 --2- 172.21.15.82:0/3213299882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af00fd270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004940 tx=0x7f0ae0009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 -- 172.21.15.82:0/3213299882 shutdown_connections 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 --2- 172.21.15.82:0/3213299882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af00fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 --2- 172.21.15.82:0/3213299882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af00fd270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 -- 172.21.15.82:0/3213299882 >> 172.21.15.82:0/3213299882 conn(0x7f0af00f8540 msgr2=0x7f0af00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 -- 172.21.15.82:0/3213299882 shutdown_connections 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.567+0000 7f0af4e42700 1 -- 172.21.15.82:0/3213299882 wait complete. 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 Processor -- start 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 -- start start 2024-04-27T07:41:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af010e480 con 0x7f0af00fce60 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0af4e42700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af010e5f0 con 0x7f0af00fdfd0 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51722/0 (socket says 172.21.15.82:51722) 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 -- 172.21.15.82:0/2917646443 learned_addr learned my addr 172.21.15.82:0/2917646443 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0ae5d9b700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 -- 172.21.15.82:0/2917646443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 msgr2=0x7f0af010de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af010de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0aee59c700 1 -- 172.21.15.82:0/2917646443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0005040 con 0x7f0af00fce60 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.568+0000 7f0ae5d9b700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0aee59c700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b3b0 tx=0x7f0ae0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae000e040 con 0x7f0af00fce60 2024-04-27T07:41:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ae0004290 con 0x7f0af00fce60 2024-04-27T07:41:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af0112ff0 con 0x7f0af00fce60 2024-04-27T07:41:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae001c630 con 0x7f0af00fce60 2024-04-27T07:41:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.569+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0113520 con 0x7f0af00fce60 2024-04-27T07:41:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.570+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af004c710 con 0x7f0af00fce60 2024-04-27T07:41:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.570+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0ae000bbf0 con 0x7f0af00fce60 2024-04-27T07:41:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.571+0000 7f0ae77fe700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 0x7f0adc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.571+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0ae008fcc0 con 0x7f0af00fce60 2024-04-27T07:41:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.571+0000 7f0ae5d9b700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 0x7f0adc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.571+0000 7f0ae5d9b700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 0x7f0adc0710b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8007fd0 tx=0x7f0ad8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:24.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.576+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0ae005c620 con 0x7f0af00fce60 2024-04-27T07:41:24.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.797+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0af0113740 con 0x7f0adc06ec00 2024-04-27T07:41:24.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.798+0000 7f0ae77fe700 1 -- 172.21.15.82:0/2917646443 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0af0113740 con 0x7f0adc06ec00 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 msgr2=0x7f0adc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 0x7f0adc0710b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0ad8007fd0 tx=0x7f0ad8009040 comp rx=0 tx=0).stop 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 msgr2=0x7f0af010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b3b0 tx=0x7f0ae0009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 shutdown_connections 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0adc06ec00 0x7f0adc0710b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af00fce60 0x7f0af010d940 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 --2- 172.21.15.82:0/2917646443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af00fdfd0 0x7f0af010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.800+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 >> 172.21.15.82:0/2917646443 conn(0x7f0af00f8540 msgr2=0x7f0af00f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.801+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 shutdown_connections 2024-04-27T07:41:24.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.801+0000 7f0af4e42700 1 -- 172.21.15.82:0/2917646443 wait complete. 2024-04-27T07:41:24.813 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:41:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3351733444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fe430 msgr2=0x7f2d440fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3351733444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fe430 0x7f2d440fe840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d38004940 tx=0x7f2d38009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3351733444 shutdown_connections 2024-04-27T07:41:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3351733444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fed80 0x7f2d440faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3351733444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fe430 0x7f2d440fe840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3351733444 >> 172.21.15.82:0/3351733444 conn(0x7f2d440f6bd0 msgr2=0x7f2d440f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3351733444 shutdown_connections 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.904+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3351733444 wait complete. 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 Processor -- start 2024-04-27T07:41:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 -- start start 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fe430 0x7f2d4410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4410e470 con 0x7f2d440fed80 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d4aca7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4410e5e0 con 0x7f2d440fe430 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d43fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51738/0 (socket says 172.21.15.82:51738) 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.905+0000 7f2d43fff700 1 -- 172.21.15.82:0/3336824119 learned_addr learned my addr 172.21.15.82:0/3336824119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d48a43700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fe430 0x7f2d4410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d43fff700 1 -- 172.21.15.82:0/3336824119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fe430 msgr2=0x7f2d4410d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d43fff700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fe430 0x7f2d4410d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d43fff700 1 -- 172.21.15.82:0/3336824119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38005040 con 0x7f2d440fed80 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d43fff700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d30002a50 tx=0x7f2d300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d30007cc0 con 0x7f2d440fed80 2024-04-27T07:41:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d3000f040 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d44113040 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d3000da30 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.906+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d441135d0 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.907+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404c710 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.908+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f2d3000db90 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.908+0000 7f2d417fa700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 0x7f2d340710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.908+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2d3008e640 con 0x7f2d440fed80 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.908+0000 7f2d48a43700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 0x7f2d340710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:24.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.909+0000 7f2d48a43700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 0x7f2d340710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b970 tx=0x7f2d38009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:24.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:24.915+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2d3005af20 con 0x7f2d440fed80 2024-04-27T07:41:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.133+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d44102570 con 0x7f2d3406ec00 2024-04-27T07:41:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.134+0000 7f2d417fa700 1 -- 172.21.15.82:0/3336824119 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2d44102570 con 0x7f2d3406ec00 2024-04-27T07:41:25.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 msgr2=0x7f2d340710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 0x7f2d340710b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b970 tx=0x7f2d38009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 msgr2=0x7f2d4410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d30002a50 tx=0x7f2d300046b0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 shutdown_connections 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f2d3406ec00 0x7f2d340710b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d440fe430 0x7f2d4410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 --2- 172.21.15.82:0/3336824119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440fed80 0x7f2d4410de70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 >> 172.21.15.82:0/3336824119 conn(0x7f2d440f6bd0 msgr2=0x7f2d440f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 shutdown_connections 2024-04-27T07:41:25.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.136+0000 7f2d4aca7700 1 -- 172.21.15.82:0/3336824119 wait complete. 2024-04-27T07:41:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:24 smithi100 ceph-mon[80397]: pgmap v217: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 -- 172.21.15.82:0/679036139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 msgr2=0x7f325c0fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 --2- 172.21.15.82:0/679036139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c0fc570 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3250004940 tx=0x7f3250009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 -- 172.21.15.82:0/679036139 shutdown_connections 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 --2- 172.21.15.82:0/679036139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 0x7f325c0faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 --2- 172.21.15.82:0/679036139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c0fc570 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.237+0000 7f326311c700 1 -- 172.21.15.82:0/679036139 >> 172.21.15.82:0/679036139 conn(0x7f325c0f6bd0 msgr2=0x7f325c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.241 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:24 smithi082 ceph-mon[91103]: pgmap v217: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 -- 172.21.15.82:0/679036139 shutdown_connections 2024-04-27T07:41:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 -- 172.21.15.82:0/679036139 wait complete. 2024-04-27T07:41:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 Processor -- start 2024-04-27T07:41:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 -- start start 2024-04-27T07:41:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 0x7f325c1144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c114ad0 con 0x7f325c0fc160 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.238+0000 7f326311c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c114c40 con 0x7f325c0fcab0 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51756/0 (socket says 172.21.15.82:51756) 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 -- 172.21.15.82:0/648387845 learned_addr learned my addr 172.21.15.82:0/648387845 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f325bfff700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 0x7f325c1144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 -- 172.21.15.82:0/648387845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 msgr2=0x7f325c1144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 0x7f325c1144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 -- 172.21.15.82:0/648387845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250005040 con 0x7f325c0fc160 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f3260eb8700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3250009150 tx=0x7f3250009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325000e040 con 0x7f325c0fc160 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3250004290 con 0x7f325c0fc160 2024-04-27T07:41:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c1195f0 con 0x7f325c0fc160 2024-04-27T07:41:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.239+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325001c630 con 0x7f325c0fc160 2024-04-27T07:41:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.240+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c119bb0 con 0x7f325c0fc160 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.241+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f325000bbf0 con 0x7f325c0fc160 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.241+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c04c710 con 0x7f325c0fc160 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.241+0000 7f32597fa700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 0x7f324c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.241+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f325008f430 con 0x7f325c0fc160 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.241+0000 7f325bfff700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 0x7f324c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.242+0000 7f325bfff700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 0x7f324c0710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3248007fd0 tx=0x7f3248009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.246+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f325005bd90 con 0x7f325c0fc160 2024-04-27T07:41:25.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.457+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f325c100260 con 0x7f324c06ec00 2024-04-27T07:41:25.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.467+0000 7f32597fa700 1 -- 172.21.15.82:0/648387845 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f325c100260 con 0x7f324c06ec00 2024-04-27T07:41:25.469 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:41:25.469 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (7m) 11s ago 16m 25.1M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:41:25.469 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 11s ago 16m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:41:25.469 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (4m) 97s ago 15m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (7m) 11s ago 16m 85.8M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (19s) 11s ago 10m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (46s) 11s ago 10m 66.0M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (10m) 97s ago 10m 64.3M - 17.2.7-907-g2be3efa9 1c5834633715 ab63071bb436 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (10m) 97s ago 10m 119M - 17.2.7-907-g2be3efa9 1c5834633715 bfcd3ade3e17 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (7m) 11s ago 17m 509M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (6m) 97s ago 15m 452M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 11s ago 17m 54.6M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (5m) 97s ago 15m 39.0M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 11s ago 16m 16.7M - 1.5.0 0da6a335fe13 c5c8bd0abe53 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (7m) 97s ago 15m 15.1M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 11s ago 14m 98.8M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 11s ago 14m 103M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:41:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 11s ago 13m 79.8M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:41:25.471 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (2m) 97s ago 13m 88.4M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:41:25.471 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (2m) 97s ago 12m 90.5M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:41:25.471 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (101s) 97s ago 12m 15.1M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:41:25.471 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 11s ago 15m 65.7M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 msgr2=0x7f324c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 0x7f324c0710b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3248007fd0 tx=0x7f3248009040 comp rx=0 tx=0).stop 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 msgr2=0x7f325c113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3250009150 tx=0x7f3250009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 shutdown_connections 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f324c06ec00 0x7f324c0710b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f325c0fc160 0x7f325c113f90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 --2- 172.21.15.82:0/648387845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f325c0fcab0 0x7f325c1144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 >> 172.21.15.82:0/648387845 conn(0x7f325c0f6bd0 msgr2=0x7f325c0f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 shutdown_connections 2024-04-27T07:41:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.469+0000 7f326311c700 1 -- 172.21.15.82:0/648387845 wait complete. 2024-04-27T07:41:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.568+0000 7f462a3b2700 1 -- 172.21.15.82:0/3335002392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 msgr2=0x7f46240fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.568+0000 7f462a3b2700 1 --2- 172.21.15.82:0/3335002392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f46240fd270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4614004940 tx=0x7f4614009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- 172.21.15.82:0/3335002392 shutdown_connections 2024-04-27T07:41:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 --2- 172.21.15.82:0/3335002392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 0x7f46240fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 --2- 172.21.15.82:0/3335002392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f46240fd270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- 172.21.15.82:0/3335002392 >> 172.21.15.82:0/3335002392 conn(0x7f46240f8540 msgr2=0x7f46240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- 172.21.15.82:0/3335002392 shutdown_connections 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- 172.21.15.82:0/3335002392 wait complete. 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 Processor -- start 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- start start 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 0x7f46240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4624072200 con 0x7f46240fce60 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.569+0000 7f462a3b2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46240707f0 con 0x7f46240fdfd0 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49344/0 (socket says 172.21.15.82:49344) 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 -- 172.21.15.82:0/751387334 learned_addr learned my addr 172.21.15.82:0/751387334 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:25.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f46237fe700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 0x7f46240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 -- 172.21.15.82:0/751387334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 msgr2=0x7f46240702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 0x7f46240702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 -- 172.21.15.82:0/751387334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614005040 con 0x7f46240fce60 2024-04-27T07:41:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4623fff700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f461400b3b0 tx=0x7f4614009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461400e040 con 0x7f46240fce60 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f461400bbf0 con 0x7f46240fce60 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4624070a40 con 0x7f46240fce60 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f461401c630 con 0x7f46240fce60 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.570+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4624071000 con 0x7f46240fce60 2024-04-27T07:41:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.571+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462404c710 con 0x7f46240fce60 2024-04-27T07:41:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.572+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f461400bd60 con 0x7f46240fce60 2024-04-27T07:41:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.572+0000 7f4620ff9700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 0x7f460c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.572+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f461408f450 con 0x7f46240fce60 2024-04-27T07:41:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.572+0000 7f46237fe700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 0x7f460c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.573+0000 7f46237fe700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 0x7f460c0710b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46180041d0 tx=0x7f46180043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.577+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f461405bdb0 con 0x7f46240fce60 2024-04-27T07:41:25.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.863+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4624115aa0 con 0x7f46240fce60 2024-04-27T07:41:25.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.863+0000 7f4620ff9700 1 -- 172.21.15.82:0/751387334 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f461405b940 con 0x7f46240fce60 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:25.866 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 17.2.7-907-g2be3efa9 (2be3efa97a7972f8e925bd899b474329979b74d6) quincy (stable)": 1, 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 12 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:41:25.867 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 msgr2=0x7f460c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 0x7f460c0710b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46180041d0 tx=0x7f46180043c0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 msgr2=0x7f4624071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f461400b3b0 tx=0x7f4614009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 shutdown_connections 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.865+0000 7f462a3b2700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f460c06ec00 0x7f460c0710b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.866+0000 7f462a3b2700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46240fce60 0x7f4624071c00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.866+0000 7f462a3b2700 1 --2- 172.21.15.82:0/751387334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46240fdfd0 0x7f46240702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.866+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 >> 172.21.15.82:0/751387334 conn(0x7f46240f8540 msgr2=0x7f46240f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.866+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 shutdown_connections 2024-04-27T07:41:25.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.866+0000 7f462a3b2700 1 -- 172.21.15.82:0/751387334 wait complete. 2024-04-27T07:41:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 -- 172.21.15.82:0/32533272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 msgr2=0x7f00d80fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/32533272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d80fd3e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00cc004940 tx=0x7f00cc009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 -- 172.21.15.82:0/32533272 shutdown_connections 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/32533272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d80fd3e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/32533272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d80fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 -- 172.21.15.82:0/32533272 >> 172.21.15.82:0/32533272 conn(0x7f00d80f7440 msgr2=0x7f00d80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 -- 172.21.15.82:0/32533272 shutdown_connections 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.970+0000 7f00dcf2d700 1 -- 172.21.15.82:0/32533272 wait complete. 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 Processor -- start 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 -- start start 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d810c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d810d380 con 0x7f00d80fcf70 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00dcf2d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d810d4f0 con 0x7f00d80fbcc0 2024-04-27T07:41:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00d5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49368/0 (socket says 172.21.15.82:49368) 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.971+0000 7f00d5d9b700 1 -- 172.21.15.82:0/1119793735 learned_addr learned my addr 172.21.15.82:0/1119793735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d659c700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d810c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d5d9b700 1 -- 172.21.15.82:0/1119793735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 msgr2=0x7f00d810c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d5d9b700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d810c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d5d9b700 1 -- 172.21.15.82:0/1119793735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc005040 con 0x7f00d80fcf70 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d659c700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d810c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00d5d9b700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009380 tx=0x7f00cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00cc00e040 con 0x7f00d80fcf70 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00cc00be00 con 0x7f00d80fcf70 2024-04-27T07:41:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d8066250 con 0x7f00d80fcf70 2024-04-27T07:41:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00cc013960 con 0x7f00d80fcf70 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.972+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d8066810 con 0x7f00d80fcf70 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.973+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d804c710 con 0x7f00d80fcf70 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.973+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f00cc013bd0 con 0x7f00d80fcf70 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.974+0000 7f00c6ffd700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 0x7f00c00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.974+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f00cc0922c0 con 0x7f00d80fcf70 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.974+0000 7f00d659c700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 0x7f00c00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:25.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.974+0000 7f00d659c700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 0x7f00c00710b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00c8007fd0 tx=0x7f00c8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:25.978+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f00cc05eba0 con 0x7f00d80fcf70 2024-04-27T07:41:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:25 smithi100 ceph-mon[80397]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:25 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/751387334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:26.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.224+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00d8066df0 con 0x7f00d80fcf70 2024-04-27T07:41:26.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:25 smithi082 ceph-mon[91103]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:26.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:26.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:25 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/751387334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:26.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.224+0000 7f00c6ffd700 1 -- 172.21.15.82:0/1119793735 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1755 (secure 0 0 0) 0x7f00cc05e730 con 0x7f00d80fcf70 2024-04-27T07:41:26.228 INFO:teuthology.orchestra.run.smithi082.stdout:e37 2024-04-27T07:41:26.228 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:41:26.228 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 35 2024-04-27T07:41:26.229 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-27T07:41:26.230 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:41:26.230 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:41:03.206897+0000 2024-04-27T07:41:26.230 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:41:26.230 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:41:26.230 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:41:26.231 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 83 2024-04-27T07:41:26.232 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-27T07:41:26.232 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-04-27T07:41:26.232 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-04-27T07:41:26.232 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34444} 2024-04-27T07:41:26.232 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:41:26.233 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:41:26.233 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-04-27T07:41:26.233 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:41:26.233 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:41:26.233 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34444 members: 34444 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:34444} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:26.234 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:26.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:26.235 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-04-27T07:41:26.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:26.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{-1:34476} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:26.235 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/733762917,v1:172.21.15.100:6827/733762917] compat {c=[1],r=[1],i=[7ff]}] 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 msgr2=0x7f00c00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 0x7f00c00710b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00c8007fd0 tx=0x7f00c8009040 comp rx=0 tx=0).stop 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 msgr2=0x7f00d810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009380 tx=0x7f00cc009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 shutdown_connections 2024-04-27T07:41:26.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f00c006ec00 0x7f00c00710b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00d80fbcc0 0x7f00d810c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 --2- 172.21.15.82:0/1119793735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d80fcf70 0x7f00d810cd80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 >> 172.21.15.82:0/1119793735 conn(0x7f00d80f7440 msgr2=0x7f00d80f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.226+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 shutdown_connections 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.227+0000 7f00dcf2d700 1 -- 172.21.15.82:0/1119793735 wait complete. 2024-04-27T07:41:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 -- 172.21.15.82:0/3481010746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 msgr2=0x7f37340fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 --2- 172.21.15.82:0/3481010746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f37340fd3d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3724004940 tx=0x7f3724009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 -- 172.21.15.82:0/3481010746 shutdown_connections 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 --2- 172.21.15.82:0/3481010746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f37340fd3d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 --2- 172.21.15.82:0/3481010746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 0x7f37340fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 -- 172.21.15.82:0/3481010746 >> 172.21.15.82:0/3481010746 conn(0x7f37340f7430 msgr2=0x7f37340f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 -- 172.21.15.82:0/3481010746 shutdown_connections 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 -- 172.21.15.82:0/3481010746 wait complete. 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.329+0000 7f373a780700 1 Processor -- start 2024-04-27T07:41:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f373a780700 1 -- start start 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f373a780700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 0x7f373410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f373a780700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f373a780700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373410e5b0 con 0x7f37340fcf60 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f373a780700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373410eda0 con 0x7f37340fbcb0 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49388/0 (socket says 172.21.15.82:49388) 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 -- 172.21.15.82:0/4212553615 learned_addr learned my addr 172.21.15.82:0/4212553615 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f3733fff700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 0x7f373410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 -- 172.21.15.82:0/4212553615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 msgr2=0x7f373410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 0x7f373410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 -- 172.21.15.82:0/4212553615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724005040 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f37337fe700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f372400b3b0 tx=0x7f3724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.330+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372400e040 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.331+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f372400bcc0 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.331+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373410f020 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.331+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372401c630 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.331+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373410f5e0 con 0x7f37340fcf60 2024-04-27T07:41:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.332+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734101af0 con 0x7f37340fcf60 2024-04-27T07:41:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.332+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3724013980 con 0x7f37340fcf60 2024-04-27T07:41:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.333+0000 7f3730ff9700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 0x7f371c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.333+0000 7f3733fff700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 0x7f371c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.333+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f372408f4e0 con 0x7f37340fcf60 2024-04-27T07:41:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.333+0000 7f3733fff700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 0x7f371c0710b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3728006fd0 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.337+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f372405be40 con 0x7f37340fcf60 2024-04-27T07:41:26.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.558+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f373410f850 con 0x7f371c06ec00 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.559+0000 7f3730ff9700 1 -- 172.21.15.82:0/4212553615 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f373410f850 con 0x7f371c06ec00 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:41:26.561 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "14/21 daemons upgraded", 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mds daemons", 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:41:26.562 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:41:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 msgr2=0x7f371c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 0x7f371c0710b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3728006fd0 tx=0x7f3728008040 comp rx=0 tx=0).stop 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 msgr2=0x7f373410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f372400b3b0 tx=0x7f3724009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 shutdown_connections 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f371c06ec00 0x7f371c0710b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37340fbcb0 0x7f373410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 --2- 172.21.15.82:0/4212553615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37340fcf60 0x7f373410df20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 >> 172.21.15.82:0/4212553615 conn(0x7f37340f7430 msgr2=0x7f37340f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 shutdown_connections 2024-04-27T07:41:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.562+0000 7f373a780700 1 -- 172.21.15.82:0/4212553615 wait complete. 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- 172.21.15.82:0/2092275237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 msgr2=0x7efd9c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 --2- 172.21.15.82:0/2092275237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c0fd3e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efd8c004940 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- 172.21.15.82:0/2092275237 shutdown_connections 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 --2- 172.21.15.82:0/2092275237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c0fd3e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 --2- 172.21.15.82:0/2092275237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 0x7efd9c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- 172.21.15.82:0/2092275237 >> 172.21.15.82:0/2092275237 conn(0x7efd9c0f7440 msgr2=0x7efd9c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- 172.21.15.82:0/2092275237 shutdown_connections 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- 172.21.15.82:0/2092275237 wait complete. 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 Processor -- start 2024-04-27T07:41:26.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- start start 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 0x7efd9c066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c112c90 con 0x7efd9c0fcf70 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.664+0000 7efda3be8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c112dd0 con 0x7efd9c0fbcc0 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49406/0 (socket says 172.21.15.82:49406) 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 -- 172.21.15.82:0/134999128 learned_addr learned my addr 172.21.15.82:0/134999128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1984700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 0x7efd9c066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 -- 172.21.15.82:0/134999128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 msgr2=0x7efd9c066cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 0x7efd9c066cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 -- 172.21.15.82:0/134999128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c005040 con 0x7efd9c0fcf70 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda1183700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c00e040 con 0x7efd9c0fcf70 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd8c00bbf0 con 0x7efd9c0fcf70 2024-04-27T07:41:26.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c112fd0 con 0x7efd9c0fcf70 2024-04-27T07:41:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c01c630 con 0x7efd9c0fcf70 2024-04-27T07:41:26.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.665+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c113560 con 0x7efd9c0fcf70 2024-04-27T07:41:26.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.666+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c04c710 con 0x7efd9c0fcf70 2024-04-27T07:41:26.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.667+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efd8c00bd60 con 0x7efd9c0fcf70 2024-04-27T07:41:26.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.667+0000 7efd927fc700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 0x7efd880710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:26.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.667+0000 7efda1984700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 0x7efd880710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:26.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.667+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efd8c08f320 con 0x7efd9c0fcf70 2024-04-27T07:41:26.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.668+0000 7efda1984700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 0x7efd880710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd98004f40 tx=0x7efd9800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:26.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.672+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efd8c05bd40 con 0x7efd9c0fcf70 2024-04-27T07:41:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.954+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efd9c1047b0 con 0x7efd9c0fcf70 2024-04-27T07:41:26.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.955+0000 7efd927fc700 1 -- 172.21.15.82:0/134999128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efd8c05b8d0 con 0x7efd9c0fcf70 2024-04-27T07:41:26.957 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:41:26.957 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:41:26.958 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:41:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 msgr2=0x7efd880710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 0x7efd880710b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd98004f40 tx=0x7efd9800b040 comp rx=0 tx=0).stop 2024-04-27T07:41:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 msgr2=0x7efd9c112750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:26.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 shutdown_connections 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efd8806ec00 0x7efd880710b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd9c0fbcc0 0x7efd9c066cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 --2- 172.21.15.82:0/134999128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd9c0fcf70 0x7efd9c112750 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 >> 172.21.15.82:0/134999128 conn(0x7efd9c0f7440 msgr2=0x7efd9c0f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 shutdown_connections 2024-04-27T07:41:26.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:26.957+0000 7efda3be8700 1 -- 172.21.15.82:0/134999128 wait complete. 2024-04-27T07:41:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:26 smithi100 ceph-mon[80397]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:26 smithi100 ceph-mon[80397]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:26 smithi100 ceph-mon[80397]: pgmap v218: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:27.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:26 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1119793735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:41:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:26 smithi082 ceph-mon[91103]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:26 smithi082 ceph-mon[91103]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:26 smithi082 ceph-mon[91103]: pgmap v218: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:26 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1119793735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:41:28.356 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:27 smithi082 ceph-mon[91103]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:28.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:27 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/134999128' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:41:28.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:27 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:28.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:27 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:28.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:27 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:28.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:27 smithi100 ceph-mon[80397]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:28.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:27 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/134999128' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:41:28.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:27 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:28.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:27 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:28.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:27 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:29.294 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:28 smithi100 ceph-mon[80397]: pgmap v219: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:29.294 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:28 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] up:boot 2024-04-27T07:41:29.294 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:28 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:29.294 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:28 smithi082 ceph-mon[91103]: pgmap v219: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:28 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] up:boot 2024-04-27T07:41:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:28 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:30 smithi082 ceph-mon[91103]: pgmap v220: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:31.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:30 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:30 smithi100 ceph-mon[80397]: pgmap v220: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:31.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:31.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:30 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:32 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:32.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:32 smithi100 ceph-mon[80397]: pgmap v221: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:32 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:32 smithi082 ceph-mon[91103]: pgmap v221: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:35.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:34 smithi100 ceph-mon[80397]: pgmap v222: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:34 smithi082 ceph-mon[91103]: pgmap v222: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:36.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: Detected new or changed devices on smithi100 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.kjopce"]}]: dispatch 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: Upgrade: It appears safe to stop mds.cephfs.smithi100.kjopce 2024-04-27T07:41:36.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:36 smithi082 ceph-mon[91103]: pgmap v223: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: Detected new or changed devices on smithi100 2024-04-27T07:41:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi100.kjopce"]}]: dispatch 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: Upgrade: It appears safe to stop mds.cephfs.smithi100.kjopce 2024-04-27T07:41:36.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:36 smithi100 ceph-mon[80397]: pgmap v223: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:37 smithi100 ceph-mon[80397]: Upgrade: Updating mds.cephfs.smithi100.kjopce 2024-04-27T07:41:37.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:37 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:37.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:37 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:41:37.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:37 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:37.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:37 smithi100 ceph-mon[80397]: Deploying daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:41:38.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:37 smithi082 ceph-mon[91103]: Upgrade: Updating mds.cephfs.smithi100.kjopce 2024-04-27T07:41:38.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:37 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:38.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:37 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi100.kjopce", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-27T07:41:38.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:37 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:38.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:37 smithi082 ceph-mon[91103]: Deploying daemon mds.cephfs.smithi100.kjopce on smithi100 2024-04-27T07:41:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:38 smithi100 ceph-mon[80397]: pgmap v224: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:39.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:38 smithi082 ceph-mon[91103]: pgmap v224: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:39 smithi082 ceph-mon[91103]: osdmap e85: 6 total, 6 up, 6 in 2024-04-27T07:41:40.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:39 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:39 smithi100 ceph-mon[80397]: osdmap e85: 6 total, 6 up, 6 in 2024-04-27T07:41:40.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:39 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 2 up:standby 2024-04-27T07:41:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:40 smithi082 ceph-mon[91103]: pgmap v226: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:40 smithi100 ceph-mon[80397]: pgmap v226: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:42.778 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:42 smithi100 ceph-mon[80397]: pgmap v227: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:42 smithi082 ceph-mon[91103]: pgmap v227: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:44 smithi100 ceph-mon[80397]: pgmap v228: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:44 smithi082 ceph-mon[91103]: pgmap v228: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:45 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] up:boot 2024-04-27T07:41:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:45 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:46.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:45 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:45 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] up:boot 2024-04-27T07:41:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:45 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:45 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:46 smithi100 ceph-mon[80397]: pgmap v229: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:46 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:46 smithi082 ceph-mon[91103]: pgmap v229: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:46 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:48 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:48.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:48 smithi100 ceph-mon[80397]: pgmap v230: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:48.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:48.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:48 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:48.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:48 smithi082 ceph-mon[91103]: pgmap v230: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:51.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: pgmap v231: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.bqtewe"}]': finished 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.vlqbei"}]': finished 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.kjopce"}]': finished 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.udlhfn"}]': finished 2024-04-27T07:41:51.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:50 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: pgmap v231: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.bqtewe"}]: dispatch 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.bqtewe"}]': finished 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.vlqbei"}]: dispatch 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.vlqbei"}]': finished 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.kjopce"}]: dispatch 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.kjopce"}]': finished 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.udlhfn"}]: dispatch 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi100.udlhfn"}]': finished 2024-04-27T07:41:51.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:50 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-27T07:41:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all mds 2024-04-27T07:41:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-27T07:41:52.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: daemon mds.cephfs.smithi082.bqtewe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi082.bqtewe=up:starting} 2 up:standby 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-27T07:41:52.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:51 smithi100 ceph-mon[80397]: daemon mds.cephfs.smithi082.bqtewe is now active in filesystem cephfs as rank 1 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all mds 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: daemon mds.cephfs.smithi082.bqtewe assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-27T07:41:52.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: fsmap cephfs:1 {0=cephfs.smithi082.vlqbei=up:active} 3 up:standby 2024-04-27T07:41:52.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi082.bqtewe=up:starting} 2 up:standby 2024-04-27T07:41:52.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:52.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-27T07:41:52.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:51 smithi082 ceph-mon[91103]: daemon mds.cephfs.smithi082.bqtewe is now active in filesystem cephfs as rank 1 2024-04-27T07:41:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: pgmap v232: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-27T07:41:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-27T07:41:53.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: mds.? [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] up:active 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi082.bqtewe=up:active} 2 up:standby-replay 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:52 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: pgmap v232: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: mds.? [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] up:active 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: fsmap cephfs:2 {0=cephfs.smithi082.vlqbei=up:active,1=cephfs.smithi082.bqtewe=up:active} 2 up:standby-replay 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:53.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:52 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all rgw 2024-04-27T07:41:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all rbd-mirror 2024-04-27T07:41:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all ceph-exporter 2024-04-27T07:41:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all iscsi 2024-04-27T07:41:54.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all nfs 2024-04-27T07:41:54.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:53 smithi100 ceph-mon[80397]: Upgrade: Setting container_image for all nvmeof 2024-04-27T07:41:54.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all rgw 2024-04-27T07:41:54.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all rbd-mirror 2024-04-27T07:41:54.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all ceph-exporter 2024-04-27T07:41:54.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all iscsi 2024-04-27T07:41:54.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all nfs 2024-04-27T07:41:54.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:53 smithi082 ceph-mon[91103]: Upgrade: Setting container_image for all nvmeof 2024-04-27T07:41:55.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:54 smithi082 ceph-mon[91103]: pgmap v233: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3 op/s 2024-04-27T07:41:55.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:54 smithi100 ceph-mon[80397]: pgmap v233: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3 op/s 2024-04-27T07:41:56.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:55 smithi082 ceph-mon[91103]: Upgrade: Updating node-exporter.smithi082 (1/2) 2024-04-27T07:41:56.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:55 smithi082 ceph-mon[91103]: Deploying daemon node-exporter.smithi082 on smithi082 2024-04-27T07:41:56.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:55 smithi100 ceph-mon[80397]: Upgrade: Updating node-exporter.smithi082 (1/2) 2024-04-27T07:41:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:55 smithi100 ceph-mon[80397]: Deploying daemon node-exporter.smithi082 on smithi082 2024-04-27T07:41:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:41:57.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 -- 172.21.15.82:0/2893219588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90200fff10 msgr2=0x7f9020102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 --2- 172.21.15.82:0/2893219588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90200fff10 0x7f9020102330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9010004940 tx=0x7f9010009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 -- 172.21.15.82:0/2893219588 shutdown_connections 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 --2- 172.21.15.82:0/2893219588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90200fff10 0x7f9020102330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 --2- 172.21.15.82:0/2893219588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9020066f70 0x7f90200ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 -- 172.21.15.82:0/2893219588 >> 172.21.15.82:0/2893219588 conn(0x7f90200f7440 msgr2=0x7f90200f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 -- 172.21.15.82:0/2893219588 shutdown_connections 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.064+0000 7f90272a9700 1 -- 172.21.15.82:0/2893219588 wait complete. 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 Processor -- start 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 -- start start 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90200fff10 0x7f902010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902010e450 con 0x7f9020066f70 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f90272a9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902010e5c0 con 0x7f90200fff10 2024-04-27T07:41:57.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55342/0 (socket says 172.21.15.82:55342) 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 -- 172.21.15.82:0/940789743 learned_addr learned my addr 172.21.15.82:0/940789743 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9024844700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90200fff10 0x7f902010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 -- 172.21.15.82:0/940789743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90200fff10 msgr2=0x7f902010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90200fff10 0x7f902010de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 -- 172.21.15.82:0/940789743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010005040 con 0x7f9020066f70 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9025045700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f901c002a50 tx=0x7f901c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.065+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901c007cc0 con 0x7f9020066f70 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.066+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9020112fd0 con 0x7f9020066f70 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.066+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f901c00f040 con 0x7f9020066f70 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.066+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f901c00db30 con 0x7f9020066f70 2024-04-27T07:41:57.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.066+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9020113500 con 0x7f9020066f70 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.067+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902004c710 con 0x7f9020066f70 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.067+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f901c00dc90 con 0x7f9020066f70 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.068+0000 7f9015ffb700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 0x7f900c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.068+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f901c08e4c0 con 0x7f9020066f70 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.068+0000 7f9024844700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 0x7f900c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.068+0000 7f9024844700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 0x7f900c0710b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f901000b970 tx=0x7f9010009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.073+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f901c05ada0 con 0x7f9020066f70 2024-04-27T07:41:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:56 smithi082 ceph-mon[91103]: pgmap v234: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 7 op/s 2024-04-27T07:41:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:56 smithi100 ceph-mon[80397]: pgmap v234: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 6.7 MiB/s rd, 7 op/s 2024-04-27T07:41:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.295+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90201136f0 con 0x7f900c06ec00 2024-04-27T07:41:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.296+0000 7f9015ffb700 1 -- 172.21.15.82:0/940789743 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f90201136f0 con 0x7f900c06ec00 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 msgr2=0x7f900c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 0x7f900c0710b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f901000b970 tx=0x7f9010009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 msgr2=0x7f902010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f901c002a50 tx=0x7f901c0046b0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 shutdown_connections 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f900c06ec00 0x7f900c0710b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9020066f70 0x7f902010d910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 --2- 172.21.15.82:0/940789743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90200fff10 0x7f902010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 >> 172.21.15.82:0/940789743 conn(0x7f90200f7440 msgr2=0x7f90200f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 shutdown_connections 2024-04-27T07:41:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.298+0000 7f90272a9700 1 -- 172.21.15.82:0/940789743 wait complete. 2024-04-27T07:41:57.311 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:41:57.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 -- 172.21.15.82:0/1001424681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fe080 msgr2=0x7f46d40fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 --2- 172.21.15.82:0/1001424681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fe080 0x7f46d40fe4f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46c4004940 tx=0x7f46c4009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 -- 172.21.15.82:0/1001424681 shutdown_connections 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 --2- 172.21.15.82:0/1001424681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fe080 0x7f46d40fe4f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 --2- 172.21.15.82:0/1001424681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fce80 0x7f46d40fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 -- 172.21.15.82:0/1001424681 >> 172.21.15.82:0/1001424681 conn(0x7f46d40f8590 msgr2=0x7f46d40fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 -- 172.21.15.82:0/1001424681 shutdown_connections 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 -- 172.21.15.82:0/1001424681 wait complete. 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.400+0000 7f46db5ca700 1 Processor -- start 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 -- start start 2024-04-27T07:41:57.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fe080 0x7f46d410dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d410e4e0 con 0x7f46d40fce80 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d410ed30 con 0x7f46d40fe080 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55362/0 (socket says 172.21.15.82:55362) 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 -- 172.21.15.82:0/2522071625 learned_addr learned my addr 172.21.15.82:0/2522071625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d8b65700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fe080 0x7f46d410dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 -- 172.21.15.82:0/2522071625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fe080 msgr2=0x7f46d410dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fe080 0x7f46d410dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 -- 172.21.15.82:0/2522071625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4005040 con 0x7f46d40fce80 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46d9366700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f46d0001db0 tx=0x7f46d0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d000ed50 con 0x7f46d40fce80 2024-04-27T07:41:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d410f010 con 0x7f46d40fce80 2024-04-27T07:41:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.401+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46d0007df0 con 0x7f46d40fce80 2024-04-27T07:41:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.402+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d0014640 con 0x7f46d40fce80 2024-04-27T07:41:57.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.402+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d410f550 con 0x7f46d40fce80 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.403+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d405f5c0 con 0x7f46d40fce80 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.403+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f46d0007920 con 0x7f46d40fce80 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.403+0000 7f46c9ffb700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 0x7f46c00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.404+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46d008e630 con 0x7f46d40fce80 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.404+0000 7f46d8b65700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 0x7f46c00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.404+0000 7f46d8b65700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 0x7f46c00710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46c400b970 tx=0x7f46c4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.408+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f46d005afc0 con 0x7f46d40fce80 2024-04-27T07:41:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.627+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46d410f940 con 0x7f46c006ec00 2024-04-27T07:41:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.628+0000 7f46c9ffb700 1 -- 172.21.15.82:0/2522071625 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f46d410f940 con 0x7f46c006ec00 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 msgr2=0x7f46c00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 0x7f46c00710b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46c400b970 tx=0x7f46c4009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 msgr2=0x7f46d410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f46d0001db0 tx=0x7f46d0009ee0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 shutdown_connections 2024-04-27T07:41:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f46c006ec00 0x7f46c00710b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d40fce80 0x7f46d410d9a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 --2- 172.21.15.82:0/2522071625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46d40fe080 0x7f46d410dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 >> 172.21.15.82:0/2522071625 conn(0x7f46d40f8590 msgr2=0x7f46d40f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 shutdown_connections 2024-04-27T07:41:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.631+0000 7f46db5ca700 1 -- 172.21.15.82:0/2522071625 wait complete. 2024-04-27T07:41:57.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.732+0000 7f7dee263700 1 -- 172.21.15.82:0/512582409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 msgr2=0x7f7de80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.732+0000 7f7dee263700 1 --2- 172.21.15.82:0/512582409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de80fd270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8004940 tx=0x7f7dd8009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 -- 172.21.15.82:0/512582409 shutdown_connections 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 --2- 172.21.15.82:0/512582409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 0x7f7de80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 --2- 172.21.15.82:0/512582409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de80fd270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 -- 172.21.15.82:0/512582409 >> 172.21.15.82:0/512582409 conn(0x7f7de80f8540 msgr2=0x7f7de80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 -- 172.21.15.82:0/512582409 shutdown_connections 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 -- 172.21.15.82:0/512582409 wait complete. 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 Processor -- start 2024-04-27T07:41:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 -- start start 2024-04-27T07:41:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.733+0000 7f7dee263700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7dee263700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 0x7f7de810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7dee263700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de810e3f0 con 0x7f7de80fce60 2024-04-27T07:41:57.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7dee263700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de810e560 con 0x7f7de80fdfd0 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55382/0 (socket says 172.21.15.82:55382) 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 -- 172.21.15.82:0/3325047674 learned_addr learned my addr 172.21.15.82:0/3325047674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de77fe700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 0x7f7de810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 -- 172.21.15.82:0/3325047674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 msgr2=0x7f7de810ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 0x7f7de810ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 -- 172.21.15.82:0/3325047674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8005040 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de7fff700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009150 tx=0x7f7dd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd800e040 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de8112f60 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7dd8004290 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dd801c630 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.734+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de8113490 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.735+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804c710 con 0x7f7de80fce60 2024-04-27T07:41:57.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.736+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7dd800bbf0 con 0x7f7de80fce60 2024-04-27T07:41:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.736+0000 7f7de4ff9700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 0x7f7dd00710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.736+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7dd808f440 con 0x7f7de80fce60 2024-04-27T07:41:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.736+0000 7f7de77fe700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 0x7f7dd00710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.737+0000 7f7de77fe700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 0x7f7dd00710b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009fd0 tx=0x7f7ddc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:57.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.741+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7dd805bda0 con 0x7f7de80fce60 2024-04-27T07:41:57.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.950+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de8113770 con 0x7f7dd006ec00 2024-04-27T07:41:57.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.960+0000 7f7de4ff9700 1 -- 172.21.15.82:0/3325047674 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7de8113770 con 0x7f7dd006ec00 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (8m) 44s ago 16m 25.1M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 44s ago 17m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (5m) 11s ago 16m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (8m) 44s ago 16m 85.8M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (52s) 44s ago 11m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (79s) 44s ago 11m 66.0M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (14s) 11s ago 11m 11.3M - 19.0.0-3227-gc37f63b3 d1033e293654 493ac111fafd 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (30s) 11s ago 11m 12.7M - 19.0.0-3227-gc37f63b3 d1033e293654 0c17286fc3ca 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (7m) 44s ago 18m 509M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (6m) 11s ago 15m 452M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:41:57.963 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 44s ago 18m 54.6M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (6m) 11s ago 15m 37.7M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 starting - - - - 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (8m) 11s ago 15m 14.9M - 1.5.0 0da6a335fe13 bd0e421f51c0 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 44s ago 15m 98.8M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 44s ago 14m 103M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 44s ago 14m 79.8M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (3m) 11s ago 13m 101M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (2m) 11s ago 13m 98.7M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (2m) 11s ago 12m 86.6M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:41:57.964 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (7m) 44s ago 16m 65.7M - 2.43.0 a07b618ecd1d 22b050dd1ff1 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 msgr2=0x7f7dd00710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 0x7f7dd00710b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009fd0 tx=0x7f7ddc00b040 comp rx=0 tx=0).stop 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 msgr2=0x7f7de810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009150 tx=0x7f7dd8009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 shutdown_connections 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7dd006ec00 0x7f7dd00710b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7de80fce60 0x7f7de810d8b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 --2- 172.21.15.82:0/3325047674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80fdfd0 0x7f7de810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 >> 172.21.15.82:0/3325047674 conn(0x7f7de80f8540 msgr2=0x7f7de80f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 shutdown_connections 2024-04-27T07:41:57.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:57.962+0000 7f7dee263700 1 -- 172.21.15.82:0/3325047674 wait complete. 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- 172.21.15.82:0/2908132043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c071de0 msgr2=0x7f520c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 --2- 172.21.15.82:0/2908132043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c071de0 0x7f520c0702f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5208004940 tx=0x7f5208009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- 172.21.15.82:0/2908132043 shutdown_connections 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 --2- 172.21.15.82:0/2908132043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c070830 0x7f520c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 --2- 172.21.15.82:0/2908132043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c071de0 0x7f520c0702f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- 172.21.15.82:0/2908132043 >> 172.21.15.82:0/2908132043 conn(0x7f520c0f8560 msgr2=0x7f520c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- 172.21.15.82:0/2908132043 shutdown_connections 2024-04-27T07:41:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- 172.21.15.82:0/2908132043 wait complete. 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 Processor -- start 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.063+0000 7f52146a1700 1 -- start start 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071de0 0x7f520c110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c110760 con 0x7f520c070830 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c110f40 con 0x7f520c071de0 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55404/0 (socket says 172.21.15.82:55404) 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 -- 172.21.15.82:0/2153143119 learned_addr learned my addr 172.21.15.82:0/2153143119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f5211c3c700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071de0 0x7f520c110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 -- 172.21.15.82:0/2153143119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071de0 msgr2=0x7f520c110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071de0 0x7f520c110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 -- 172.21.15.82:0/2153143119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208005040 con 0x7f520c070830 2024-04-27T07:41:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f521243d700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f520800b3b0 tx=0x7f5208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520800e040 con 0x7f520c070830 2024-04-27T07:41:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f520800bbf0 con 0x7f520c070830 2024-04-27T07:41:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c1111c0 con 0x7f520c070830 2024-04-27T07:41:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520801c630 con 0x7f520c070830 2024-04-27T07:41:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.064+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c111700 con 0x7f520c070830 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.065+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c05f5c0 con 0x7f520c070830 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.066+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f520800bd60 con 0x7f520c070830 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.066+0000 7f5202ffd700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 0x7f51f80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.066+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f520808f310 con 0x7f520c070830 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.066+0000 7f5211c3c700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 0x7f51f80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.067+0000 7f5211c3c700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 0x7f51f80710b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51fc004f40 tx=0x7f51fc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.071+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f520805bd30 con 0x7f520c070830 2024-04-27T07:41:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:58.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:58.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: pgmap v235: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 85 B/s wr, 10 op/s 2024-04-27T07:41:58.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:57 smithi100 ceph-mon[80397]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:41:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: pgmap v235: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 9.0 MiB/s rd, 85 B/s wr, 10 op/s 2024-04-27T07:41:58.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:57 smithi082 ceph-mon[91103]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:41:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.355+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f520c107ac0 con 0x7f520c070830 2024-04-27T07:41:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.356+0000 7f5202ffd700 1 -- 172.21.15.82:0/2153143119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f520805b8c0 con 0x7f520c070830 2024-04-27T07:41:58.358 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:41:58.358 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:41:58.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 14 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:41:58.359 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:41:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 msgr2=0x7f51f80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 0x7f51f80710b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51fc004f40 tx=0x7f51fc00b040 comp rx=0 tx=0).stop 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 msgr2=0x7f520c10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f520800b3b0 tx=0x7f5208009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 shutdown_connections 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f51f806ec00 0x7f51f80710b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f520c070830 0x7f520c10fc20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 --2- 172.21.15.82:0/2153143119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f520c071de0 0x7f520c110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 >> 172.21.15.82:0/2153143119 conn(0x7f520c0f8560 msgr2=0x7f520c0f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 shutdown_connections 2024-04-27T07:41:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.358+0000 7f52146a1700 1 -- 172.21.15.82:0/2153143119 wait complete. 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 -- 172.21.15.82:0/2532719453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fce60 msgr2=0x7fcc380fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/2532719453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fce60 0x7fcc380fd270 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc28004940 tx=0x7fcc28009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 -- 172.21.15.82:0/2532719453 shutdown_connections 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/2532719453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fdfd0 0x7fcc380fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/2532719453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fce60 0x7fcc380fd270 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 -- 172.21.15.82:0/2532719453 >> 172.21.15.82:0/2532719453 conn(0x7fcc380f8540 msgr2=0x7fcc380fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 -- 172.21.15.82:0/2532719453 shutdown_connections 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 -- 172.21.15.82:0/2532719453 wait complete. 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.458+0000 7fcc3dff7700 1 Processor -- start 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc3dff7700 1 -- start start 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc3dff7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 0x7fcc3810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc3dff7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc3dff7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3810e450 con 0x7fcc380fdfd0 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc3dff7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3810e5c0 con 0x7fcc380fce60 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55428/0 (socket says 172.21.15.82:55428) 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 -- 172.21.15.82:0/4251187589 learned_addr learned my addr 172.21.15.82:0/4251187589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:58.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc377fe700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 0x7fcc3810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 -- 172.21.15.82:0/4251187589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 msgr2=0x7fcc3810d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 0x7fcc3810d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc2effd700 1 -- 172.21.15.82:0/4251187589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28005040 con 0x7fcc380fdfd0 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.459+0000 7fcc377fe700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 0x7fcc3810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc2effd700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c830 tx=0x7fcc20004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2000a760 con 0x7fcc380fdfd0 2024-04-27T07:41:58.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc2000ad90 con 0x7fcc380fdfd0 2024-04-27T07:41:58.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38113020 con 0x7fcc380fdfd0 2024-04-27T07:41:58.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc200113a0 con 0x7fcc380fdfd0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.460+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc381135b0 con 0x7fcc380fdfd0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.461+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3804c710 con 0x7fcc380fdfd0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.461+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcc20012400 con 0x7fcc380fdfd0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.462+0000 7fcc34ff9700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 0x7fcc240710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.462+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcc2008e8b0 con 0x7fcc380fdfd0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.462+0000 7fcc377fe700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 0x7fcc240710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.462+0000 7fcc377fe700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 0x7fcc240710b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3b0 tx=0x7fcc28009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.466+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcc2005b210 con 0x7fcc380fdfd0 2024-04-27T07:41:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.709+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc381058c0 con 0x7fcc380fdfd0 2024-04-27T07:41:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.710+0000 7fcc34ff9700 1 -- 172.21.15.82:0/4251187589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1963 (secure 0 0 0) 0x7fcc2005ada0 con 0x7fcc380fdfd0 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:e43 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 43 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:41:58.713 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:41:52.485728+0000 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 83 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-27T07:41:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34444,1=34476} 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:41:58.715 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34444 members: 34444,34476 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:34444} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{0:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{1:34476} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 msgr2=0x7fcc240710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 0x7fcc240710b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3b0 tx=0x7fcc28009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 msgr2=0x7fcc3810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c830 tx=0x7fcc20004470 comp rx=0 tx=0).stop 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 shutdown_connections 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc2406ec00 0x7fcc240710b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc380fce60 0x7fcc3810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 --2- 172.21.15.82:0/4251187589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc380fdfd0 0x7fcc3810de50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 >> 172.21.15.82:0/4251187589 conn(0x7fcc380f8540 msgr2=0x7fcc380f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:58.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 shutdown_connections 2024-04-27T07:41:58.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.713+0000 7fcc3dff7700 1 -- 172.21.15.82:0/4251187589 wait complete. 2024-04-27T07:41:58.718 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2024-04-27T07:41:58.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 -- 172.21.15.82:0/2126309518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 msgr2=0x7f33800ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 --2- 172.21.15.82:0/2126309518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f33800ff9a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3374004940 tx=0x7f3374009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 -- 172.21.15.82:0/2126309518 shutdown_connections 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 --2- 172.21.15.82:0/2126309518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 0x7f3380102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 --2- 172.21.15.82:0/2126309518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f33800ff9a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 -- 172.21.15.82:0/2126309518 >> 172.21.15.82:0/2126309518 conn(0x7f33800f7430 msgr2=0x7f33800f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 -- 172.21.15.82:0/2126309518 shutdown_connections 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 -- 172.21.15.82:0/2126309518 wait complete. 2024-04-27T07:41:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.816+0000 7f3385fad700 1 Processor -- start 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3385fad700 1 -- start start 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3385fad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3385fad700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 0x7f3380110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3385fad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3380110780 con 0x7f33800662c0 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3385fad700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3380110fd0 con 0x7f33800ffee0 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55444/0 (socket says 172.21.15.82:55444) 2024-04-27T07:41:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 -- 172.21.15.82:0/4034483083 learned_addr learned my addr 172.21.15.82:0/4034483083 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337effd700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 0x7f3380110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 -- 172.21.15.82:0/4034483083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 msgr2=0x7f3380110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 0x7f3380110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 -- 172.21.15.82:0/4034483083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374005040 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f337f7fe700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f337400b3b0 tx=0x7f3374009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.817+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337400e040 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.818+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3380111250 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.818+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f337400bbf0 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.818+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337401c630 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.818+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3380111790 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.819+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338005f5c0 con 0x7f33800662c0 2024-04-27T07:41:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.819+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f3374026440 con 0x7f33800662c0 2024-04-27T07:41:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.819+0000 7f3367fff700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 0x7f33680710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.819+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f337408f430 con 0x7f33800662c0 2024-04-27T07:41:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.819+0000 7f337effd700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 0x7f33680710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.820+0000 7f337effd700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 0x7f33680710b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3370004f40 tx=0x7f337000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:58.824+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f337405be00 con 0x7f33800662c0 2024-04-27T07:41:59.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.047+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3380111ac0 con 0x7f336806ec00 2024-04-27T07:41:59.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.048+0000 7f3367fff700 1 -- 172.21.15.82:0/4034483083 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3380111ac0 con 0x7f336806ec00 2024-04-27T07:41:59.050 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "16/21 daemons upgraded", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:41:59.051 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 msgr2=0x7f33680710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 0x7f33680710b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3370004f40 tx=0x7f337000b040 comp rx=0 tx=0).stop 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 msgr2=0x7f338010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f337400b3b0 tx=0x7f3374009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 shutdown_connections 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f336806ec00 0x7f33680710b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33800662c0 0x7f338010fc40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 --2- 172.21.15.82:0/4034483083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33800ffee0 0x7f3380110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.050+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 >> 172.21.15.82:0/4034483083 conn(0x7f33800f7430 msgr2=0x7f33800fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.051+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 shutdown_connections 2024-04-27T07:41:59.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.051+0000 7f3385fad700 1 -- 172.21.15.82:0/4034483083 wait complete. 2024-04-27T07:41:59.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 -- 172.21.15.82:0/3861469061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 msgr2=0x7f7ca40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 --2- 172.21.15.82:0/3861469061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca40702f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c94004940 tx=0x7f7c94009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 -- 172.21.15.82:0/3861469061 shutdown_connections 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 --2- 172.21.15.82:0/3861469061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca4070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 --2- 172.21.15.82:0/3861469061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca40702f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 -- 172.21.15.82:0/3861469061 >> 172.21.15.82:0/3861469061 conn(0x7f7ca40f8540 msgr2=0x7f7ca40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 -- 172.21.15.82:0/3861469061 shutdown_connections 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.151+0000 7f7ca9874700 1 -- 172.21.15.82:0/3861469061 wait complete. 2024-04-27T07:41:59.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 Processor -- start 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 -- start start 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4110860 con 0x7f7ca4071de0 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca9874700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4110fa0 con 0x7f7ca4070830 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:59.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55454/0 (socket says 172.21.15.82:55454) 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 -- 172.21.15.82:0/2676072266 learned_addr learned my addr 172.21.15.82:0/2676072266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca2ffd700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 -- 172.21.15.82:0/2676072266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 msgr2=0x7f7ca410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca27fc700 1 -- 172.21.15.82:0/2676072266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94005040 con 0x7f7ca4071de0 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.152+0000 7f7ca2ffd700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-27T07:41:59.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7ca27fc700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c98002a50 tx=0x7f7c980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:59.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98007cc0 con 0x7f7ca4071de0 2024-04-27T07:41:59.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4111280 con 0x7f7ca4071de0 2024-04-27T07:41:59.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c9800f040 con 0x7f7ca4071de0 2024-04-27T07:41:59.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9800da30 con 0x7f7ca4071de0 2024-04-27T07:41:59.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.153+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca4111840 con 0x7f7ca4071de0 2024-04-27T07:41:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.154+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca405f5c0 con 0x7f7ca4071de0 2024-04-27T07:41:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.154+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7c9800db90 con 0x7f7ca4071de0 2024-04-27T07:41:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.155+0000 7f7c8b7fe700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 0x7f7c8c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:41:59.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.155+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7c9808e660 con 0x7f7ca4071de0 2024-04-27T07:41:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.155+0000 7f7ca2ffd700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 0x7f7c8c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:41:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.155+0000 7f7ca2ffd700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 0x7f7c8c0710b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c94004890 tx=0x7f7c94009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:41:59.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.160+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7c9805af00 con 0x7f7ca4071de0 2024-04-27T07:41:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:58 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2153143119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:58 smithi082 ceph-mon[91103]: Upgrade: Updating node-exporter.smithi100 (2/2) 2024-04-27T07:41:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:58 smithi082 ceph-mon[91103]: Deploying daemon node-exporter.smithi100 on smithi100 2024-04-27T07:41:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:58 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/4251187589' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:41:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:58 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2153143119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:41:59.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:58 smithi100 ceph-mon[80397]: Upgrade: Updating node-exporter.smithi100 (2/2) 2024-04-27T07:41:59.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:58 smithi100 ceph-mon[80397]: Deploying daemon node-exporter.smithi100 on smithi100 2024-04-27T07:41:59.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:58 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/4251187589' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:41:59.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.444+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ca404bed0 con 0x7f7ca4071de0 2024-04-27T07:41:59.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.444+0000 7f7c8b7fe700 1 -- 172.21.15.82:0/2676072266 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7c9805aa90 con 0x7f7ca4071de0 2024-04-27T07:41:59.447 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:41:59.447 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:41:59.447 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 msgr2=0x7f7c8c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 0x7f7c8c0710b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c94004890 tx=0x7f7c94009e30 comp rx=0 tx=0).stop 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 msgr2=0x7f7ca4110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c98002a50 tx=0x7f7c980046b0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 shutdown_connections 2024-04-27T07:41:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f7c8c06ec00 0x7f7c8c0710b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca4070830 0x7f7ca410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 --2- 172.21.15.82:0/2676072266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ca4071de0 0x7f7ca4110260 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:41:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.446+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 >> 172.21.15.82:0/2676072266 conn(0x7f7ca40f8540 msgr2=0x7f7ca40fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:41:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.447+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 shutdown_connections 2024-04-27T07:41:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:41:59.447+0000 7f7ca9874700 1 -- 172.21.15.82:0/2676072266 wait complete. 2024-04-27T07:42:00.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:59 smithi100 ceph-mon[80397]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:00.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:59 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2676072266' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:42:00.210 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:41:59 smithi100 ceph-mon[80397]: pgmap v236: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-04-27T07:42:00.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:59 smithi082 ceph-mon[91103]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:00.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:59 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2676072266' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:42:00.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:41:59 smithi082 ceph-mon[91103]: pgmap v236: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-04-27T07:42:02.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:02 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:02.594 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:02 smithi082 ceph-mon[91103]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 12 op/s 2024-04-27T07:42:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:02 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:02.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:02 smithi100 ceph-mon[80397]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 12 op/s 2024-04-27T07:42:05.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:05.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:05.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:04 smithi082 ceph-mon[91103]: pgmap v238: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 13 op/s 2024-04-27T07:42:05.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:05.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:05.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:04 smithi100 ceph-mon[80397]: pgmap v238: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 13 op/s 2024-04-27T07:42:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:06.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:05 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:06.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:05 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:07.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:06 smithi100 ceph-mon[80397]: pgmap v239: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 9 op/s 2024-04-27T07:42:07.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:07.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:06 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:06 smithi082 ceph-mon[91103]: pgmap v239: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 9 op/s 2024-04-27T07:42:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:06 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:08.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:08 smithi100 ceph-mon[80397]: pgmap v240: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-27T07:42:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:08 smithi082 ceph-mon[91103]: pgmap v240: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 170 B/s wr, 6 op/s 2024-04-27T07:42:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:09.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:09.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:09.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:10.427 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:10 smithi082 ceph-mon[91103]: pgmap v241: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-27T07:42:10.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:10 smithi100 ceph-mon[80397]: pgmap v241: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 85 B/s wr, 4 op/s 2024-04-27T07:42:11.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:11.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:11.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:12.748 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:12 smithi100 ceph-mon[80397]: pgmap v242: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 718 KiB/s rd, 3 op/s 2024-04-27T07:42:12.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:12 smithi082 ceph-mon[91103]: pgmap v242: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 718 KiB/s rd, 3 op/s 2024-04-27T07:42:13.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:13 smithi082 ceph-mon[91103]: Upgrade: Updating prometheus.smithi082 2024-04-27T07:42:13.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:13 smithi082 ceph-mon[91103]: Deploying daemon prometheus.smithi082 on smithi082 2024-04-27T07:42:13.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:13 smithi100 ceph-mon[80397]: Upgrade: Updating prometheus.smithi082 2024-04-27T07:42:13.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:13 smithi100 ceph-mon[80397]: Deploying daemon prometheus.smithi082 on smithi082 2024-04-27T07:42:14.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:14 smithi082 ceph-mon[91103]: pgmap v243: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T07:42:14.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:14 smithi100 ceph-mon[80397]: pgmap v243: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T07:42:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:16 smithi082 ceph-mon[91103]: pgmap v244: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:17.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:16 smithi100 ceph-mon[80397]: pgmap v244: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:19.154 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:18 smithi082 ceph-mon[91103]: pgmap v245: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:19.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:19.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:19.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:18 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:18 smithi100 ceph-mon[80397]: pgmap v245: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:19.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:19.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:18 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:21.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:20 smithi082 ceph-mon[91103]: pgmap v246: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:21.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:20 smithi100 ceph-mon[80397]: pgmap v246: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:22 smithi100 ceph-mon[80397]: pgmap v247: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:22 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:23.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:22 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:22 smithi082 ceph-mon[91103]: pgmap v247: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:22 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:22 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:25.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:24 smithi082 ceph-mon[91103]: pgmap v248: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:25.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:24 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:25.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:24 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:24 smithi100 ceph-mon[80397]: pgmap v248: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:24 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:25.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:24 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:27.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:26 smithi082 ceph-mon[91103]: pgmap v249: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:26 smithi100 ceph-mon[80397]: pgmap v249: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:42:28.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:28 smithi082 ceph-mon[91103]: pgmap v250: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:28.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.918 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:28.919 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:28 smithi100 ceph-mon[80397]: pgmap v250: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 -- 172.21.15.82:0/1160185840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 msgr2=0x7f93000fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 --2- 172.21.15.82:0/1160185840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f93000fd460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92f0004940 tx=0x7f92f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 -- 172.21.15.82:0/1160185840 shutdown_connections 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 --2- 172.21.15.82:0/1160185840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f93000fd460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 --2- 172.21.15.82:0/1160185840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f93000fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 -- 172.21.15.82:0/1160185840 >> 172.21.15.82:0/1160185840 conn(0x7f93000f74c0 msgr2=0x7f93000f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 -- 172.21.15.82:0/1160185840 shutdown_connections 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.554+0000 7f9304f24700 1 -- 172.21.15.82:0/1160185840 wait complete. 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 Processor -- start 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 -- start start 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f930010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930010e580 con 0x7f93000fcff0 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f9304f24700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930010ed80 con 0x7f93000fbd40 2024-04-27T07:42:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35708/0 (socket says 172.21.15.82:35708) 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 -- 172.21.15.82:0/4044274456 learned_addr learned my addr 172.21.15.82:0/4044274456 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fe59c700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f930010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 -- 172.21.15.82:0/4044274456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 msgr2=0x7f930010da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f930010da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fdd9b700 1 -- 172.21.15.82:0/4044274456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0005040 con 0x7f93000fcff0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.555+0000 7f92fe59c700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f930010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f92fdd9b700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f92f000b3b0 tx=0x7f92f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f000e040 con 0x7f93000fcff0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92f000bcc0 con 0x7f93000fcff0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930010f000 con 0x7f93000fcff0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f001c630 con 0x7f93000fcff0 2024-04-27T07:42:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.556+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930010f540 con 0x7f93000fcff0 2024-04-27T07:42:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.557+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9300101b80 con 0x7f93000fcff0 2024-04-27T07:42:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.557+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f92f0013980 con 0x7f93000fcff0 2024-04-27T07:42:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.558+0000 7f92eeffd700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 0x7f92e80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.558+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f92f008f5c0 con 0x7f93000fcff0 2024-04-27T07:42:29.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.558+0000 7f92fe59c700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 0x7f92e80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.558+0000 7f92fe59c700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 0x7f92e80710b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92f40041d0 tx=0x7f92f4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:29.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.563+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f92f005be60 con 0x7f93000fcff0 2024-04-27T07:42:29.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.798+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f930010f820 con 0x7f92e806ec00 2024-04-27T07:42:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.800+0000 7f92eeffd700 1 -- 172.21.15.82:0/4044274456 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f930010f820 con 0x7f92e806ec00 2024-04-27T07:42:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 msgr2=0x7f92e80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 0x7f92e80710b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92f40041d0 tx=0x7f92f4009040 comp rx=0 tx=0).stop 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 msgr2=0x7f930010df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f92f000b3b0 tx=0x7f92f0009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 shutdown_connections 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f92e806ec00 0x7f92e80710b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93000fbd40 0x7f930010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 --2- 172.21.15.82:0/4044274456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93000fcff0 0x7f930010df80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 >> 172.21.15.82:0/4044274456 conn(0x7f93000f74c0 msgr2=0x7f9300066430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 shutdown_connections 2024-04-27T07:42:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.802+0000 7f9304f24700 1 -- 172.21.15.82:0/4044274456 wait complete. 2024-04-27T07:42:29.814 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:42:29.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 -- 172.21.15.82:0/2436226561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fcda0 msgr2=0x7f4a740fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 --2- 172.21.15.82:0/2436226561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fcda0 0x7f4a740fd210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a68004940 tx=0x7f4a68009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 -- 172.21.15.82:0/2436226561 shutdown_connections 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 --2- 172.21.15.82:0/2436226561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fcda0 0x7f4a740fd210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 --2- 172.21.15.82:0/2436226561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fbaf0 0x7f4a740fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 -- 172.21.15.82:0/2436226561 >> 172.21.15.82:0/2436226561 conn(0x7f4a740f7250 msgr2=0x7f4a740f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 -- 172.21.15.82:0/2436226561 shutdown_connections 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 -- 172.21.15.82:0/2436226561 wait complete. 2024-04-27T07:42:29.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.906+0000 7f4a797a2700 1 Processor -- start 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a797a2700 1 -- start start 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a797a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a797a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 0x7f4a74112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a797a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74066350 con 0x7f4a740fbaf0 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a797a2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74066490 con 0x7f4a740fcda0 2024-04-27T07:42:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35726/0 (socket says 172.21.15.82:35726) 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 -- 172.21.15.82:0/542978844 learned_addr learned my addr 172.21.15.82:0/542978844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a737fe700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 0x7f4a74112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 -- 172.21.15.82:0/542978844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 msgr2=0x7f4a74112a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 0x7f4a74112a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 -- 172.21.15.82:0/542978844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68005040 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a737fe700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 0x7f4a74112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.907+0000 7f4a73fff700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a64002a80 tx=0x7f4a640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.908+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a64007cc0 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.908+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74112fb0 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.908+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a6400f040 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.908+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a640096f0 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.908+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74113540 con 0x7f4a740fbaf0 2024-04-27T07:42:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.909+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7405f5c0 con 0x7f4a740fbaf0 2024-04-27T07:42:29.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.909+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4a6400d690 con 0x7f4a740fbaf0 2024-04-27T07:42:29.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.909+0000 7f4a70ff9700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 0x7f4a5c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:29.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.910+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4a6408e040 con 0x7f4a740fbaf0 2024-04-27T07:42:29.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.910+0000 7f4a737fe700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 0x7f4a5c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:29.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.910+0000 7f4a737fe700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 0x7f4a5c0710c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800b3b0 tx=0x7f4a68009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:29.914+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4a64056df0 con 0x7f4a740fbaf0 2024-04-27T07:42:30.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.141+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a741010c0 con 0x7f4a5c06ec10 2024-04-27T07:42:30.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.143+0000 7f4a70ff9700 1 -- 172.21.15.82:0/542978844 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f4a741010c0 con 0x7f4a5c06ec10 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 msgr2=0x7f4a5c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 0x7f4a5c0710c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800b3b0 tx=0x7f4a68009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 msgr2=0x7f4a741104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a64002a80 tx=0x7f4a640046b0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 shutdown_connections 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a5c06ec10 0x7f4a5c0710c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a740fbaf0 0x7f4a741104c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 --2- 172.21.15.82:0/542978844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a740fcda0 0x7f4a74112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 >> 172.21.15.82:0/542978844 conn(0x7f4a740f7250 msgr2=0x7f4a740f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 shutdown_connections 2024-04-27T07:42:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.146+0000 7f4a797a2700 1 -- 172.21.15.82:0/542978844 wait complete. 2024-04-27T07:42:30.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.246+0000 7fc56f1c6700 1 -- 172.21.15.82:0/3714995173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fdfd0 msgr2=0x7fc5680fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.246+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/3714995173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fdfd0 0x7fc5680fe440 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc554004940 tx=0x7fc554009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- 172.21.15.82:0/3714995173 shutdown_connections 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/3714995173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fdfd0 0x7fc5680fe440 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/3714995173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fce60 0x7fc5680fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- 172.21.15.82:0/3714995173 >> 172.21.15.82:0/3714995173 conn(0x7fc5680f8540 msgr2=0x7fc5680fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- 172.21.15.82:0/3714995173 shutdown_connections 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- 172.21.15.82:0/3714995173 wait complete. 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 Processor -- start 2024-04-27T07:42:30.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- start start 2024-04-27T07:42:30.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fdfd0 0x7fc568110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568110710 con 0x7fc5680fce60 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.247+0000 7fc56f1c6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681150b0 con 0x7fc5680fdfd0 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35734/0 (socket says 172.21.15.82:35734) 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 -- 172.21.15.82:0/2850237161 learned_addr learned my addr 172.21.15.82:0/2850237161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc567fff700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fdfd0 0x7fc568110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 -- 172.21.15.82:0/2850237161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fdfd0 msgr2=0x7fc568110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fdfd0 0x7fc568110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 -- 172.21.15.82:0/2850237161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc554005040 con 0x7fc5680fce60 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56cf62700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00b790 tx=0x7fc55c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55c00f6f0 con 0x7fc5680fce60 2024-04-27T07:42:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc55c00fd20 con 0x7fc5680fce60 2024-04-27T07:42:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568115310 con 0x7fc5680fce60 2024-04-27T07:42:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55c0103a0 con 0x7fc5680fce60 2024-04-27T07:42:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.248+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568115880 con 0x7fc5680fce60 2024-04-27T07:42:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.249+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc568101960 con 0x7fc5680fce60 2024-04-27T07:42:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.250+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc55c011400 con 0x7fc5680fce60 2024-04-27T07:42:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.250+0000 7fc5657fa700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 0x7fc5580710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.250+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc55c08e6b0 con 0x7fc5680fce60 2024-04-27T07:42:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.250+0000 7fc567fff700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 0x7fc5580710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.251+0000 7fc567fff700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 0x7fc5580710b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b3b0 tx=0x7fc554009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.255+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc55c05b010 con 0x7fc5680fce60 2024-04-27T07:42:30.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.473+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc56802b3b0 con 0x7fc55806ec00 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.483+0000 7fc5657fa700 1 -- 172.21.15.82:0/2850237161 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc56802b3b0 con 0x7fc55806ec00 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (8m) 7s ago 17m 24.8M - 0.25.0 c8568f914cd2 01797cfd22b2 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 7s ago 17m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (6m) 26s ago 16m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (8m) 7s ago 17m 84.7M - 9.4.7 954c08fa6188 42f55b4e44f4 2024-04-27T07:42:30.486 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (84s) 7s ago 11m 17.3M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (111s) 7s ago 12m 66.0M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (46s) 26s ago 11m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 493ac111fafd 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (63s) 26s ago 11m 62.8M - 19.0.0-3227-gc37f63b3 d1033e293654 0c17286fc3ca 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (8m) 7s ago 18m 513M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (7m) 26s ago 16m 453M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 7s ago 19m 58.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (6m) 26s ago 16m 38.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (33s) 7s ago 17m 7574k - 1.5.0 0da6a335fe13 de4abb622e61 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (29s) 26s ago 16m 3632k - 1.5.0 0da6a335fe13 8348b365d48e 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 7s ago 15m 99.5M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 7s ago 15m 104M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (4m) 7s ago 14m 80.9M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:42:30.487 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (3m) 26s ago 14m 102M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (3m) 26s ago 13m 99.8M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (2m) 26s ago 13m 87.6M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (12s) 7s ago 16m 43.8M - 2.43.0 a07b618ecd1d 2b5229c4dba5 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.485+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 msgr2=0x7fc5580710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.485+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 0x7fc5580710b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc55400b3b0 tx=0x7fc554009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.485+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 msgr2=0x7fc56810fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.485+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00b790 tx=0x7fc55c009250 comp rx=0 tx=0).stop 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 shutdown_connections 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc55806ec00 0x7fc5580710b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680fce60 0x7fc56810fb40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 --2- 172.21.15.82:0/2850237161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5680fdfd0 0x7fc568110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 >> 172.21.15.82:0/2850237161 conn(0x7fc5680f8540 msgr2=0x7fc5680f9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 shutdown_connections 2024-04-27T07:42:30.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.486+0000 7fc56f1c6700 1 -- 172.21.15.82:0/2850237161 wait complete. 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 -- 172.21.15.82:0/1074634841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 msgr2=0x7f97f00fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1074634841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f00fd280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f97e0004940 tx=0x7f97e0009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 -- 172.21.15.82:0/1074634841 shutdown_connections 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1074634841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 0x7f97f00fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1074634841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f00fd280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 -- 172.21.15.82:0/1074634841 >> 172.21.15.82:0/1074634841 conn(0x7f97f00f8550 msgr2=0x7f97f00fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 -- 172.21.15.82:0/1074634841 shutdown_connections 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.585+0000 7f97f6a45700 1 -- 172.21.15.82:0/1074634841 wait complete. 2024-04-27T07:42:30.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 Processor -- start 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 -- start start 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 0x7f97f010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f010e400 con 0x7f97f00fce70 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97f6a45700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f010e570 con 0x7f97f00fdfe0 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97effff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35760/0 (socket says 172.21.15.82:35760) 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97effff700 1 -- 172.21.15.82:0/1641971720 learned_addr learned my addr 172.21.15.82:0/1641971720 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.586+0000 7f97ef7fe700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 0x7f97f010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97effff700 1 -- 172.21.15.82:0/1641971720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 msgr2=0x7f97f010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97effff700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 0x7f97f010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97effff700 1 -- 172.21.15.82:0/1641971720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0005040 con 0x7f97f00fce70 2024-04-27T07:42:30.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97effff700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97e0013870 tx=0x7f97e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e0021070 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97e0009430 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f0112f70 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e000e070 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.587+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f0113420 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.588+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f004c710 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.588+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f97e001c750 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.589+0000 7f97ecff9700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 0x7f97d8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.589+0000 7f97ef7fe700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 0x7f97d8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.589+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f97e008f9c0 con 0x7f97f00fce70 2024-04-27T07:42:30.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.589+0000 7f97ef7fe700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 0x7f97d8071050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009b80 tx=0x7f97e400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:30.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.594+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f97e005c320 con 0x7f97f00fce70 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.888+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97f01139d0 con 0x7f97f00fce70 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.889+0000 7f97ecff9700 1 -- 172.21.15.82:0/1641971720 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f97e005beb0 con 0x7f97f00fce70 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:42:30.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 14 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:42:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:42:30.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 msgr2=0x7f97d8071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 0x7f97d8071050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009b80 tx=0x7f97e400b040 comp rx=0 tx=0).stop 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 msgr2=0x7f97f010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97e0013870 tx=0x7f97e0009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 shutdown_connections 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97d806eba0 0x7f97d8071050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97f00fce70 0x7f97f010d8c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 --2- 172.21.15.82:0/1641971720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97f00fdfe0 0x7f97f010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 >> 172.21.15.82:0/1641971720 conn(0x7f97f00f8550 msgr2=0x7f97f00f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 shutdown_connections 2024-04-27T07:42:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.891+0000 7f97f6a45700 1 -- 172.21.15.82:0/1641971720 wait complete. 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 -- 172.21.15.82:0/3083076742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fcf60 msgr2=0x7f17780fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 --2- 172.21.15.82:0/3083076742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fcf60 0x7f17780fd3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f176c004940 tx=0x7f176c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 -- 172.21.15.82:0/3083076742 shutdown_connections 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 --2- 172.21.15.82:0/3083076742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fcf60 0x7f17780fd3d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 --2- 172.21.15.82:0/3083076742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fbcb0 0x7f17780fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 -- 172.21.15.82:0/3083076742 >> 172.21.15.82:0/3083076742 conn(0x7f17780f7450 msgr2=0x7f17780f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 -- 172.21.15.82:0/3083076742 shutdown_connections 2024-04-27T07:42:30.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.993+0000 7f177cab4700 1 -- 172.21.15.82:0/3083076742 wait complete. 2024-04-27T07:42:30.996 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:30 smithi082 ceph-mon[91103]: Upgrade: Updating alertmanager.smithi082 2024-04-27T07:42:30.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:30 smithi082 ceph-mon[91103]: Deploying daemon alertmanager.smithi082 on smithi082 2024-04-27T07:42:30.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:30 smithi082 ceph-mon[91103]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:30.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:30 smithi082 ceph-mon[91103]: pgmap v251: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:30.997 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:30 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1641971720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 Processor -- start 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 -- start start 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 0x7f1778114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778114a50 con 0x7f17780fbcb0 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177cab4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778114bc0 con 0x7f17780fcf60 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35784/0 (socket says 172.21.15.82:35784) 2024-04-27T07:42:30.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 -- 172.21.15.82:0/3081360096 learned_addr learned my addr 172.21.15.82:0/3081360096 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 -- 172.21.15.82:0/3081360096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 msgr2=0x7f1778114450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f1775d9b700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 0x7f1778114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 0x7f1778114450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 -- 172.21.15.82:0/3081360096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c005040 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f1775d9b700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 0x7f1778114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.994+0000 7f177659c700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1768002a50 tx=0x7f17680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.995+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1768007cc0 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.995+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1778119620 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.995+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f176800f040 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.995+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1768009640 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.995+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1778119be0 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.996+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17781018f0 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.996+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f17680097a0 con 0x7f17780fbcb0 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.997+0000 7f1766ffd700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 0x7f17600710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.997+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f176808e680 con 0x7f17780fbcb0 2024-04-27T07:42:31.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.997+0000 7f1775d9b700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 0x7f17600710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:30.997+0000 7f1775d9b700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 0x7f17600710b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f176c00b970 tx=0x7f176c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.001+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f176805af60 con 0x7f17780fbcb0 2024-04-27T07:42:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:30 smithi100 ceph-mon[80397]: Upgrade: Updating alertmanager.smithi082 2024-04-27T07:42:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:30 smithi100 ceph-mon[80397]: Deploying daemon alertmanager.smithi082 on smithi082 2024-04-27T07:42:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:30 smithi100 ceph-mon[80397]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:30 smithi100 ceph-mon[80397]: pgmap v251: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:31.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:30 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1641971720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.252+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f177802b340 con 0x7f17780fbcb0 2024-04-27T07:42:31.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.253+0000 7f1766ffd700 1 -- 172.21.15.82:0/3081360096 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f176805aaf0 con 0x7f17780fbcb0 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:e43 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 43 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:41:52.485728+0000 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:42:31.256 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 83 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34444,1=34476} 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:42:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34444 members: 34444,34476 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:34444} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{0:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{1:34476} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:42:31.258 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 msgr2=0x7f17600710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 0x7f17600710b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f176c00b970 tx=0x7f176c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 msgr2=0x7f1778113f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1768002a50 tx=0x7f17680046b0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 shutdown_connections 2024-04-27T07:42:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f176006ec00 0x7f17600710b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17780fbcb0 0x7f1778113f10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 --2- 172.21.15.82:0/3081360096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17780fcf60 0x7f1778114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 >> 172.21.15.82:0/3081360096 conn(0x7f17780f7450 msgr2=0x7f17780f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 shutdown_connections 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.255+0000 7f177cab4700 1 -- 172.21.15.82:0/3081360096 wait complete. 2024-04-27T07:42:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- 172.21.15.82:0/2418363782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 msgr2=0x7fda1c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 --2- 172.21.15.82:0/2418363782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c0fc0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fda0c004940 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- 172.21.15.82:0/2418363782 shutdown_connections 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 --2- 172.21.15.82:0/2418363782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 0x7fda1c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 --2- 172.21.15.82:0/2418363782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c0fc0c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- 172.21.15.82:0/2418363782 >> 172.21.15.82:0/2418363782 conn(0x7fda1c0f7430 msgr2=0x7fda1c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- 172.21.15.82:0/2418363782 shutdown_connections 2024-04-27T07:42:31.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- 172.21.15.82:0/2418363782 wait complete. 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 Processor -- start 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.358+0000 7fda2098a700 1 -- start start 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 0x7fda1c112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c066330 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c066470 con 0x7fda1c0fcf60 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35800/0 (socket says 172.21.15.82:35800) 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 -- 172.21.15.82:0/1322088072 learned_addr learned my addr 172.21.15.82:0/1322088072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda19d9b700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 0x7fda1c112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 -- 172.21.15.82:0/1322088072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 msgr2=0x7fda1c112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 0x7fda1c112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 -- 172.21.15.82:0/1322088072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c005040 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda1a59c700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009150 tx=0x7fda0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c00e040 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c1131b0 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0c00bbf0 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c01c630 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.359+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c113770 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.360+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c05f5c0 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.361+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fda0c00bd60 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.361+0000 7fda0affd700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 0x7fda040710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.361+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fda0c08fbc0 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.361+0000 7fda19d9b700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 0x7fda040710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.362+0000 7fda19d9b700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 0x7fda040710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda10004f40 tx=0x7fda1000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.366+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fda0c0589f0 con 0x7fda1c0fbcb0 2024-04-27T07:42:31.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.589+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1c1012c0 con 0x7fda0406ec10 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.591+0000 7fda0affd700 1 -- 172.21.15.82:0/1322088072 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fda1c1012c0 con 0x7fda0406ec10 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:42:31.593 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "16/21 daemons upgraded", 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:42:31.594 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 msgr2=0x7fda040710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 0x7fda040710c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda10004f40 tx=0x7fda1000b040 comp rx=0 tx=0).stop 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 msgr2=0x7fda1c110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009150 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 shutdown_connections 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fda0406ec10 0x7fda040710c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda1c0fbcb0 0x7fda1c110720 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 --2- 172.21.15.82:0/1322088072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c0fcf60 0x7fda1c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 >> 172.21.15.82:0/1322088072 conn(0x7fda1c0f7430 msgr2=0x7fda1c0f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 shutdown_connections 2024-04-27T07:42:31.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.593+0000 7fda2098a700 1 -- 172.21.15.82:0/1322088072 wait complete. 2024-04-27T07:42:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 -- 172.21.15.82:0/2379424887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 msgr2=0x7fc7440fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 --2- 172.21.15.82:0/2379424887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc7440fd3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc72c004940 tx=0x7fc72c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 -- 172.21.15.82:0/2379424887 shutdown_connections 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 --2- 172.21.15.82:0/2379424887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc7440fd3d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 --2- 172.21.15.82:0/2379424887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 0x7fc7440fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 -- 172.21.15.82:0/2379424887 >> 172.21.15.82:0/2379424887 conn(0x7fc7440f7430 msgr2=0x7fc7440f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 -- 172.21.15.82:0/2379424887 shutdown_connections 2024-04-27T07:42:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.696+0000 7fc749774700 1 -- 172.21.15.82:0/2379424887 wait complete. 2024-04-27T07:42:31.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 Processor -- start 2024-04-27T07:42:31.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 -- start start 2024-04-27T07:42:31.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 0x7fc744112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744066220 con 0x7fc7440fcf60 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc749774700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744066360 con 0x7fc7440fbcb0 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc73a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc73a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35810/0 (socket says 172.21.15.82:35810) 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc742ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 0x7fc744112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.697+0000 7fc73a7fc700 1 -- 172.21.15.82:0/1031113196 learned_addr learned my addr 172.21.15.82:0/1031113196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73a7fc700 1 -- 172.21.15.82:0/1031113196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 msgr2=0x7fc744112ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73a7fc700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 0x7fc744112ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73a7fc700 1 -- 172.21.15.82:0/1031113196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c005040 con 0x7fc7440fcf60 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73a7fc700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc72c013870 tx=0x7fc72c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc72c021070 con 0x7fc7440fcf60 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc744115550 con 0x7fc7440fcf60 2024-04-27T07:42:31.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc72c009430 con 0x7fc7440fcf60 2024-04-27T07:42:31.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc72c00e070 con 0x7fc7440fcf60 2024-04-27T07:42:31.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.698+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7441158a0 con 0x7fc7440fcf60 2024-04-27T07:42:31.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.699+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74405f5c0 con 0x7fc7440fcf60 2024-04-27T07:42:31.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.700+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc72c01c750 con 0x7fc7440fcf60 2024-04-27T07:42:31.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.700+0000 7fc73bfff700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 0x7fc730071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:42:31.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.700+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc72c08f9c0 con 0x7fc7440fcf60 2024-04-27T07:42:31.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.700+0000 7fc742ffd700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 0x7fc730071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:42:31.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.701+0000 7fc742ffd700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 0x7fc730071040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc744065fb0 tx=0x7fc73400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:42:31.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.705+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc72c0587f0 con 0x7fc7440fcf60 2024-04-27T07:42:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.998+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc74404bed0 con 0x7fc7440fcf60 2024-04-27T07:42:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:31.998+0000 7fc73bfff700 1 -- 172.21.15.82:0/1031113196 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc72c05beb0 con 0x7fc7440fcf60 2024-04-27T07:42:32.001 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:42:32.001 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:42:32.001 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.000+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 msgr2=0x7fc730071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.000+0000 7fc749774700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 0x7fc730071040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc744065fb0 tx=0x7fc73400b040 comp rx=0 tx=0).stop 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.000+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 msgr2=0x7fc744115010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.000+0000 7fc749774700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc72c013870 tx=0x7fc72c009e30 comp rx=0 tx=0).stop 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 shutdown_connections 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc73006eb90 0x7fc730071040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7440fbcb0 0x7fc744112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 --2- 172.21.15.82:0/1031113196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7440fcf60 0x7fc744115010 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:42:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 >> 172.21.15.82:0/1031113196 conn(0x7fc7440f7430 msgr2=0x7fc7440f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:42:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 shutdown_connections 2024-04-27T07:42:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:42:32.001+0000 7fc749774700 1 -- 172.21.15.82:0/1031113196 wait complete. 2024-04-27T07:42:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:31 smithi100 ceph-mon[80397]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:31 smithi100 ceph-mon[80397]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:32.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:31 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3081360096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:42:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:31 smithi082 ceph-mon[91103]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:31 smithi082 ceph-mon[91103]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:31 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3081360096' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:42:33.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:32 smithi082 ceph-mon[91103]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:33.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:32 smithi082 ceph-mon[91103]: pgmap v252: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:33.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:32 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1031113196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:42:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:32 smithi100 ceph-mon[80397]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:42:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:32 smithi100 ceph-mon[80397]: pgmap v252: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:33.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:32 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1031113196' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:42:35.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:34 smithi100 ceph-mon[80397]: pgmap v253: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:34 smithi082 ceph-mon[91103]: pgmap v253: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:36 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:36 smithi082 ceph-mon[91103]: pgmap v254: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:36 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:36 smithi100 ceph-mon[80397]: pgmap v254: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:39.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:38 smithi100 ceph-mon[80397]: pgmap v255: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:39.180 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:38 smithi082 ceph-mon[91103]: pgmap v255: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:40 smithi082 ceph-mon[91103]: pgmap v256: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:41.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:40 smithi100 ceph-mon[80397]: pgmap v256: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:42.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:42.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:43.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:42 smithi082 ceph-mon[91103]: pgmap v257: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:43.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:42 smithi100 ceph-mon[80397]: pgmap v257: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:45.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.169 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:44 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.247 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.248 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:45.249 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:44 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:42:46.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:45 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:42:46.170 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:45 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:42:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:45 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-27T07:42:46.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:45 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082:9093"}]: dispatch 2024-04-27T07:42:47.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:46 smithi100 ceph-mon[80397]: pgmap v259: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:46 smithi082 ceph-mon[91103]: pgmap v259: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:47 smithi082 ceph-mon[91103]: Upgrade: Updating grafana.smithi082 2024-04-27T07:42:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:47 smithi082 ceph-mon[91103]: Deploying daemon grafana.smithi082 on smithi082 2024-04-27T07:42:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:47 smithi100 ceph-mon[80397]: Upgrade: Updating grafana.smithi082 2024-04-27T07:42:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:47 smithi100 ceph-mon[80397]: Deploying daemon grafana.smithi082 on smithi082 2024-04-27T07:42:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:48 smithi082 ceph-mon[91103]: pgmap v260: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:48 smithi100 ceph-mon[80397]: pgmap v260: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:50 smithi082 ceph-mon[91103]: pgmap v261: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:50 smithi100 ceph-mon[80397]: pgmap v261: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:42:53.220 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:52 smithi100 ceph-mon[80397]: pgmap v262: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:53.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:52 smithi082 ceph-mon[91103]: pgmap v262: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:42:55.271 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:54 smithi082 ceph-mon[91103]: pgmap v263: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:54 smithi100 ceph-mon[80397]: pgmap v263: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:42:56.271 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:42:57.289 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:56 smithi082 ceph-mon[91103]: pgmap v264: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:56 smithi100 ceph-mon[80397]: pgmap v264: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:42:59.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:58 smithi082 ceph-mon[91103]: pgmap v265: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:59.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:59.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:59.324 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:42:58 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:42:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:58 smithi100 ceph-mon[80397]: pgmap v265: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:42:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:42:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:42:58 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:00 smithi082 ceph-mon[91103]: pgmap v266: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:00 smithi100 ceph-mon[80397]: pgmap v266: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 -- 172.21.15.82:0/1280028799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fe420 msgr2=0x7fc08c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 --2- 172.21.15.82:0/1280028799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fe420 0x7fc08c0fe830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc084009ce0 tx=0x7fc084004d10 comp rx=0 tx=0).stop 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 -- 172.21.15.82:0/1280028799 shutdown_connections 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 --2- 172.21.15.82:0/1280028799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fed70 0x7fc08c0faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 --2- 172.21.15.82:0/1280028799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fe420 0x7fc08c0fe830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 -- 172.21.15.82:0/1280028799 >> 172.21.15.82:0/1280028799 conn(0x7fc08c0f6be0 msgr2=0x7fc08c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 -- 172.21.15.82:0/1280028799 shutdown_connections 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.110+0000 7fc091b1f700 1 -- 172.21.15.82:0/1280028799 wait complete. 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 Processor -- start 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 -- start start 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fe420 0x7fc08c10da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c10e620 con 0x7fc08c0fed70 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc091b1f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c112fc0 con 0x7fc08c0fe420 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc08affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc08affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36016/0 (socket says 172.21.15.82:36016) 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.111+0000 7fc08affd700 1 -- 172.21.15.82:0/2859827831 learned_addr learned my addr 172.21.15.82:0/2859827831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc08b7fe700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fe420 0x7fc08c10da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc08affd700 1 -- 172.21.15.82:0/2859827831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fe420 msgr2=0x7fc08c10da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc08affd700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fe420 0x7fc08c10da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc08affd700 1 -- 172.21.15.82:0/2859827831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009940 con 0x7fc08c0fed70 2024-04-27T07:43:02.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc08affd700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc07400b790 tx=0x7fc074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07400f6f0 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc07400fd20 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c113220 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0740103a0 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.112+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c113790 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.113+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c04c710 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.114+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc074011400 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.114+0000 7fc083fff700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 0x7fc0780710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.114+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc07408e6b0 con 0x7fc08c0fed70 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.114+0000 7fc08b7fe700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 0x7fc0780710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.115+0000 7fc08b7fe700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 0x7fc0780710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc084015040 tx=0x7fc084004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.119+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc07405b010 con 0x7fc08c0fed70 2024-04-27T07:43:02.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.348+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc08c102410 con 0x7fc07806ec00 2024-04-27T07:43:02.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.349+0000 7fc083fff700 1 -- 172.21.15.82:0/2859827831 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fc08c102410 con 0x7fc07806ec00 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 msgr2=0x7fc0780710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 0x7fc0780710b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc084015040 tx=0x7fc084004d10 comp rx=0 tx=0).stop 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 msgr2=0x7fc08c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc07400b790 tx=0x7fc074009250 comp rx=0 tx=0).stop 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 shutdown_connections 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc07806ec00 0x7fc0780710b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc08c0fe420 0x7fc08c10da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 --2- 172.21.15.82:0/2859827831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c0fed70 0x7fc08c10df90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 >> 172.21.15.82:0/2859827831 conn(0x7fc08c0f6be0 msgr2=0x7fc08c0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:02.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 shutdown_connections 2024-04-27T07:43:02.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.351+0000 7fc091b1f700 1 -- 172.21.15.82:0/2859827831 wait complete. 2024-04-27T07:43:02.364 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- 172.21.15.82:0/199115356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fcf60 msgr2=0x7f58340fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 --2- 172.21.15.82:0/199115356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fcf60 0x7f58340fd3d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f581c004940 tx=0x7f581c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- 172.21.15.82:0/199115356 shutdown_connections 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 --2- 172.21.15.82:0/199115356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fcf60 0x7f58340fd3d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 --2- 172.21.15.82:0/199115356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fbcb0 0x7f58340fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- 172.21.15.82:0/199115356 >> 172.21.15.82:0/199115356 conn(0x7f58340f7430 msgr2=0x7f58340f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- 172.21.15.82:0/199115356 shutdown_connections 2024-04-27T07:43:02.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- 172.21.15.82:0/199115356 wait complete. 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 Processor -- start 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.453+0000 7f5838822700 1 -- start start 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5838822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5838822700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 0x7f583410ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5838822700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583410d470 con 0x7f58340fbcb0 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5838822700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583410dcc0 con 0x7f58340fcf60 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36038/0 (socket says 172.21.15.82:36038) 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 -- 172.21.15.82:0/313284012 learned_addr learned my addr 172.21.15.82:0/313284012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5831d9b700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 0x7f583410ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 -- 172.21.15.82:0/313284012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 msgr2=0x7f583410ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 0x7f583410ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 -- 172.21.15.82:0/313284012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c005040 con 0x7f58340fbcb0 2024-04-27T07:43:02.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5831d9b700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 0x7f583410ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f583259c700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f582c00cb10 tx=0x7f582c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c004200 con 0x7f58340fbcb0 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f582c00acc0 con 0x7f58340fbcb0 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c003d90 con 0x7f58340fbcb0 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.454+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583410dfa0 con 0x7f58340fbcb0 2024-04-27T07:43:02.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.455+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583410e4e0 con 0x7f58340fbcb0 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.455+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583405f5c0 con 0x7f58340fbcb0 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.456+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f582c003430 con 0x7f58340fbcb0 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.456+0000 7f582affd700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 0x7f58200710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.457+0000 7f5831d9b700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 0x7f58200710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.457+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f582c08edc0 con 0x7f58340fbcb0 2024-04-27T07:43:02.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.457+0000 7f5831d9b700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 0x7f58200710b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b970 tx=0x7f581c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.461+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f582c05b720 con 0x7f58340fbcb0 2024-04-27T07:43:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.702+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f583410e8c0 con 0x7f582006ec00 2024-04-27T07:43:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.704+0000 7f582affd700 1 -- 172.21.15.82:0/313284012 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f583410e8c0 con 0x7f582006ec00 2024-04-27T07:43:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 msgr2=0x7f58200710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 0x7f58200710b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b970 tx=0x7f581c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 msgr2=0x7f583410c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f582c00cb10 tx=0x7f582c007f70 comp rx=0 tx=0).stop 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 shutdown_connections 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f582006ec00 0x7f58200710b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58340fbcb0 0x7f583410c930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 --2- 172.21.15.82:0/313284012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58340fcf60 0x7f583410ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 >> 172.21.15.82:0/313284012 conn(0x7f58340f7430 msgr2=0x7f58340f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 shutdown_connections 2024-04-27T07:43:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.706+0000 7f5838822700 1 -- 172.21.15.82:0/313284012 wait complete. 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.808+0000 7fa70bb82700 1 -- 172.21.15.82:0/4080703086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 msgr2=0x7fa704102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.808+0000 7fa70bb82700 1 --2- 172.21.15.82:0/4080703086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa704102390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4004940 tx=0x7fa6f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- 172.21.15.82:0/4080703086 shutdown_connections 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 --2- 172.21.15.82:0/4080703086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa704102390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 --2- 172.21.15.82:0/4080703086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 0x7fa7040ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- 172.21.15.82:0/4080703086 >> 172.21.15.82:0/4080703086 conn(0x7fa7040f7420 msgr2=0x7fa7040f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- 172.21.15.82:0/4080703086 shutdown_connections 2024-04-27T07:43:02.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- 172.21.15.82:0/4080703086 wait complete. 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 Processor -- start 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- start start 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 0x7fa7040fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041116c0 con 0x7fa7040fffb0 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.809+0000 7fa70bb82700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704111830 con 0x7fa704066a90 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36050/0 (socket says 172.21.15.82:36050) 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 -- 172.21.15.82:0/73988991 learned_addr learned my addr 172.21.15.82:0/73988991 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:02.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70991e700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 0x7fa7040fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 -- 172.21.15.82:0/73988991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 msgr2=0x7fa7040fd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 0x7fa7040fd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 -- 172.21.15.82:0/73988991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4005040 con 0x7fa7040fffb0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70911d700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009fd0 tx=0x7fa6f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f400e040 con 0x7fa7040fffb0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7040fbf70 con 0x7fa7040fffb0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6f400bbf0 con 0x7fa7040fffb0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f401c650 con 0x7fa7040fffb0 2024-04-27T07:43:02.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.810+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7040fc4e0 con 0x7fa7040fffb0 2024-04-27T07:43:02.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.812+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7041060c0 con 0x7fa7040fffb0 2024-04-27T07:43:02.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.812+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa6f400bd60 con 0x7fa7040fffb0 2024-04-27T07:43:02.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.812+0000 7fa6fa7fc700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 0x7fa6f00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:02.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.813+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa6f408fa70 con 0x7fa7040fffb0 2024-04-27T07:43:02.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.813+0000 7fa70991e700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 0x7fa6f00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:02.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.813+0000 7fa70991e700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 0x7fa6f00710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7040fd230 tx=0x7fa70000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:02.822+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa6f4058960 con 0x7fa7040fffb0 2024-04-27T07:43:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.036+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa704105a60 con 0x7fa6f006ec10 2024-04-27T07:43:03.039 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:02 smithi082 ceph-mon[91103]: pgmap v267: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:03.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.046+0000 7fa6fa7fc700 1 -- 172.21.15.82:0/73988991 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa70000f040 con 0x7fa6f006ec10 2024-04-27T07:43:03.048 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:43:03.048 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (28s) 23s ago 17m 15.1M - 0.25.0 c8568f914cd2 9345c8c0d306 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 23s ago 18m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (6m) 59s ago 17m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 starting - - - - 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (117s) 23s ago 12m 17.8M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (2m) 23s ago 12m 66.1M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (79s) 59s ago 12m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 493ac111fafd 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (95s) 59s ago 12m 62.8M - 19.0.0-3227-gc37f63b3 d1033e293654 0c17286fc3ca 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (8m) 23s ago 19m 513M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (8m) 59s ago 17m 453M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 23s ago 19m 59.2M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (7m) 59s ago 16m 38.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (66s) 23s ago 18m 7755k - 1.5.0 0da6a335fe13 de4abb622e61 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (62s) 59s ago 17m 3632k - 1.5.0 0da6a335fe13 8348b365d48e 2024-04-27T07:43:03.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 23s ago 16m 99.6M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 23s ago 15m 104M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 23s ago 15m 81.0M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (4m) 59s ago 14m 102M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (3m) 59s ago 14m 99.8M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (3m) 59s ago 13m 87.6M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:43:03.050 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (45s) 23s ago 17m 48.9M - 2.43.0 a07b618ecd1d 2b5229c4dba5 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 msgr2=0x7fa6f00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 0x7fa6f00710c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7040fd230 tx=0x7fa70000b040 comp rx=0 tx=0).stop 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 msgr2=0x7fa7040fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009fd0 tx=0x7fa6f4009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 shutdown_connections 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa6f006ec10 0x7fa6f00710c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa704066a90 0x7fa7040fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 --2- 172.21.15.82:0/73988991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7040fffb0 0x7fa7040fb970 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 >> 172.21.15.82:0/73988991 conn(0x7fa7040f7420 msgr2=0x7fa7040f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 shutdown_connections 2024-04-27T07:43:03.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.048+0000 7fa70bb82700 1 -- 172.21.15.82:0/73988991 wait complete. 2024-04-27T07:43:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 -- 172.21.15.82:0/85738949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 msgr2=0x7fba880fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/85738949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba880fc0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fba78004940 tx=0x7fba78009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 -- 172.21.15.82:0/85738949 shutdown_connections 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/85738949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 0x7fba880fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/85738949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba880fc0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 -- 172.21.15.82:0/85738949 >> 172.21.15.82:0/85738949 conn(0x7fba880f7420 msgr2=0x7fba880f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 -- 172.21.15.82:0/85738949 shutdown_connections 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.148+0000 7fba8dd0f700 1 -- 172.21.15.82:0/85738949 wait complete. 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 Processor -- start 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 -- start start 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 0x7fba881022d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88102910 con 0x7fba880fbcc0 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba8dd0f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88102a80 con 0x7fba880fcf70 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba877fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba877fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36074/0 (socket says 172.21.15.82:36074) 2024-04-27T07:43:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.149+0000 7fba877fe700 1 -- 172.21.15.82:0/919559379 learned_addr learned my addr 172.21.15.82:0/919559379 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba86ffd700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 0x7fba881022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba877fe700 1 -- 172.21.15.82:0/919559379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 msgr2=0x7fba881022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba877fe700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 0x7fba881022d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba877fe700 1 -- 172.21.15.82:0/919559379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78005040 con 0x7fba880fbcc0 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba877fe700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba78009150 tx=0x7fba78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba7800e040 con 0x7fba880fbcc0 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba78004290 con 0x7fba880fbcc0 2024-04-27T07:43:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88102d00 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba7801c630 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.150+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba88115a30 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.151+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8805f5c0 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.151+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fba78013420 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.152+0000 7fba6ffff700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 0x7fba700710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.152+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fba7808f410 con 0x7fba880fbcc0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.152+0000 7fba86ffd700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 0x7fba700710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.152+0000 7fba86ffd700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 0x7fba700710b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009d30 tx=0x7fba7c0091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.157+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fba78058240 con 0x7fba880fbcc0 2024-04-27T07:43:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:02 smithi100 ceph-mon[80397]: pgmap v267: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.465+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba88115c80 con 0x7fba880fbcc0 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.465+0000 7fba6ffff700 1 -- 172.21.15.82:0/919559379 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fba7805b900 con 0x7fba880fbcc0 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:43:03.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 14 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:43:03.469 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 msgr2=0x7fba700710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 0x7fba700710b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009d30 tx=0x7fba7c0091a0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 msgr2=0x7fba88103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fba78009150 tx=0x7fba78009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 shutdown_connections 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fba7006ec00 0x7fba700710b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba880fbcc0 0x7fba88103e00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 --2- 172.21.15.82:0/919559379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba880fcf70 0x7fba881022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.467+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 >> 172.21.15.82:0/919559379 conn(0x7fba880f7420 msgr2=0x7fba880f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.468+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 shutdown_connections 2024-04-27T07:43:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.468+0000 7fba8dd0f700 1 -- 172.21.15.82:0/919559379 wait complete. 2024-04-27T07:43:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- 172.21.15.82:0/1846311229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fed30 msgr2=0x7f0a680fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1846311229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fed30 0x7f0a680fae70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a58004940 tx=0x7f0a58009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- 172.21.15.82:0/1846311229 shutdown_connections 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1846311229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fed30 0x7f0a680fae70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1846311229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fe3e0 0x7f0a680fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- 172.21.15.82:0/1846311229 >> 172.21.15.82:0/1846311229 conn(0x7f0a680f6b80 msgr2=0x7f0a680f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- 172.21.15.82:0/1846311229 shutdown_connections 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- 172.21.15.82:0/1846311229 wait complete. 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 Processor -- start 2024-04-27T07:43:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.579+0000 7f0a6f969700 1 -- start start 2024-04-27T07:43:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6f969700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6f969700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fed30 0x7f0a6810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6f969700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6810e570 con 0x7f0a680fe3e0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6f969700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6810ed70 con 0x7f0a680fed30 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36088/0 (socket says 172.21.15.82:36088) 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 -- 172.21.15.82:0/1608882366 learned_addr learned my addr 172.21.15.82:0/1608882366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6cf04700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fed30 0x7f0a6810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 -- 172.21.15.82:0/1608882366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fed30 msgr2=0x7f0a6810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fed30 0x7f0a6810df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 -- 172.21.15.82:0/1608882366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58005040 con 0x7f0a680fe3e0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a6d705700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c830 tx=0x7f0a64004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.580+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a640106f0 con 0x7f0a680fe3e0 2024-04-27T07:43:03.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.581+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a64010d20 con 0x7f0a680fe3e0 2024-04-27T07:43:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.581+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6810f050 con 0x7f0a680fe3e0 2024-04-27T07:43:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.581+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a640113a0 con 0x7f0a680fe3e0 2024-04-27T07:43:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.581+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6810f590 con 0x7f0a680fe3e0 2024-04-27T07:43:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.582+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6805f5c0 con 0x7f0a680fe3e0 2024-04-27T07:43:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.582+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0a64011500 con 0x7f0a680fe3e0 2024-04-27T07:43:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.582+0000 7f0a5dffb700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 0x7f0a540710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.583+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0a6408e700 con 0x7f0a680fe3e0 2024-04-27T07:43:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.583+0000 7f0a6cf04700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 0x7f0a540710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.583+0000 7f0a6cf04700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 0x7f0a540710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a58009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.587+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0a6405b190 con 0x7f0a680fe3e0 2024-04-27T07:43:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.842+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a6810f9c0 con 0x7f0a680fe3e0 2024-04-27T07:43:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.843+0000 7f0a5dffb700 1 -- 172.21.15.82:0/1608882366 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f0a6405ad20 con 0x7f0a680fe3e0 2024-04-27T07:43:03.845 INFO:teuthology.orchestra.run.smithi082.stdout:e43 2024-04-27T07:43:03.845 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:43:03.845 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 43 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:41:52.485728+0000 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:43:03.846 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 83 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34444,1=34476} 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:43:03.847 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34444 members: 34444,34476 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:34444} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{0:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{1:34476} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:43:03.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 msgr2=0x7f0a540710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 0x7f0a540710c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a58009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 msgr2=0x7f0a6810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c830 tx=0x7f0a64004470 comp rx=0 tx=0).stop 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 shutdown_connections 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0a5406ec10 0x7f0a540710c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a680fe3e0 0x7f0a6810da30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 --2- 172.21.15.82:0/1608882366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a680fed30 0x7f0a6810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 >> 172.21.15.82:0/1608882366 conn(0x7f0a680f6b80 msgr2=0x7f0a680f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 shutdown_connections 2024-04-27T07:43:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.846+0000 7f0a6f969700 1 -- 172.21.15.82:0/1608882366 wait complete. 2024-04-27T07:43:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2024-04-27T07:43:03.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 -- 172.21.15.82:0/3390806800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fbd40 msgr2=0x7f15100fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 --2- 172.21.15.82:0/3390806800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fbd40 0x7f15100fc150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f150c004940 tx=0x7f150c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:03.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 -- 172.21.15.82:0/3390806800 shutdown_connections 2024-04-27T07:43:03.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 --2- 172.21.15.82:0/3390806800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fcff0 0x7f15100fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 --2- 172.21.15.82:0/3390806800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fbd40 0x7f15100fc150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.952+0000 7f1517f78700 1 -- 172.21.15.82:0/3390806800 >> 172.21.15.82:0/3390806800 conn(0x7f15100f74c0 msgr2=0x7f15100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 -- 172.21.15.82:0/3390806800 shutdown_connections 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 -- 172.21.15.82:0/3390806800 wait complete. 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 Processor -- start 2024-04-27T07:43:03.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 -- start start 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fbd40 0x7f15100ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100fe8e0 con 0x7f15100fcff0 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1517f78700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100fea50 con 0x7f15100fbd40 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1515513700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1515513700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36092/0 (socket says 172.21.15.82:36092) 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.953+0000 7f1515513700 1 -- 172.21.15.82:0/2274306245 learned_addr learned my addr 172.21.15.82:0/2274306245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1515d14700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fbd40 0x7f15100ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1515513700 1 -- 172.21.15.82:0/2274306245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fbd40 msgr2=0x7f15100ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1515513700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fbd40 0x7f15100ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1515513700 1 -- 172.21.15.82:0/2274306245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c005040 con 0x7f15100fcff0 2024-04-27T07:43:03.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1515513700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1500002a50 tx=0x7f15000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1500007cc0 con 0x7f15100fcff0 2024-04-27T07:43:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f150000f040 con 0x7f15100fcff0 2024-04-27T07:43:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15100fed30 con 0x7f15100fcff0 2024-04-27T07:43:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150000da30 con 0x7f15100fcff0 2024-04-27T07:43:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.954+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1510115a40 con 0x7f15100fcff0 2024-04-27T07:43:03.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.955+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1510101b80 con 0x7f15100fcff0 2024-04-27T07:43:03.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.956+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f150000db90 con 0x7f15100fcff0 2024-04-27T07:43:03.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.956+0000 7f15067fc700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 0x7f14fc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:03.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.956+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f150008e550 con 0x7f15100fcff0 2024-04-27T07:43:03.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.957+0000 7f1515d14700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 0x7f14fc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:03.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.957+0000 7f1515d14700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 0x7f14fc0710b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f150c004890 tx=0x7f150c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:03.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:03.964+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1500057380 con 0x7f15100fcff0 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/919559379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:04.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:03 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1608882366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:43:04.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.199+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f151005e3a0 con 0x7f14fc06ec00 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/919559379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:04.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:03 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1608882366' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.200+0000 7f15067fc700 1 -- 172.21.15.82:0/2274306245 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f151005e3a0 con 0x7f14fc06ec00 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d", 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-04-27T07:43:04.203 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "16/21 daemons upgraded", 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading grafana daemons", 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:43:04.204 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 msgr2=0x7f14fc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 0x7f14fc0710b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f150c004890 tx=0x7f150c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 msgr2=0x7f15100fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1500002a50 tx=0x7f15000046b0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 shutdown_connections 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f14fc06ec00 0x7f14fc0710b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100fbd40 0x7f15100ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 --2- 172.21.15.82:0/2274306245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15100fcff0 0x7f15100fe330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 >> 172.21.15.82:0/2274306245 conn(0x7f15100f74c0 msgr2=0x7f15100f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 shutdown_connections 2024-04-27T07:43:04.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.202+0000 7f1517f78700 1 -- 172.21.15.82:0/2274306245 wait complete. 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.308+0000 7f8076717700 1 -- 172.21.15.82:0/917753672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fcf90 msgr2=0x7f80700fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.308+0000 7f8076717700 1 --2- 172.21.15.82:0/917753672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fcf90 0x7f80700fd400 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8064004940 tx=0x7f8064009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.308+0000 7f8076717700 1 -- 172.21.15.82:0/917753672 shutdown_connections 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.308+0000 7f8076717700 1 --2- 172.21.15.82:0/917753672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fcf90 0x7f80700fd400 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 --2- 172.21.15.82:0/917753672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fbce0 0x7f80700fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- 172.21.15.82:0/917753672 >> 172.21.15.82:0/917753672 conn(0x7f80700f7440 msgr2=0x7f80700f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- 172.21.15.82:0/917753672 shutdown_connections 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- 172.21.15.82:0/917753672 wait complete. 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 Processor -- start 2024-04-27T07:43:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- start start 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fcf90 0x7f80700fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700fe860 con 0x7f80700fbce0 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.309+0000 7f8076717700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700fe9a0 con 0x7f80700fcf90 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36108/0 (socket says 172.21.15.82:36108) 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 -- 172.21.15.82:0/3708582765 learned_addr learned my addr 172.21.15.82:0/3708582765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806f7fe700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fcf90 0x7f80700fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 -- 172.21.15.82:0/3708582765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fcf90 msgr2=0x7f80700fe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fcf90 0x7f80700fe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 -- 172.21.15.82:0/3708582765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064005040 con 0x7f80700fbce0 2024-04-27T07:43:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806ffff700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8060002a50 tx=0x7f80600046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8060007cc0 con 0x7f80700fbce0 2024-04-27T07:43:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f806000f040 con 0x7f80700fbce0 2024-04-27T07:43:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80700fec80 con 0x7f80700fbce0 2024-04-27T07:43:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8060009640 con 0x7f80700fbce0 2024-04-27T07:43:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.310+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070115ac0 con 0x7f80700fbce0 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.311+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8070101b20 con 0x7f80700fbce0 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.312+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f80600097a0 con 0x7f80700fbce0 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.312+0000 7f806cff9700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 0x7f80580710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.313+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f806008e680 con 0x7f80700fbce0 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.313+0000 7f806f7fe700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 0x7f80580710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:04.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.313+0000 7f806f7fe700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 0x7f80580710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8070100390 tx=0x7f8064009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:04.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.317+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8060057430 con 0x7f80700fbce0 2024-04-27T07:43:04.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.617+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f80701048d0 con 0x7f80700fbce0 2024-04-27T07:43:04.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.617+0000 7f806cff9700 1 -- 172.21.15.82:0/3708582765 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f806005aaf0 con 0x7f80700fbce0 2024-04-27T07:43:04.620 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:43:04.620 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:43:04.620 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:43:04.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 msgr2=0x7f80580710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 0x7f80580710b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8070100390 tx=0x7f8064009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 msgr2=0x7f80700ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8060002a50 tx=0x7f80600046b0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 shutdown_connections 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f805806ec00 0x7f80580710b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80700fbce0 0x7f80700ffdb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 --2- 172.21.15.82:0/3708582765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80700fcf90 0x7f80700fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 >> 172.21.15.82:0/3708582765 conn(0x7f80700f7440 msgr2=0x7f80700663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 shutdown_connections 2024-04-27T07:43:04.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:04.620+0000 7f8076717700 1 -- 172.21.15.82:0/3708582765 wait complete. 2024-04-27T07:43:05.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:04 smithi082 ceph-mon[91103]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:05.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:04 smithi082 ceph-mon[91103]: pgmap v268: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:05.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:04 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3708582765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:43:05.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:05.282 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:04 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:04 smithi100 ceph-mon[80397]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:04 smithi100 ceph-mon[80397]: pgmap v268: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:04 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3708582765' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:43:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:04 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:06.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:05 smithi082 ceph-mon[91103]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:06.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:05 smithi100 ceph-mon[80397]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:06 smithi082 ceph-mon[91103]: pgmap v269: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:06 smithi100 ceph-mon[80397]: pgmap v269: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: pgmap v270: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-27T07:43:09.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-27T07:43:09.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-27T07:43:09.348 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:08 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:09.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: pgmap v270: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:09.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:09.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:09.420 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-27T07:43:09.421 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-27T07:43:09.422 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.423 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.424 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-27T07:43:09.424 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-27T07:43:09.424 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-27T07:43:09.424 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:08 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:43:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:43:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: Upgrade: Finalizing container_image settings 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: Upgrade: Complete! 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:10.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082:3000"}]: dispatch 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: Upgrade: Finalizing container_image settings 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: Upgrade: Complete! 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:43:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:43:10.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:43:10.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:10 smithi082 ceph-mon[91103]: pgmap v271: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:10 smithi100 ceph-mon[80397]: pgmap v271: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:12 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:12 smithi100 ceph-mon[80397]: pgmap v272: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:12 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:43:12.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:12 smithi082 ceph-mon[91103]: pgmap v272: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:15.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:14 smithi100 ceph-mon[80397]: pgmap v273: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:14 smithi082 ceph-mon[91103]: pgmap v273: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:16 smithi082 ceph-mon[91103]: pgmap v274: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:16 smithi100 ceph-mon[80397]: pgmap v274: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:19.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:18 smithi082 ceph-mon[91103]: pgmap v275: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:18 smithi100 ceph-mon[80397]: pgmap v275: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:21.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:20 smithi082 ceph-mon[91103]: pgmap v276: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:21.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:20 smithi100 ceph-mon[80397]: pgmap v276: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:23.219 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:22 smithi100 ceph-mon[80397]: pgmap v277: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:22 smithi082 ceph-mon[91103]: pgmap v277: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:24 smithi082 ceph-mon[91103]: pgmap v278: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:24 smithi100 ceph-mon[80397]: pgmap v278: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:26 smithi082 ceph-mon[91103]: pgmap v279: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:26 smithi100 ceph-mon[80397]: pgmap v279: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:28 smithi082 ceph-mon[91103]: pgmap v280: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:28 smithi100 ceph-mon[80397]: pgmap v280: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:30 smithi082 ceph-mon[91103]: pgmap v281: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:30 smithi100 ceph-mon[80397]: pgmap v281: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:32 smithi082 ceph-mon[91103]: pgmap v282: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:33.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:32 smithi100 ceph-mon[80397]: pgmap v282: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:34.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 -- 172.21.15.82:0/2774861512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 msgr2=0x7f3690102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:34.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 --2- 172.21.15.82:0/2774861512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f3690102310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3680004940 tx=0x7f3680009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:34.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 -- 172.21.15.82:0/2774861512 shutdown_connections 2024-04-27T07:43:34.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 --2- 172.21.15.82:0/2774861512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f3690102310 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 --2- 172.21.15.82:0/2774861512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f36900ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 -- 172.21.15.82:0/2774861512 >> 172.21.15.82:0/2774861512 conn(0x7f36900f7420 msgr2=0x7f36900f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:34.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 -- 172.21.15.82:0/2774861512 shutdown_connections 2024-04-27T07:43:34.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.729+0000 7f3697693700 1 -- 172.21.15.82:0/2774861512 wait complete. 2024-04-27T07:43:34.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 Processor -- start 2024-04-27T07:43:34.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 -- start start 2024-04-27T07:43:34.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f369010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:34.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:34.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369010e550 con 0x7f36900ffef0 2024-04-27T07:43:34.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3697693700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690112ef0 con 0x7f3690066fb0 2024-04-27T07:43:34.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41854/0 (socket says 172.21.15.82:41854) 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 -- 172.21.15.82:0/3201583584 learned_addr learned my addr 172.21.15.82:0/3201583584 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f369542f700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f369010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 -- 172.21.15.82:0/3201583584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 msgr2=0x7f369010d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f369010d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 -- 172.21.15.82:0/3201583584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680005040 con 0x7f36900ffef0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f369542f700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f369010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.730+0000 7f3694c2e700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f368000b3b0 tx=0x7f3680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.731+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368000e040 con 0x7f36900ffef0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.731+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36901130f0 con 0x7f36900ffef0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.731+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3680004290 con 0x7f36900ffef0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.731+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f368001c630 con 0x7f36900ffef0 2024-04-27T07:43:34.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.731+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690113660 con 0x7f36900ffef0 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.732+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369004c710 con 0x7f36900ffef0 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.732+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f368000bbf0 con 0x7f36900ffef0 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.733+0000 7f3685ffb700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 0x7f367c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.733+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f368008fcc0 con 0x7f36900ffef0 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.733+0000 7f369542f700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 0x7f367c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:34.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.733+0000 7f369542f700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 0x7f367c0710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:34.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.738+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f368005c620 con 0x7f36900ffef0 2024-04-27T07:43:34.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.954+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3690113880 con 0x7f367c06ec00 2024-04-27T07:43:34.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.955+0000 7f3685ffb700 1 -- 172.21.15.82:0/3201583584 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3690113880 con 0x7f367c06ec00 2024-04-27T07:43:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 msgr2=0x7f367c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 0x7f367c0710b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f368c006fd0 tx=0x7f368c008040 comp rx=0 tx=0).stop 2024-04-27T07:43:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 msgr2=0x7f369010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f368000b3b0 tx=0x7f3680009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 shutdown_connections 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f367c06ec00 0x7f367c0710b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3690066fb0 0x7f369010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 --2- 172.21.15.82:0/3201583584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ffef0 0x7f369010dec0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 >> 172.21.15.82:0/3201583584 conn(0x7f36900f7420 msgr2=0x7f36900f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 shutdown_connections 2024-04-27T07:43:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:34.958+0000 7f3697693700 1 -- 172.21.15.82:0/3201583584 wait complete. 2024-04-27T07:43:35.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:34 smithi082 ceph-mon[91103]: pgmap v283: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:34 smithi100 ceph-mon[80397]: pgmap v283: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:35.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph orch ps' 2024-04-27T07:43:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:36.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:35 smithi082 ceph-mon[91103]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:36.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:35 smithi100 ceph-mon[80397]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:37.329 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:36 smithi082 ceph-mon[91103]: pgmap v284: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:36 smithi100 ceph-mon[80397]: pgmap v284: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 -- 172.21.15.82:0/647840630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624103760 msgr2=0x7f36240fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 --2- 172.21.15.82:0/647840630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624103760 0x7f36240fcdd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3620004940 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 -- 172.21.15.82:0/647840630 shutdown_connections 2024-04-27T07:43:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 --2- 172.21.15.82:0/647840630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624103760 0x7f36240fcdd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 --2- 172.21.15.82:0/647840630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624102dc0 0x7f3624103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 -- 172.21.15.82:0/647840630 >> 172.21.15.82:0/647840630 conn(0x7f36240f8930 msgr2=0x7f36240fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 -- 172.21.15.82:0/647840630 shutdown_connections 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.689+0000 7f362becc700 1 -- 172.21.15.82:0/647840630 wait complete. 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 Processor -- start 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 -- start start 2024-04-27T07:43:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624103760 0x7f36240707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240721b0 con 0x7f3624102dc0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f362becc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3624070ce0 con 0x7f3624103760 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51338/0 (socket says 172.21.15.82:51338) 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 -- 172.21.15.82:0/2869155723 learned_addr learned my addr 172.21.15.82:0/2869155723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629467700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624103760 0x7f36240707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 -- 172.21.15.82:0/2869155723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624103760 msgr2=0x7f36240707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624103760 0x7f36240707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.690+0000 7f3629c68700 1 -- 172.21.15.82:0/2869155723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620005040 con 0x7f3624102dc0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f3629c68700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3614002a50 tx=0x7f36140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3614007cc0 con 0x7f3624102dc0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3624070fc0 con 0x7f3624102dc0 2024-04-27T07:43:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f361400f040 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361400da30 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.691+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362411a100 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.692+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36240fe510 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.692+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f361400db90 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.693+0000 7f361a7fc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 0x7f36100710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.693+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f361408e640 con 0x7f3624102dc0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.693+0000 7f3629467700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 0x7f36100710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.693+0000 7f3629467700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 0x7f36100710b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3624071990 tx=0x7f3620009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.698+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f36140573f0 con 0x7f3624102dc0 2024-04-27T07:43:37.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.909+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36240fa000 con 0x7f361006ec00 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.919+0000 7f361a7fc700 1 -- 172.21.15.82:0/2869155723 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f36240fa000 con 0x7f361006ec00 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (63s) 34s ago 18m 15.1M - 0.25.0 c8568f914cd2 9345c8c0d306 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 34s ago 18m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (7m) 94s ago 17m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (39s) 34s ago 18m 52.4M - 9.4.12 2bacad6d85d8 fc51bf227c64 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (2m) 34s ago 13m 18.5M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (2m) 34s ago 13m 66.1M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (114s) 94s ago 13m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 493ac111fafd 2024-04-27T07:43:37.922 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (2m) 94s ago 13m 62.8M - 19.0.0-3227-gc37f63b3 d1033e293654 0c17286fc3ca 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (9m) 34s ago 19m 520M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (8m) 94s ago 17m 453M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 34s ago 20m 59.8M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (7m) 94s ago 17m 38.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (101s) 34s ago 18m 9.80M - 1.5.0 0da6a335fe13 de4abb622e61 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (96s) 94s ago 17m 3632k - 1.5.0 0da6a335fe13 8348b365d48e 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 34s ago 16m 99.7M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 34s ago 16m 104M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 34s ago 15m 81.1M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (5m) 94s ago 15m 102M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (4m) 94s ago 14m 99.8M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (3m) 94s ago 14m 87.6M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:43:37.923 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (80s) 34s ago 18m 49.2M - 2.43.0 a07b618ecd1d 2b5229c4dba5 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 msgr2=0x7f36100710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 0x7f36100710b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3624071990 tx=0x7f3620009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 msgr2=0x7f3624070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3614002a50 tx=0x7f36140046b0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 shutdown_connections 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f361006ec00 0x7f36100710b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3624102dc0 0x7f3624070260 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 --2- 172.21.15.82:0/2869155723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3624103760 0x7f36240707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:37.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 >> 172.21.15.82:0/2869155723 conn(0x7f36240f8930 msgr2=0x7f36240f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:37.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 shutdown_connections 2024-04-27T07:43:37.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:37.921+0000 7f362becc700 1 -- 172.21.15.82:0/2869155723 wait complete. 2024-04-27T07:43:38.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph orch upgrade status' 2024-04-27T07:43:38.844 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:39.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:38 smithi082 ceph-mon[91103]: pgmap v285: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:39.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:38 smithi082 ceph-mon[91103]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:38 smithi100 ceph-mon[80397]: pgmap v285: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:38 smithi100 ceph-mon[80397]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:40.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 -- 172.21.15.82:0/648052062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0065640 msgr2=0x7f85e0065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 --2- 172.21.15.82:0/648052062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0065640 0x7f85e0065ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85d4004940 tx=0x7f85d4009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 -- 172.21.15.82:0/648052062 shutdown_connections 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 --2- 172.21.15.82:0/648052062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0065640 0x7f85e0065ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 --2- 172.21.15.82:0/648052062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0102e50 0x7f85e0103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 -- 172.21.15.82:0/648052062 >> 172.21.15.82:0/648052062 conn(0x7f85e0071d00 msgr2=0x7f85e0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 -- 172.21.15.82:0/648052062 shutdown_connections 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 -- 172.21.15.82:0/648052062 wait complete. 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.544+0000 7f85e5a66700 1 Processor -- start 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85e5a66700 1 -- start start 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85e5a66700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0065640 0x7f85e0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85e5a66700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85e5a66700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0114720 con 0x7f85e0102e50 2024-04-27T07:43:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85e5a66700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e010db10 con 0x7f85e0065640 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51362/0 (socket says 172.21.15.82:51362) 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 -- 172.21.15.82:0/3854748411 learned_addr learned my addr 172.21.15.82:0/3854748411 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85df7fe700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0065640 0x7f85e0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 -- 172.21.15.82:0/3854748411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0065640 msgr2=0x7f85e0113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0065640 0x7f85e0113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 -- 172.21.15.82:0/3854748411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4005040 con 0x7f85e0102e50 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.545+0000 7f85deffd700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85d400b8b0 tx=0x7f85d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.546+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d400e040 con 0x7f85e0102e50 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.546+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85d4004290 con 0x7f85e0102e50 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.546+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85d401c3f0 con 0x7f85e0102e50 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.546+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e010dd90 con 0x7f85e0102e50 2024-04-27T07:43:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.546+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e010e350 con 0x7f85e0102e50 2024-04-27T07:43:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.547+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e0100100 con 0x7f85e0102e50 2024-04-27T07:43:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.547+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f85d400baf0 con 0x7f85e0102e50 2024-04-27T07:43:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.548+0000 7f85c7fff700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 0x7f85c80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.548+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f85d408faa0 con 0x7f85e0102e50 2024-04-27T07:43:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.548+0000 7f85df7fe700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 0x7f85c80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:40.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.548+0000 7f85df7fe700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 0x7f85c80710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85d0004f60 tx=0x7f85d000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:40.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.553+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f85d405c400 con 0x7f85e0102e50 2024-04-27T07:43:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.771+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85e010f1e0 con 0x7f85c806ec00 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.772+0000 7f85c7fff700 1 -- 172.21.15.82:0/3854748411 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f85e010f1e0 con 0x7f85c806ec00 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": null, 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": false, 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "", 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": null, 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-04-27T07:43:40.775 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 msgr2=0x7f85c80710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 0x7f85c80710b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85d0004f60 tx=0x7f85d000b040 comp rx=0 tx=0).stop 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 msgr2=0x7f85e01140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85d400b8b0 tx=0x7f85d4009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 shutdown_connections 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f85c806ec00 0x7f85c80710b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85e0065640 0x7f85e0113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 --2- 172.21.15.82:0/3854748411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0102e50 0x7f85e01140d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 >> 172.21.15.82:0/3854748411 conn(0x7f85e0071d00 msgr2=0x7f85e00faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 shutdown_connections 2024-04-27T07:43:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:40.774+0000 7f85e5a66700 1 -- 172.21.15.82:0/3854748411 wait complete. 2024-04-27T07:43:41.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:40 smithi082 ceph-mon[91103]: pgmap v286: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:41.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:40 smithi100 ceph-mon[80397]: pgmap v286: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:41.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph health detail' 2024-04-27T07:43:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:42.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:41 smithi082 ceph-mon[91103]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:41 smithi100 ceph-mon[80397]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:43:43.190 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:42 smithi082 ceph-mon[91103]: pgmap v287: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:42 smithi100 ceph-mon[80397]: pgmap v287: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 -- 172.21.15.82:0/506798303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218103780 msgr2=0x7f82180fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 --2- 172.21.15.82:0/506798303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218103780 0x7f82180fcdf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f820c004940 tx=0x7f820c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 -- 172.21.15.82:0/506798303 shutdown_connections 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 --2- 172.21.15.82:0/506798303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218103780 0x7f82180fcdf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 --2- 172.21.15.82:0/506798303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8218102de0 0x7f82181031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 -- 172.21.15.82:0/506798303 >> 172.21.15.82:0/506798303 conn(0x7f82180f8990 msgr2=0x7f82180fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 -- 172.21.15.82:0/506798303 shutdown_connections 2024-04-27T07:43:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.417+0000 7f821d577700 1 -- 172.21.15.82:0/506798303 wait complete. 2024-04-27T07:43:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 Processor -- start 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 -- start start 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8218103780 0x7f8218113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8218114520 con 0x7f8218102de0 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f821d577700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821810db20 con 0x7f8218103780 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51378/0 (socket says 172.21.15.82:51378) 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 -- 172.21.15.82:0/436673381 learned_addr learned my addr 172.21.15.82:0/436673381 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 -- 172.21.15.82:0/436673381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8218103780 msgr2=0x7f8218113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8218103780 0x7f8218113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.418+0000 7f8216ffd700 1 -- 172.21.15.82:0/436673381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c005040 con 0x7f8218102de0 2024-04-27T07:43:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f8216ffd700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8208002a50 tx=0x7f82080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8208007cc0 con 0x7f8218102de0 2024-04-27T07:43:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821810de00 con 0x7f8218102de0 2024-04-27T07:43:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f820800f040 con 0x7f8218102de0 2024-04-27T07:43:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8208009640 con 0x7f8218102de0 2024-04-27T07:43:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.419+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821810e3c0 con 0x7f8218102de0 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.420+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180fe530 con 0x7f8218102de0 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.420+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f82080097a0 con 0x7f8218102de0 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.421+0000 7f81ff7fe700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 0x7f82000710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.421+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f820808e680 con 0x7f8218102de0 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.421+0000 7f82167fc700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 0x7f82000710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.421+0000 7f82167fc700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 0x7f82000710b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b3b0 tx=0x7f820c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.426+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f820805af60 con 0x7f8218102de0 2024-04-27T07:43:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.710+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8218109ec0 con 0x7f8218102de0 2024-04-27T07:43:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.711+0000 7f81ff7fe700 1 -- 172.21.15.82:0/436673381 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f820805aaf0 con 0x7f8218102de0 2024-04-27T07:43:43.715 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:43:43.715 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-04-27T07:43:43.715 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-04-27T07:43:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 msgr2=0x7f82000710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 0x7f82000710b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b3b0 tx=0x7f820c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 msgr2=0x7f8218113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8208002a50 tx=0x7f82080046b0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 shutdown_connections 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f820006ec00 0x7f82000710b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8218102de0 0x7f8218113990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 --2- 172.21.15.82:0/436673381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8218103780 0x7f8218113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 >> 172.21.15.82:0/436673381 conn(0x7f82180f8990 msgr2=0x7f82180f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 shutdown_connections 2024-04-27T07:43:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:43.713+0000 7f821d577700 1 -- 172.21.15.82:0/436673381 wait complete. 2024-04-27T07:43:44.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:43 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/436673381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:43:44.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:43 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/436673381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-27T07:43:44.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph versions' 2024-04-27T07:43:44.680 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:45.063 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:44 smithi082 ceph-mon[91103]: pgmap v288: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:44 smithi100 ceph-mon[80397]: pgmap v288: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:46.085 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:45 smithi082 ceph-mon[91103]: pgmap v289: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 -- 172.21.15.82:0/936742680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fb5a0 msgr2=0x7f5a600fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 --2- 172.21.15.82:0/936742680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fb970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c004940 tx=0x7f5a5c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 -- 172.21.15.82:0/936742680 shutdown_connections 2024-04-27T07:43:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 --2- 172.21.15.82:0/936742680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fbf40 0x7f5a60101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 --2- 172.21.15.82:0/936742680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fb970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 -- 172.21.15.82:0/936742680 >> 172.21.15.82:0/936742680 conn(0x7f5a60073350 msgr2=0x7f5a60073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 -- 172.21.15.82:0/936742680 shutdown_connections 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.290+0000 7f5a6829d700 1 -- 172.21.15.82:0/936742680 wait complete. 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 Processor -- start 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 -- start start 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600fe480 con 0x7f5a600fbf40 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a6829d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600fcfb0 con 0x7f5a600fb5a0 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60474/0 (socket says 172.21.15.82:60474) 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 -- 172.21.15.82:0/2558447496 learned_addr learned my addr 172.21.15.82:0/2558447496 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:43:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a66039700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 -- 172.21.15.82:0/2558447496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fb5a0 msgr2=0x7f5a600fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.291+0000 7f5a65838700 1 -- 172.21.15.82:0/2558447496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c005040 con 0x7f5a600fbf40 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a65838700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009b80 tx=0x7f5a50004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a50004e70 con 0x7f5a600fbf40 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600fd290 con 0x7f5a600fbf40 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x7f5a600fbf40 2024-04-27T07:43:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a5000da60 con 0x7f5a600fbf40 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.292+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6011a0f0 con 0x7f5a600fbf40 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.293+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a600fe670 con 0x7f5a600fbf40 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.293+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5a5000dce0 con 0x7f5a600fbf40 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.294+0000 7f5a56ffd700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 0x7f5a4c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.294+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5a5008e5a0 con 0x7f5a600fbf40 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.294+0000 7f5a66039700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 0x7f5a4c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:43:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.294+0000 7f5a66039700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 0x7f5a4c0710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00b3b0 tx=0x7f5a5c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:43:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.299+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5a50057350 con 0x7f5a600fbf40 2024-04-27T07:43:46.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:45 smithi100 ceph-mon[80397]: pgmap v289: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.580+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a6011a2e0 con 0x7f5a600fbf40 2024-04-27T07:43:46.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.581+0000 7f5a56ffd700 1 -- 172.21.15.82:0/2558447496 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f5a5005aa10 con 0x7f5a600fbf40 2024-04-27T07:43:46.583 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:43:46.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 14 2024-04-27T07:43:46.585 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:43:46.585 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:43:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 msgr2=0x7f5a4c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:46.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 0x7f5a4c0710b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00b3b0 tx=0x7f5a5c009e30 comp rx=0 tx=0).stop 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 msgr2=0x7f5a600fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009b80 tx=0x7f5a50004600 comp rx=0 tx=0).stop 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 shutdown_connections 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5a4c06ec00 0x7f5a4c0710b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a600fb5a0 0x7f5a600fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 --2- 172.21.15.82:0/2558447496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a600fbf40 0x7f5a600fca70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 >> 172.21.15.82:0/2558447496 conn(0x7f5a60073350 msgr2=0x7f5a60100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 shutdown_connections 2024-04-27T07:43:46.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:43:46.583+0000 7f5a6829d700 1 -- 172.21.15.82:0/2558447496 wait complete. 2024-04-27T07:43:47.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:46 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2558447496' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:47.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-27T07:43:47.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:46 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2558447496' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:43:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:48.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:47 smithi082 ceph-mon[91103]: pgmap v290: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:48.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:47 smithi100 ceph-mon[80397]: pgmap v290: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:49.121 INFO:teuthology.orchestra.run.smithi082.stdout:wait for servicemap items w/ changing names to refresh 2024-04-27T07:43:49.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'sleep 60' 2024-04-27T07:43:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:43:51.183 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:50 smithi082 ceph-mon[91103]: pgmap v291: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:50 smithi100 ceph-mon[80397]: pgmap v291: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:43:53.219 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:52 smithi100 ceph-mon[80397]: pgmap v292: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:53.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:52 smithi082 ceph-mon[91103]: pgmap v292: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:43:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:54 smithi082 ceph-mon[91103]: pgmap v293: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:54 smithi100 ceph-mon[80397]: pgmap v293: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:43:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:43:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:56 smithi082 ceph-mon[91103]: pgmap v294: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:56 smithi100 ceph-mon[80397]: pgmap v294: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:43:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:43:58 smithi082 ceph-mon[91103]: pgmap v295: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:43:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:43:58 smithi100 ceph-mon[80397]: pgmap v295: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:00 smithi082 ceph-mon[91103]: pgmap v296: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:00 smithi100 ceph-mon[80397]: pgmap v296: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:03.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:02 smithi082 ceph-mon[91103]: pgmap v297: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:02 smithi100 ceph-mon[80397]: pgmap v297: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:04 smithi082 ceph-mon[91103]: pgmap v298: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:05.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:04 smithi100 ceph-mon[80397]: pgmap v298: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:06 smithi082 ceph-mon[91103]: pgmap v299: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:06 smithi100 ceph-mon[80397]: pgmap v299: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:08 smithi082 ceph-mon[91103]: pgmap v300: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:08 smithi100 ceph-mon[80397]: pgmap v300: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:10.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:09 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:44:10.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:09 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:44:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:10 smithi082 ceph-mon[91103]: pgmap v301: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:44:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:44:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:44:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:10 smithi100 ceph-mon[80397]: pgmap v301: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:44:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:44:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:44:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:13.352 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:12 smithi082 ceph-mon[91103]: pgmap v302: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:12 smithi100 ceph-mon[80397]: pgmap v302: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:14 smithi082 ceph-mon[91103]: pgmap v303: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:14 smithi100 ceph-mon[80397]: pgmap v303: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:16 smithi082 ceph-mon[91103]: pgmap v304: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:16 smithi100 ceph-mon[80397]: pgmap v304: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:18 smithi082 ceph-mon[91103]: pgmap v305: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:18 smithi100 ceph-mon[80397]: pgmap v305: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:20 smithi082 ceph-mon[91103]: pgmap v306: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:20 smithi100 ceph-mon[80397]: pgmap v306: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:22 smithi082 ceph-mon[91103]: pgmap v307: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:22 smithi100 ceph-mon[80397]: pgmap v307: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:24 smithi082 ceph-mon[91103]: pgmap v308: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:24.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:24 smithi100 ceph-mon[80397]: pgmap v308: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:26.145 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:26 smithi100 ceph-mon[80397]: pgmap v309: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:26 smithi082 ceph-mon[91103]: pgmap v309: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:28 smithi082 ceph-mon[91103]: pgmap v310: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:28 smithi100 ceph-mon[80397]: pgmap v310: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:30 smithi082 ceph-mon[91103]: pgmap v311: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:30 smithi100 ceph-mon[80397]: pgmap v311: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:44:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:32 smithi082 ceph-mon[91103]: pgmap v312: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:33.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:32 smithi100 ceph-mon[80397]: pgmap v312: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:34 smithi082 ceph-mon[91103]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:34 smithi100 ceph-mon[80397]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:36 smithi082 ceph-mon[91103]: pgmap v314: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:36 smithi100 ceph-mon[80397]: pgmap v314: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:39.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:38 smithi082 ceph-mon[91103]: pgmap v315: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:39.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:38 smithi100 ceph-mon[80397]: pgmap v315: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:40 smithi082 ceph-mon[91103]: pgmap v316: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:44:41.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:40 smithi100 ceph-mon[80397]: pgmap v316: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:44:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:42 smithi082 ceph-mon[91103]: pgmap v317: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:44:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:42 smithi100 ceph-mon[80397]: pgmap v317: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T07:44:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:44 smithi082 ceph-mon[91103]: pgmap v318: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T07:44:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:44 smithi100 ceph-mon[80397]: pgmap v318: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T07:44:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:46 smithi082 ceph-mon[91103]: pgmap v319: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:44:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:46 smithi100 ceph-mon[80397]: pgmap v319: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T07:44:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:48 smithi082 ceph-mon[91103]: pgmap v320: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-04-27T07:44:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:48 smithi100 ceph-mon[80397]: pgmap v320: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-04-27T07:44:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:50 smithi082 ceph-mon[91103]: pgmap v321: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:44:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:50 smithi100 ceph-mon[80397]: pgmap v321: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T07:44:52.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph orch ps' 2024-04-27T07:44:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:44:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:52 smithi082 ceph-mon[91103]: pgmap v322: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:52 smithi100 ceph-mon[80397]: pgmap v322: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 -- 172.21.15.82:0/2855538725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd60102e20 msgr2=0x7fbd601031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2855538725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd60102e20 0x7fbd601031f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009ce0 tx=0x7fbd58004d10 comp rx=0 tx=0).stop 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 -- 172.21.15.82:0/2855538725 shutdown_connections 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2855538725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd601037c0 0x7fbd600fb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2855538725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd60102e20 0x7fbd601031f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 -- 172.21.15.82:0/2855538725 >> 172.21.15.82:0/2855538725 conn(0x7fbd60072380 msgr2=0x7fbd60072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 -- 172.21.15.82:0/2855538725 shutdown_connections 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.132+0000 7fbd67f61700 1 -- 172.21.15.82:0/2855538725 wait complete. 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 Processor -- start 2024-04-27T07:44:54.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 -- start start 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 0x7fbd60113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60114750 con 0x7fbd601037c0 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.133+0000 7fbd67f61700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6010dca0 con 0x7fbd60102e20 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54736/0 (socket says 172.21.15.82:54736) 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 -- 172.21.15.82:0/2829185590 learned_addr learned my addr 172.21.15.82:0/2829185590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd65cfd700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 0x7fbd60113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 -- 172.21.15.82:0/2829185590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 msgr2=0x7fbd60113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 0x7fbd60113b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 -- 172.21.15.82:0/2829185590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009940 con 0x7fbd601037c0 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd65cfd700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 0x7fbd60113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:44:54.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd654fc700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000b790 tx=0x7fbd50009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5000f6f0 con 0x7fbd601037c0 2024-04-27T07:44:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd5000fd20 con 0x7fbd601037c0 2024-04-27T07:44:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6010df20 con 0x7fbd601037c0 2024-04-27T07:44:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd500103a0 con 0x7fbd601037c0 2024-04-27T07:44:54.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.134+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6010e460 con 0x7fbd601037c0 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.135+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600fe6e0 con 0x7fbd601037c0 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.136+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fbd50011400 con 0x7fbd601037c0 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.136+0000 7fbd567fc700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 0x7fbd4c0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.136+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbd5008e740 con 0x7fbd601037c0 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.136+0000 7fbd65cfd700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 0x7fbd4c0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:54.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.137+0000 7fbd65cfd700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 0x7fbd4c0710b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800b740 tx=0x7fbd58004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:54.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.141+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbd5005b020 con 0x7fbd601037c0 2024-04-27T07:44:54.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.352+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 --> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd6010a030 con 0x7fbd4c06ec00 2024-04-27T07:44:54.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.362+0000 7fbd567fc700 1 -- 172.21.15.82:0/2829185590 <== mgr.34102 v2:172.21.15.82:6800/2055369903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fbd6010a030 con 0x7fbd4c06ec00 2024-04-27T07:44:54.364 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (2m) 110s ago 19m 15.1M - 0.25.0 c8568f914cd2 9345c8c0d306 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 110s ago 20m 6665k - 19.0.0-3227-gc37f63b3 d1033e293654 dc17eb218e44 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi100 smithi100 running (8m) 2m ago 19m 6660k - 19.0.0-3227-gc37f63b3 d1033e293654 434ae3b3c9f4 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (116s) 110s ago 19m 52.4M - 9.4.12 2bacad6d85d8 fc51bf227c64 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.bqtewe smithi082 running (3m) 110s ago 14m 18.5M - 19.0.0-3227-gc37f63b3 d1033e293654 87ba8c4f25bc 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.vlqbei smithi082 running (4m) 110s ago 14m 66.1M - 19.0.0-3227-gc37f63b3 d1033e293654 41d1caf9a38f 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.kjopce smithi100 running (3m) 2m ago 14m 13.9M - 19.0.0-3227-gc37f63b3 d1033e293654 493ac111fafd 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi100.udlhfn smithi100 running (3m) 2m ago 14m 62.8M - 19.0.0-3227-gc37f63b3 d1033e293654 0c17286fc3ca 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.hhlhmf smithi082 *:8443,9283,8765 running (10m) 110s ago 21m 520M - 19.0.0-3227-gc37f63b3 d1033e293654 5d8082c2d90f 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi100.eparbe smithi100 *:8443,9283,8765 running (9m) 2m ago 18m 453M - 19.0.0-3227-gc37f63b3 d1033e293654 ad2ea915b251 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (9m) 110s ago 21m 59.8M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 40fa3d40b777 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi100 smithi100 running (9m) 2m ago 18m 38.9M 2048M 19.0.0-3227-gc37f63b3 d1033e293654 07b61e2da755 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (2m) 110s ago 19m 9.80M - 1.5.0 0da6a335fe13 de4abb622e61 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi100 smithi100 *:9100 running (2m) 2m ago 18m 3632k - 1.5.0 0da6a335fe13 8348b365d48e 2024-04-27T07:44:54.365 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (8m) 110s ago 18m 99.7M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 95f4ef5645d0 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (7m) 110s ago 17m 104M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 8b047025c2bb 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 110s ago 17m 81.1M 1557M 19.0.0-3227-gc37f63b3 d1033e293654 91932106b4cc 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi100 running (6m) 2m ago 16m 102M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bb89023ec444 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi100 running (5m) 2m ago 16m 99.8M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 bc48a356d7ea 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi100 running (5m) 2m ago 15m 87.6M 2581M 19.0.0-3227-gc37f63b3 d1033e293654 a25fdc3db009 2024-04-27T07:44:54.366 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 110s ago 19m 49.2M - 2.43.0 a07b618ecd1d 2b5229c4dba5 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 msgr2=0x7fbd4c0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 0x7fbd4c0710b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800b740 tx=0x7fbd58004d10 comp rx=0 tx=0).stop 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 msgr2=0x7fbd60114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000b790 tx=0x7fbd50009220 comp rx=0 tx=0).stop 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 shutdown_connections 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fbd4c06ec00 0x7fbd4c0710b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd60102e20 0x7fbd60113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 --2- 172.21.15.82:0/2829185590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd601037c0 0x7fbd60114070 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 >> 172.21.15.82:0/2829185590 conn(0x7fbd60072380 msgr2=0x7fbd600f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 shutdown_connections 2024-04-27T07:44:54.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:54.364+0000 7fbd67f61700 1 -- 172.21.15.82:0/2829185590 wait complete. 2024-04-27T07:44:55.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph versions' 2024-04-27T07:44:55.310 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:44:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:54 smithi082 ceph-mon[91103]: pgmap v323: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:54 smithi100 ceph-mon[80397]: pgmap v323: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:44:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:55 smithi082 ceph-mon[91103]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:44:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:55 smithi100 ceph-mon[80397]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-27T07:44:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 -- 172.21.15.82:0/251533105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658102690 msgr2=0x7f06580fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 --2- 172.21.15.82:0/251533105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658102690 0x7f06580fbd00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0654004940 tx=0x7f0654009e30 comp rx=0 tx=0).stop 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 -- 172.21.15.82:0/251533105 shutdown_connections 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 --2- 172.21.15.82:0/251533105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658102690 0x7f06580fbd00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 --2- 172.21.15.82:0/251533105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658101cf0 0x7f06581020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 -- 172.21.15.82:0/251533105 >> 172.21.15.82:0/251533105 conn(0x7f06580f7860 msgr2=0x7f06580f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 -- 172.21.15.82:0/251533105 shutdown_connections 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.043+0000 7f065f3fe700 1 -- 172.21.15.82:0/251533105 wait complete. 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 Processor -- start 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 -- start start 2024-04-27T07:44:57.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658102690 0x7f0658113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658114530 con 0x7f0658101cf0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065f3fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065810db30 con 0x7f0658102690 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44992/0 (socket says 172.21.15.82:44992) 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 -- 172.21.15.82:0/50193000 learned_addr learned my addr 172.21.15.82:0/50193000 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065c999700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658102690 0x7f0658113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 -- 172.21.15.82:0/50193000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658102690 msgr2=0x7f0658113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658102690 0x7f0658113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 -- 172.21.15.82:0/50193000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654005040 con 0x7f0658101cf0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.044+0000 7f065d19a700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f064800c8c0 tx=0x7f06480044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.045+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f064800a980 con 0x7f0658101cf0 2024-04-27T07:44:57.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.045+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f064800ce60 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.045+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065810de10 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.045+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06480115e0 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.045+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065810e3d0 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.046+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06580fd440 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.046+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0648012400 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.047+0000 7f064dffb700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 0x7f06440710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.047+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f064808e850 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.047+0000 7f065c999700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 0x7f06440710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.047+0000 7f065c999700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 0x7f06440710b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f065810ecf0 tx=0x7f0654009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:57.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.052+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f064805b270 con 0x7f0658101cf0 2024-04-27T07:44:57.181 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:56 smithi082 ceph-mon[91103]: pgmap v324: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.337+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0658108dd0 con 0x7f0658101cf0 2024-04-27T07:44:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.338+0000 7f064dffb700 1 -- 172.21.15.82:0/50193000 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f06480126b0 con 0x7f0658101cf0 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 2 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 6 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 4 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-04-27T07:44:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)": 14 2024-04-27T07:44:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-27T07:44:57.342 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 msgr2=0x7f06440710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 0x7f06440710b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f065810ecf0 tx=0x7f0654009e30 comp rx=0 tx=0).stop 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 msgr2=0x7f06581139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f064800c8c0 tx=0x7f06480044c0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 shutdown_connections 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f064406ec00 0x7f06440710b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0658101cf0 0x7f06581139a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 --2- 172.21.15.82:0/50193000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0658102690 0x7f0658113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 >> 172.21.15.82:0/50193000 conn(0x7f06580f7860 msgr2=0x7f06580f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:44:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 shutdown_connections 2024-04-27T07:44:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:57.340+0000 7f065f3fe700 1 -- 172.21.15.82:0/50193000 wait complete. 2024-04-27T07:44:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:56 smithi100 ceph-mon[80397]: pgmap v324: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T07:44:57.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-27T07:44:58.246 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:44:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:57 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/50193000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:44:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:57 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/50193000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:44:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:58 smithi082 ceph-mon[91103]: pgmap v325: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:58 smithi100 ceph-mon[80397]: pgmap v325: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:44:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/1928970612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec102df0 msgr2=0x7f0fec1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/1928970612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec102df0 0x7f0fec1031c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc004940 tx=0x7f0fdc009e30 comp rx=0 tx=0).stop 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/1928970612 shutdown_connections 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/1928970612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec103790 0x7f0fec0fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/1928970612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec102df0 0x7f0fec1031c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/1928970612 >> 172.21.15.82:0/1928970612 conn(0x7f0fec0f8980 msgr2=0x7f0fec0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/1928970612 shutdown_connections 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.922+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/1928970612 wait complete. 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 Processor -- start 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 -- start start 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 0x7f0fec070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec070dc0 con 0x7f0fec103790 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0ff1b6e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec070f00 con 0x7f0fec102df0 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45012/0 (socket says 172.21.15.82:45012) 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0feaffd700 1 -- 172.21.15.82:0/2597588110 learned_addr learned my addr 172.21.15.82:0/2597588110 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.923+0000 7f0feb7fe700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 0x7f0fec070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0feaffd700 1 -- 172.21.15.82:0/2597588110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 msgr2=0x7f0fec070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0feaffd700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 0x7f0fec070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0feaffd700 1 -- 172.21.15.82:0/2597588110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc005040 con 0x7f0fec103790 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0feb7fe700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 0x7f0fec070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0feaffd700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b790 tx=0x7f0fe0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe000f6f0 con 0x7f0fec103790 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec119e90 con 0x7f0fec103790 2024-04-27T07:44:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fe000fd20 con 0x7f0fec103790 2024-04-27T07:44:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fe00103a0 con 0x7f0fec103790 2024-04-27T07:44:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.924+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec11a370 con 0x7f0fec103790 2024-04-27T07:44:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.926+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec0fe540 con 0x7f0fec103790 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.926+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0fe0011400 con 0x7f0fec103790 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.927+0000 7f0fd3fff700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 0x7f0fd40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.927+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0fe008e680 con 0x7f0fec103790 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.927+0000 7f0feb7fe700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 0x7f0fd40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.927+0000 7f0feb7fe700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 0x7f0fd40710b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc004f90 tx=0x7f0fdc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:44:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:44:59.932+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0fe0057430 con 0x7f0fec103790 2024-04-27T07:45:00.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.220+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0fec04bed0 con 0x7f0fec103790 2024-04-27T07:45:00.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:44:59 smithi082 ceph-mon[91103]: pgmap v326: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:00.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.221+0000 7f0fd3fff700 1 -- 172.21.15.82:0/2597588110 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0fe005aaf0 con 0x7f0fec103790 2024-04-27T07:45:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 msgr2=0x7f0fd40710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 0x7f0fd40710b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc004f90 tx=0x7f0fdc009e30 comp rx=0 tx=0).stop 2024-04-27T07:45:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 msgr2=0x7f0fec0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b790 tx=0x7f0fe0009220 comp rx=0 tx=0).stop 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 shutdown_connections 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fd406ec00 0x7f0fd40710b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fec102df0 0x7f0fec070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 --2- 172.21.15.82:0/2597588110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fec103790 0x7f0fec0707a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 >> 172.21.15.82:0/2597588110 conn(0x7f0fec0f8980 msgr2=0x7f0fec0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 shutdown_connections 2024-04-27T07:45:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:00.223+0000 7f0ff1b6e700 1 -- 172.21.15.82:0/2597588110 wait complete. 2024-04-27T07:45:00.236 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-04-27T07:45:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:44:59 smithi100 ceph-mon[80397]: pgmap v326: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:00.832 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -e sha1=c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-27T07:45:01.087 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:45:01.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:00 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2597588110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:45:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:00 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2597588110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:45:02.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:01 smithi082 ceph-mon[91103]: pgmap v327: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:01 smithi100 ceph-mon[80397]: pgmap v327: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 -- 172.21.15.82:0/2525968759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c101ce0 msgr2=0x7f741c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 --2- 172.21.15.82:0/2525968759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c101ce0 0x7f741c1020b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f740c004940 tx=0x7f740c009e30 comp rx=0 tx=0).stop 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 -- 172.21.15.82:0/2525968759 shutdown_connections 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 --2- 172.21.15.82:0/2525968759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c102680 0x7f741c0fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 --2- 172.21.15.82:0/2525968759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c101ce0 0x7f741c1020b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 -- 172.21.15.82:0/2525968759 >> 172.21.15.82:0/2525968759 conn(0x7f741c0f7870 msgr2=0x7f741c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 -- 172.21.15.82:0/2525968759 shutdown_connections 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 -- 172.21.15.82:0/2525968759 wait complete. 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.937+0000 7f742292d700 1 Processor -- start 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f742292d700 1 -- start start 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f742292d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c101ce0 0x7f741c10eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f742292d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f742292d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c10f570 con 0x7f741c102680 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f742292d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c10f6b0 con 0x7f741c101ce0 2024-04-27T07:45:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45032/0 (socket says 172.21.15.82:45032) 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 -- 172.21.15.82:0/4099756919 learned_addr learned my addr 172.21.15.82:0/4099756919 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741bfff700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c101ce0 0x7f741c10eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 -- 172.21.15.82:0/4099756919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c101ce0 msgr2=0x7f741c10eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c101ce0 0x7f741c10eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 -- 172.21.15.82:0/4099756919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c005040 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f741b7fe700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7410002a50 tx=0x7f7410004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.938+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7410007cc0 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.939+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c117b60 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.939+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f741000f040 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.939+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741000da40 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.939+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c117f30 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.939+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0fd430 con 0x7f741c102680 2024-04-27T07:45:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.940+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f74100097c0 con 0x7f741c102680 2024-04-27T07:45:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.940+0000 7f7418ff9700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 0x7f74040710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.941+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f741008e6b0 con 0x7f741c102680 2024-04-27T07:45:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.941+0000 7f741bfff700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 0x7f74040710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.941+0000 7f741bfff700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 0x7f74040710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f740c004f90 tx=0x7f740c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:02.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:02.945+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f741005af90 con 0x7f741c102680 2024-04-27T07:45:03.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.235+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f741c108de0 con 0x7f741c102680 2024-04-27T07:45:03.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.235+0000 7f7418ff9700 1 -- 172.21.15.82:0/4099756919 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f741005ab20 con 0x7f741c102680 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 msgr2=0x7f74040710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 0x7f74040710b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f740c004f90 tx=0x7f740c009e30 comp rx=0 tx=0).stop 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 msgr2=0x7f741c10f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7410002a50 tx=0x7f7410004600 comp rx=0 tx=0).stop 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 shutdown_connections 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f740406ec00 0x7f74040710b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c101ce0 0x7f741c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 --2- 172.21.15.82:0/4099756919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f741c102680 0x7f741c10f030 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:03.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 >> 172.21.15.82:0/4099756919 conn(0x7f741c0f7870 msgr2=0x7f741c0f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:03.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.237+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 shutdown_connections 2024-04-27T07:45:03.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:03.238+0000 7f742292d700 1 -- 172.21.15.82:0/4099756919 wait complete. 2024-04-27T07:45:03.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.0.0-3227-gc37f63b3 (c37f63b3705f40f1bfcd7d8aeb311499c65cfa1f) squid (dev)" 2024-04-27T07:45:03.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:03 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/4099756919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:45:03.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:03 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/4099756919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-27T07:45:03.928 DEBUG:teuthology.parallel:result is None 2024-04-27T07:45:03.928 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-27T07:45:03.942 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:45:03.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-27T07:45:04.200 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/mon.smithi082/config 2024-04-27T07:45:04.559 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:04 smithi082 ceph-mon[91103]: pgmap v328: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:04.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:04 smithi100 ceph-mon[80397]: pgmap v328: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 -- 172.21.15.82:0/3061715912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fde10 msgr2=0x7f17e80fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3061715912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fde10 0x7f17e80fe1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f17d8004940 tx=0x7f17d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 -- 172.21.15.82:0/3061715912 shutdown_connections 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3061715912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fe7b0 0x7f17e8106e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3061715912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fde10 0x7f17e80fe1e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 -- 172.21.15.82:0/3061715912 >> 172.21.15.82:0/3061715912 conn(0x7f17e80f7850 msgr2=0x7f17e80f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 -- 172.21.15.82:0/3061715912 shutdown_connections 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.792+0000 7f17ecc35700 1 -- 172.21.15.82:0/3061715912 wait complete. 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 Processor -- start 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 -- start start 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fde10 0x7f17e8113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e81147b0 con 0x7f17e80fe7b0 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17ecc35700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e810db30 con 0x7f17e80fde10 2024-04-27T07:45:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35224/0 (socket says 172.21.15.82:35224) 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17e5d9b700 1 -- 172.21.15.82:0/3533060192 learned_addr learned my addr 172.21.15.82:0/3533060192 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.793+0000 7f17e659c700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fde10 0x7f17e8113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17e5d9b700 1 -- 172.21.15.82:0/3533060192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fde10 msgr2=0x7f17e8113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17e5d9b700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fde10 0x7f17e8113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17e5d9b700 1 -- 172.21.15.82:0/3533060192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8005040 con 0x7f17e80fe7b0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17e5d9b700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b790 tx=0x7f17dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc00f770 con 0x7f17e80fe7b0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e810de10 con 0x7f17e80fe7b0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17dc00fda0 con 0x7f17e80fe7b0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17dc00d310 con 0x7f17e80fe7b0 2024-04-27T07:45:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.794+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e810e350 con 0x7f17e80fe7b0 2024-04-27T07:45:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.795+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e8066690 con 0x7f17e80fe7b0 2024-04-27T07:45:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.795+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f17dc010420 con 0x7f17e80fe7b0 2024-04-27T07:45:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.796+0000 7f17d6ffd700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 0x7f17d00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.796+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f17dc08e8d0 con 0x7f17e80fe7b0 2024-04-27T07:45:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.796+0000 7f17e659c700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 0x7f17d00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.796+0000 7f17e659c700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 0x7f17d00710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b3b0 tx=0x7f17d8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:05.801+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f17dc057700 con 0x7f17e80fe7b0 2024-04-27T07:45:06.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.050+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17e805f5c0 con 0x7f17e80fe7b0 2024-04-27T07:45:06.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.050+0000 7f17d6ffd700 1 -- 172.21.15.82:0/3533060192 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f17dc05adc0 con 0x7f17e80fe7b0 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:e43 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 43 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-04-27T07:30:26.029684+0000 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-04-27T07:41:52.485728+0000 2024-04-27T07:45:06.054 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 83 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34444,1=34476} 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-04-27T07:45:06.055 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34444 members: 34444,34476 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.vlqbei{0:34444} state up:active seq 9 join_fscid=1 addr [v2:172.21.15.82:6826/3903654232,v1:172.21.15.82:6827/3903654232] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.udlhfn{0:44369} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6824/1294989723,v1:172.21.15.100:6825/1294989723] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.bqtewe{1:34476} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.82:6828/981074485,v1:172.21.15.82:6829/981074485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi100.kjopce{1:44373} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.100:6826/625675545,v1:172.21.15.100:6827/625675545] compat {c=[1],r=[1],i=[1fff]}] 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:06.056 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 msgr2=0x7f17d00710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 0x7f17d00710c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b3b0 tx=0x7f17d8009e30 comp rx=0 tx=0).stop 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 msgr2=0x7f17e81140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b790 tx=0x7f17dc009250 comp rx=0 tx=0).stop 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 shutdown_connections 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f17d006ec10 0x7f17d00710c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e80fde10 0x7f17e8113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 --2- 172.21.15.82:0/3533060192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e80fe7b0 0x7f17e81140d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.052+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 >> 172.21.15.82:0/3533060192 conn(0x7f17e80f7850 msgr2=0x7f17e8103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.053+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 shutdown_connections 2024-04-27T07:45:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.053+0000 7f17ecc35700 1 -- 172.21.15.82:0/3533060192 wait complete. 2024-04-27T07:45:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2024-04-27T07:45:06.721 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-27T07:45:06.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T07:45:06.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.827+0000 7f0278714640 1 -- 172.21.15.82:0/1194534008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 msgr2=0x7f02700fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:06.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.827+0000 7f0278714640 1 --2- 172.21.15.82:0/1194534008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02700fb160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02600048d0 tx=0x7f0260009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- 172.21.15.82:0/1194534008 shutdown_connections 2024-04-27T07:45:06.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 --2- 172.21.15.82:0/1194534008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02700fb160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 --2- 172.21.15.82:0/1194534008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 0x7f02701014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- 172.21.15.82:0/1194534008 >> 172.21.15.82:0/1194534008 conn(0x7f02700711c0 msgr2=0x7f02700715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- 172.21.15.82:0/1194534008 shutdown_connections 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- 172.21.15.82:0/1194534008 wait complete. 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 Processor -- start 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- start start 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 0x7f0270111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270112870 con 0x7f0270101aa0 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0278714640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027010be30 con 0x7f0270101100 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0275caf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0275caf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35230/0 (socket says 172.21.15.82:35230) 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.828+0000 7f0275caf640 1 -- 172.21.15.82:0/2597892119 learned_addr learned my addr 172.21.15.82:0/2597892119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f02764b0640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 0x7f0270111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:06.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0275caf640 1 -- 172.21.15.82:0/2597892119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 msgr2=0x7f0270111ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0275caf640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 0x7f0270111ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0275caf640 1 -- 172.21.15.82:0/2597892119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260005040 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0275caf640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f026002bda0 tx=0x7f0260009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02600094c0 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0260032e50 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027010c0b0 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026003b640 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.829+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027010c5d0 con 0x7f0270101aa0 2024-04-27T07:45:06.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.830+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700fc880 con 0x7f0270101aa0 2024-04-27T07:45:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.830+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f026002f070 con 0x7f0270101aa0 2024-04-27T07:45:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.831+0000 7f0266ffd640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 0x7f025c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.831+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f02600b0c80 con 0x7f0270101aa0 2024-04-27T07:45:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.831+0000 7f02764b0640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 0x7f025c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:06.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.831+0000 7f02764b0640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 0x7f025c071020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f026c006fd0 tx=0x7f026c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:06.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:06.836+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0260079a30 con 0x7f0270101aa0 2024-04-27T07:45:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.015+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02701082e0 con 0x7f0270101aa0 2024-04-27T07:45:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.016+0000 7f0266ffd640 1 -- 172.21.15.82:0/2597892119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f026007d0f0 con 0x7f0270101aa0 2024-04-27T07:45:07.019 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:07.019 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:41:38.635860+0000","last_up_change":"2024-04-27T07:39:50.670033+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-27T07:30:24.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-27T07:30:25.253832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6803","nonce":1477776965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6805","nonce":1477776965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6809","nonce":1477776965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6807","nonce":1477776965}]},"public_addr":"172.21.15.82:6803/1477776965","cluster_addr":"172.21.15.82:6805/1477776965","heartbeat_back_addr":"172.21.15.82:6809/1477776965","heartbeat_front_addr":"172.21.15.82:6807/1477776965","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6811","nonce":247193686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6813","nonce":247193686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6817","nonce":247193686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6815","nonce":247193686}]},"public_addr":"172.21.15.82:6811/247193686","cluster_addr":"172.21.15.82:6813/247193686","heartbeat_back_addr":"172.21.15.82:6817/247193686","heartbeat_front_addr":"172.21.15.82:6815/247193686","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6819","nonce":240501577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6821","nonce":240501577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6825","nonce":240501577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6823","nonce":240501577}]},"public_addr":"172.21.15.82:6819/240501577","cluster_addr":"172.21.15.82:6821/240501577","heartbeat_back_addr":"172.21.15.82:6825/240501577","heartbeat_front_addr":"172.21.15.82:6823/240501577","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6801","nonce":2753948765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6803","nonce":2753948765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6807","nonce":2753948765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6805","nonce":2753948765}]},"public_addr":"172.21.15.100:6801/2753948765","cluster_addr":"172.21.15.100:6803/2753948765","heartbeat_back_addr":"172.21.15.100:6807/2753948765","heartbeat_front_addr":"172.21.15.100:6805/2753948765","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6809","nonce":1234887297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6811","nonce":1234887297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6815","nonce":1234887297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6813","nonce":1234887297}]},"public_addr":"172.21.15.100:6809/1234887297","cluster_addr":"172.21.15.100:6811/1234887297","heartbeat_back_addr":"172.21.15.100:6815/1234887297","heartbeat_front_addr":"172.21.15.100:6813/1234887297","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6817","nonce":4221202958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6819","nonce":4221202958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6823","nonce":4221202958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6821","nonce":4221202958}]},"public_addr":"172.21.15.100:6817/4221202958","cluster_addr":"172.21.15.100:6819/4221202958","heartbeat_back_addr":"172.21.15.100:6823/4221202958","heartbeat_front_addr":"172.21.15.100:6821/4221202958","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6829/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.100:6828/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.100:0/1395364237":"2024-04-28T07:34:31.470816+0000","172.21.15.82:6801/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6828/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.82:0/2001119936":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/151072868":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6801/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/507086912":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3300584346":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6827/2940930803":"2024-04-28T07:40:30.474281+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.100:0/3011964559":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4080505049":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/812733995":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/4133994313":"2024-04-28T07:34:31.470816+0000","172.21.15.100:6829/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/4079596977":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/92279690":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/4140677880":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/3056095726":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1059916025":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6826/2940930803":"2024-04-28T07:40:30.474281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:45:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 msgr2=0x7f025c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 0x7f025c071020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f026c006fd0 tx=0x7f026c008040 comp rx=0 tx=0).stop 2024-04-27T07:45:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 msgr2=0x7f02701121e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f026002bda0 tx=0x7f0260009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 shutdown_connections 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f025c06eb70 0x7f025c071020 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0270101aa0 0x7f02701121e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 --2- 172.21.15.82:0/2597892119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0270101100 0x7f0270111ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 >> 172.21.15.82:0/2597892119 conn(0x7f02700711c0 msgr2=0x7f02700faa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 shutdown_connections 2024-04-27T07:45:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.018+0000 7f0278714640 1 -- 172.21.15.82:0/2597892119 wait complete. 2024-04-27T07:45:07.030 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:06 smithi082 ceph-mon[91103]: pgmap v329: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:07.030 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:06 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3533060192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:45:07.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-27T07:27:58.687625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-27T07:30:24.468959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-27T07:30:25.253832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-27T07:45:07.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-27T07:45:07.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 -- 172.21.15.82:0/1551182185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa20101a50 msgr2=0x7faa200fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 --2- 172.21.15.82:0/1551182185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa20101a50 0x7faa200fb0e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa140048d0 tx=0x7faa14009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 -- 172.21.15.82:0/1551182185 shutdown_connections 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 --2- 172.21.15.82:0/1551182185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa20101a50 0x7faa200fb0e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 --2- 172.21.15.82:0/1551182185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa201010b0 0x7faa20101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 -- 172.21.15.82:0/1551182185 >> 172.21.15.82:0/1551182185 conn(0x7faa200f6c60 msgr2=0x7faa200f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 -- 172.21.15.82:0/1551182185 shutdown_connections 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 -- 172.21.15.82:0/1551182185 wait complete. 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.127+0000 7faa25e2e640 1 Processor -- start 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa25e2e640 1 -- start start 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa25e2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa25e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa20101a50 0x7faa2010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa25e2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200664d0 con 0x7faa201010b0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa25e2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2010ec70 con 0x7faa20101a50 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35248/0 (socket says 172.21.15.82:35248) 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 -- 172.21.15.82:0/887565029 learned_addr learned my addr 172.21.15.82:0/887565029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1effd640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa20101a50 0x7faa2010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 -- 172.21.15.82:0/887565029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa20101a50 msgr2=0x7faa2010e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa20101a50 0x7faa2010e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.128+0000 7faa1f7fe640 1 -- 172.21.15.82:0/887565029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14005040 con 0x7faa201010b0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa1f7fe640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa10002a80 tx=0x7faa10004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa10007c30 con 0x7faa201010b0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2010ef50 con 0x7faa201010b0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa1000f040 con 0x7faa201010b0 2024-04-27T07:45:07.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa100096b0 con 0x7faa201010b0 2024-04-27T07:45:07.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.129+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa201174e0 con 0x7faa201010b0 2024-04-27T07:45:07.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.130+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa200fc820 con 0x7faa201010b0 2024-04-27T07:45:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.130+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7faa1000d6b0 con 0x7faa201010b0 2024-04-27T07:45:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.131+0000 7faa07fff640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 0x7faa08071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.131+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faa1008e210 con 0x7faa201010b0 2024-04-27T07:45:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.131+0000 7faa1effd640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 0x7faa08071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.131+0000 7faa1effd640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 0x7faa08071020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa20065d20 tx=0x7faa14009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.135+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7faa10057070 con 0x7faa201010b0 2024-04-27T07:45:07.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.311+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa2004bcc0 con 0x7faa201010b0 2024-04-27T07:45:07.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.311+0000 7faa07fff640 1 -- 172.21.15.82:0/887565029 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa1005a730 con 0x7faa201010b0 2024-04-27T07:45:07.314 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-27T07:45:07.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.313+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 msgr2=0x7faa08071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.313+0000 7faa25e2e640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 0x7faa08071020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa20065d20 tx=0x7faa14009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.313+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 msgr2=0x7faa2010e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.313+0000 7faa25e2e640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa10002a80 tx=0x7faa10004600 comp rx=0 tx=0).stop 2024-04-27T07:45:07.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 shutdown_connections 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7faa0806eb70 0x7faa08071020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa20101a50 0x7faa2010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 --2- 172.21.15.82:0/887565029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa201010b0 0x7faa2010e1c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 >> 172.21.15.82:0/887565029 conn(0x7faa200f6c60 msgr2=0x7faa200f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 shutdown_connections 2024-04-27T07:45:07.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.314+0000 7faa25e2e640 1 -- 172.21.15.82:0/887565029 wait complete. 2024-04-27T07:45:07.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-27T07:45:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:06 smithi100 ceph-mon[80397]: pgmap v329: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:07.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:06 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3533060192' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-27T07:45:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- 172.21.15.82:0/992492654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101a30 msgr2=0x7f77a80fb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 --2- 172.21.15.82:0/992492654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101a30 0x7f77a80fb0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f77a40048d0 tx=0x7f77a4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- 172.21.15.82:0/992492654 shutdown_connections 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 --2- 172.21.15.82:0/992492654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101a30 0x7f77a80fb0c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 --2- 172.21.15.82:0/992492654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101090 0x7f77a8101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- 172.21.15.82:0/992492654 >> 172.21.15.82:0/992492654 conn(0x7f77a80f6c40 msgr2=0x7f77a80f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- 172.21.15.82:0/992492654 shutdown_connections 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- 172.21.15.82:0/992492654 wait complete. 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 Processor -- start 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.428+0000 7f77b04ae640 1 -- start start 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101a30 0x7f77a8113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8113870 con 0x7f77a8101090 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a810cec0 con 0x7f77a8101a30 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35264/0 (socket says 172.21.15.82:35264) 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 -- 172.21.15.82:0/98398585 learned_addr learned my addr 172.21.15.82:0/98398585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ada49640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101a30 0x7f77a8113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 -- 172.21.15.82:0/98398585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101a30 msgr2=0x7f77a8113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101a30 0x7f77a8113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 -- 172.21.15.82:0/98398585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4005040 con 0x7f77a8101090 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77ae24a640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f779800eb70 tx=0x7f779800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7798007c30 con 0x7f77a8101090 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a810d140 con 0x7f77a8101090 2024-04-27T07:45:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f779800f040 con 0x7f77a8101090 2024-04-27T07:45:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77980095b0 con 0x7f77a8101090 2024-04-27T07:45:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.429+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a810d630 con 0x7f77a8101090 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.431+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a80fc800 con 0x7f77a8101090 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.431+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f7798009730 con 0x7f77a8101090 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.431+0000 7f779effd640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 0x7f7794071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.432+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f779808e540 con 0x7f77a8101090 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.432+0000 7f77ada49640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 0x7f7794071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.432+0000 7f77ada49640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 0x7f7794071020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77a80f9700 tx=0x7f77a4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.440+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f77980573a0 con 0x7f77a8101090 2024-04-27T07:45:07.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.620+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f77a81081f0 con 0x7f77a8101090 2024-04-27T07:45:07.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.621+0000 7f779effd640 1 -- 172.21.15.82:0/98398585 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f779805aa60 con 0x7f77a8101090 2024-04-27T07:45:07.623 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:07.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 msgr2=0x7f7794071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 0x7f7794071020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77a80f9700 tx=0x7f77a4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 msgr2=0x7f77a8112d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f779800eb70 tx=0x7f779800b040 comp rx=0 tx=0).stop 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 shutdown_connections 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f779406eb70 0x7f7794071020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77a8101a30 0x7f77a8113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 --2- 172.21.15.82:0/98398585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77a8101090 0x7f77a8112d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 >> 172.21.15.82:0/98398585 conn(0x7f77a80f6c40 msgr2=0x7f77a80f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 shutdown_connections 2024-04-27T07:45:07.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.623+0000 7f77b04ae640 1 -- 172.21.15.82:0/98398585 wait complete. 2024-04-27T07:45:07.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 -- 172.21.15.82:0/2762132298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fdcd0 msgr2=0x7f69201063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2762132298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fdcd0 0x7f69201063a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69080048d0 tx=0x7f6908009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 -- 172.21.15.82:0/2762132298 shutdown_connections 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2762132298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fdcd0 0x7f69201063a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2762132298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fd3c0 0x7f69200fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 -- 172.21.15.82:0/2762132298 >> 172.21.15.82:0/2762132298 conn(0x7f69200f6e70 msgr2=0x7f69200f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 -- 172.21.15.82:0/2762132298 shutdown_connections 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.730+0000 7f6924c2e640 1 -- 172.21.15.82:0/2762132298 wait complete. 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 Processor -- start 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 -- start start 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 0x7f69201134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920113aa0 con 0x7f69200fd3c0 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6924c2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692010d0f0 con 0x7f69200fdcd0 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35278/0 (socket says 172.21.15.82:35278) 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 -- 172.21.15.82:0/2046930406 learned_addr learned my addr 172.21.15.82:0/2046930406 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6917fff640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 0x7f69201134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 -- 172.21.15.82:0/2046930406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 msgr2=0x7f69201134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 0x7f69201134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 -- 172.21.15.82:0/2046930406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908005040 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f6917fff640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 0x7f69201134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.731+0000 7f691e59c640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f691000eb70 tx=0x7f691000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6910007c30 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f691000f040 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692010d370 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69100095b0 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692010d890 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.732+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920065e10 con 0x7f69200fd3c0 2024-04-27T07:45:07.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.733+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6910009730 con 0x7f69200fd3c0 2024-04-27T07:45:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.733+0000 7f6916ffd640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 0x7f690c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.733+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f691008e5f0 con 0x7f69200fd3c0 2024-04-27T07:45:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.733+0000 7f6917fff640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 0x7f690c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:07.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.734+0000 7f6917fff640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 0x7f690c071020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f692010e820 tx=0x7f6908009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.738+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f69100573a0 con 0x7f69200fd3c0 2024-04-27T07:45:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.914+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6920109520 con 0x7f69200fd3c0 2024-04-27T07:45:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.914+0000 7f6916ffd640 1 -- 172.21.15.82:0/2046930406 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f691005aa60 con 0x7f69200fd3c0 2024-04-27T07:45:07.917 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.916+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 msgr2=0x7f690c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.916+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 0x7f690c071020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f692010e820 tx=0x7f6908009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.916+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 msgr2=0x7f6920112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.916+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f691000eb70 tx=0x7f691000b040 comp rx=0 tx=0).stop 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 shutdown_connections 2024-04-27T07:45:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f690c06eb70 0x7f690c071020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200fdcd0 0x7f69201134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 --2- 172.21.15.82:0/2046930406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69200fd3c0 0x7f6920112f60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 >> 172.21.15.82:0/2046930406 conn(0x7f69200f6e70 msgr2=0x7f6920100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 shutdown_connections 2024-04-27T07:45:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:07.917+0000 7f6924c2e640 1 -- 172.21.15.82:0/2046930406 wait complete. 2024-04-27T07:45:07.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-27T07:45:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- 172.21.15.82:0/388479540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 msgr2=0x7f97dc0fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 --2- 172.21.15.82:0/388479540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc0fb160 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f97d0009c50 tx=0x7f97d0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- 172.21.15.82:0/388479540 shutdown_connections 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 --2- 172.21.15.82:0/388479540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc0fb160 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 --2- 172.21.15.82:0/388479540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- 172.21.15.82:0/388479540 >> 172.21.15.82:0/388479540 conn(0x7f97dc0f6cc0 msgr2=0x7f97dc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- 172.21.15.82:0/388479540 shutdown_connections 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- 172.21.15.82:0/388479540 wait complete. 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 Processor -- start 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.023+0000 7f97e08ae640 1 -- start start 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc113af0 con 0x7f97dc101ad0 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc10d140 con 0x7f97dc101130 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35298/0 (socket says 172.21.15.82:35298) 2024-04-27T07:45:08.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 -- 172.21.15.82:0/3122970292 learned_addr learned my addr 172.21.15.82:0/3122970292 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97da59c640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 -- 172.21.15.82:0/3122970292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 msgr2=0x7f97dc112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc112fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 -- 172.21.15.82:0/3122970292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00098b0 con 0x7f97dc101ad0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97da59c640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97d9d9b640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97d0004f80 tx=0x7f97d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d003a070 con 0x7f97dc101ad0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc10d3c0 con 0x7f97dc101ad0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97d0009740 con 0x7f97dc101ad0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d003ea60 con 0x7f97dc101ad0 2024-04-27T07:45:08.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.024+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc10d960 con 0x7f97dc101ad0 2024-04-27T07:45:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.025+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0fc8a0 con 0x7f97dc101ad0 2024-04-27T07:45:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.026+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f97d0032070 con 0x7f97dc101ad0 2024-04-27T07:45:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.026+0000 7f97caffd640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 0x7f97c4071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.026+0000 7f97da59c640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 0x7f97c4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.026+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f97d00b09e0 con 0x7f97dc101ad0 2024-04-27T07:45:08.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.027+0000 7f97da59c640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 0x7f97c4071070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97d40049d0 tx=0x7f97d400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.031+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f97d00797c0 con 0x7f97dc101ad0 2024-04-27T07:45:08.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.244+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97dc108290 con 0x7f97dc101ad0 2024-04-27T07:45:08.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.244+0000 7f97caffd640 1 -- 172.21.15.82:0/3122970292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+5245 (secure 0 0 0) 0x7f97d007ce80 con 0x7f97dc101ad0 2024-04-27T07:45:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:08.247 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:52.485728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34444,"mds_1":34476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34476":{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":1,"incarnation":42,"state":"up:active","state_seq":13,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44369":{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44373":{"gid":44373,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6827/625675545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":625675545},{"type":"v1","addr":"172.21.15.100:6827","nonce":625675545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444,34476]},"id":1}]} 2024-04-27T07:45:08.248 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 msgr2=0x7f97c4071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 0x7f97c4071070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97d40049d0 tx=0x7f97d400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 msgr2=0x7f97dc1134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97d0004f80 tx=0x7f97d0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 shutdown_connections 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f97c406ebc0 0x7f97c4071070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97dc101ad0 0x7f97dc1134f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 --2- 172.21.15.82:0/3122970292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97dc101130 0x7f97dc112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 >> 172.21.15.82:0/3122970292 conn(0x7f97dc0f6cc0 msgr2=0x7f97dc100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 shutdown_connections 2024-04-27T07:45:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.246+0000 7f97e08ae640 1 -- 172.21.15.82:0/3122970292 wait complete. 2024-04-27T07:45:08.258 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:07 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2597892119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:08.259 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:07 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/887565029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.259 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:07 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/98398585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.259 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:07 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2046930406' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.260 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-04-27T07:45:08.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-27T07:45:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 -- 172.21.15.82:0/4092073021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c01010a0 msgr2=0x7f81c0101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 --2- 172.21.15.82:0/4092073021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c01010a0 0x7f81c0101470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0048d0 tx=0x7f81bc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 -- 172.21.15.82:0/4092073021 shutdown_connections 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 --2- 172.21.15.82:0/4092073021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c0101a40 0x7f81c00fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 --2- 172.21.15.82:0/4092073021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c01010a0 0x7f81c0101470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 -- 172.21.15.82:0/4092073021 >> 172.21.15.82:0/4092073021 conn(0x7f81c00f6c10 msgr2=0x7f81c00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 -- 172.21.15.82:0/4092073021 shutdown_connections 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 -- 172.21.15.82:0/4092073021 wait complete. 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.352+0000 7f81c8621640 1 Processor -- start 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 -- start start 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 0x7f81c010de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0066740 con 0x7f81c0101a40 2024-04-27T07:45:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c010e910 con 0x7f81c01010a0 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35310/0 (socket says 172.21.15.82:35310) 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 -- 172.21.15.82:0/3030194139 learned_addr learned my addr 172.21.15.82:0/3030194139 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c63bd640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 0x7f81c010de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 -- 172.21.15.82:0/3030194139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 msgr2=0x7f81c010de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 0x7f81c010de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 -- 172.21.15.82:0/3030194139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc005040 con 0x7f81c0101a40 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c63bd640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 0x7f81c010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c5bbc640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f81b0002a50 tx=0x7f81b0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b0007c30 con 0x7f81c0101a40 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81b000f040 con 0x7f81c0101a40 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81b000db50 con 0x7f81c0101a40 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.353+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c010ebf0 con 0x7f81c0101a40 2024-04-27T07:45:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.354+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c010bdf0 con 0x7f81c0101a40 2024-04-27T07:45:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.355+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00fc810 con 0x7f81c0101a40 2024-04-27T07:45:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.355+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f81b000dcf0 con 0x7f81c0101a40 2024-04-27T07:45:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.355+0000 7f81b6ffd640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 0x7f81ac075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.356+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f81b008e130 con 0x7f81c0101a40 2024-04-27T07:45:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.356+0000 7f81c63bd640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 0x7f81ac075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.356+0000 7f81c63bd640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 0x7f81ac075500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81bc000c00 tx=0x7f81bc009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.360+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f81b0056ee0 con 0x7f81c0101a40 2024-04-27T07:45:08.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:07 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2597892119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:08.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:07 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/887565029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:07 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/98398585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:07 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2046930406' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:08.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.578+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f81c0064350 con 0x7f81c0101a40 2024-04-27T07:45:08.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.578+0000 7f81b6ffd640 1 -- 172.21.15.82:0/3030194139 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v43) v1 ==== 107+0+4887 (secure 0 0 0) 0x7f81b005a5a0 con 0x7f81c0101a40 2024-04-27T07:45:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:08.581 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:32:40.495590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14476":{"gid":14476,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/450518230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":450518230},{"type":"v1","addr":"172.21.15.82:6829","nonce":450518230}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.100:6827/398524698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":398524698},{"type":"v1","addr":"172.21.15.100:6827","nonce":398524698}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:08.582 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-04-27T07:45:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.580+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 msgr2=0x7f81ac075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.580+0000 7f81c8621640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 0x7f81ac075500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81bc000c00 tx=0x7f81bc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.580+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 msgr2=0x7f81c010e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.580+0000 7f81c8621640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f81b0002a50 tx=0x7f81b0004600 comp rx=0 tx=0).stop 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.580+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 shutdown_connections 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f81ac073050 0x7f81ac075500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c0101a40 0x7f81c010e3a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 --2- 172.21.15.82:0/3030194139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c01010a0 0x7f81c010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 >> 172.21.15.82:0/3030194139 conn(0x7f81c00f6c10 msgr2=0x7f81c00f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 shutdown_connections 2024-04-27T07:45:08.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.581+0000 7f81c8621640 1 -- 172.21.15.82:0/3030194139 wait complete. 2024-04-27T07:45:08.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-27T07:45:08.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 -- 172.21.15.82:0/3608755570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 msgr2=0x7fcc340fbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/3608755570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc340fbe20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc280048d0 tx=0x7fcc28009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 -- 172.21.15.82:0/3608755570 shutdown_connections 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/3608755570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc340fbe20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/3608755570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc341011a0 0x7fcc34101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 -- 172.21.15.82:0/3608755570 >> 172.21.15.82:0/3608755570 conn(0x7fcc340717e0 msgr2=0x7fcc34071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 -- 172.21.15.82:0/3608755570 shutdown_connections 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.686+0000 7fcc3a79d640 1 -- 172.21.15.82:0/3608755570 wait complete. 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 Processor -- start 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 -- start start 2024-04-27T07:45:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc341011a0 0x7fcc3410e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340fb890 con 0x7fcc340fb9d0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc3a79d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3410e900 con 0x7fcc341011a0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35322/0 (socket says 172.21.15.82:35322) 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 -- 172.21.15.82:0/1464068763 learned_addr learned my addr 172.21.15.82:0/1464068763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 -- 172.21.15.82:0/1464068763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc341011a0 msgr2=0x7fcc3410e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc341011a0 0x7fcc3410e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.687+0000 7fcc33fff640 1 -- 172.21.15.82:0/1464068763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28005040 con 0x7fcc340fb9d0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc33fff640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc24002a50 tx=0x7fcc24004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc24007c30 con 0x7fcc340fb9d0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3410ebe0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc2400f040 con 0x7fcc340fb9d0 2024-04-27T07:45:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2400dbe0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.688+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc34117170 con 0x7fcc340fb9d0 2024-04-27T07:45:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.689+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc340fc9e0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.689+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fcc2400dd40 con 0x7fcc340fb9d0 2024-04-27T07:45:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.690+0000 7fcc30ff9640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 0x7fcc1c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.690+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcc2408e840 con 0x7fcc340fb9d0 2024-04-27T07:45:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.690+0000 7fcc337fe640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 0x7fcc1c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.690+0000 7fcc337fe640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 0x7fcc1c071020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc280043d0 tx=0x7fcc28009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.694+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcc240575f0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.914+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fcc340fe3d0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.914+0000 7fcc30ff9640 1 -- 172.21.15.82:0/1464068763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v43) v1 ==== 107+0+4888 (secure 0 0 0) 0x7fcc2405acb0 con 0x7fcc340fb9d0 2024-04-27T07:45:08.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:08.917 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:34:07.591618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14476":{"gid":14476,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/450518230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":450518230},{"type":"v1","addr":"172.21.15.82:6829","nonce":450518230}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.100:6827/398524698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":398524698},{"type":"v1","addr":"172.21.15.100:6827","nonce":398524698}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:08.918 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-04-27T07:45:08.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 msgr2=0x7fcc1c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 0x7fcc1c071020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc280043d0 tx=0x7fcc28009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 msgr2=0x7fcc3410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc24002a50 tx=0x7fcc24004600 comp rx=0 tx=0).stop 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 shutdown_connections 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fcc1c06eb70 0x7fcc1c071020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc341011a0 0x7fcc3410e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 --2- 172.21.15.82:0/1464068763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc340fb9d0 0x7fcc3410de50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 >> 172.21.15.82:0/1464068763 conn(0x7fcc340717e0 msgr2=0x7fcc340f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 shutdown_connections 2024-04-27T07:45:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:08.917+0000 7fcc3a79d640 1 -- 172.21.15.82:0/1464068763 wait complete. 2024-04-27T07:45:08.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-27T07:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 -- 172.21.15.82:0/3432750180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 msgr2=0x7fd9980fbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3432750180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd9980fbe40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd9880048d0 tx=0x7fd988009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 -- 172.21.15.82:0/3432750180 shutdown_connections 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3432750180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd9980fbe40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3432750180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 0x7fd998100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.023+0000 7fd9a002e640 1 -- 172.21.15.82:0/3432750180 >> 172.21.15.82:0/3432750180 conn(0x7fd9980717e0 msgr2=0x7fd998071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 -- 172.21.15.82:0/3432750180 shutdown_connections 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 -- 172.21.15.82:0/3432750180 wait complete. 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 Processor -- start 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 -- start start 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 0x7fd99810c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980fb6e0 con 0x7fd9980fb9d0 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.024+0000 7fd9a002e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980fb820 con 0x7fd998100160 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35346/0 (socket says 172.21.15.82:35346) 2024-04-27T07:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 -- 172.21.15.82:0/3436941992 learned_addr learned my addr 172.21.15.82:0/3436941992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99d5c9640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 0x7fd99810c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 -- 172.21.15.82:0/3436941992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 msgr2=0x7fd99810c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 0x7fd99810c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 -- 172.21.15.82:0/3436941992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988005040 con 0x7fd9980fb9d0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd99ddca640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd994002a50 tx=0x7fd994004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd994007c30 con 0x7fd9980fb9d0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd99400f040 con 0x7fd9980fb9d0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99810c9c0 con 0x7fd9980fb9d0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd99400db50 con 0x7fd9980fb9d0 2024-04-27T07:45:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.025+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd998119630 con 0x7fd9980fb9d0 2024-04-27T07:45:09.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.026+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9980fc9e0 con 0x7fd9980fb9d0 2024-04-27T07:45:09.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.027+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd99400dcf0 con 0x7fd9980fb9d0 2024-04-27T07:45:09.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.027+0000 7fd98e7fc640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 0x7fd984071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.027+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd99408e030 con 0x7fd9980fb9d0 2024-04-27T07:45:09.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.027+0000 7fd99d5c9640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 0x7fd984071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.028+0000 7fd99d5c9640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 0x7fd984071020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9981018f0 tx=0x7fd988009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.032+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd994056f10 con 0x7fd9980fb9d0 2024-04-27T07:45:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.249+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fd998064350 con 0x7fd9980fb9d0 2024-04-27T07:45:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.250+0000 7fd98e7fc640 1 -- 172.21.15.82:0/3436941992 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v43) v1 ==== 107+0+4902 (secure 0 0 0) 0x7fd99405a5d0 con 0x7fd9980fb9d0 2024-04-27T07:45:09.252 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:09.253 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:37:45.891605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14476":{"gid":14476,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/450518230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":450518230},{"type":"v1","addr":"172.21.15.82:6829","nonce":450518230}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.100:6827/398524698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":398524698},{"type":"v1","addr":"172.21.15.100:6827","nonce":398524698}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-04-27T07:45:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 msgr2=0x7fd984071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 0x7fd984071020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9981018f0 tx=0x7fd988009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 msgr2=0x7fd99810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd994002a50 tx=0x7fd994004600 comp rx=0 tx=0).stop 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 shutdown_connections 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd98406eb70 0x7fd984071020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd998100160 0x7fd99810c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 --2- 172.21.15.82:0/3436941992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9980fb9d0 0x7fd99810be20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 >> 172.21.15.82:0/3436941992 conn(0x7fd9980717e0 msgr2=0x7fd9980f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 shutdown_connections 2024-04-27T07:45:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.252+0000 7fd9a002e640 1 -- 172.21.15.82:0/3436941992 wait complete. 2024-04-27T07:45:09.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:08 smithi082 ceph-mon[91103]: pgmap v330: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:45:09.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:08 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3122970292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:45:09.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:08 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3030194139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-27T07:45:09.264 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:08 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1464068763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-27T07:45:09.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 -- 172.21.15.82:0/1743788768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 msgr2=0x7f53d80fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 --2- 172.21.15.82:0/1743788768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d80fbe00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0048d0 tx=0x7f53cc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 -- 172.21.15.82:0/1743788768 shutdown_connections 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 --2- 172.21.15.82:0/1743788768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d80fbe00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 --2- 172.21.15.82:0/1743788768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d8101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 -- 172.21.15.82:0/1743788768 >> 172.21.15.82:0/1743788768 conn(0x7f53d8070900 msgr2=0x7f53d8070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 -- 172.21.15.82:0/1743788768 shutdown_connections 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.357+0000 7f53de19d640 1 -- 172.21.15.82:0/1743788768 wait complete. 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 Processor -- start 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 -- start start 2024-04-27T07:45:09.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d810e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80fb860 con 0x7f53d80fb9b0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53de19d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d810e940 con 0x7f53d8101150 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35372/0 (socket says 172.21.15.82:35372) 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 -- 172.21.15.82:0/1182490857 learned_addr learned my addr 172.21.15.82:0/1182490857 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d6ffd640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d810e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 -- 172.21.15.82:0/1182490857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 msgr2=0x7f53d810e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d810e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d77fe640 1 -- 172.21.15.82:0/1182490857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc005040 con 0x7f53d80fb9b0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.358+0000 7f53d6ffd640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d810e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53d77fe640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53c8002a50 tx=0x7f53c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53c8007c30 con 0x7f53d80fb9b0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d810ec20 con 0x7f53d80fb9b0 2024-04-27T07:45:09.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53c800f040 con 0x7f53d80fb9b0 2024-04-27T07:45:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53c800db50 con 0x7f53d80fb9b0 2024-04-27T07:45:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.359+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81171b0 con 0x7f53d80fb9b0 2024-04-27T07:45:09.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.360+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80fc9c0 con 0x7f53d80fb9b0 2024-04-27T07:45:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.360+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f53c801c400 con 0x7f53d80fb9b0 2024-04-27T07:45:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.361+0000 7f53bffff640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 0x7f53c0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.361+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f53c808e190 con 0x7f53d80fb9b0 2024-04-27T07:45:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.361+0000 7f53d6ffd640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 0x7f53c0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.361+0000 7f53d6ffd640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 0x7f53c0071020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009fa0 tx=0x7f53cc009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.366+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f53c8056f40 con 0x7f53d80fb9b0 2024-04-27T07:45:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:08 smithi100 ceph-mon[80397]: pgmap v330: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-04-27T07:45:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:08 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3122970292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-27T07:45:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:08 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3030194139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-27T07:45:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:08 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1464068763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-27T07:45:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.577+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f53d8064350 con 0x7f53d80fb9b0 2024-04-27T07:45:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.578+0000 7f53bffff640 1 -- 172.21.15.82:0/1182490857 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v43) v1 ==== 107+0+4901 (secure 0 0 0) 0x7f53c805a600 con 0x7f53d80fb9b0 2024-04-27T07:45:09.581 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:09.581 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:37:47.445128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14476":{"gid":14476,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/450518230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":450518230},{"type":"v1","addr":"172.21.15.82:6829","nonce":450518230}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24285":{"gid":24285,"name":"cephfs.smithi100.kjopce","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.100:6827/398524698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":398524698},{"type":"v1","addr":"172.21.15.100:6827","nonce":398524698}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24269,14464]},"id":1}]} 2024-04-27T07:45:09.581 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 msgr2=0x7f53c0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 0x7f53c0071020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009fa0 tx=0x7f53cc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 msgr2=0x7f53d810de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53c8002a50 tx=0x7f53c8004600 comp rx=0 tx=0).stop 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 shutdown_connections 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53c006eb70 0x7f53c0071020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53d8101150 0x7f53d810e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 --2- 172.21.15.82:0/1182490857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53d80fb9b0 0x7f53d810de90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 >> 172.21.15.82:0/1182490857 conn(0x7f53d8070900 msgr2=0x7f53d80f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 shutdown_connections 2024-04-27T07:45:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.580+0000 7f53de19d640 1 -- 172.21.15.82:0/1182490857 wait complete. 2024-04-27T07:45:09.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.685+0000 7f2520a21640 1 -- 172.21.15.82:0/3996881703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c064390 msgr2=0x7f251c064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.685+0000 7f2520a21640 1 --2- 172.21.15.82:0/3996881703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c064390 0x7f251c064800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f250c0048d0 tx=0x7f250c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- 172.21.15.82:0/3996881703 shutdown_connections 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 --2- 172.21.15.82:0/3996881703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c064390 0x7f251c064800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 --2- 172.21.15.82:0/3996881703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c102270 0x7f251c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- 172.21.15.82:0/3996881703 >> 172.21.15.82:0/3996881703 conn(0x7f251c071fd0 msgr2=0x7f251c0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- 172.21.15.82:0/3996881703 shutdown_connections 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- 172.21.15.82:0/3996881703 wait complete. 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 Processor -- start 2024-04-27T07:45:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- start start 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 0x7f251c112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1137c0 con 0x7f251c102270 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2520a21640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c10ce10 con 0x7f251c064390 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2519d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2519d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35404/0 (socket says 172.21.15.82:35404) 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f2519d9b640 1 -- 172.21.15.82:0/3659166414 learned_addr learned my addr 172.21.15.82:0/3659166414 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.686+0000 7f251a59c640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 0x7f251c112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2519d9b640 1 -- 172.21.15.82:0/3659166414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 msgr2=0x7f251c112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2519d9b640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 0x7f251c112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2519d9b640 1 -- 172.21.15.82:0/3659166414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c005040 con 0x7f251c102270 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f251a59c640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 0x7f251c112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2519d9b640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f250c004930 tx=0x7f250c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c0094c0 con 0x7f251c102270 2024-04-27T07:45:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c10d090 con 0x7f251c102270 2024-04-27T07:45:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f250c032e50 con 0x7f251c102270 2024-04-27T07:45:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c0433b0 con 0x7f251c102270 2024-04-27T07:45:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.687+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c10d550 con 0x7f251c102270 2024-04-27T07:45:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.688+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c0fd970 con 0x7f251c102270 2024-04-27T07:45:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.688+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f250c02f070 con 0x7f251c102270 2024-04-27T07:45:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.689+0000 7f250affd640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 0x7f2504071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.689+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f250c0b0760 con 0x7f251c102270 2024-04-27T07:45:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.689+0000 7f251a59c640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 0x7f2504071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.689+0000 7f251a59c640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 0x7f2504071020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2510004d80 tx=0x7f251000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.693+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f250c079510 con 0x7f251c102270 2024-04-27T07:45:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.909+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f251c1093a0 con 0x7f251c102270 2024-04-27T07:45:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.910+0000 7f250affd640 1 -- 172.21.15.82:0/3659166414 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v43) v1 ==== 107+0+3333 (secure 0 0 0) 0x7f250c03fd20 con 0x7f251c102270 2024-04-27T07:45:09.913 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:09.913 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:39:53.444999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-04-27T07:45:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 20 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 msgr2=0x7f2504071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 0x7f2504071020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2510004d80 tx=0x7f251000b040 comp rx=0 tx=0).stop 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 msgr2=0x7f251c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f250c004930 tx=0x7f250c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 shutdown_connections 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f250406eb70 0x7f2504071020 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c102270 0x7f251c1131c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 --2- 172.21.15.82:0/3659166414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251c064390 0x7f251c112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 >> 172.21.15.82:0/3659166414 conn(0x7f251c071fd0 msgr2=0x7f251c0fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 shutdown_connections 2024-04-27T07:45:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:09.912+0000 7f2520a21640 1 -- 172.21.15.82:0/3659166414 wait complete. 2024-04-27T07:45:09.925 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-27T07:45:09.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-27T07:45:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 -- 172.21.15.82:0/1355579808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fd1c0 msgr2=0x7f8da40fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 --2- 172.21.15.82:0/1355579808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fd1c0 0x7f8da40fd590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0048d0 tx=0x7f8d9c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 -- 172.21.15.82:0/1355579808 shutdown_connections 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 --2- 172.21.15.82:0/1355579808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fdb60 0x7f8da4106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 --2- 172.21.15.82:0/1355579808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fd1c0 0x7f8da40fd590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 -- 172.21.15.82:0/1355579808 >> 172.21.15.82:0/1355579808 conn(0x7f8da40f6be0 msgr2=0x7f8da40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 -- 172.21.15.82:0/1355579808 shutdown_connections 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.018+0000 7f8dac59d640 1 -- 172.21.15.82:0/1355579808 wait complete. 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 Processor -- start 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 -- start start 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fd1c0 0x7f8da4112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da4113820 con 0x7f8da40fdb60 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da410ce70 con 0x7f8da40fd1c0 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35430/0 (socket says 172.21.15.82:35430) 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 -- 172.21.15.82:0/2305776040 learned_addr learned my addr 172.21.15.82:0/2305776040 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8daa339640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fd1c0 0x7f8da4112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 -- 172.21.15.82:0/2305776040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fd1c0 msgr2=0x7f8da4112ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fd1c0 0x7f8da4112ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 -- 172.21.15.82:0/2305776040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c005040 con 0x7f8da40fdb60 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da9b38640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c830 tx=0x7f8d98004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9800a850 con 0x7f8da40fdb60 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da410d150 con 0x7f8da40fdb60 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d9800ae80 con 0x7f8da40fdb60 2024-04-27T07:45:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.019+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d98012ea0 con 0x7f8da40fdb60 2024-04-27T07:45:10.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.020+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da410d670 con 0x7f8da40fdb60 2024-04-27T07:45:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.021+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da4065fa0 con 0x7f8da40fdb60 2024-04-27T07:45:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.021+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8d98012400 con 0x7f8da40fdb60 2024-04-27T07:45:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.021+0000 7f8da2ffd640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 0x7f8d8c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.022+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8d9808eb20 con 0x7f8da40fdb60 2024-04-27T07:45:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.022+0000 7f8daa339640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 0x7f8d8c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.022+0000 7f8daa339640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 0x7f8d8c071020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000c00 tx=0x7f8d9c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.026+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8d98057950 con 0x7f8da40fdb60 2024-04-27T07:45:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.263+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f8da4064350 con 0x7f8da40fdb60 2024-04-27T07:45:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.264+0000 7f8da2ffd640 1 -- 172.21.15.82:0/2305776040 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v43) v1 ==== 107+0+4890 (secure 0 0 0) 0x7f8d980126b0 con 0x7f8da40fdb60 2024-04-27T07:45:10.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:10.268 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:39:54.616229+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24269,14464]},"id":1}]} 2024-04-27T07:45:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-04-27T07:45:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 msgr2=0x7f8d8c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 0x7f8d8c071020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c000c00 tx=0x7f8d9c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 msgr2=0x7f8da4113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c830 tx=0x7f8d98004430 comp rx=0 tx=0).stop 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 shutdown_connections 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8d8c06eb70 0x7f8d8c071020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da40fdb60 0x7f8da4113220 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 --2- 172.21.15.82:0/2305776040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8da40fd1c0 0x7f8da4112ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 >> 172.21.15.82:0/2305776040 conn(0x7f8da40f6be0 msgr2=0x7f8da40f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 shutdown_connections 2024-04-27T07:45:10.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.266+0000 7f8dac59d640 1 -- 172.21.15.82:0/2305776040 wait complete. 2024-04-27T07:45:10.279 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:09 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3436941992' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-27T07:45:10.279 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:09 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1182490857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-27T07:45:10.280 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:09 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3659166414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-27T07:45:10.281 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-04-27T07:45:10.281 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-27T07:45:10.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-27T07:45:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- 172.21.15.82:0/2366821166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 msgr2=0x7f27c00fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/2366821166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c00fb5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27b40048d0 tx=0x7f27b4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- 172.21.15.82:0/2366821166 shutdown_connections 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/2366821166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c00fb5c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/2366821166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 0x7f27c0101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- 172.21.15.82:0/2366821166 >> 172.21.15.82:0/2366821166 conn(0x7f27c0071fd0 msgr2=0x7f27c00723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- 172.21.15.82:0/2366821166 shutdown_connections 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- 172.21.15.82:0/2366821166 wait complete. 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 Processor -- start 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- start start 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 0x7f27c010e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00652f0 con 0x7f27c00fb150 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.379+0000 7f27c4f9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c010e8b0 con 0x7f27c0101170 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35458/0 (socket says 172.21.15.82:35458) 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 -- 172.21.15.82:0/3058482649 learned_addr learned my addr 172.21.15.82:0/3058482649 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27bdd9b640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 0x7f27c010e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 -- 172.21.15.82:0/3058482649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 msgr2=0x7f27c010e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 0x7f27c010e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 -- 172.21.15.82:0/3058482649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4005040 con 0x7f27c00fb150 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27be59c640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f27b0002a80 tx=0x7f27b0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b0007c30 con 0x7f27c00fb150 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c010eb90 con 0x7f27c00fb150 2024-04-27T07:45:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27b000f040 con 0x7f27c00fb150 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b00096b0 con 0x7f27c00fb150 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.380+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c0117150 con 0x7f27c00fb150 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.381+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00fc870 con 0x7f27c00fb150 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.382+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f27b000d6b0 con 0x7f27c00fb150 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.383+0000 7f27aeffd640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 0x7f27a8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.383+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f27b008e1b0 con 0x7f27c00fb150 2024-04-27T07:45:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.383+0000 7f27bdd9b640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 0x7f27a8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.383+0000 7f27bdd9b640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 0x7f27a8071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f27c0064b40 tx=0x7f27b4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.387+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f27b0057010 con 0x7f27c00fb150 2024-04-27T07:45:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:09 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3436941992' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-27T07:45:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:09 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1182490857' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-27T07:45:10.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:09 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3659166414' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-27T07:45:10.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.616+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f27c0064980 con 0x7f27c00fb150 2024-04-27T07:45:10.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.617+0000 7f27aeffd640 1 -- 172.21.15.82:0/3058482649 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v43) v1 ==== 107+0+4886 (secure 0 0 0) 0x7f27b005a6d0 con 0x7f27c00fb150 2024-04-27T07:45:10.620 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:10.620 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:39:55.467242+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi100.udlhfn","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.100:6825/1114832337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1114832337},{"type":"v1","addr":"172.21.15.100:6825","nonce":1114832337}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-04-27T07:45:10.620 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 msgr2=0x7f27a8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 0x7f27a8071020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f27c0064b40 tx=0x7f27b4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 msgr2=0x7f27c010de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f27b0002a80 tx=0x7f27b0004600 comp rx=0 tx=0).stop 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 shutdown_connections 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f27a806eb70 0x7f27a8071020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27c0101170 0x7f27c010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 --2- 172.21.15.82:0/3058482649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27c00fb150 0x7f27c010de30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 >> 172.21.15.82:0/3058482649 conn(0x7f27c0071fd0 msgr2=0x7f27c00fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 shutdown_connections 2024-04-27T07:45:10.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.619+0000 7f27c4f9d640 1 -- 172.21.15.82:0/3058482649 wait complete. 2024-04-27T07:45:10.633 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-04-27T07:45:10.633 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-27T07:45:10.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-27T07:45:10.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.734+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1386634144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4064390 msgr2=0x7f5cb4064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.734+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1386634144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4064390 0x7f5cb4064800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40048d0 tx=0x7f5ca4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1386634144 shutdown_connections 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1386634144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4064390 0x7f5cb4064800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1386634144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4102270 0x7f5cb4102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1386634144 >> 172.21.15.82:0/1386634144 conn(0x7f5cb4071fd0 msgr2=0x7f5cb40723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1386634144 shutdown_connections 2024-04-27T07:45:10.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1386634144 wait complete. 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 Processor -- start 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- start start 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4064390 0x7f5cb4112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb41137a0 con 0x7f5cb4102270 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.735+0000 7f5cba0ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb410cdf0 con 0x7f5cb4064390 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35474/0 (socket says 172.21.15.82:35474) 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 -- 172.21.15.82:0/1738762251 learned_addr learned my addr 172.21.15.82:0/1738762251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:10.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb37fe640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4064390 0x7f5cb4112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 -- 172.21.15.82:0/1738762251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4064390 msgr2=0x7f5cb4112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4064390 0x7f5cb4112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 -- 172.21.15.82:0/1738762251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4005040 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cb2ffd640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4004930 tx=0x7f5ca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca40094c0 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ca4032e50 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb410d070 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca40433b0 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.736+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb410d530 con 0x7f5cb4102270 2024-04-27T07:45:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.737+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb40fd970 con 0x7f5cb4102270 2024-04-27T07:45:10.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.738+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f5ca402f070 con 0x7f5cb4102270 2024-04-27T07:45:10.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.738+0000 7f5c9bfff640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 0x7f5c9c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:10.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.738+0000 7f5cb37fe640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 0x7f5c9c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:10.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.738+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5ca40b06b0 con 0x7f5cb4102270 2024-04-27T07:45:10.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.739+0000 7f5cb37fe640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 0x7f5c9c071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8004eb0 tx=0x7f5ca800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.743+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5ca4079510 con 0x7f5cb4102270 2024-04-27T07:45:10.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.966+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f5cb4109380 con 0x7f5cb4102270 2024-04-27T07:45:10.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.967+0000 7f5c9bfff640 1 -- 172.21.15.82:0/1738762251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v43) v1 ==== 107+0+4088 (secure 0 0 0) 0x7f5ca407cbd0 con 0x7f5cb4102270 2024-04-27T07:45:10.969 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:10.970 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:17.448847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-04-27T07:45:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 msgr2=0x7f5c9c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 0x7f5c9c071020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8004eb0 tx=0x7f5ca800b040 comp rx=0 tx=0).stop 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 msgr2=0x7f5cb41131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4004930 tx=0x7f5ca4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 shutdown_connections 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f5c9c06eb70 0x7f5c9c071020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cb4102270 0x7f5cb41131a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 --2- 172.21.15.82:0/1738762251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb4064390 0x7f5cb4112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 >> 172.21.15.82:0/1738762251 conn(0x7f5cb4071fd0 msgr2=0x7f5cb40fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 shutdown_connections 2024-04-27T07:45:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:10.969+0000 7f5cba0ae640 1 -- 172.21.15.82:0/1738762251 wait complete. 2024-04-27T07:45:10.983 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-04-27T07:45:10.983 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-27T07:45:10.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 -- 172.21.15.82:0/1164869951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 msgr2=0x7f10580fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 --2- 172.21.15.82:0/1164869951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f10580fb5c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f10480048d0 tx=0x7f1048009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 -- 172.21.15.82:0/1164869951 shutdown_connections 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 --2- 172.21.15.82:0/1164869951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f10580fb5c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 --2- 172.21.15.82:0/1164869951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 0x7f1058101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.081+0000 7f105e42e640 1 -- 172.21.15.82:0/1164869951 >> 172.21.15.82:0/1164869951 conn(0x7f1058071fd0 msgr2=0x7f10580723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:11.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.082+0000 7f105e42e640 1 -- 172.21.15.82:0/1164869951 shutdown_connections 2024-04-27T07:45:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.082+0000 7f105e42e640 1 -- 172.21.15.82:0/1164869951 wait complete. 2024-04-27T07:45:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.082+0000 7f105e42e640 1 Processor -- start 2024-04-27T07:45:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.082+0000 7f105e42e640 1 -- start start 2024-04-27T07:45:11.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 0x7f1058111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581125f0 con 0x7f10580fb150 2024-04-27T07:45:11.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058112760 con 0x7f1058101170 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35488/0 (socket says 172.21.15.82:35488) 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 -- 172.21.15.82:0/278006636 learned_addr learned my addr 172.21.15.82:0/278006636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f10577fe640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 0x7f1058111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 -- 172.21.15.82:0/278006636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 msgr2=0x7f1058111ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 0x7f1058111ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 -- 172.21.15.82:0/278006636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048005040 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1057fff640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f104c002a50 tx=0x7f104c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104c007c30 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105810be60 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f104c00f040 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104c00dbe0 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.083+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105810c380 con 0x7f10580fb150 2024-04-27T07:45:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.084+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10580fc870 con 0x7f10580fb150 2024-04-27T07:45:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.085+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f104c00dd40 con 0x7f10580fb150 2024-04-27T07:45:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.085+0000 7f1054ff9640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 0x7f1040071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.086+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f104c08e860 con 0x7f10580fb150 2024-04-27T07:45:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.086+0000 7f10577fe640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 0x7f1040071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.086+0000 7f10577fe640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 0x7f1040071020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10580f9a50 tx=0x7f1048009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.090+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f104c057610 con 0x7f10580fb150 2024-04-27T07:45:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.329+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f10580fe3a0 con 0x7f10580fb150 2024-04-27T07:45:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.330+0000 7f1054ff9640 1 -- 172.21.15.82:0/278006636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v43) v1 ==== 107+0+4870 (secure 0 0 0) 0x7f104c05acd0 con 0x7f10580fb150 2024-04-27T07:45:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:11.333 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:17.448847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/2940930803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2940930803},{"type":"v1","addr":"172.21.15.82:6827","nonce":2940930803}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-04-27T07:45:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 msgr2=0x7f1040071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 0x7f1040071020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10580f9a50 tx=0x7f1048009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 msgr2=0x7f1058111ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f104c002a50 tx=0x7f104c004600 comp rx=0 tx=0).stop 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 shutdown_connections 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f104006eb70 0x7f1040071020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1058101170 0x7f1058111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 --2- 172.21.15.82:0/278006636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10580fb150 0x7f1058111ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 >> 172.21.15.82:0/278006636 conn(0x7f1058071fd0 msgr2=0x7f10580fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 shutdown_connections 2024-04-27T07:45:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.332+0000 7f105e42e640 1 -- 172.21.15.82:0/278006636 wait complete. 2024-04-27T07:45:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: pgmap v331: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:45:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2305776040' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-27T07:45:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3058482649' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-27T07:45:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:11.346 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-04-27T07:45:11.346 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-27T07:45:11.346 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: pgmap v331: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2305776040' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3058482649' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-27T07:45:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:11.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- 172.21.15.82:0/842305751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 msgr2=0x7f8fb8101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/842305751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8101440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009c50 tx=0x7f8fb0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:11.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- 172.21.15.82:0/842305751 shutdown_connections 2024-04-27T07:45:11.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/842305751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 0x7f8fb80fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/842305751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8101440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- 172.21.15.82:0/842305751 >> 172.21.15.82:0/842305751 conn(0x7f8fb80f6be0 msgr2=0x7f8fb80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- 172.21.15.82:0/842305751 shutdown_connections 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- 172.21.15.82:0/842305751 wait complete. 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 Processor -- start 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.440+0000 7f8fc04ae640 1 -- start start 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 0x7f8fb8112070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8112670 con 0x7f8fb8101070 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb810bcc0 con 0x7f8fb8101a10 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35508/0 (socket says 172.21.15.82:35508) 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 -- 172.21.15.82:0/2623682469 learned_addr learned my addr 172.21.15.82:0/2623682469 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:11.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbda49640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 0x7f8fb8112070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 -- 172.21.15.82:0/2623682469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 msgr2=0x7f8fb8112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 0x7f8fb8112070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 -- 172.21.15.82:0/2623682469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00098b0 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fbe24a640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0004a30 tx=0x7f8fb0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb003a070 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fb0035b20 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb810bf40 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb003eaa0 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.441+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb810c4e0 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.442+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb80fc7e0 con 0x7f8fb8101070 2024-04-27T07:45:11.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.443+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8fb0032070 con 0x7f8fb8101070 2024-04-27T07:45:11.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.443+0000 7f8faeffd640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 0x7f8fa4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.443+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8fb00b1150 con 0x7f8fb8101070 2024-04-27T07:45:11.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.443+0000 7f8fbda49640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 0x7f8fa4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.444+0000 7f8fbda49640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 0x7f8fa4071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fb810d3f0 tx=0x7f8fa8009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.448+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8fb0079f00 con 0x7f8fb8101070 2024-04-27T07:45:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.663+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f8fb8064350 con 0x7f8fb8101070 2024-04-27T07:45:11.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.664+0000 7f8faeffd640 1 -- 172.21.15.82:0/2623682469 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v43) v1 ==== 107+0+4073 (secure 0 0 0) 0x7f8fb007d5c0 con 0x7f8fb8101070 2024-04-27T07:45:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:11.667 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:30.474565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 msgr2=0x7f8fa4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 0x7f8fa4071020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8fb810d3f0 tx=0x7f8fa8009040 comp rx=0 tx=0).stop 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 msgr2=0x7f8fb8111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0004a30 tx=0x7f8fb0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 shutdown_connections 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8fa406eb70 0x7f8fa4071020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fb8101a10 0x7f8fb8112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 --2- 172.21.15.82:0/2623682469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fb8101070 0x7f8fb8111b30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 >> 172.21.15.82:0/2623682469 conn(0x7f8fb80f6be0 msgr2=0x7f8fb80f7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 shutdown_connections 2024-04-27T07:45:11.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.666+0000 7f8fc04ae640 1 -- 172.21.15.82:0/2623682469 wait complete. 2024-04-27T07:45:11.680 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-04-27T07:45:11.680 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-27T07:45:11.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 -- 172.21.15.82:0/4226459624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c4101170 msgr2=0x7f79c4101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 --2- 172.21.15.82:0/4226459624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c4101170 0x7f79c4101540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f79b40048d0 tx=0x7f79b4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 -- 172.21.15.82:0/4226459624 shutdown_connections 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 --2- 172.21.15.82:0/4226459624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40fb150 0x7f79c40fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 --2- 172.21.15.82:0/4226459624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c4101170 0x7f79c4101540 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 -- 172.21.15.82:0/4226459624 >> 172.21.15.82:0/4226459624 conn(0x7f79c4071fd0 msgr2=0x7f79c40723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 -- 172.21.15.82:0/4226459624 shutdown_connections 2024-04-27T07:45:11.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.773+0000 7f79c899d640 1 -- 172.21.15.82:0/4226459624 wait complete. 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 Processor -- start 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 -- start start 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c4101170 0x7f79c410e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4065310 con 0x7f79c40fb150 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c899d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c410e8c0 con 0x7f79c4101170 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35536/0 (socket says 172.21.15.82:35536) 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 -- 172.21.15.82:0/4014839067 learned_addr learned my addr 172.21.15.82:0/4014839067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 -- 172.21.15.82:0/4014839067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c4101170 msgr2=0x7f79c410e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c4101170 0x7f79c410e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.774+0000 7f79c259c640 1 -- 172.21.15.82:0/4014839067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b4005040 con 0x7f79c40fb150 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79c259c640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004930 tx=0x7f79b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b40094c0 con 0x7f79c40fb150 2024-04-27T07:45:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c410eb40 con 0x7f79c40fb150 2024-04-27T07:45:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79b4032e50 con 0x7f79c40fb150 2024-04-27T07:45:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79b40433b0 con 0x7f79c40fb150 2024-04-27T07:45:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.775+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c4117070 con 0x7f79c40fb150 2024-04-27T07:45:11.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.776+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c40fc870 con 0x7f79c40fb150 2024-04-27T07:45:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.776+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f79b402f070 con 0x7f79c40fb150 2024-04-27T07:45:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.776+0000 7f79b2ffd640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 0x7f79ac071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.777+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f79b40b08b0 con 0x7f79c40fb150 2024-04-27T07:45:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.777+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 0x7f79ac071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.777+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 0x7f79ac071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79c4064b60 tx=0x7f79b8007c30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:11.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:11.781+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f79b4079660 con 0x7f79c40fb150 2024-04-27T07:45:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.001+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f79c4063f00 con 0x7f79c40fb150 2024-04-27T07:45:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.002+0000 7f79b2ffd640 1 -- 172.21.15.82:0/4014839067 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v43) v1 ==== 107+0+4084 (secure 0 0 0) 0x7f79b407cd20 con 0x7f79c40fb150 2024-04-27T07:45:12.005 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:12.005 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:30.478792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34410":{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-04-27T07:45:12.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 msgr2=0x7f79ac071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 0x7f79ac071020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79c4064b60 tx=0x7f79b8007c30 comp rx=0 tx=0).stop 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 msgr2=0x7f79c410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f79b4004930 tx=0x7f79b4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 shutdown_connections 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f79ac06eb70 0x7f79ac071020 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c4101170 0x7f79c410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 --2- 172.21.15.82:0/4014839067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c40fb150 0x7f79c410de10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 >> 172.21.15.82:0/4014839067 conn(0x7f79c4071fd0 msgr2=0x7f79c40fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 shutdown_connections 2024-04-27T07:45:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.004+0000 7f79c899d640 1 -- 172.21.15.82:0/4014839067 wait complete. 2024-04-27T07:45:12.017 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-04-27T07:45:12.017 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-27T07:45:12.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 -- 172.21.15.82:0/3366488754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101070 msgr2=0x7f77f4101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 --2- 172.21.15.82:0/3366488754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101070 0x7f77f4101440 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0048d0 tx=0x7f77ec009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 -- 172.21.15.82:0/3366488754 shutdown_connections 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 --2- 172.21.15.82:0/3366488754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101a10 0x7f77f40fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 --2- 172.21.15.82:0/3366488754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101070 0x7f77f4101440 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 -- 172.21.15.82:0/3366488754 >> 172.21.15.82:0/3366488754 conn(0x7f77f40f6be0 msgr2=0x7f77f40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 -- 172.21.15.82:0/3366488754 shutdown_connections 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.110+0000 7f77f9221640 1 -- 172.21.15.82:0/3366488754 wait complete. 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 Processor -- start 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 -- start start 2024-04-27T07:45:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101070 0x7f77f4111bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41127c0 con 0x7f77f4101a10 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f9221640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410bd80 con 0x7f77f4101070 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35560/0 (socket says 172.21.15.82:35560) 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 -- 172.21.15.82:0/1261181450 learned_addr learned my addr 172.21.15.82:0/1261181450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f2d9d640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101070 0x7f77f4111bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 -- 172.21.15.82:0/1261181450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101070 msgr2=0x7f77f4111bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101070 0x7f77f4111bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.111+0000 7f77f259c640 1 -- 172.21.15.82:0/1261181450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec005040 con 0x7f77f4101a10 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77f259c640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f77e800bbb0 tx=0x7f77e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e800c940 con 0x7f77f4101a10 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77e80092e0 con 0x7f77f4101a10 2024-04-27T07:45:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f410c060 con 0x7f77f4101a10 2024-04-27T07:45:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e8007640 con 0x7f77f4101a10 2024-04-27T07:45:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.112+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f410c580 con 0x7f77f4101a10 2024-04-27T07:45:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.113+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f40fc7e0 con 0x7f77f4101a10 2024-04-27T07:45:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.113+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f77e8012070 con 0x7f77f4101a10 2024-04-27T07:45:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.114+0000 7f77db7fe640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 0x7f77dc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.114+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f77e808e9a0 con 0x7f77f4101a10 2024-04-27T07:45:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.114+0000 7f77f2d9d640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 0x7f77dc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.114+0000 7f77f2d9d640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 0x7f77dc071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0048a0 tx=0x7f77ec009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.118+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f77e8057750 con 0x7f77f4101a10 2024-04-27T07:45:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.332+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f77f4108290 con 0x7f77f4101a10 2024-04-27T07:45:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.333+0000 7f77db7fe640 1 -- 172.21.15.82:0/1261181450 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v43) v1 ==== 107+0+4088 (secure 0 0 0) 0x7f77e805ae10 con 0x7f77f4101a10 2024-04-27T07:45:12.335 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:12.335 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:36.461845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34410":{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 msgr2=0x7f77dc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 0x7f77dc071020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0048a0 tx=0x7f77ec009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 msgr2=0x7f77f4112130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f77e800bbb0 tx=0x7f77e8009840 comp rx=0 tx=0).stop 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 shutdown_connections 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f77dc06eb70 0x7f77dc071020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f4101a10 0x7f77f4112130 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 --2- 172.21.15.82:0/1261181450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77f4101070 0x7f77f4111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 >> 172.21.15.82:0/1261181450 conn(0x7f77f40f6be0 msgr2=0x7f77f40f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 shutdown_connections 2024-04-27T07:45:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.335+0000 7f77f9221640 1 -- 172.21.15.82:0/1261181450 wait complete. 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1738762251' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/278006636' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-27T07:45:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:11 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2623682469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-27T07:45:12.348 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-04-27T07:45:12.349 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-27T07:45:12.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-27T07:45:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1738762251' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-27T07:45:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:45:12.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:45:12.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:45:12.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/278006636' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-27T07:45:12.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:11 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2623682469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-27T07:45:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- 172.21.15.82:0/3948264342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 msgr2=0x7fe3940fd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 --2- 172.21.15.82:0/3948264342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe3940fd550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe390004900 tx=0x7fe390009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- 172.21.15.82:0/3948264342 shutdown_connections 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 --2- 172.21.15.82:0/3948264342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3940fdb20 0x7fe3941061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 --2- 172.21.15.82:0/3948264342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe3940fd550 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- 172.21.15.82:0/3948264342 >> 172.21.15.82:0/3948264342 conn(0x7fe3940f6be0 msgr2=0x7fe3940f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- 172.21.15.82:0/3948264342 shutdown_connections 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- 172.21.15.82:0/3948264342 wait complete. 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 Processor -- start 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.441+0000 7fe39baae640 1 -- start start 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3940fdb20 0x7fe3941133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394113a40 con 0x7fe3940fd180 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39410d000 con 0x7fe3940fdb20 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35576/0 (socket says 172.21.15.82:35576) 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 -- 172.21.15.82:0/1997195746 learned_addr learned my addr 172.21.15.82:0/1997195746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 -- 172.21.15.82:0/1997195746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3940fdb20 msgr2=0x7fe3941133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3940fdb20 0x7fe3941133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 -- 172.21.15.82:0/1997195746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390005040 con 0x7fe3940fd180 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39984a640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe390000c00 tx=0x7fe390009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3900094c0 con 0x7fe3940fd180 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe39003d920 con 0x7fe3940fd180 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39410d280 con 0x7fe3940fd180 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe39003b930 con 0x7fe3940fd180 2024-04-27T07:45:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.442+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39410d7a0 con 0x7fe3940fd180 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.443+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394066040 con 0x7fe3940fd180 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.444+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fe39003da90 con 0x7fe3940fd180 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.444+0000 7fe38a7fc640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 0x7fe380071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.444+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe3900b1150 con 0x7fe3940fd180 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.444+0000 7fe399049640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 0x7fe380071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.445+0000 7fe399049640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 0x7fe380071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe39410e730 tx=0x7fe384006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.449+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe390079fc0 con 0x7fe3940fd180 2024-04-27T07:45:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.665+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fe394064350 con 0x7fe3940fd180 2024-04-27T07:45:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.665+0000 7fe38a7fc640 1 -- 172.21.15.82:0/1997195746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v43) v1 ==== 107+0+4085 (secure 0 0 0) 0x7fe39007d680 con 0x7fe3940fd180 2024-04-27T07:45:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:12.668 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:36.925371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34410":{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 msgr2=0x7fe380071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 0x7fe380071020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe39410e730 tx=0x7fe384006d20 comp rx=0 tx=0).stop 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 msgr2=0x7fe394112e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe390000c00 tx=0x7fe390009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 shutdown_connections 2024-04-27T07:45:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fe38006eb70 0x7fe380071020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3940fdb20 0x7fe3941133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 --2- 172.21.15.82:0/1997195746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3940fd180 0x7fe394112e70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.667+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 >> 172.21.15.82:0/1997195746 conn(0x7fe3940f6be0 msgr2=0x7fe3940f80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.668+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 shutdown_connections 2024-04-27T07:45:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.668+0000 7fe39baae640 1 -- 172.21.15.82:0/1997195746 wait complete. 2024-04-27T07:45:12.681 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-04-27T07:45:12.681 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-27T07:45:12.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 -- 172.21.15.82:0/3951650096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 msgr2=0x7f4a900faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3951650096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a900faea0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4a780048d0 tx=0x7f4a78009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 -- 172.21.15.82:0/3951650096 shutdown_connections 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3951650096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a900faea0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3951650096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a90102420 0x7f4a901027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 -- 172.21.15.82:0/3951650096 >> 172.21.15.82:0/3951650096 conn(0x7f4a90071990 msgr2=0x7f4a90071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 -- 172.21.15.82:0/3951650096 shutdown_connections 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.774+0000 7f4a94cae640 1 -- 172.21.15.82:0/3951650096 wait complete. 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 Processor -- start 2024-04-27T07:45:12.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 -- start start 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a90102420 0x7f4a90113430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90113a30 con 0x7f4a900faa50 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9010d080 con 0x7f4a90102420 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35596/0 (socket says 172.21.15.82:35596) 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 -- 172.21.15.82:0/3604455611 learned_addr learned my addr 172.21.15.82:0/3604455611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 -- 172.21.15.82:0/3604455611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a90102420 msgr2=0x7f4a90113430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a90102420 0x7f4a90113430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 -- 172.21.15.82:0/3604455611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78005040 con 0x7f4a900faa50 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a8e59c640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000c830 tx=0x7f4a80004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8000a850 con 0x7f4a900faa50 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9010d360 con 0x7f4a900faa50 2024-04-27T07:45:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a8000ae80 con 0x7f4a900faa50 2024-04-27T07:45:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.775+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a80012ea0 con 0x7f4a900faa50 2024-04-27T07:45:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.776+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9010d880 con 0x7f4a900faa50 2024-04-27T07:45:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.776+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a90065560 con 0x7f4a900faa50 2024-04-27T07:45:12.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.777+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4a80012400 con 0x7f4a900faa50 2024-04-27T07:45:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.777+0000 7f4a86ffd640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 0x7f4a7c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.777+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4a8008eb20 con 0x7f4a900faa50 2024-04-27T07:45:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.777+0000 7f4a87fff640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 0x7f4a7c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.778+0000 7f4a87fff640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 0x7f4a7c071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a780043d0 tx=0x7f4a78009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.782+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4a80057950 con 0x7f4a900faa50 2024-04-27T07:45:13.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.998+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f4a90064350 con 0x7f4a900faa50 2024-04-27T07:45:13.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:12.999+0000 7f4a86ffd640 1 -- 172.21.15.82:0/3604455611 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v43) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f4a800126b0 con 0x7f4a900faa50 2024-04-27T07:45:13.002 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:13.002 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:38.931587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34410":{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34410,"qdb_cluster":[34410]},"id":1}]} 2024-04-27T07:45:13.002 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-04-27T07:45:13.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 msgr2=0x7f4a7c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 0x7f4a7c071020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a780043d0 tx=0x7f4a78009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 msgr2=0x7f4a90112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000c830 tx=0x7f4a80004430 comp rx=0 tx=0).stop 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 shutdown_connections 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4a7c06eb70 0x7f4a7c071020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a90102420 0x7f4a90113430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 --2- 172.21.15.82:0/3604455611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a900faa50 0x7f4a90112ef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 >> 172.21.15.82:0/3604455611 conn(0x7f4a90071990 msgr2=0x7f4a900f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 shutdown_connections 2024-04-27T07:45:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.001+0000 7f4a94cae640 1 -- 172.21.15.82:0/3604455611 wait complete. 2024-04-27T07:45:13.014 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-04-27T07:45:13.014 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-27T07:45:13.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-27T07:45:13.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 -- 172.21.15.82:0/1237682107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 msgr2=0x7f8b180faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/1237682107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b180faea0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0048d0 tx=0x7f8b0c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 -- 172.21.15.82:0/1237682107 shutdown_connections 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/1237682107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b180faea0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/1237682107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 0x7f8b181027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 -- 172.21.15.82:0/1237682107 >> 172.21.15.82:0/1237682107 conn(0x7f8b18071990 msgr2=0x7f8b18071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 -- 172.21.15.82:0/1237682107 shutdown_connections 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.107+0000 7f8b1eaae640 1 -- 172.21.15.82:0/1237682107 wait complete. 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 Processor -- start 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 -- start start 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 0x7f8b18113430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18113a30 con 0x7f8b180faa50 2024-04-27T07:45:13.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1eaae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1810d080 con 0x7f8b18102420 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35620/0 (socket says 172.21.15.82:35620) 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 -- 172.21.15.82:0/3605000923 learned_addr learned my addr 172.21.15.82:0/3605000923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b17fff640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 0x7f8b18113430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 -- 172.21.15.82:0/3605000923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 msgr2=0x7f8b18113430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 0x7f8b18113430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.108+0000 7f8b1c84a640 1 -- 172.21.15.82:0/3605000923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c005040 con 0x7f8b180faa50 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b1c84a640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b08002a50 tx=0x7f8b08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b08007c30 con 0x7f8b180faa50 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1810d360 con 0x7f8b180faa50 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b0800f040 con 0x7f8b180faa50 2024-04-27T07:45:13.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b0800db50 con 0x7f8b180faa50 2024-04-27T07:45:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.109+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1810d850 con 0x7f8b180faa50 2024-04-27T07:45:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.110+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18064350 con 0x7f8b180faa50 2024-04-27T07:45:13.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.110+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8b0801c400 con 0x7f8b180faa50 2024-04-27T07:45:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.111+0000 7f8b157fa640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 0x7f8b00071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.111+0000 7f8b17fff640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 0x7f8b00071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.111+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8b0808e190 con 0x7f8b180faa50 2024-04-27T07:45:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.111+0000 7f8b17fff640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 0x7f8b00071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8b180f8ef0 tx=0x7f8b0c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.116+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8b08056f40 con 0x7f8b180faa50 2024-04-27T07:45:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.329+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f8b18065590 con 0x7f8b180faa50 2024-04-27T07:45:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.330+0000 7f8b157fa640 1 -- 172.21.15.82:0/3605000923 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v43) v1 ==== 107+0+4941 (secure 0 0 0) 0x7f8b0805a600 con 0x7f8b180faa50 2024-04-27T07:45:13.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:13.333 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:38.931587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34410},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34410":{"gid":34410,"name":"cephfs.smithi082.bqtewe","rank":0,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.82:6829/3714048367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3714048367},{"type":"v1","addr":"172.21.15.82:6829","nonce":3714048367}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34410,"qdb_cluster":[34410]},"id":1}]} 2024-04-27T07:45:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-04-27T07:45:13.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 msgr2=0x7f8b00071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 0x7f8b00071020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8b180f8ef0 tx=0x7f8b0c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 msgr2=0x7f8b18112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b08002a50 tx=0x7f8b08004600 comp rx=0 tx=0).stop 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 shutdown_connections 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8b0006eb70 0x7f8b00071020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b18102420 0x7f8b18113430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 --2- 172.21.15.82:0/3605000923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b180faa50 0x7f8b18112ef0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 >> 172.21.15.82:0/3605000923 conn(0x7f8b18071990 msgr2=0x7f8b180f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 shutdown_connections 2024-04-27T07:45:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.332+0000 7f8b1eaae640 1 -- 172.21.15.82:0/3605000923 wait complete. 2024-04-27T07:45:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:12 smithi082 ceph-mon[91103]: pgmap v332: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:12 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/4014839067' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-27T07:45:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:12 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1261181450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-27T07:45:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:12 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1997195746' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-27T07:45:13.345 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-04-27T07:45:13.345 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-27T07:45:13.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-27T07:45:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:12 smithi100 ceph-mon[80397]: pgmap v332: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:12 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/4014839067' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-27T07:45:13.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:12 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1261181450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-27T07:45:13.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:12 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1997195746' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-27T07:45:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 -- 172.21.15.82:0/1815778723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc06f7b0 msgr2=0x7f76fc06fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 --2- 172.21.15.82:0/1815778723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc06f7b0 0x7f76fc06fb80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0048d0 tx=0x7f76ec009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 -- 172.21.15.82:0/1815778723 shutdown_connections 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 --2- 172.21.15.82:0/1815778723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc0700c0 0x7f76fc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 --2- 172.21.15.82:0/1815778723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc06f7b0 0x7f76fc06fb80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 -- 172.21.15.82:0/1815778723 >> 172.21.15.82:0/1815778723 conn(0x7f76fc0f7db0 msgr2=0x7f76fc0fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 -- 172.21.15.82:0/1815778723 shutdown_connections 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.437+0000 7f770286e640 1 -- 172.21.15.82:0/1815778723 wait complete. 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 Processor -- start 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 -- start start 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 0x7f76fc114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1159b0 con 0x7f76fc0700c0 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f770286e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc115b20 con 0x7f76fc06f7b0 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35632/0 (socket says 172.21.15.82:35632) 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 -- 172.21.15.82:0/1633129163 learned_addr learned my addr 172.21.15.82:0/1633129163 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 -- 172.21.15.82:0/1633129163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 msgr2=0x7f76fc114e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fbfff640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 0x7f76fc114e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 0x7f76fc114e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fb7fe640 1 -- 172.21.15.82:0/1633129163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec005040 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.438+0000 7f76fbfff640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 0x7f76fc114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f76fb7fe640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76e4002a50 tx=0x7f76e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e4007c30 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76e400f040 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc10f1b0 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e400db50 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.439+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc10f6d0 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.440+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc070ef0 con 0x7f76fc0700c0 2024-04-27T07:45:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.440+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f76e401c400 con 0x7f76fc0700c0 2024-04-27T07:45:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.441+0000 7f76f8ff9640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 0x7f76e8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.441+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f76e408e190 con 0x7f76fc0700c0 2024-04-27T07:45:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.441+0000 7f76fbfff640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 0x7f76e8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.441+0000 7f76fbfff640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 0x7f76e8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.445+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f76e4056f40 con 0x7f76fc0700c0 2024-04-27T07:45:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.658+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f76fc064350 con 0x7f76fc0700c0 2024-04-27T07:45:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.659+0000 7f76f8ff9640 1 -- 172.21.15.82:0/1633129163 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v43) v1 ==== 107+0+4141 (secure 0 0 0) 0x7f76e405a600 con 0x7f76fc0700c0 2024-04-27T07:45:13.662 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:13.662 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:55.150512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:13.662 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-04-27T07:45:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 msgr2=0x7f76e8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 0x7f76e8071020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 msgr2=0x7f76fc1153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76e4002a50 tx=0x7f76e4004600 comp rx=0 tx=0).stop 2024-04-27T07:45:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 shutdown_connections 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f76e806eb70 0x7f76e8071020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76fc0700c0 0x7f76fc1153b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 --2- 172.21.15.82:0/1633129163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76fc06f7b0 0x7f76fc114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 >> 172.21.15.82:0/1633129163 conn(0x7f76fc0f7db0 msgr2=0x7f76fc100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 shutdown_connections 2024-04-27T07:45:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.661+0000 7f770286e640 1 -- 172.21.15.82:0/1633129163 wait complete. 2024-04-27T07:45:13.675 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-04-27T07:45:13.675 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-27T07:45:13.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- 172.21.15.82:0/3621242639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fdb50 msgr2=0x7f7444106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 --2- 172.21.15.82:0/3621242639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fdb50 0x7f7444106190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f74340048d0 tx=0x7f7434009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- 172.21.15.82:0/3621242639 shutdown_connections 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 --2- 172.21.15.82:0/3621242639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fdb50 0x7f7444106190 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 --2- 172.21.15.82:0/3621242639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fd1b0 0x7f74440fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- 172.21.15.82:0/3621242639 >> 172.21.15.82:0/3621242639 conn(0x7f74440f6c60 msgr2=0x7f74440f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- 172.21.15.82:0/3621242639 shutdown_connections 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- 172.21.15.82:0/3621242639 wait complete. 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 Processor -- start 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.767+0000 7f744a66e640 1 -- start start 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fdb50 0x7f7444113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7444113810 con 0x7f74440fd1b0 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744410ce60 con 0x7f74440fdb50 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35648/0 (socket says 172.21.15.82:35648) 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 -- 172.21.15.82:0/2025388082 learned_addr learned my addr 172.21.15.82:0/2025388082 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f74437fe640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fdb50 0x7f7444113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 -- 172.21.15.82:0/2025388082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fdb50 msgr2=0x7f7444113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fdb50 0x7f7444113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 -- 172.21.15.82:0/2025388082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434005040 con 0x7f74440fd1b0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7443fff640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f743800c810 tx=0x7f74380043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743800a820 con 0x7f74440fd1b0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744410d140 con 0x7f74440fd1b0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f743800ae50 con 0x7f74440fd1b0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74380115c0 con 0x7f74440fd1b0 2024-04-27T07:45:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.768+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744410d630 con 0x7f74440fd1b0 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.769+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7444066080 con 0x7f74440fd1b0 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.770+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f743800a980 con 0x7f74440fd1b0 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.770+0000 7f7440ff9640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 0x7f742c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.770+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f743808ee50 con 0x7f74440fd1b0 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.770+0000 7f74437fe640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 0x7f742c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.770+0000 7f74437fe640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 0x7f742c071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f74440fe520 tx=0x7f7434009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.775+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7438057c00 con 0x7f74440fd1b0 2024-04-27T07:45:13.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.990+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f744410e340 con 0x7f74440fd1b0 2024-04-27T07:45:13.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.991+0000 7f7440ff9640 1 -- 172.21.15.82:0/2025388082 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v43) v1 ==== 107+0+4220 (secure 0 0 0) 0x7f743805b2c0 con 0x7f74440fd1b0 2024-04-27T07:45:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:13.994 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:40:55.155183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:13.994 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 32 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 msgr2=0x7f742c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 0x7f742c071020 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f74440fe520 tx=0x7f7434009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 msgr2=0x7f7444112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f743800c810 tx=0x7f74380043c0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 shutdown_connections 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f742c06eb70 0x7f742c071020 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74440fdb50 0x7f7444113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 --2- 172.21.15.82:0/2025388082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74440fd1b0 0x7f7444112cd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 >> 172.21.15.82:0/2025388082 conn(0x7f74440f6c60 msgr2=0x7f74440f8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:13.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 shutdown_connections 2024-04-27T07:45:13.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:13.993+0000 7f744a66e640 1 -- 172.21.15.82:0/2025388082 wait complete. 2024-04-27T07:45:14.006 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-04-27T07:45:14.007 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-27T07:45:14.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 -- 172.21.15.82:0/2168559106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358101170 msgr2=0x7f1358101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 --2- 172.21.15.82:0/2168559106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358101170 0x7f1358101540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1354009c50 tx=0x7f1354004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 -- 172.21.15.82:0/2168559106 shutdown_connections 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 --2- 172.21.15.82:0/2168559106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13580fb150 0x7f13580fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 --2- 172.21.15.82:0/2168559106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1358101170 0x7f1358101540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 -- 172.21.15.82:0/2168559106 >> 172.21.15.82:0/2168559106 conn(0x7f1358071fd0 msgr2=0x7f13580723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 -- 172.21.15.82:0/2168559106 shutdown_connections 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.098+0000 7f135f621640 1 -- 172.21.15.82:0/2168559106 wait complete. 2024-04-27T07:45:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 Processor -- start 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 -- start start 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358101170 0x7f1358113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358113780 con 0x7f13580fb150 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135f621640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135810cdd0 con 0x7f1358101170 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35674/0 (socket says 172.21.15.82:35674) 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 -- 172.21.15.82:0/975969651 learned_addr learned my addr 172.21.15.82:0/975969651 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 -- 172.21.15.82:0/975969651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358101170 msgr2=0x7f1358113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358101170 0x7f1358113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.099+0000 7f135d3bd640 1 -- 172.21.15.82:0/975969651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540098b0 con 0x7f13580fb150 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f135d3bd640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1354004a30 tx=0x7f1354004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135403a070 con 0x7f13580fb150 2024-04-27T07:45:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1354035b20 con 0x7f13580fb150 2024-04-27T07:45:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135403eaa0 con 0x7f13580fb150 2024-04-27T07:45:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135810d050 con 0x7f13580fb150 2024-04-27T07:45:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.100+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135810d5a0 con 0x7f13580fb150 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.101+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13580fc870 con 0x7f13580fb150 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.102+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f1354032070 con 0x7f13580fb150 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.102+0000 7f134dffb640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 0x7f1344071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.102+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f13540b1200 con 0x7f13580fb150 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.102+0000 7f135cbbc640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 0x7f1344071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.102+0000 7f135cbbc640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 0x7f1344071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135810e500 tx=0x7f1348007cb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.107+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f135407a060 con 0x7f13580fb150 2024-04-27T07:45:14.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.321+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1358063f00 con 0x7f13580fb150 2024-04-27T07:45:14.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.321+0000 7f134dffb640 1 -- 172.21.15.82:0/975969651 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v43) v1 ==== 107+0+4223 (secure 0 0 0) 0x7f135407d720 con 0x7f13580fb150 2024-04-27T07:45:14.324 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:14.325 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:01.148226+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:14.325 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2024-04-27T07:45:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.323+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 msgr2=0x7f1344071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.323+0000 7f135f621640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 0x7f1344071020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f135810e500 tx=0x7f1348007cb0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.323+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 msgr2=0x7f1358112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.323+0000 7f135f621640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1354004a30 tx=0x7f1354004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:14.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 shutdown_connections 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f134406eb70 0x7f1344071020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1358101170 0x7f1358113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 --2- 172.21.15.82:0/975969651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13580fb150 0x7f1358112c40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 >> 172.21.15.82:0/975969651 conn(0x7f1358071fd0 msgr2=0x7f13580645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 shutdown_connections 2024-04-27T07:45:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.324+0000 7f135f621640 1 -- 172.21.15.82:0/975969651 wait complete. 2024-04-27T07:45:14.336 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:13 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3604455611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-27T07:45:14.336 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:13 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3605000923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-27T07:45:14.336 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:13 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1633129163' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-27T07:45:14.337 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-04-27T07:45:14.337 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-27T07:45:14.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-27T07:45:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:13 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3604455611' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-27T07:45:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:13 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3605000923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-27T07:45:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:13 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1633129163' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-27T07:45:14.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- 172.21.15.82:0/4042617046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 msgr2=0x7fd1d0100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 --2- 172.21.15.82:0/4042617046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d0100530 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0048d0 tx=0x7fd1cc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- 172.21.15.82:0/4042617046 shutdown_connections 2024-04-27T07:45:14.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 --2- 172.21.15.82:0/4042617046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 0x7fd1d00fbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 --2- 172.21.15.82:0/4042617046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d0100530 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- 172.21.15.82:0/4042617046 >> 172.21.15.82:0/4042617046 conn(0x7fd1d00717e0 msgr2=0x7fd1d0071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- 172.21.15.82:0/4042617046 shutdown_connections 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- 172.21.15.82:0/4042617046 wait complete. 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 Processor -- start 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- start start 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 0x7fd1d010dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00fb880 con 0x7fd1d0100160 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d771d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d010ea60 con 0x7fd1d00fb9d0 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.430+0000 7fd1d4cb8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35700/0 (socket says 172.21.15.82:35700) 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 -- 172.21.15.82:0/997030071 learned_addr learned my addr 172.21.15.82:0/997030071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d54b9640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 0x7fd1d010dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 -- 172.21.15.82:0/997030071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 msgr2=0x7fd1d010dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 0x7fd1d010dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 -- 172.21.15.82:0/997030071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc005040 con 0x7fd1d0100160 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d4cb8640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0002a50 tx=0x7fd1c0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c0007c30 con 0x7fd1d0100160 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1c000f040 con 0x7fd1d0100160 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d010ed40 con 0x7fd1d0100160 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1c000db50 con 0x7fd1d0100160 2024-04-27T07:45:14.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.431+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d01172d0 con 0x7fd1d0100160 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.432+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d00fc9e0 con 0x7fd1d0100160 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.433+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fd1c001c400 con 0x7fd1d0100160 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.433+0000 7fd1c5ffb640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 0x7fd1bc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.433+0000 7fd1d54b9640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 0x7fd1bc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.433+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1c008e0e0 con 0x7fd1d0100160 2024-04-27T07:45:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.434+0000 7fd1d54b9640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 0x7fd1bc071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc003080 tx=0x7fd1cc009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.438+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd1c0056f40 con 0x7fd1d0100160 2024-04-27T07:45:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.656+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fd1d01083e0 con 0x7fd1d0100160 2024-04-27T07:45:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.657+0000 7fd1c5ffb640 1 -- 172.21.15.82:0/997030071 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v43) v1 ==== 107+0+4220 (secure 0 0 0) 0x7fd1c005a600 con 0x7fd1d0100160 2024-04-27T07:45:14.660 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:14.660 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:01.202370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-27T07:45:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 34 2024-04-27T07:45:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 msgr2=0x7fd1bc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 0x7fd1bc071020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc003080 tx=0x7fd1cc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 msgr2=0x7fd1d010e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0002a50 tx=0x7fd1c0004600 comp rx=0 tx=0).stop 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 shutdown_connections 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fd1bc06eb70 0x7fd1bc071020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1d0100160 0x7fd1d010e4f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 --2- 172.21.15.82:0/997030071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1d00fb9d0 0x7fd1d010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 >> 172.21.15.82:0/997030071 conn(0x7fd1d00717e0 msgr2=0x7fd1d00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 shutdown_connections 2024-04-27T07:45:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.659+0000 7fd1d771d640 1 -- 172.21.15.82:0/997030071 wait complete. 2024-04-27T07:45:14.673 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-04-27T07:45:14.673 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-04-27T07:45:14.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-27T07:45:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 -- 172.21.15.82:0/1217956748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a0101170 msgr2=0x7fc7a0101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1217956748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a0101170 0x7fc7a0101540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc790009c50 tx=0x7fc790004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 -- 172.21.15.82:0/1217956748 shutdown_connections 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1217956748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a00fb150 0x7fc7a00fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1217956748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a0101170 0x7fc7a0101540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.765+0000 7fc7a542e640 1 -- 172.21.15.82:0/1217956748 >> 172.21.15.82:0/1217956748 conn(0x7fc7a0071fd0 msgr2=0x7fc7a00723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 -- 172.21.15.82:0/1217956748 shutdown_connections 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 -- 172.21.15.82:0/1217956748 wait complete. 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 Processor -- start 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 -- start start 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a0101170 0x7fc7a010e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.766+0000 7fc7a542e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00652f0 con 0x7fc7a00fb150 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7a542e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a010e900 con 0x7fc7a0101170 2024-04-27T07:45:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35718/0 (socket says 172.21.15.82:35718) 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 -- 172.21.15.82:0/1509504139 learned_addr learned my addr 172.21.15.82:0/1509504139 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79e7fc640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a0101170 0x7fc7a010e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 -- 172.21.15.82:0/1509504139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a0101170 msgr2=0x7fc7a010e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a0101170 0x7fc7a010e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 -- 172.21.15.82:0/1509504139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900098b0 con 0x7fc7a00fb150 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc79effd640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc790004f80 tx=0x7fc790004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79003a070 con 0x7fc7a00fb150 2024-04-27T07:45:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc790009740 con 0x7fc7a00fb150 2024-04-27T07:45:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a010eb80 con 0x7fc7a00fb150 2024-04-27T07:45:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79003ea60 con 0x7fc7a00fb150 2024-04-27T07:45:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.767+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a01171c0 con 0x7fc7a00fb150 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.768+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a00fc870 con 0x7fc7a00fb150 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.769+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc790032070 con 0x7fc7a00fb150 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.769+0000 7fc7877fe640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 0x7fc788071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.769+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc7900b0940 con 0x7fc7a00fb150 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.769+0000 7fc79e7fc640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 0x7fc788071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.770+0000 7fc79e7fc640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 0x7fc788071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0064b40 tx=0x7fc79400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:14.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.774+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc7900797a0 con 0x7fc7a00fb150 2024-04-27T07:45:14.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.988+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fc7a00fe3a0 con 0x7fc7a00fb150 2024-04-27T07:45:14.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.989+0000 7fc7877fe640 1 -- 172.21.15.82:0/1509504139 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v43) v1 ==== 107+0+4229 (secure 0 0 0) 0x7fc79007ce60 con 0x7fc7a00fb150 2024-04-27T07:45:14.991 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:14.992 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:14.992 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 35 2024-04-27T07:45:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 msgr2=0x7fc788071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 0x7fc788071020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0064b40 tx=0x7fc79400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 msgr2=0x7fc7a010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc790004f80 tx=0x7fc790004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 shutdown_connections 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc78806eb70 0x7fc788071020 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a0101170 0x7fc7a010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 --2- 172.21.15.82:0/1509504139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7a00fb150 0x7fc7a010de80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 >> 172.21.15.82:0/1509504139 conn(0x7fc7a0071fd0 msgr2=0x7fc7a00fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 shutdown_connections 2024-04-27T07:45:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:14.991+0000 7fc7a542e640 1 -- 172.21.15.82:0/1509504139 wait complete. 2024-04-27T07:45:15.004 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-04-27T07:45:15.004 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-04-27T07:45:15.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-04-27T07:45:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- 172.21.15.82:0/1971001595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 msgr2=0x7f83d80fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 --2- 172.21.15.82:0/1971001595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d80fb0a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83d40048d0 tx=0x7f83d4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- 172.21.15.82:0/1971001595 shutdown_connections 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 --2- 172.21.15.82:0/1971001595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d80fb0a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 --2- 172.21.15.82:0/1971001595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 0x7f83d8101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- 172.21.15.82:0/1971001595 >> 172.21.15.82:0/1971001595 conn(0x7f83d80f6be0 msgr2=0x7f83d80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- 172.21.15.82:0/1971001595 shutdown_connections 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- 172.21.15.82:0/1971001595 wait complete. 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 Processor -- start 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.097+0000 7f83dfcae640 1 -- start start 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 0x7f83d810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d8066720 con 0x7f83d8101a10 2024-04-27T07:45:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d810e910 con 0x7f83d8101070 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35742/0 (socket says 172.21.15.82:35742) 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 -- 172.21.15.82:0/3561440328 learned_addr learned my addr 172.21.15.82:0/3561440328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dda4a640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 0x7f83d810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 -- 172.21.15.82:0/3561440328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 msgr2=0x7f83d810de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 0x7f83d810de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 -- 172.21.15.82:0/3561440328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d4005040 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dd249640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83d4004930 tx=0x7f83d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d40094c0 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d810eb90 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83d4032e50 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d40433b0 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.098+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d81170c0 con 0x7f83d8101a10 2024-04-27T07:45:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.099+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d80fc7e0 con 0x7f83d8101a10 2024-04-27T07:45:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.100+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f83d402f070 con 0x7f83d8101a10 2024-04-27T07:45:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.100+0000 7f83ca7fc640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 0x7f83c4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.100+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f83d40b0670 con 0x7f83d8101a10 2024-04-27T07:45:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.100+0000 7f83dda4a640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 0x7f83c4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.100+0000 7f83dda4a640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 0x7f83c4071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83cc004ed0 tx=0x7f83cc00b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.105+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f83d40794d0 con 0x7f83d8101a10 2024-04-27T07:45:15.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.319+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f83d8064350 con 0x7f83d8101a10 2024-04-27T07:45:15.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.319+0000 7f83ca7fc640 1 -- 172.21.15.82:0/3561440328 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v43) v1 ==== 107+0+5073 (secure 0 0 0) 0x7f83d407cb90 con 0x7f83d8101a10 2024-04-27T07:45:15.322 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:15.322 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44303,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/2686792360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2686792360},{"type":"v1","addr":"172.21.15.100:6825","nonce":2686792360}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:15.322 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 36 2024-04-27T07:45:15.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 msgr2=0x7f83c4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 0x7f83c4071020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83cc004ed0 tx=0x7f83cc00b040 comp rx=0 tx=0).stop 2024-04-27T07:45:15.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 msgr2=0x7f83d810e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83d4004930 tx=0x7f83d4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 shutdown_connections 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f83c406eb70 0x7f83c4071020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83d8101a10 0x7f83d810e3a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 --2- 172.21.15.82:0/3561440328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8101070 0x7f83d810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 >> 172.21.15.82:0/3561440328 conn(0x7f83d80f6be0 msgr2=0x7f83d80f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 shutdown_connections 2024-04-27T07:45:15.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.322+0000 7f83dfcae640 1 -- 172.21.15.82:0/3561440328 wait complete. 2024-04-27T07:45:15.334 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:14 smithi082 ceph-mon[91103]: pgmap v333: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:15.334 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:14 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2025388082' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-27T07:45:15.334 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:14 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/975969651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-27T07:45:15.334 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:14 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/997030071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-27T07:45:15.335 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-04-27T07:45:15.335 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-04-27T07:45:15.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-04-27T07:45:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:14 smithi100 ceph-mon[80397]: pgmap v333: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:14 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2025388082' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-27T07:45:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:14 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/975969651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-27T07:45:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:14 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/997030071' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 -- 172.21.15.82:0/3879761941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be41021a0 msgr2=0x7f6be4102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 --2- 172.21.15.82:0/3879761941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be41021a0 0x7f6be4102570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009c50 tx=0x7f6bd4004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 -- 172.21.15.82:0/3879761941 shutdown_connections 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 --2- 172.21.15.82:0/3879761941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be4102b40 0x7f6be40fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 --2- 172.21.15.82:0/3879761941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be41021a0 0x7f6be4102570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 -- 172.21.15.82:0/3879761941 >> 172.21.15.82:0/3879761941 conn(0x7f6be40f7d50 msgr2=0x7f6be40fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 -- 172.21.15.82:0/3879761941 shutdown_connections 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.427+0000 7f6be922e640 1 -- 172.21.15.82:0/3879761941 wait complete. 2024-04-27T07:45:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 Processor -- start 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 -- start start 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be41021a0 0x7f6be4112cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41137f0 con 0x7f6be4102b40 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be922e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be410ce40 con 0x7f6be41021a0 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35770/0 (socket says 172.21.15.82:35770) 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.428+0000 7f6be259c640 1 -- 172.21.15.82:0/434900944 learned_addr learned my addr 172.21.15.82:0/434900944 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be2d9d640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be41021a0 0x7f6be4112cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be259c640 1 -- 172.21.15.82:0/434900944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be41021a0 msgr2=0x7f6be4112cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be259c640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be41021a0 0x7f6be4112cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be259c640 1 -- 172.21.15.82:0/434900944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40098b0 con 0x7f6be4102b40 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be259c640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8002a50 tx=0x7f6bd8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd8007c30 con 0x7f6be4102b40 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bd800f040 con 0x7f6be4102b40 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be410d120 con 0x7f6be4102b40 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd800db50 con 0x7f6be4102b40 2024-04-27T07:45:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.429+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be410d6c0 con 0x7f6be4102b40 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.430+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be40fd910 con 0x7f6be4102b40 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.430+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f6bd801c400 con 0x7f6be4102b40 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.431+0000 7f6bcb7fe640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 0x7f6bcc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.431+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6bd808e190 con 0x7f6be4102b40 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.431+0000 7f6be2d9d640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 0x7f6bcc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.431+0000 7f6be2d9d640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 0x7f6bcc071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4004a30 tx=0x7f6bd402e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.436+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6bd8056f40 con 0x7f6be4102b40 2024-04-27T07:45:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.649+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f6be4063eb0 con 0x7f6be4102b40 2024-04-27T07:45:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.649+0000 7f6bcb7fe640 1 -- 172.21.15.82:0/434900944 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v43) v1 ==== 107+0+4291 (secure 0 0 0) 0x7f6bd805a600 con 0x7f6be4102b40 2024-04-27T07:45:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:15.669 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 msgr2=0x7f6bcc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 0x7f6bcc071020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4004a30 tx=0x7f6bd402e040 comp rx=0 tx=0).stop 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 msgr2=0x7f6be41131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8002a50 tx=0x7f6bd8004600 comp rx=0 tx=0).stop 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 shutdown_connections 2024-04-27T07:45:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f6bcc06eb70 0x7f6bcc071020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be4102b40 0x7f6be41131f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 --2- 172.21.15.82:0/434900944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be41021a0 0x7f6be4112cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.651+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 >> 172.21.15.82:0/434900944 conn(0x7f6be40f7d50 msgr2=0x7f6be40f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.652+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 shutdown_connections 2024-04-27T07:45:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.652+0000 7f6be922e640 1 -- 172.21.15.82:0/434900944 wait complete. 2024-04-27T07:45:15.672 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-04-27T07:45:15.672 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-04-27T07:45:15.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.764+0000 7f9de8f9d640 1 -- 172.21.15.82:0/4097366014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 msgr2=0x7f9de40fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.764+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/4097366014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de40fb0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0048d0 tx=0x7f9dcc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.764+0000 7f9de8f9d640 1 -- 172.21.15.82:0/4097366014 shutdown_connections 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/4097366014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de40fb0a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/4097366014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 0x7f9de4101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- 172.21.15.82:0/4097366014 >> 172.21.15.82:0/4097366014 conn(0x7f9de40f6be0 msgr2=0x7f9de40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- 172.21.15.82:0/4097366014 shutdown_connections 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- 172.21.15.82:0/4097366014 wait complete. 2024-04-27T07:45:15.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 Processor -- start 2024-04-27T07:45:15.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- start start 2024-04-27T07:45:15.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 0x7f9de410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4066720 con 0x7f9de4101a10 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de8f9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de410e910 con 0x7f9de4101070 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60694/0 (socket says 172.21.15.82:60694) 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9ddbfff640 1 -- 172.21.15.82:0/2297300431 learned_addr learned my addr 172.21.15.82:0/2297300431 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.765+0000 7f9de259c640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 0x7f9de410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddbfff640 1 -- 172.21.15.82:0/2297300431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 msgr2=0x7f9de410de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddbfff640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 0x7f9de410de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddbfff640 1 -- 172.21.15.82:0/2297300431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc005040 con 0x7f9de4101a10 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddbfff640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc004930 tx=0x7f9dcc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dcc0094c0 con 0x7f9de4101a10 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dcc032e50 con 0x7f9de4101a10 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de410eb90 con 0x7f9de4101a10 2024-04-27T07:45:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dcc0433b0 con 0x7f9de4101a10 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.766+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de41170c0 con 0x7f9de4101a10 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.767+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de40fc7e0 con 0x7f9de4101a10 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.767+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9dcc02f070 con 0x7f9de4101a10 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.768+0000 7f9ddaffd640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 0x7f9dd0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.768+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9dcc0b0670 con 0x7f9de4101a10 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.768+0000 7f9de259c640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 0x7f9dd0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.768+0000 7f9de259c640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 0x7f9dd0071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4004eb0 tx=0x7f9dd400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:15.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.773+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9dcc0794d0 con 0x7f9de4101a10 2024-04-27T07:45:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.990+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f9de4064350 con 0x7f9de4101a10 2024-04-27T07:45:15.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.990+0000 7f9ddaffd640 1 -- 172.21.15.82:0/2297300431 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v43) v1 ==== 107+0+5141 (secure 0 0 0) 0x7f9dcc07cb90 con 0x7f9de4101a10 2024-04-27T07:45:15.996 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:15.996 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44297,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/733762917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":733762917},{"type":"v1","addr":"172.21.15.100:6827","nonce":733762917}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:16.000 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 38 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 msgr2=0x7f9dd0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 0x7f9dd0071020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4004eb0 tx=0x7f9dd400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 msgr2=0x7f9de410e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc004930 tx=0x7f9dcc009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 shutdown_connections 2024-04-27T07:45:16.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9dd006eb70 0x7f9dd0071020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9de4101a10 0x7f9de410e3a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 --2- 172.21.15.82:0/2297300431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9de4101070 0x7f9de410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.992+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 >> 172.21.15.82:0/2297300431 conn(0x7f9de40f6be0 msgr2=0x7f9de40f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.993+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 shutdown_connections 2024-04-27T07:45:16.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:15.993+0000 7f9de8f9d640 1 -- 172.21.15.82:0/2297300431 wait complete. 2024-04-27T07:45:16.006 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-04-27T07:45:16.007 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-04-27T07:45:16.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3579634471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102ba0 msgr2=0x7fc8cc0fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3579634471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102ba0 0x7fc8cc0fc230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009c50 tx=0x7fc8c0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3579634471 shutdown_connections 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3579634471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102ba0 0x7fc8cc0fc230 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3579634471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc102200 0x7fc8cc1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3579634471 >> 172.21.15.82:0/3579634471 conn(0x7fc8cc0f7e10 msgr2=0x7fc8cc0fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3579634471 shutdown_connections 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3579634471 wait complete. 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.100+0000 7fc8d3f5d640 1 Processor -- start 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 -- start start 2024-04-27T07:45:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc102ba0 0x7fc8cc06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc071600 con 0x7fc8cc102200 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc071770 con 0x7fc8cc102ba0 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60712/0 (socket says 172.21.15.82:60712) 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 -- 172.21.15.82:0/3293351641 learned_addr learned my addr 172.21.15.82:0/3293351641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 -- 172.21.15.82:0/3293351641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc102ba0 msgr2=0x7fc8cc06fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc102ba0 0x7fc8cc06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 -- 172.21.15.82:0/3293351641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00098b0 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d1cf9640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c790 tx=0x7fc8c40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c400a820 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8c400ae50 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc070390 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c40115e0 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.101+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc1193f0 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.102+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc0fd970 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.103+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc8c4012400 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.103+0000 7fc8ca7fc640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 0x7fc8b4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.103+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc8c408ea20 con 0x7fc8cc102200 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.103+0000 7fc8d14f8640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 0x7fc8b4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.104+0000 7fc8d14f8640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 0x7fc8b4071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0004750 tx=0x7fc8c0004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.108+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc8c4057850 con 0x7fc8cc102200 2024-04-27T07:45:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.321+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fc8cc064350 con 0x7fc8cc102200 2024-04-27T07:45:16.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.322+0000 7fc8ca7fc640 1 -- 172.21.15.82:0/3293351641 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v43) v1 ==== 107+0+4362 (secure 0 0 0) 0x7fc8c405af10 con 0x7fc8cc102200 2024-04-27T07:45:16.324 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:16.325 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 39 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 msgr2=0x7fc8b4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 0x7fc8b4071020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0004750 tx=0x7fc8c0004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 msgr2=0x7fc8cc06f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400c790 tx=0x7fc8c40043c0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 shutdown_connections 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc8b406eb70 0x7fc8b4071020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8cc102ba0 0x7fc8cc06fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 --2- 172.21.15.82:0/3293351641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8cc102200 0x7fc8cc06f770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 >> 172.21.15.82:0/3293351641 conn(0x7fc8cc0f7e10 msgr2=0x7fc8cc0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 shutdown_connections 2024-04-27T07:45:16.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.324+0000 7fc8d3f5d640 1 -- 172.21.15.82:0/3293351641 wait complete. 2024-04-27T07:45:16.336 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:15 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1509504139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-27T07:45:16.336 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:15 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3561440328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-27T07:45:16.337 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:15 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/434900944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-27T07:45:16.338 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-04-27T07:45:16.338 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-04-27T07:45:16.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-04-27T07:45:16.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:15 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1509504139' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-27T07:45:16.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:15 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3561440328' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-27T07:45:16.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:15 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/434900944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-27T07:45:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- 172.21.15.82:0/2695849182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c0faa50 msgr2=0x7f913c0faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 --2- 172.21.15.82:0/2695849182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c0faa50 0x7f913c0faec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f912c0048d0 tx=0x7f912c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- 172.21.15.82:0/2695849182 shutdown_connections 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 --2- 172.21.15.82:0/2695849182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c0faa50 0x7f913c0faec0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 --2- 172.21.15.82:0/2695849182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c102450 0x7f913c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- 172.21.15.82:0/2695849182 >> 172.21.15.82:0/2695849182 conn(0x7f913c071990 msgr2=0x7f913c071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- 172.21.15.82:0/2695849182 shutdown_connections 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- 172.21.15.82:0/2695849182 wait complete. 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 Processor -- start 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.431+0000 7f914411d640 1 -- start start 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0faa50 0x7f913c112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c113a70 con 0x7f913c102450 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c10d0c0 con 0x7f913c0faa50 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60738/0 (socket says 172.21.15.82:60738) 2024-04-27T07:45:16.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 -- 172.21.15.82:0/1046921492 learned_addr learned my addr 172.21.15.82:0/1046921492 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f9141eb9640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0faa50 0x7f913c112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 -- 172.21.15.82:0/1046921492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0faa50 msgr2=0x7f913c112f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0faa50 0x7f913c112f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 -- 172.21.15.82:0/1046921492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c005040 con 0x7f913c102450 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91416b8640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f912c004930 tx=0x7f912c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c0094c0 con 0x7f913c102450 2024-04-27T07:45:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c10d340 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f912c032e50 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c0433b0 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.432+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c10d800 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.433+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c065560 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.434+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f912c02f070 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.434+0000 7f91327fc640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 0x7f9128071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.434+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f912c0b0760 con 0x7f913c102450 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.434+0000 7f9141eb9640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 0x7f9128071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.434+0000 7f9141eb9640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 0x7f9128071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f913c0650c0 tx=0x7f9134004d00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.439+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f912c079510 con 0x7f913c102450 2024-04-27T07:45:16.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.653+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f913c109610 con 0x7f913c102450 2024-04-27T07:45:16.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.654+0000 7f91327fc640 1 -- 172.21.15.82:0/1046921492 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v43) v1 ==== 107+0+5209 (secure 0 0 0) 0x7f912c07cbd0 con 0x7f913c102450 2024-04-27T07:45:16.656 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:16.657 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44373,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/625675545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":625675545},{"type":"v1","addr":"172.21.15.100:6827","nonce":625675545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:03.206897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:16.657 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 40 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 msgr2=0x7f9128071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 0x7f9128071020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f913c0650c0 tx=0x7f9134004d00 comp rx=0 tx=0).stop 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 msgr2=0x7f913c113470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f912c004930 tx=0x7f912c009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 shutdown_connections 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f912806eb70 0x7f9128071020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f913c102450 0x7f913c113470 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 --2- 172.21.15.82:0/1046921492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f913c0faa50 0x7f913c112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 >> 172.21.15.82:0/1046921492 conn(0x7f913c071990 msgr2=0x7f913c0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 shutdown_connections 2024-04-27T07:45:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.656+0000 7f914411d640 1 -- 172.21.15.82:0/1046921492 wait complete. 2024-04-27T07:45:16.670 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-04-27T07:45:16.670 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-04-27T07:45:16.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-04-27T07:45:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 -- 172.21.15.82:0/1572667472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf4101170 msgr2=0x7fdaf4101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 --2- 172.21.15.82:0/1572667472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf4101170 0x7fdaf4101540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00048d0 tx=0x7fdaf0009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 -- 172.21.15.82:0/1572667472 shutdown_connections 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 --2- 172.21.15.82:0/1572667472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaf40fb150 0x7fdaf40fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 --2- 172.21.15.82:0/1572667472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf4101170 0x7fdaf4101540 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.762+0000 7fdafb39d640 1 -- 172.21.15.82:0/1572667472 >> 172.21.15.82:0/1572667472 conn(0x7fdaf4071fd0 msgr2=0x7fdaf40723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 -- 172.21.15.82:0/1572667472 shutdown_connections 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 -- 172.21.15.82:0/1572667472 wait complete. 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 Processor -- start 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 -- start start 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaf4101170 0x7fdaf4113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4113780 con 0x7fdaf40fb150 2024-04-27T07:45:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdafb39d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf410cdd0 con 0x7fdaf4101170 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdaf9139640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdaf9139640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60768/0 (socket says 172.21.15.82:60768) 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdaf9139640 1 -- 172.21.15.82:0/2638863494 learned_addr learned my addr 172.21.15.82:0/2638863494 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.763+0000 7fdaf9139640 1 -- 172.21.15.82:0/2638863494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaf4101170 msgr2=0x7fdaf4113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdaf9139640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaf4101170 0x7fdaf4113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdaf9139640 1 -- 172.21.15.82:0/2638863494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0005040 con 0x7fdaf40fb150 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdaf9139640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0034040 tx=0x7fdaf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf00092b0 con 0x7fdaf40fb150 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaf003b400 con 0x7fdaf40fb150 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaf00435d0 con 0x7fdaf40fb150 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf410d050 con 0x7fdaf40fb150 2024-04-27T07:45:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.764+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf410d510 con 0x7fdaf40fb150 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.765+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40fc870 con 0x7fdaf40fb150 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.766+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fdaf002f070 con 0x7fdaf40fb150 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.766+0000 7fdae9ffb640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 0x7fdae0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.766+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdaf00b0610 con 0x7fdaf40fb150 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.766+0000 7fdaf8938640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 0x7fdae0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.766+0000 7fdaf8938640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 0x7fdae0071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf410e500 tx=0x7fdae400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.771+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdaf00793c0 con 0x7fdaf40fb150 2024-04-27T07:45:16.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.985+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7fdaf4108270 con 0x7fdaf40fb150 2024-04-27T07:45:16.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.986+0000 7fdae9ffb640 1 -- 172.21.15.82:0/2638863494 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v43) v1 ==== 107+0+5209 (secure 0 0 0) 0x7fdaf007ca80 con 0x7fdaf40fb150 2024-04-27T07:45:16.988 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:16.988 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44373,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/625675545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":625675545},{"type":"v1","addr":"172.21.15.100:6827","nonce":625675545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:50.833285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34444},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:16.989 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2024-04-27T07:45:16.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 msgr2=0x7fdae0071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 0x7fdae0071020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf410e500 tx=0x7fdae400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 msgr2=0x7fdaf4112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0034040 tx=0x7fdaf0009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 shutdown_connections 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fdae006eb70 0x7fdae0071020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaf4101170 0x7fdaf4113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 --2- 172.21.15.82:0/2638863494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaf40fb150 0x7fdaf4112c40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 >> 172.21.15.82:0/2638863494 conn(0x7fdaf4071fd0 msgr2=0x7fdaf40645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 shutdown_connections 2024-04-27T07:45:16.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:16.988+0000 7fdafb39d640 1 -- 172.21.15.82:0/2638863494 wait complete. 2024-04-27T07:45:17.002 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-04-27T07:45:17.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-04-27T07:45:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 -- 172.21.15.82:0/556937612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc520102b50 msgr2=0x7fc5200fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 --2- 172.21.15.82:0/556937612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc520102b50 0x7fc5200fc1e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc5140048d0 tx=0x7fc514009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 -- 172.21.15.82:0/556937612 shutdown_connections 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 --2- 172.21.15.82:0/556937612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc520102b50 0x7fc5200fc1e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 --2- 172.21.15.82:0/556937612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5201021b0 0x7fc520102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 -- 172.21.15.82:0/556937612 >> 172.21.15.82:0/556937612 conn(0x7fc5200f7da0 msgr2=0x7fc5200fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 -- 172.21.15.82:0/556937612 shutdown_connections 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.094+0000 7fc52675d640 1 -- 172.21.15.82:0/556937612 wait complete. 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 Processor -- start 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 -- start start 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc520102b50 0x7fc520113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520113830 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc52675d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52010ce80 con 0x7fc520102b50 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc51ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc51ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60796/0 (socket says 172.21.15.82:60796) 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.095+0000 7fc51ffff640 1 -- 172.21.15.82:0/2677013953 learned_addr learned my addr 172.21.15.82:0/2677013953 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51f7fe640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc520102b50 0x7fc520113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51ffff640 1 -- 172.21.15.82:0/2677013953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc520102b50 msgr2=0x7fc520113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51ffff640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc520102b50 0x7fc520113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51ffff640 1 -- 172.21.15.82:0/2677013953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514005040 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51ffff640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc51000c790 tx=0x7fc5100043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51000a820 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52010d160 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc51000ae50 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5100115e0 con 0x7fc5201021b0 2024-04-27T07:45:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.096+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52010d680 con 0x7fc5201021b0 2024-04-27T07:45:17.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.097+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5200fd920 con 0x7fc5201021b0 2024-04-27T07:45:17.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.098+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fc510012400 con 0x7fc5201021b0 2024-04-27T07:45:17.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.098+0000 7fc51cff9640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 0x7fc508071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.098+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc51008ea70 con 0x7fc5201021b0 2024-04-27T07:45:17.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.098+0000 7fc51f7fe640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 0x7fc508071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.098+0000 7fc51f7fe640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 0x7fc508071020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.103+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc5100578a0 con 0x7fc5201021b0 2024-04-27T07:45:17.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.322+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fc520063f00 con 0x7fc5201021b0 2024-04-27T07:45:17.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.322+0000 7fc51cff9640 1 -- 172.21.15.82:0/2677013953 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v43) v1 ==== 107+0+5226 (secure 0 0 0) 0x7fc510057030 con 0x7fc5201021b0 2024-04-27T07:45:17.325 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:17.325 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44369,"name":"cephfs.smithi100.udlhfn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6825/1294989723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1294989723},{"type":"v1","addr":"172.21.15.100:6825","nonce":1294989723}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44373,"name":"cephfs.smithi100.kjopce","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6827/625675545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":625675545},{"type":"v1","addr":"172.21.15.100:6827","nonce":625675545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-27T07:30:26.029684+0000","modified":"2024-04-27T07:41:51.834850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34444,"mds_1":34476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34444":{"gid":34444,"name":"cephfs.smithi082.vlqbei","rank":0,"incarnation":32,"state":"up:active","state_seq":9,"addr":"172.21.15.82:6827/3903654232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3903654232},{"type":"v1","addr":"172.21.15.82:6827","nonce":3903654232}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34476":{"gid":34476,"name":"cephfs.smithi082.bqtewe","rank":1,"incarnation":42,"state":"up:starting","state_seq":1,"addr":"172.21.15.82:6829/981074485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":981074485},{"type":"v1","addr":"172.21.15.82:6829","nonce":981074485}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34444,"qdb_cluster":[34444]},"id":1}]} 2024-04-27T07:45:17.325 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 42 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 msgr2=0x7fc508071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 0x7fc508071020 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 msgr2=0x7fc520112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc51000c790 tx=0x7fc5100043c0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 shutdown_connections 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fc50806eb70 0x7fc508071020 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc520102b50 0x7fc520113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 --2- 172.21.15.82:0/2677013953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5201021b0 0x7fc520112cf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.324+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 >> 172.21.15.82:0/2677013953 conn(0x7fc5200f7da0 msgr2=0x7fc5200f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:17.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.325+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 shutdown_connections 2024-04-27T07:45:17.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.325+0000 7fc52675d640 1 -- 172.21.15.82:0/2677013953 wait complete. 2024-04-27T07:45:17.337 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:16 smithi082 ceph-mon[91103]: pgmap v334: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:17.337 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:16 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2297300431' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-27T07:45:17.337 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:16 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3293351641' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-27T07:45:17.337 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:16 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1046921492' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-27T07:45:17.338 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 42 2024-04-27T07:45:17.338 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-27T07:45:17.352 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-27T07:45:17.352 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:45:17.352 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-27T07:45:17.369 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:45:17.369 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-27T07:45:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:16 smithi100 ceph-mon[80397]: pgmap v334: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:16 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2297300431' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-27T07:45:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:16 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3293351641' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-27T07:45:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:16 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1046921492' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-27T07:45:17.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T07:45:17.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- 172.21.15.82:0/311968059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84580fa850 msgr2=0x7f84580facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 --2- 172.21.15.82:0/311968059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84580fa850 0x7f84580facc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84540048d0 tx=0x7f8454009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- 172.21.15.82:0/311968059 shutdown_connections 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 --2- 172.21.15.82:0/311968059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84580fa850 0x7f84580facc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 --2- 172.21.15.82:0/311968059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8458100870 0x7f8458100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- 172.21.15.82:0/311968059 >> 172.21.15.82:0/311968059 conn(0x7f8458071770 msgr2=0x7f8458071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- 172.21.15.82:0/311968059 shutdown_connections 2024-04-27T07:45:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- 172.21.15.82:0/311968059 wait complete. 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 Processor -- start 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.557+0000 7f845f99d640 1 -- start start 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845f99d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 0x7f8458111c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845f99d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845f99d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458112850 con 0x7f8458100870 2024-04-27T07:45:17.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845f99d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845810be10 con 0x7f84580fa850 2024-04-27T07:45:17.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60816/0 (socket says 172.21.15.82:60816) 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 -- 172.21.15.82:0/3105297619 learned_addr learned my addr 172.21.15.82:0/3105297619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845d739640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 0x7f8458111c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 -- 172.21.15.82:0/3105297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 msgr2=0x7f8458111c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 0x7f8458111c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 -- 172.21.15.82:0/3105297619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454005040 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845d739640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 0x7f8458111c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845cf38640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8454004930 tx=0x7f8454009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84540094c0 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845810c090 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8454032e50 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.558+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84540433b0 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.559+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845810c550 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.559+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84580fbf90 con 0x7f8458100870 2024-04-27T07:45:17.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.560+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f845402f070 con 0x7f8458100870 2024-04-27T07:45:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.560+0000 7f844dffb640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 0x7f8444071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.560+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f84540b0850 con 0x7f8458100870 2024-04-27T07:45:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.560+0000 7f845d739640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 0x7f8444071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.561+0000 7f845d739640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 0x7f8444071020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8448006fd0 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.565+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8454079600 con 0x7f8458100870 2024-04-27T07:45:17.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.745+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84581082c0 con 0x7f8458100870 2024-04-27T07:45:17.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.747+0000 7f844dffb640 1 -- 172.21.15.82:0/3105297619 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f845407ccc0 con 0x7f8458100870 2024-04-27T07:45:17.750 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:17.750 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:41:38.635860+0000","last_up_change":"2024-04-27T07:39:50.670033+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-27T07:30:24.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-27T07:30:25.253832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6803","nonce":1477776965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6805","nonce":1477776965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6809","nonce":1477776965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6807","nonce":1477776965}]},"public_addr":"172.21.15.82:6803/1477776965","cluster_addr":"172.21.15.82:6805/1477776965","heartbeat_back_addr":"172.21.15.82:6809/1477776965","heartbeat_front_addr":"172.21.15.82:6807/1477776965","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6811","nonce":247193686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6813","nonce":247193686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6817","nonce":247193686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6815","nonce":247193686}]},"public_addr":"172.21.15.82:6811/247193686","cluster_addr":"172.21.15.82:6813/247193686","heartbeat_back_addr":"172.21.15.82:6817/247193686","heartbeat_front_addr":"172.21.15.82:6815/247193686","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6819","nonce":240501577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6821","nonce":240501577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6825","nonce":240501577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6823","nonce":240501577}]},"public_addr":"172.21.15.82:6819/240501577","cluster_addr":"172.21.15.82:6821/240501577","heartbeat_back_addr":"172.21.15.82:6825/240501577","heartbeat_front_addr":"172.21.15.82:6823/240501577","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6801","nonce":2753948765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6803","nonce":2753948765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6807","nonce":2753948765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6805","nonce":2753948765}]},"public_addr":"172.21.15.100:6801/2753948765","cluster_addr":"172.21.15.100:6803/2753948765","heartbeat_back_addr":"172.21.15.100:6807/2753948765","heartbeat_front_addr":"172.21.15.100:6805/2753948765","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6809","nonce":1234887297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6811","nonce":1234887297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6815","nonce":1234887297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6813","nonce":1234887297}]},"public_addr":"172.21.15.100:6809/1234887297","cluster_addr":"172.21.15.100:6811/1234887297","heartbeat_back_addr":"172.21.15.100:6815/1234887297","heartbeat_front_addr":"172.21.15.100:6813/1234887297","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6817","nonce":4221202958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6819","nonce":4221202958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6823","nonce":4221202958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6821","nonce":4221202958}]},"public_addr":"172.21.15.100:6817/4221202958","cluster_addr":"172.21.15.100:6819/4221202958","heartbeat_back_addr":"172.21.15.100:6823/4221202958","heartbeat_front_addr":"172.21.15.100:6821/4221202958","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6829/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.100:6828/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.100:0/1395364237":"2024-04-28T07:34:31.470816+0000","172.21.15.82:6801/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6828/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.82:0/2001119936":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/151072868":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6801/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/507086912":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3300584346":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6827/2940930803":"2024-04-28T07:40:30.474281+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.100:0/3011964559":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4080505049":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/812733995":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/4133994313":"2024-04-28T07:34:31.470816+0000","172.21.15.100:6829/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/4079596977":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/92279690":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/4140677880":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/3056095726":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1059916025":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6826/2940930803":"2024-04-28T07:40:30.474281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 msgr2=0x7f8444071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 0x7f8444071020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8448006fd0 tx=0x7f8448008040 comp rx=0 tx=0).stop 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 msgr2=0x7f84581121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8454004930 tx=0x7f8454009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 shutdown_connections 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f844406eb70 0x7f8444071020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8458100870 0x7f84581121c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 --2- 172.21.15.82:0/3105297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84580fa850 0x7f8458111c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 >> 172.21.15.82:0/3105297619 conn(0x7f8458071770 msgr2=0x7f84581035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:17.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 shutdown_connections 2024-04-27T07:45:17.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.749+0000 7f845f99d640 1 -- 172.21.15.82:0/3105297619 wait complete. 2024-04-27T07:45:17.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-27T07:27:58.687625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-27T07:30:24.468959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-27T07:30:25.253832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-27T07:45:17.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-27T07:45:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 -- 172.21.15.82:0/3876833491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 msgr2=0x7fa3741025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 --2- 172.21.15.82:0/3876833491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa3741025d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa3640048d0 tx=0x7fa364009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 -- 172.21.15.82:0/3876833491 shutdown_connections 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 --2- 172.21.15.82:0/3876833491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3740fa840 0x7fa3740fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 --2- 172.21.15.82:0/3876833491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa3741025d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 -- 172.21.15.82:0/3876833491 >> 172.21.15.82:0/3876833491 conn(0x7fa374071700 msgr2=0x7fa374071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 -- 172.21.15.82:0/3876833491 shutdown_connections 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.857+0000 7fa378e2e640 1 -- 172.21.15.82:0/3876833491 wait complete. 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 Processor -- start 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 -- start start 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3740fa840 0x7fa374112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa374113890 con 0x7fa374102200 2024-04-27T07:45:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa378e2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37410cee0 con 0x7fa3740fa840 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60826/0 (socket says 172.21.15.82:60826) 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 -- 172.21.15.82:0/12653437 learned_addr learned my addr 172.21.15.82:0/12653437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 -- 172.21.15.82:0/12653437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3740fa840 msgr2=0x7fa374112d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3740fa840 0x7fa374112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 -- 172.21.15.82:0/12653437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364005040 con 0x7fa374102200 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.858+0000 7fa36bfff640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c790 tx=0x7fa35c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c00a820 con 0x7fa374102200 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa35c00ae50 con 0x7fa374102200 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37410d1c0 con 0x7fa374102200 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c0115e0 con 0x7fa374102200 2024-04-27T07:45:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37410d6e0 con 0x7fa374102200 2024-04-27T07:45:17.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.859+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3740652a0 con 0x7fa374102200 2024-04-27T07:45:17.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.860+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7fa35c012400 con 0x7fa374102200 2024-04-27T07:45:17.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.860+0000 7fa36affd640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 0x7fa360071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:17.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.860+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa35c08ea70 con 0x7fa374102200 2024-04-27T07:45:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.860+0000 7fa37259c640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 0x7fa360071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.861+0000 7fa37259c640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 0x7fa360071020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3640043d0 tx=0x7fa364009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:17.865+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa35c0578a0 con 0x7fa374102200 2024-04-27T07:45:18.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.044+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa37404bcc0 con 0x7fa374102200 2024-04-27T07:45:18.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.044+0000 7fa36affd640 1 -- 172.21.15.82:0/12653437 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa35c057030 con 0x7fa374102200 2024-04-27T07:45:18.047 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 msgr2=0x7fa360071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 0x7fa360071020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3640043d0 tx=0x7fa364009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 msgr2=0x7fa374113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00c790 tx=0x7fa35c0043c0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 shutdown_connections 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7fa36006eb70 0x7fa360071020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa374102200 0x7fa374113290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 --2- 172.21.15.82:0/12653437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3740fa840 0x7fa374112d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 >> 172.21.15.82:0/12653437 conn(0x7fa374071700 msgr2=0x7fa3740f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 shutdown_connections 2024-04-27T07:45:18.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.046+0000 7fa378e2e640 1 -- 172.21.15.82:0/12653437 wait complete. 2024-04-27T07:45:18.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:17 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2638863494' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-27T07:45:18.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:17 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2677013953' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-04-27T07:45:18.059 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:17 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3105297619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:18.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.154+0000 7efc3435d640 1 -- 172.21.15.82:0/4189537703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 msgr2=0x7efc2c0fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.154+0000 7efc3435d640 1 --2- 172.21.15.82:0/4189537703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c0fb530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efc280048d0 tx=0x7efc28009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- 172.21.15.82:0/4189537703 shutdown_connections 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 --2- 172.21.15.82:0/4189537703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c0fb530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 --2- 172.21.15.82:0/4189537703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 0x7efc2c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- 172.21.15.82:0/4189537703 >> 172.21.15.82:0/4189537703 conn(0x7efc2c0710c0 msgr2=0x7efc2c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- 172.21.15.82:0/4189537703 shutdown_connections 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- 172.21.15.82:0/4189537703 wait complete. 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 Processor -- start 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- start start 2024-04-27T07:45:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 0x7efc2c10e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c10e8e0 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc3435d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c10ea50 con 0x7efc2c101110 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc320f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc320f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60840/0 (socket says 172.21.15.82:60840) 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.155+0000 7efc320f9640 1 -- 172.21.15.82:0/1362185754 learned_addr learned my addr 172.21.15.82:0/1362185754 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc318f8640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 0x7efc2c10e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc320f9640 1 -- 172.21.15.82:0/1362185754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 msgr2=0x7efc2c10e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc320f9640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 0x7efc2c10e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc320f9640 1 -- 172.21.15.82:0/1362185754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28005040 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc320f9640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc1c002a50 tx=0x7efc1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc1c007c30 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc1c00f040 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c116ed0 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc1c00db50 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.156+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c117200 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.157+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0fc7d0 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.157+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7efc1c01c400 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.158+0000 7efc22ffd640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 0x7efc18071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.158+0000 7efc318f8640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 0x7efc18071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.158+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efc1c08e190 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.158+0000 7efc318f8640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 0x7efc18071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc28009fa0 tx=0x7efc28009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.163+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efc1c056f40 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.339+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7efc2c0649e0 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.339+0000 7efc22ffd640 1 -- 172.21.15.82:0/1362185754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7efc1c05a600 con 0x7efc2c0fb0e0 2024-04-27T07:45:18.342 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.341+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 msgr2=0x7efc18071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.341+0000 7efc3435d640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 0x7efc18071020 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efc28009fa0 tx=0x7efc28009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.341+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 msgr2=0x7efc2c10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.341+0000 7efc3435d640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc1c002a50 tx=0x7efc1c004600 comp rx=0 tx=0).stop 2024-04-27T07:45:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 shutdown_connections 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7efc1806eb70 0x7efc18071020 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc2c101110 0x7efc2c10e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 --2- 172.21.15.82:0/1362185754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc2c0fb0e0 0x7efc2c10de60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 >> 172.21.15.82:0/1362185754 conn(0x7efc2c0710c0 msgr2=0x7efc2c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 shutdown_connections 2024-04-27T07:45:18.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.342+0000 7efc3435d640 1 -- 172.21.15.82:0/1362185754 wait complete. 2024-04-27T07:45:18.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-27T07:45:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:17 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2638863494' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-27T07:45:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:17 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2677013953' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-04-27T07:45:18.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:17 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3105297619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- 172.21.15.82:0/1954692352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 msgr2=0x7f0410101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 --2- 172.21.15.82:0/1954692352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f0410101460 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f04000048d0 tx=0x7f0400009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- 172.21.15.82:0/1954692352 shutdown_connections 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 --2- 172.21.15.82:0/1954692352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 0x7f04100fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 --2- 172.21.15.82:0/1954692352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f0410101460 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- 172.21.15.82:0/1954692352 >> 172.21.15.82:0/1954692352 conn(0x7f04100f6c20 msgr2=0x7f04100f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- 172.21.15.82:0/1954692352 shutdown_connections 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- 172.21.15.82:0/1954692352 wait complete. 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 Processor -- start 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- start start 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 0x7f041010e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041010e8d0 con 0x7f0410101090 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f0416b5d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041010ea40 con 0x7f0410101a30 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f04148f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.450+0000 7f04148f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60846/0 (socket says 172.21.15.82:60846) 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f04148f9640 1 -- 172.21.15.82:0/2343006600 learned_addr learned my addr 172.21.15.82:0/2343006600 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f040ffff640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 0x7f041010e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f04148f9640 1 -- 172.21.15.82:0/2343006600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 msgr2=0x7f041010e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f04148f9640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 0x7f041010e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f04148f9640 1 -- 172.21.15.82:0/2343006600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400005040 con 0x7f0410101090 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f04148f9640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0400004930 tx=0x7f0400009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04000094c0 con 0x7f0410101090 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0400032e50 con 0x7f0410101090 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041010ecc0 con 0x7f0410101090 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04000433b0 con 0x7f0410101090 2024-04-27T07:45:18.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.451+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0410117110 con 0x7f0410101090 2024-04-27T07:45:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.452+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04100fc800 con 0x7f0410101090 2024-04-27T07:45:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.452+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f040002f070 con 0x7f0410101090 2024-04-27T07:45:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.453+0000 7f040d7fa640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 0x7f03f8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.453+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f04000b0500 con 0x7f0410101090 2024-04-27T07:45:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.453+0000 7f040ffff640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 0x7f03f8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.453+0000 7f040ffff640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 0x7f03f8071020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0410065d40 tx=0x7f040400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.457+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0400079360 con 0x7f0410101090 2024-04-27T07:45:18.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.634+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f041010ecc0 con 0x7f0410101090 2024-04-27T07:45:18.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.634+0000 7f040d7fa640 1 -- 172.21.15.82:0/2343006600 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f041010ecc0 con 0x7f0410101090 2024-04-27T07:45:18.637 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.636+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 msgr2=0x7f03f8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.636+0000 7f0416b5d640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 0x7f03f8071020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0410065d40 tx=0x7f040400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.636+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 msgr2=0x7f041010de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.636+0000 7f0416b5d640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0400004930 tx=0x7f0400009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 shutdown_connections 2024-04-27T07:45:18.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f03f806eb70 0x7f03f8071020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0410101a30 0x7f041010e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 --2- 172.21.15.82:0/2343006600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0410101090 0x7f041010de50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 >> 172.21.15.82:0/2343006600 conn(0x7f04100f6c20 msgr2=0x7f04100f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 shutdown_connections 2024-04-27T07:45:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.637+0000 7f0416b5d640 1 -- 172.21.15.82:0/2343006600 wait complete. 2024-04-27T07:45:18.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-27T07:45:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.744+0000 7f0fd875d640 1 -- 172.21.15.82:0/1712749556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 msgr2=0x7f0fd01014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.744+0000 7f0fd875d640 1 --2- 172.21.15.82:0/1712749556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd01014f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009c50 tx=0x7f0fcc004d10 comp rx=0 tx=0).stop 2024-04-27T07:45:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- 172.21.15.82:0/1712749556 shutdown_connections 2024-04-27T07:45:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 --2- 172.21.15.82:0/1712749556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 0x7f0fd00fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 --2- 172.21.15.82:0/1712749556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd01014f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- 172.21.15.82:0/1712749556 >> 172.21.15.82:0/1712749556 conn(0x7f0fd00710c0 msgr2=0x7f0fd00714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- 172.21.15.82:0/1712749556 shutdown_connections 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- 172.21.15.82:0/1712749556 wait complete. 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 Processor -- start 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- start start 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 0x7f0fd010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00652f0 con 0x7f0fd0101120 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd875d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd010e960 con 0x7f0fd00fb100 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd5cf8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd5cf8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60856/0 (socket says 172.21.15.82:60856) 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd5cf8640 1 -- 172.21.15.82:0/3317275728 learned_addr learned my addr 172.21.15.82:0/3317275728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.745+0000 7f0fd64f9640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 0x7f0fd010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd5cf8640 1 -- 172.21.15.82:0/3317275728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 msgr2=0x7f0fd010dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd5cf8640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 0x7f0fd010dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd5cf8640 1 -- 172.21.15.82:0/3317275728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0098b0 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd5cf8640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0002a50 tx=0x7f0fc0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc0007c30 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd010ec40 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fc000f040 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fc000db50 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.746+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd0117200 con 0x7f0fd0101120 2024-04-27T07:45:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.747+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00fc7e0 con 0x7f0fd0101120 2024-04-27T07:45:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.747+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f0fc001c400 con 0x7f0fd0101120 2024-04-27T07:45:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.748+0000 7f0fc6ffd640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 0x7f0fbc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.748+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0fc008e0e0 con 0x7f0fd0101120 2024-04-27T07:45:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.748+0000 7f0fd64f9640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 0x7f0fbc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.748+0000 7f0fd64f9640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 0x7f0fbc071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc004a30 tx=0x7f0fcc037040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:18.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.752+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0fc0056f40 con 0x7f0fd0101120 2024-04-27T07:45:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.943+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0fd0108260 con 0x7f0fd0101120 2024-04-27T07:45:18.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.944+0000 7f0fc6ffd640 1 -- 172.21.15.82:0/3317275728 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v85) v1 ==== 81+0+2301 (secure 0 0 0) 0x7f0fc005a600 con 0x7f0fd0101120 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6829/3714048367 2024-04-28T07:40:55.150292+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:6828/15913842 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/1395364237 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/627056972 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6828/3714048367 2024-04-28T07:40:55.150292+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2001119936 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1316496039 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/151072868 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3417466421 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1322799412 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:18.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1077237808 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1079100432 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1079100432 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/507086912 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4158420091 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3300584346 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6827/2940930803 2024-04-28T07:40:30.474281+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3911518479 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/3011964559 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/6504988 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4080505049 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2198298480 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:18.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2553043456 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/627056972 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/812733995 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/4133994313 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:6829/15913842 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/767321209 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3417466421 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4079596977 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/92279690 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1415088792 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3242457432 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1415088792 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3242457432 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:18.949 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4140677880 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3056095726 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1059916025 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:18.950 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6826/2940930803 2024-04-28T07:40:30.474281+0000 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:listed 39 entries 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 msgr2=0x7f0fbc071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 0x7f0fbc071020 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc004a30 tx=0x7f0fcc037040 comp rx=0 tx=0).stop 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 msgr2=0x7f0fd010e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0002a50 tx=0x7f0fc0004600 comp rx=0 tx=0).stop 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 shutdown_connections 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f0fbc06eb70 0x7f0fbc071020 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd0101120 0x7f0fd010e420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 --2- 172.21.15.82:0/3317275728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fd00fb100 0x7f0fd010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 >> 172.21.15.82:0/3317275728 conn(0x7f0fd00710c0 msgr2=0x7f0fd01041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 shutdown_connections 2024-04-27T07:45:18.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:18.946+0000 7f0fd875d640 1 -- 172.21.15.82:0/3317275728 wait complete. 2024-04-27T07:45:18.959 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-27T07:45:18.959 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-27T07:45:18.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-27T07:45:19.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- 172.21.15.82:0/1631365785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 msgr2=0x7f4600101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 --2- 172.21.15.82:0/1631365785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600101460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f45f40048d0 tx=0x7f45f4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- 172.21.15.82:0/1631365785 shutdown_connections 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 --2- 172.21.15.82:0/1631365785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 0x7f46000fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 --2- 172.21.15.82:0/1631365785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600101460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- 172.21.15.82:0/1631365785 >> 172.21.15.82:0/1631365785 conn(0x7f46000f6c20 msgr2=0x7f46000f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- 172.21.15.82:0/1631365785 shutdown_connections 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- 172.21.15.82:0/1631365785 wait complete. 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 Processor -- start 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.107+0000 7f460839d640 1 -- start start 2024-04-27T07:45:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 0x7f46001120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001126d0 con 0x7f4600101090 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460010bd20 con 0x7f4600101a30 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60872/0 (socket says 172.21.15.82:60872) 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 -- 172.21.15.82:0/2703249145 learned_addr learned my addr 172.21.15.82:0/2703249145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4605938640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 0x7f46001120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 -- 172.21.15.82:0/2703249145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 msgr2=0x7f46001120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 0x7f46001120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 -- 172.21.15.82:0/2703249145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4005040 con 0x7f4600101090 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f4606139640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f45f4004930 tx=0x7f45f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f40094c0 con 0x7f4600101090 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45f4032e50 con 0x7f4600101090 2024-04-27T07:45:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f40433b0 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460010bfa0 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.108+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460010c460 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.109+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46000fc800 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.110+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f45f402f070 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.110+0000 7f45f2ffd640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 0x7f45ec071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.110+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f45f40b0800 con 0x7f4600101090 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.110+0000 7f4605938640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 0x7f45ec071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.110+0000 7f4605938640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 0x7f45ec071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f460010d450 tx=0x7f45fc009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.115+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f45f40795b0 con 0x7f4600101090 2024-04-27T07:45:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.293+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f460010d200 con 0x7f4600101090 2024-04-27T07:45:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.294+0000 7f45f2ffd640 1 -- 172.21.15.82:0/2703249145 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16633 (secure 0 0 0) 0x7f45f407cc70 con 0x7f4600101090 2024-04-27T07:45:19.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-27T07:45:19.297 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"ebadc0d6-0466-11ef-bc93-c7b262605968","created":"2024-04-27T07:23:28.744820+0000","modified":"2024-04-27T07:41:38.635860+0000","last_up_change":"2024-04-27T07:39:50.670033+0000","last_in_change":"2024-04-27T07:28:52.264377+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-27T07:27:58.687625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-27T07:30:24.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-27T07:30:25.253832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b90ef0d2-e3cd-4cbd-9ab9-e739dac3fdef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6803","nonce":1477776965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6805","nonce":1477776965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6809","nonce":1477776965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1477776965},{"type":"v1","addr":"172.21.15.82:6807","nonce":1477776965}]},"public_addr":"172.21.15.82:6803/1477776965","cluster_addr":"172.21.15.82:6805/1477776965","heartbeat_back_addr":"172.21.15.82:6809/1477776965","heartbeat_front_addr":"172.21.15.82:6807/1477776965","state":["exists","up"]},{"osd":1,"uuid":"49804229-f1b4-4b6c-93c2-2e918a8c4acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6811","nonce":247193686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6813","nonce":247193686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6817","nonce":247193686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":247193686},{"type":"v1","addr":"172.21.15.82:6815","nonce":247193686}]},"public_addr":"172.21.15.82:6811/247193686","cluster_addr":"172.21.15.82:6813/247193686","heartbeat_back_addr":"172.21.15.82:6817/247193686","heartbeat_front_addr":"172.21.15.82:6815/247193686","state":["exists","up"]},{"osd":2,"uuid":"f876dc76-f7f6-4cf0-9aa2-90143dcc191d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6819","nonce":240501577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6821","nonce":240501577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6825","nonce":240501577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":240501577},{"type":"v1","addr":"172.21.15.82:6823","nonce":240501577}]},"public_addr":"172.21.15.82:6819/240501577","cluster_addr":"172.21.15.82:6821/240501577","heartbeat_back_addr":"172.21.15.82:6825/240501577","heartbeat_front_addr":"172.21.15.82:6823/240501577","state":["exists","up"]},{"osd":3,"uuid":"94cf05fd-8fc6-4a90-95dc-8c0bfcb57371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6801","nonce":2753948765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6803","nonce":2753948765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6807","nonce":2753948765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2753948765},{"type":"v1","addr":"172.21.15.100:6805","nonce":2753948765}]},"public_addr":"172.21.15.100:6801/2753948765","cluster_addr":"172.21.15.100:6803/2753948765","heartbeat_back_addr":"172.21.15.100:6807/2753948765","heartbeat_front_addr":"172.21.15.100:6805/2753948765","state":["exists","up"]},{"osd":4,"uuid":"4abec552-f6f7-4611-8a92-8521469ff82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6809","nonce":1234887297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6811","nonce":1234887297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6815","nonce":1234887297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1234887297},{"type":"v1","addr":"172.21.15.100:6813","nonce":1234887297}]},"public_addr":"172.21.15.100:6809/1234887297","cluster_addr":"172.21.15.100:6811/1234887297","heartbeat_back_addr":"172.21.15.100:6815/1234887297","heartbeat_front_addr":"172.21.15.100:6813/1234887297","state":["exists","up"]},{"osd":5,"uuid":"da729222-1a05-4b04-936c-f02b6f94e26f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6817","nonce":4221202958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6819","nonce":4221202958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6823","nonce":4221202958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4221202958},{"type":"v1","addr":"172.21.15.100:6821","nonce":4221202958}]},"public_addr":"172.21.15.100:6817/4221202958","cluster_addr":"172.21.15.100:6819/4221202958","heartbeat_back_addr":"172.21.15.100:6823/4221202958","heartbeat_front_addr":"172.21.15.100:6821/4221202958","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:26:58.225242+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:27.553400+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:27:55.155721+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:18.645639+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:28:44.270801+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-27T07:29:09.670487+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6829/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.100:6828/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.100:0/1395364237":"2024-04-28T07:34:31.470816+0000","172.21.15.82:6801/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6828/3714048367":"2024-04-28T07:40:55.150292+0000","172.21.15.82:0/2001119936":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1316496039":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/151072868":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6801/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/1322799412":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/1077237808":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6801/1079100432":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/507086912":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/4158420091":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/3300584346":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6827/2940930803":"2024-04-28T07:40:30.474281+0000","172.21.15.82:0/3911518479":"2024-04-28T07:25:38.376618+0000","172.21.15.100:0/3011964559":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/6504988":"2024-04-28T07:25:38.376618+0000","172.21.15.82:0/4080505049":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/2198298480":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/2553043456":"2024-04-28T07:24:34.994059+0000","172.21.15.82:6800/627056972":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/812733995":"2024-04-28T07:32:53.130473+0000","172.21.15.100:0/4133994313":"2024-04-28T07:34:31.470816+0000","172.21.15.100:6829/15913842":"2024-04-28T07:34:31.470816+0000","172.21.15.82:0/767321209":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6800/3417466421":"2024-04-28T07:24:34.994059+0000","172.21.15.82:0/4079596977":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/92279690":"2024-04-28T07:32:53.130473+0000","172.21.15.82:6800/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6800/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:6801/1415088792":"2024-04-28T07:25:38.376618+0000","172.21.15.82:6801/3242457432":"2024-04-28T07:24:03.907593+0000","172.21.15.82:0/4140677880":"2024-04-28T07:32:53.130473+0000","172.21.15.82:0/3056095726":"2024-04-28T07:35:25.735490+0000","172.21.15.82:0/1059916025":"2024-04-28T07:35:25.735490+0000","172.21.15.82:6826/2940930803":"2024-04-28T07:40:30.474281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-27T07:45:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 msgr2=0x7f45ec071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 0x7f45ec071020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f460010d450 tx=0x7f45fc009040 comp rx=0 tx=0).stop 2024-04-27T07:45:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 msgr2=0x7f4600111b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f45f4004930 tx=0x7f45f4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 shutdown_connections 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f45ec06eb70 0x7f45ec071020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4600101a30 0x7f46001120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 --2- 172.21.15.82:0/2703249145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4600101090 0x7f4600111b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.296+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 >> 172.21.15.82:0/2703249145 conn(0x7f46000f6c20 msgr2=0x7f46000f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.297+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 shutdown_connections 2024-04-27T07:45:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.297+0000 7f460839d640 1 -- 172.21.15.82:0/2703249145 wait complete. 2024-04-27T07:45:19.309 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:18 smithi082 ceph-mon[91103]: pgmap v335: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:19.309 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:18 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/12653437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.309 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:18 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/1362185754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.309 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:18 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2343006600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.309 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:18 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3317275728' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-27T07:45:19.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-27T07:27:58.687625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-27T07:30:24.468959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-27T07:30:25.253832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-27T07:45:19.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-27T07:45:19.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/2251550760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 msgr2=0x7f4cb4102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/2251550760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4102770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00048d0 tx=0x7f4cb0009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/2251550760 shutdown_connections 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/2251550760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 0x7f4cb40fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/2251550760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4102770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/2251550760 >> 172.21.15.82:0/2251550760 conn(0x7f4cb40f7f90 msgr2=0x7f4cb40fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/2251550760 shutdown_connections 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.405+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/2251550760 wait complete. 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 Processor -- start 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 -- start start 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 0x7f4cb4113430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb4113a30 con 0x7f4cb41023a0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cbaa6e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb410d080 con 0x7f4cb4102d40 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60886/0 (socket says 172.21.15.82:60886) 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 -- 172.21.15.82:0/293375019 learned_addr learned my addr 172.21.15.82:0/293375019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cabfff640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 0x7f4cb4113430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 -- 172.21.15.82:0/293375019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 msgr2=0x7f4cb4113430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 0x7f4cb4113430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 -- 172.21.15.82:0/293375019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0005040 con 0x7f4cb41023a0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.406+0000 7f4cb880a640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0034040 tx=0x7f4cb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.407+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb00092b0 con 0x7f4cb41023a0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.407+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb410d300 con 0x7f4cb41023a0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.407+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cb003b400 con 0x7f4cb41023a0 2024-04-27T07:45:19.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.407+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cb00435d0 con 0x7f4cb41023a0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.407+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb410d7c0 con 0x7f4cb41023a0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.408+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb40fdb10 con 0x7f4cb41023a0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.408+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f4cb002f070 con 0x7f4cb41023a0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.409+0000 7f4ca97fa640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 0x7f4c9c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.409+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4cb00b0610 con 0x7f4cb41023a0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.409+0000 7f4cabfff640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 0x7f4c9c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.409+0000 7f4cabfff640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 0x7f4c9c071020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cb410e7b0 tx=0x7f4ca400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.413+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4cb00793c0 con 0x7f4cb41023a0 2024-04-27T07:45:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:18 smithi100 ceph-mon[80397]: pgmap v335: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:18 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/12653437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:18 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/1362185754' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:18 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2343006600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:18 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3317275728' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-27T07:45:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.592+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cb404bcc0 con 0x7f4cb41023a0 2024-04-27T07:45:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.593+0000 7f4ca97fa640 1 -- 172.21.15.82:0/293375019 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cb007ca80 con 0x7f4cb41023a0 2024-04-27T07:45:19.596 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-04-27T07:45:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 msgr2=0x7f4c9c071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 0x7f4c9c071020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4cb410e7b0 tx=0x7f4ca400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 msgr2=0x7f4cb4112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0034040 tx=0x7f4cb0009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 shutdown_connections 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f4c9c06eb70 0x7f4c9c071020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb4102d40 0x7f4cb4113430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 --2- 172.21.15.82:0/293375019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cb41023a0 0x7f4cb4112ef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 >> 172.21.15.82:0/293375019 conn(0x7f4cb40f7f90 msgr2=0x7f4cb40f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 shutdown_connections 2024-04-27T07:45:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.595+0000 7f4cbaa6e640 1 -- 172.21.15.82:0/293375019 wait complete. 2024-04-27T07:45:19.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 -- 172.21.15.82:0/1270791769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 msgr2=0x7f53c40fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/1270791769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c40fff50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f53b80048d0 tx=0x7f53b8009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 -- 172.21.15.82:0/1270791769 shutdown_connections 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/1270791769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c40fff50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/1270791769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 0x7f53c40fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 -- 172.21.15.82:0/1270791769 >> 172.21.15.82:0/1270791769 conn(0x7f53c40f6c90 msgr2=0x7f53c40f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.703+0000 7f53c8f9d640 1 -- 172.21.15.82:0/1270791769 shutdown_connections 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 -- 172.21.15.82:0/1270791769 wait complete. 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 Processor -- start 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 -- start start 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 0x7f53c4119450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c4119f90 con 0x7f53c40fb930 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c8f9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41135b0 con 0x7f53c40faf90 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60894/0 (socket says 172.21.15.82:60894) 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c1d9b640 1 -- 172.21.15.82:0/505028135 learned_addr learned my addr 172.21.15.82:0/505028135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.704+0000 7f53c259c640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 0x7f53c4119450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c1d9b640 1 -- 172.21.15.82:0/505028135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 msgr2=0x7f53c4119450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c1d9b640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 0x7f53c4119450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c1d9b640 1 -- 172.21.15.82:0/505028135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8005040 con 0x7f53c40fb930 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c1d9b640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f53b8034040 tx=0x7f53b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b80092b0 con 0x7f53c40fb930 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53b803b400 con 0x7f53c40fb930 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c4113830 con 0x7f53c40fb930 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b80435d0 con 0x7f53c40fb930 2024-04-27T07:45:19.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.705+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c4113cf0 con 0x7f53c40fb930 2024-04-27T07:45:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.706+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c4065d50 con 0x7f53c40fb930 2024-04-27T07:45:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.706+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f53b802f070 con 0x7f53c40fb930 2024-04-27T07:45:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.707+0000 7f53b2ffd640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 0x7f53ac071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.707+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f53b80b04c0 con 0x7f53c40fb930 2024-04-27T07:45:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.707+0000 7f53c259c640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 0x7f53ac071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:19.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.708+0000 7f53c259c640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 0x7f53ac071020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009af0 tx=0x7f53b400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:19.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.712+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f53b8079320 con 0x7f53c40fb930 2024-04-27T07:45:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.889+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f53c410f8e0 con 0x7f53c40fb930 2024-04-27T07:45:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.889+0000 7f53b2ffd640 1 -- 172.21.15.82:0/505028135 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f53b807c9e0 con 0x7f53c40fb930 2024-04-27T07:45:19.892 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 msgr2=0x7f53ac071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 0x7f53ac071020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009af0 tx=0x7f53b400b040 comp rx=0 tx=0).stop 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 msgr2=0x7f53c4119990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f53b8034040 tx=0x7f53b8009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 shutdown_connections 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f53ac06eb70 0x7f53ac071020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53c40fb930 0x7f53c4119990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 --2- 172.21.15.82:0/505028135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53c40faf90 0x7f53c4119450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 >> 172.21.15.82:0/505028135 conn(0x7f53c40f6c90 msgr2=0x7f53c40f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 shutdown_connections 2024-04-27T07:45:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:19.891+0000 7f53c8f9d640 1 -- 172.21.15.82:0/505028135 wait complete. 2024-04-27T07:45:19.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- 172.21.15.82:0/172459189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 msgr2=0x7f9ffc0fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 --2- 172.21.15.82:0/172459189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc0fac90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40048d0 tx=0x7f9fe4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- 172.21.15.82:0/172459189 shutdown_connections 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 --2- 172.21.15.82:0/172459189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc0fac90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 --2- 172.21.15.82:0/172459189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- 172.21.15.82:0/172459189 >> 172.21.15.82:0/172459189 conn(0x7f9ffc071700 msgr2=0x7f9ffc071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:20.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- 172.21.15.82:0/172459189 shutdown_connections 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- 172.21.15.82:0/172459189 wait complete. 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 Processor -- start 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- start start 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc113990 con 0x7f9ffc0fa840 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7fa000f5d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc10cf50 con 0x7f9ffc1021f0 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.000+0000 7f9ffa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60914/0 (socket says 172.21.15.82:60914) 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 -- 172.21.15.82:0/3298979845 learned_addr learned my addr 172.21.15.82:0/3298979845 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 -- 172.21.15.82:0/3298979845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 msgr2=0x7f9ffc113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 -- 172.21.15.82:0/3298979845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4005040 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ffa59c640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b790 tx=0x7f9fec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec00c700 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fec00cd30 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc10d230 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fec013370 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.001+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc10d720 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.002+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc04bcc0 con 0x7f9ffc0fa840 2024-04-27T07:45:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.003+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f9fec012070 con 0x7f9ffc0fa840 2024-04-27T07:45:20.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.003+0000 7f9ff2ffd640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 0x7f9fe8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.003+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 0x7f9fe8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.003+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9fec08e4f0 con 0x7f9ffc0fa840 2024-04-27T07:45:20.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.003+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 0x7f9fe8071020 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc106970 tx=0x7f9fe4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.008+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9fec0572a0 con 0x7f9ffc0fa840 2024-04-27T07:45:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.186+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f9ffc10e4e0 con 0x7f9ffc0fa840 2024-04-27T07:45:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.186+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/3298979845 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9fec05a960 con 0x7f9ffc0fa840 2024-04-27T07:45:20.189 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 msgr2=0x7f9fe8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 0x7f9fe8071020 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc106970 tx=0x7f9fe4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 msgr2=0x7f9ffc112dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b790 tx=0x7f9fec0091d0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 shutdown_connections 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f9fe806eb70 0x7f9fe8071020 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ffc1021f0 0x7f9ffc113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 --2- 172.21.15.82:0/3298979845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ffc0fa840 0x7f9ffc112dc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 >> 172.21.15.82:0/3298979845 conn(0x7f9ffc071700 msgr2=0x7f9ffc0f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 shutdown_connections 2024-04-27T07:45:20.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.188+0000 7fa000f5d640 1 -- 172.21.15.82:0/3298979845 wait complete. 2024-04-27T07:45:20.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:19 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/2703249145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:20.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:19 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/293375019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:20.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:19 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/505028135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:20.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 -- 172.21.15.82:0/2853038443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd81021c0 msgr2=0x7f8cd8102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/2853038443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd81021c0 0x7f8cd8102590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40048d0 tx=0x7f8cd4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 -- 172.21.15.82:0/2853038443 shutdown_connections 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/2853038443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd8102b60 0x7f8cd80fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/2853038443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd81021c0 0x7f8cd8102590 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 -- 172.21.15.82:0/2853038443 >> 172.21.15.82:0/2853038443 conn(0x7f8cd8070890 msgr2=0x7f8cd8070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 -- 172.21.15.82:0/2853038443 shutdown_connections 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.294+0000 7f8cdfc21640 1 -- 172.21.15.82:0/2853038443 wait complete. 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 Processor -- start 2024-04-27T07:45:20.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 -- start start 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 0x7f8cd8112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8113910 con 0x7f8cd8102b60 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd810cf60 con 0x7f8cd81021c0 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60926/0 (socket says 172.21.15.82:60926) 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 -- 172.21.15.82:0/3010294730 learned_addr learned my addr 172.21.15.82:0/3010294730 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd9bd640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 0x7f8cd8112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 -- 172.21.15.82:0/3010294730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 msgr2=0x7f8cd8112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 0x7f8cd8112dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 -- 172.21.15.82:0/3010294730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4005040 con 0x7f8cd8102b60 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd9bd640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 0x7f8cd8112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdd1bc640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8002840 tx=0x7f8cc8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:20.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8007c30 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cc800f040 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.295+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd810d240 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.296+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8009570 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.296+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd810d760 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.297+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80652a0 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.297+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 92745+0+0 (secure 0 0 0) 0x7f8cc800dc80 con 0x7f8cd8102b60 2024-04-27T07:45:20.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.298+0000 7f8cce7fc640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 0x7f8cc4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T07:45:20.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.298+0000 7f8cdd9bd640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 0x7f8cc4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T07:45:20.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.298+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8cc808e180 con 0x7f8cd8102b60 2024-04-27T07:45:20.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.298+0000 7f8cdd9bd640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 0x7f8cc4071020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4031870 tx=0x7f8cd4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T07:45:20.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.302+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8cc8056f30 con 0x7f8cd8102b60 2024-04-27T07:45:20.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:19 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/2703249145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-27T07:45:20.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:19 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/293375019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-27T07:45:20.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:19 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/505028135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-27T07:45:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.490+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8cd8109390 con 0x7f8cd8102b60 2024-04-27T07:45:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.491+0000 7f8cce7fc640 1 -- 172.21.15.82:0/3010294730 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v85) v1 ==== 81+0+2301 (secure 0 0 0) 0x7f8cc805a5f0 con 0x7f8cd8102b60 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6829/3714048367 2024-04-28T07:40:55.150292+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:6828/15913842 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/1395364237 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/627056972 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6828/3714048367 2024-04-28T07:40:55.150292+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2001119936 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1316496039 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/151072868 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3417466421 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:20.495 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1322799412 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1077237808 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1079100432 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1079100432 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/507086912 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4158420091 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3300584346 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6827/2940930803 2024-04-28T07:40:30.474281+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3911518479 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/3011964559 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/6504988 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4080505049 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2198298480 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2553043456 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:20.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/627056972 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/812733995 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:0/4133994313 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.100:6829/15913842 2024-04-28T07:34:31.470816+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/767321209 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3417466421 2024-04-28T07:24:34.994059+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4079596977 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/92279690 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1415088792 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3242457432 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1415088792 2024-04-28T07:25:38.376618+0000 2024-04-27T07:45:20.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3242457432 2024-04-28T07:24:03.907593+0000 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4140677880 2024-04-28T07:32:53.130473+0000 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3056095726 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1059916025 2024-04-28T07:35:25.735490+0000 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6826/2940930803 2024-04-28T07:40:30.474281+0000 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:listed 39 entries 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 msgr2=0x7f8cc4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 0x7f8cc4071020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4031870 tx=0x7f8cd4009da0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 msgr2=0x7f8cd8113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-27T07:45:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8002840 tx=0x7f8cc8004570 comp rx=0 tx=0).stop 2024-04-27T07:45:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 shutdown_connections 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:6800/2055369903,v1:172.21.15.82:6801/2055369903] conn(0x7f8cc406eb70 0x7f8cc4071020 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd8102b60 0x7f8cd8113310 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 --2- 172.21.15.82:0/3010294730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cd81021c0 0x7f8cd8112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.493+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 >> 172.21.15.82:0/3010294730 conn(0x7f8cd8070890 msgr2=0x7f8cd8104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.494+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 shutdown_connections 2024-04-27T07:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-27T07:45:20.494+0000 7f8cdfc21640 1 -- 172.21.15.82:0/3010294730 wait complete. 2024-04-27T07:45:20.514 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-04-27T07:45:20.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-27T07:45:20.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-27T07:45:20.538 INFO:teuthology.orchestra.run:waiting for 300 2024-04-27T07:45:21.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:20 smithi082 ceph-mon[91103]: pgmap v336: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:21.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:20 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3298979845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:21.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:20 smithi082 ceph-mon[91103]: from='client.? 172.21.15.82:0/3010294730' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-27T07:45:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:20 smithi100 ceph-mon[80397]: pgmap v336: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:20 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3298979845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-27T07:45:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:20 smithi100 ceph-mon[80397]: from='client.? 172.21.15.82:0/3010294730' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-27T07:45:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:22 smithi082 ceph-mon[91103]: pgmap v337: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:22 smithi100 ceph-mon[80397]: pgmap v337: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:24.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:23 smithi082 ceph-mon[91103]: pgmap v338: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:24.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:23 smithi100 ceph-mon[80397]: pgmap v338: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:26.146 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:26.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:27.162 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:26 smithi082 ceph-mon[91103]: pgmap v339: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:27.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:26 smithi100 ceph-mon[80397]: pgmap v339: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:28 smithi082 ceph-mon[91103]: pgmap v340: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:28 smithi100 ceph-mon[80397]: pgmap v340: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:30 smithi082 ceph-mon[91103]: pgmap v341: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:30 smithi100 ceph-mon[80397]: pgmap v341: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:33.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:32 smithi082 ceph-mon[91103]: pgmap v342: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:33.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:32 smithi100 ceph-mon[80397]: pgmap v342: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:34 smithi082 ceph-mon[91103]: pgmap v343: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:34 smithi100 ceph-mon[80397]: pgmap v343: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:36 smithi082 ceph-mon[91103]: pgmap v344: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:36 smithi100 ceph-mon[80397]: pgmap v344: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:38 smithi082 ceph-mon[91103]: pgmap v345: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:38 smithi100 ceph-mon[80397]: pgmap v345: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:40 smithi082 ceph-mon[91103]: pgmap v346: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:41.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:40 smithi100 ceph-mon[80397]: pgmap v346: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:42 smithi082 ceph-mon[91103]: pgmap v347: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:42 smithi100 ceph-mon[80397]: pgmap v347: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:44 smithi082 ceph-mon[91103]: pgmap v348: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:44 smithi100 ceph-mon[80397]: pgmap v348: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:46 smithi082 ceph-mon[91103]: pgmap v349: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:46 smithi100 ceph-mon[80397]: pgmap v349: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:48 smithi082 ceph-mon[91103]: pgmap v350: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:48 smithi100 ceph-mon[80397]: pgmap v350: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:50 smithi082 ceph-mon[91103]: pgmap v351: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:50 smithi100 ceph-mon[80397]: pgmap v351: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:45:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:52 smithi082 ceph-mon[91103]: pgmap v352: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:52 smithi100 ceph-mon[80397]: pgmap v352: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:54 smithi082 ceph-mon[91103]: pgmap v353: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:54 smithi100 ceph-mon[80397]: pgmap v353: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:45:57.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:56 smithi082 ceph-mon[91103]: pgmap v354: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:56 smithi100 ceph-mon[80397]: pgmap v354: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:45:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:45:58 smithi082 ceph-mon[91103]: pgmap v355: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:45:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:45:58 smithi100 ceph-mon[80397]: pgmap v355: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:00 smithi082 ceph-mon[91103]: pgmap v356: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:00 smithi100 ceph-mon[80397]: pgmap v356: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:03.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:02 smithi082 ceph-mon[91103]: pgmap v357: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:02 smithi100 ceph-mon[80397]: pgmap v357: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:04 smithi082 ceph-mon[91103]: pgmap v358: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:05.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:04 smithi100 ceph-mon[80397]: pgmap v358: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:06 smithi082 ceph-mon[91103]: pgmap v359: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:06 smithi100 ceph-mon[80397]: pgmap v359: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:08 smithi082 ceph-mon[91103]: pgmap v360: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:08 smithi100 ceph-mon[80397]: pgmap v360: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:10 smithi082 ceph-mon[91103]: pgmap v361: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:10 smithi100 ceph-mon[80397]: pgmap v361: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:46:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:46:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:13.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:12 smithi082 ceph-mon[91103]: pgmap v362: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:13.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:12 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:46:13.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:12 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:46:13.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:12 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:12 smithi100 ceph-mon[80397]: pgmap v362: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:13.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:12 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:46:13.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:12 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:46:13.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:12 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:46:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:14 smithi082 ceph-mon[91103]: pgmap v363: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:14 smithi100 ceph-mon[80397]: pgmap v363: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:16 smithi082 ceph-mon[91103]: pgmap v364: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:16 smithi100 ceph-mon[80397]: pgmap v364: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:18 smithi082 ceph-mon[91103]: pgmap v365: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:18 smithi100 ceph-mon[80397]: pgmap v365: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:20 smithi082 ceph-mon[91103]: pgmap v366: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:20 smithi100 ceph-mon[80397]: pgmap v366: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:22 smithi082 ceph-mon[91103]: pgmap v367: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:22 smithi100 ceph-mon[80397]: pgmap v367: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:24 smithi082 ceph-mon[91103]: pgmap v368: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:24 smithi100 ceph-mon[80397]: pgmap v368: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:26.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:26 smithi082 ceph-mon[91103]: pgmap v369: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:27.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:26 smithi100 ceph-mon[80397]: pgmap v369: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:28.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:28 smithi100 ceph-mon[80397]: pgmap v370: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:28.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:28 smithi082 ceph-mon[91103]: pgmap v370: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:30 smithi082 ceph-mon[91103]: pgmap v371: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:30 smithi100 ceph-mon[80397]: pgmap v371: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:32 smithi082 ceph-mon[91103]: pgmap v372: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:33.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:32 smithi100 ceph-mon[80397]: pgmap v372: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:35.345 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:34 smithi082 ceph-mon[91103]: pgmap v373: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:34 smithi100 ceph-mon[80397]: pgmap v373: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:36 smithi082 ceph-mon[91103]: pgmap v374: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:36 smithi100 ceph-mon[80397]: pgmap v374: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:38 smithi082 ceph-mon[91103]: pgmap v375: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:38 smithi100 ceph-mon[80397]: pgmap v375: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:40 smithi082 ceph-mon[91103]: pgmap v376: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:40 smithi100 ceph-mon[80397]: pgmap v376: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:42 smithi082 ceph-mon[91103]: pgmap v377: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:42 smithi100 ceph-mon[80397]: pgmap v377: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:45.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:44 smithi082 ceph-mon[91103]: pgmap v378: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:44 smithi100 ceph-mon[80397]: pgmap v378: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:46 smithi082 ceph-mon[91103]: pgmap v379: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:46 smithi100 ceph-mon[80397]: pgmap v379: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:48 smithi082 ceph-mon[91103]: pgmap v380: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:48 smithi100 ceph-mon[80397]: pgmap v380: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:50 smithi082 ceph-mon[91103]: pgmap v381: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:50 smithi100 ceph-mon[80397]: pgmap v381: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:46:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:52 smithi082 ceph-mon[91103]: pgmap v382: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:52 smithi100 ceph-mon[80397]: pgmap v382: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:54 smithi082 ceph-mon[91103]: pgmap v383: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:54 smithi100 ceph-mon[80397]: pgmap v383: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:56.146 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:56.168 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:46:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:56 smithi100 ceph-mon[80397]: pgmap v384: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:56 smithi082 ceph-mon[91103]: pgmap v384: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:46:59.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:46:58 smithi082 ceph-mon[91103]: pgmap v385: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:46:59.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:46:58 smithi100 ceph-mon[80397]: pgmap v385: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:00 smithi082 ceph-mon[91103]: pgmap v386: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:00 smithi100 ceph-mon[80397]: pgmap v386: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:03.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:02 smithi082 ceph-mon[91103]: pgmap v387: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:02 smithi100 ceph-mon[80397]: pgmap v387: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:04 smithi082 ceph-mon[91103]: pgmap v388: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:05.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:04 smithi100 ceph-mon[80397]: pgmap v388: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:06 smithi082 ceph-mon[91103]: pgmap v389: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:06 smithi100 ceph-mon[80397]: pgmap v389: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:08 smithi082 ceph-mon[91103]: pgmap v390: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:08 smithi100 ceph-mon[80397]: pgmap v390: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:10 smithi082 ceph-mon[91103]: pgmap v391: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:10 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:10 smithi100 ceph-mon[80397]: pgmap v391: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:10 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:12 smithi082 ceph-mon[91103]: pgmap v392: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:13.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:12 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:47:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:12 smithi100 ceph-mon[80397]: pgmap v392: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:12 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:47:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:13 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:47:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:13 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:47:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:13 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:47:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:13 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:47:14.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:13 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:47:14.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:13 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:47:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:14 smithi082 ceph-mon[91103]: pgmap v393: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:14 smithi100 ceph-mon[80397]: pgmap v393: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:16 smithi082 ceph-mon[91103]: pgmap v394: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:16 smithi100 ceph-mon[80397]: pgmap v394: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:18 smithi082 ceph-mon[91103]: pgmap v395: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:18 smithi100 ceph-mon[80397]: pgmap v395: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:21 smithi082 ceph-mon[91103]: pgmap v396: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:21 smithi100 ceph-mon[80397]: pgmap v396: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:22.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:22 smithi082 ceph-mon[91103]: pgmap v397: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:22.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:22 smithi100 ceph-mon[80397]: pgmap v397: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:25.356 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:24 smithi082 ceph-mon[91103]: pgmap v398: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:24 smithi100 ceph-mon[80397]: pgmap v398: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:26.245 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:25 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:25 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:26 smithi082 ceph-mon[91103]: pgmap v399: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:26 smithi100 ceph-mon[80397]: pgmap v399: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:28 smithi082 ceph-mon[91103]: pgmap v400: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:28 smithi100 ceph-mon[80397]: pgmap v400: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:30 smithi082 ceph-mon[91103]: pgmap v401: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:30 smithi100 ceph-mon[80397]: pgmap v401: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:33.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:32 smithi082 ceph-mon[91103]: pgmap v402: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:33.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:32 smithi100 ceph-mon[80397]: pgmap v402: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:34 smithi082 ceph-mon[91103]: pgmap v403: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:34 smithi100 ceph-mon[80397]: pgmap v403: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:36 smithi082 ceph-mon[91103]: pgmap v404: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:36 smithi100 ceph-mon[80397]: pgmap v404: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:38.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:38 smithi082 ceph-mon[91103]: pgmap v405: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:38.917 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:38 smithi100 ceph-mon[80397]: pgmap v405: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:40 smithi082 ceph-mon[91103]: pgmap v406: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:40 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:40 smithi100 ceph-mon[80397]: pgmap v406: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:40 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:42 smithi082 ceph-mon[91103]: pgmap v407: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:42 smithi100 ceph-mon[80397]: pgmap v407: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:44 smithi082 ceph-mon[91103]: pgmap v408: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:44 smithi100 ceph-mon[80397]: pgmap v408: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:46 smithi082 ceph-mon[91103]: pgmap v409: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:46 smithi100 ceph-mon[80397]: pgmap v409: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:48 smithi082 ceph-mon[91103]: pgmap v410: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:48 smithi100 ceph-mon[80397]: pgmap v410: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:51.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:50 smithi082 ceph-mon[91103]: pgmap v411: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:50 smithi100 ceph-mon[80397]: pgmap v411: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:47:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:52 smithi082 ceph-mon[91103]: pgmap v412: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:52 smithi100 ceph-mon[80397]: pgmap v412: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:55 smithi082 ceph-mon[91103]: pgmap v413: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:55 smithi100 ceph-mon[80397]: pgmap v413: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:56.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:47:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:57 smithi082 ceph-mon[91103]: pgmap v414: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:57 smithi100 ceph-mon[80397]: pgmap v414: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:47:58.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:47:58 smithi082 ceph-mon[91103]: pgmap v415: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:47:58.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:47:58 smithi100 ceph-mon[80397]: pgmap v415: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:00 smithi082 ceph-mon[91103]: pgmap v416: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:00 smithi100 ceph-mon[80397]: pgmap v416: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:03.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:02 smithi082 ceph-mon[91103]: pgmap v417: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:03.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:02 smithi100 ceph-mon[80397]: pgmap v417: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:04 smithi082 ceph-mon[91103]: pgmap v418: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:05.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:04 smithi100 ceph-mon[80397]: pgmap v418: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:07.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:06 smithi082 ceph-mon[91103]: pgmap v419: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:06 smithi100 ceph-mon[80397]: pgmap v419: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:09.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:08 smithi082 ceph-mon[91103]: pgmap v420: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:08 smithi100 ceph-mon[80397]: pgmap v420: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:11 smithi082 ceph-mon[91103]: pgmap v421: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:11.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:11 smithi100 ceph-mon[80397]: pgmap v421: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:13 smithi082 ceph-mon[91103]: pgmap v422: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:13 smithi100 ceph-mon[80397]: pgmap v422: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:14.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:48:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:48:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:48:14.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:14 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:48:14.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:48:14.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:48:14.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:48:14.419 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:14 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:48:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:15 smithi082 ceph-mon[91103]: pgmap v423: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:15 smithi100 ceph-mon[80397]: pgmap v423: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:17 smithi082 ceph-mon[91103]: pgmap v424: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:17 smithi100 ceph-mon[80397]: pgmap v424: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:18 smithi082 ceph-mon[91103]: pgmap v425: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:18 smithi100 ceph-mon[80397]: pgmap v425: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:20 smithi082 ceph-mon[91103]: pgmap v426: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:20 smithi100 ceph-mon[80397]: pgmap v426: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:22 smithi082 ceph-mon[91103]: pgmap v427: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:22 smithi100 ceph-mon[80397]: pgmap v427: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:24 smithi082 ceph-mon[91103]: pgmap v428: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:24 smithi100 ceph-mon[80397]: pgmap v428: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:27.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:27 smithi082 ceph-mon[91103]: pgmap v429: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:27 smithi100 ceph-mon[80397]: pgmap v429: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:29.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:29 smithi082 ceph-mon[91103]: pgmap v430: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:29 smithi100 ceph-mon[80397]: pgmap v430: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:31.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:31 smithi082 ceph-mon[91103]: pgmap v431: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:31.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:31 smithi100 ceph-mon[80397]: pgmap v431: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:32.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:32 smithi082 ceph-mon[91103]: pgmap v432: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:32.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:32 smithi100 ceph-mon[80397]: pgmap v432: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:34 smithi082 ceph-mon[91103]: pgmap v433: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:34 smithi100 ceph-mon[80397]: pgmap v433: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:36 smithi082 ceph-mon[91103]: pgmap v434: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:36 smithi100 ceph-mon[80397]: pgmap v434: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:39.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:39 smithi082 ceph-mon[91103]: pgmap v435: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:39 smithi100 ceph-mon[80397]: pgmap v435: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:41 smithi082 ceph-mon[91103]: pgmap v436: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:41 smithi100 ceph-mon[80397]: pgmap v436: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:43.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:43 smithi082 ceph-mon[91103]: pgmap v437: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:43.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:43 smithi100 ceph-mon[80397]: pgmap v437: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:45 smithi082 ceph-mon[91103]: pgmap v438: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:45 smithi100 ceph-mon[80397]: pgmap v438: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:47 smithi082 ceph-mon[91103]: pgmap v439: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:47 smithi100 ceph-mon[80397]: pgmap v439: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:49 smithi082 ceph-mon[91103]: pgmap v440: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:49 smithi100 ceph-mon[80397]: pgmap v440: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:50.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:50 smithi082 ceph-mon[91103]: pgmap v441: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:50.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:50 smithi100 ceph-mon[80397]: pgmap v441: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:48:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:53 smithi082 ceph-mon[91103]: pgmap v442: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:53 smithi100 ceph-mon[80397]: pgmap v442: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:55.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:55 smithi082 ceph-mon[91103]: pgmap v443: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:55.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:55 smithi100 ceph-mon[80397]: pgmap v443: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:56.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:56 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:56.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:56 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:48:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:57 smithi082 ceph-mon[91103]: pgmap v444: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:57.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:57 smithi100 ceph-mon[80397]: pgmap v444: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:48:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:48:59 smithi082 ceph-mon[91103]: pgmap v445: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:48:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:48:59 smithi100 ceph-mon[80397]: pgmap v445: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:01.346 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:01 smithi082 ceph-mon[91103]: pgmap v446: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:01 smithi100 ceph-mon[80397]: pgmap v446: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:02.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:02 smithi082 ceph-mon[91103]: pgmap v447: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:02 smithi100 ceph-mon[80397]: pgmap v447: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:05 smithi082 ceph-mon[91103]: pgmap v448: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:05.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:05 smithi100 ceph-mon[80397]: pgmap v448: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:07 smithi082 ceph-mon[91103]: pgmap v449: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:07 smithi100 ceph-mon[80397]: pgmap v449: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:09 smithi082 ceph-mon[91103]: pgmap v450: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:09 smithi100 ceph-mon[80397]: pgmap v450: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:11 smithi082 ceph-mon[91103]: pgmap v451: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:11 smithi100 ceph-mon[80397]: pgmap v451: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:13.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:13 smithi082 ceph-mon[91103]: pgmap v452: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:13.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:13 smithi100 ceph-mon[80397]: pgmap v452: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:15 smithi082 ceph-mon[91103]: pgmap v453: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:49:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:49:15.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:49:15.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:49:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:15 smithi100 ceph-mon[80397]: pgmap v453: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:49:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:49:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:49:15.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:49:17.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:17 smithi082 ceph-mon[91103]: pgmap v454: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:17 smithi100 ceph-mon[80397]: pgmap v454: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:18.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:18 smithi082 ceph-mon[91103]: pgmap v455: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:18.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:18 smithi100 ceph-mon[80397]: pgmap v455: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:21.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:21 smithi082 ceph-mon[91103]: pgmap v456: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:21.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:21 smithi100 ceph-mon[80397]: pgmap v456: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:23.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:23 smithi082 ceph-mon[91103]: pgmap v457: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:23.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:23 smithi100 ceph-mon[80397]: pgmap v457: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:25.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:25 smithi082 ceph-mon[91103]: pgmap v458: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:25.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:25 smithi100 ceph-mon[80397]: pgmap v458: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:26.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:26 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:26.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:26 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:27.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:27 smithi082 ceph-mon[91103]: pgmap v459: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:27.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:27 smithi100 ceph-mon[80397]: pgmap v459: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:29.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:29 smithi082 ceph-mon[91103]: pgmap v460: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:29.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:29 smithi100 ceph-mon[80397]: pgmap v460: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:30.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:30 smithi082 ceph-mon[91103]: pgmap v461: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:30.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:30 smithi100 ceph-mon[80397]: pgmap v461: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:33.350 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:33 smithi082 ceph-mon[91103]: pgmap v462: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:33.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:33 smithi100 ceph-mon[80397]: pgmap v462: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:35.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:35 smithi082 ceph-mon[91103]: pgmap v463: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:35.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:35 smithi100 ceph-mon[80397]: pgmap v463: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:37.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:37 smithi082 ceph-mon[91103]: pgmap v464: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:37.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:37 smithi100 ceph-mon[80397]: pgmap v464: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:39.344 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:39 smithi082 ceph-mon[91103]: pgmap v465: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:39.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:39 smithi100 ceph-mon[80397]: pgmap v465: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:41 smithi082 ceph-mon[91103]: pgmap v466: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:41.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:41 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:41 smithi100 ceph-mon[80397]: pgmap v466: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:41.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:41 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:42.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:42 smithi082 ceph-mon[91103]: pgmap v467: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:42.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:42 smithi100 ceph-mon[80397]: pgmap v467: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:45.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:45 smithi082 ceph-mon[91103]: pgmap v468: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:45.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:45 smithi100 ceph-mon[80397]: pgmap v468: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:47.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:47 smithi082 ceph-mon[91103]: pgmap v469: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:47.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:47 smithi100 ceph-mon[80397]: pgmap v469: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:49.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:49 smithi082 ceph-mon[91103]: pgmap v470: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:49.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:49 smithi100 ceph-mon[80397]: pgmap v470: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:51.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:51 smithi082 ceph-mon[91103]: pgmap v471: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:51.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:51 smithi100 ceph-mon[80397]: pgmap v471: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:49:53.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:53 smithi082 ceph-mon[91103]: pgmap v472: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:53.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:53 smithi100 ceph-mon[80397]: pgmap v472: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:54.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:54 smithi082 ceph-mon[91103]: pgmap v473: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:54.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:54 smithi100 ceph-mon[80397]: pgmap v473: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:56.145 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:55 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:56.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:55 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:49:57.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:56 smithi100 ceph-mon[80397]: pgmap v474: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:57.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:56 smithi082 ceph-mon[91103]: pgmap v474: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:49:59.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:49:59 smithi082 ceph-mon[91103]: pgmap v475: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:49:59.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:49:59 smithi100 ceph-mon[80397]: pgmap v475: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:00.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:00 smithi082 ceph-mon[91103]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:50:00.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:00 smithi100 ceph-mon[80397]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-04-27T07:50:01.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:01 smithi082 ceph-mon[91103]: pgmap v476: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:50:01.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:01 smithi100 ceph-mon[80397]: pgmap v476: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:50:02.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:02 smithi082 ceph-mon[91103]: pgmap v477: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:02.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:02 smithi100 ceph-mon[80397]: pgmap v477: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:05.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:05 smithi082 ceph-mon[91103]: pgmap v478: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:05.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:05 smithi100 ceph-mon[80397]: pgmap v478: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:07.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:07 smithi082 ceph-mon[91103]: pgmap v479: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:07.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:07 smithi100 ceph-mon[80397]: pgmap v479: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:09.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:09 smithi082 ceph-mon[91103]: pgmap v480: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:09.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:09 smithi100 ceph-mon[80397]: pgmap v480: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:11 smithi082 ceph-mon[91103]: pgmap v481: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:50:11.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:11 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:50:11.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:11 smithi100 ceph-mon[80397]: pgmap v481: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T07:50:11.418 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:11 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-27T07:50:12.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:12 smithi082 ceph-mon[91103]: pgmap v482: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:12.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:12 smithi100 ceph-mon[80397]: pgmap v482: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:15 smithi082 ceph-mon[91103]: pgmap v483: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:15.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:15 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:50:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:15 smithi100 ceph-mon[80397]: pgmap v483: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:15.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:15 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T07:50:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:50:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:50:16.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:16 smithi082 ceph-mon[91103]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:50:16.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T07:50:16.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T07:50:16.454 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:16 smithi100 ceph-mon[80397]: from='mgr.34102 172.21.15.82:0/1181980789' entity='mgr.smithi082.hhlhmf' 2024-04-27T07:50:17.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:17 smithi082 ceph-mon[91103]: pgmap v484: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:17.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:17 smithi100 ceph-mon[80397]: pgmap v484: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T07:50:19.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:19 smithi082 ceph-mon[91103]: pgmap v485: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:19.417 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:19 smithi100 ceph-mon[80397]: pgmap v485: 65 pgs: 65 active+clean; 181 MiB data, 822 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T07:50:19.610 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-27T07:50:19.611 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-27T07:50:19.612 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-27T07:50:19.626 INFO:tasks.cephadm:Teardown begin 2024-04-27T07:50:19.626 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/cephadm.py", line 2246, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-27T07:50:19.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:50:19.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:50:19.692 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-27T07:50:19.692 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-27T07:50:19.718 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-27T07:50:19.750 INFO:tasks.cephadm:Stopping all daemons... 2024-04-27T07:50:19.750 INFO:tasks.cephadm.mon.smithi082:Stopping mon.smithi082... 2024-04-27T07:50:19.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082 2024-04-27T07:50:20.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:19 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:20 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[91099]: 2024-04-27T07:50:20.087+0000 7fbbfa46c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:20 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082[91099]: 2024-04-27T07:50:20.087+0000 7fbbfa46c700 -1 mon.smithi082@0(leader) e3 *** Got Signal Terminated *** 2024-04-27T07:50:20.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:20 smithi082 podman[147718]: 2024-04-27 07:50:20.1391699 +0000 UTC m=+0.193994970 container died 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-27T07:50:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:20 smithi082 podman[147718]: 2024-04-27 07:50:20.638885365 +0000 UTC m=+0.693710428 container cleanup 40fa3d40b7771c6778df31845408f9d1fa6ec0153f467974d7d7b4a51eafa555 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, ceph=True) 2024-04-27T07:50:20.843 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Apr 27 07:50:20 smithi082 bash[147718]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi082 2024-04-27T07:50:20.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi082.service' 2024-04-27T07:50:21.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:21.034 INFO:tasks.cephadm.mon.smithi082:Stopped mon.smithi082 2024-04-27T07:50:21.034 INFO:tasks.cephadm.mon.smithi100:Stopping mon.smithi100... 2024-04-27T07:50:21.034 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi100 2024-04-27T07:50:21.328 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 systemd[1]: Stopping Ceph mon.smithi100 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:21.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100[80393]: 2024-04-27T07:50:21.325+0000 7f4db75fc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi100 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:21.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100[80393]: 2024-04-27T07:50:21.325+0000 7f4db75fc700 -1 mon.smithi100@1(peon) e3 *** Got Signal Terminated *** 2024-04-27T07:50:21.667 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 podman[116650]: 2024-04-27 07:50:21.520507866 +0000 UTC m=+0.288904001 container died 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-27T07:50:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 podman[116650]: 2024-04-27 07:50:21.943278939 +0000 UTC m=+0.711675133 container cleanup 07b61e2da755a5f73715f42c3770d94426c3544f4c1ed025a497ae1eaab75d56 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-c37f63b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-27T07:50:22.167 INFO:journalctl@ceph.mon.smithi100.smithi100.stdout:Apr 27 07:50:21 smithi100 bash[116650]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-mon-smithi100 2024-04-27T07:50:22.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@mon.smithi100.service' 2024-04-27T07:50:22.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:22.452 INFO:tasks.cephadm.mon.smithi100:Stopped mon.smithi100 2024-04-27T07:50:22.452 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-27T07:50:22.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.0 2024-04-27T07:50:22.752 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:22 smithi082 systemd[1]: Stopping Ceph osd.0 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:23.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:22 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:50:22.750+0000 7f0ec613c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:23.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:22 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:50:22.750+0000 7f0ec613c700 -1 osd.0 85 *** Got signal Terminated *** 2024-04-27T07:50:23.093 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:22 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0[99948]: 2024-04-27T07:50:22.750+0000 7f0ec613c700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:50:28.593 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:28 smithi082 podman[147850]: 2024-04-27 07:50:28.250683906 +0000 UTC m=+5.613378887 container died 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:50:28.887 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:28 smithi082 podman[147850]: 2024-04-27 07:50:28.684775699 +0000 UTC m=+6.047470670 container cleanup 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-27T07:50:28.887 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:28 smithi082 bash[147850]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0 2024-04-27T07:50:29.305 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:28 smithi082 podman[147880]: 2024-04-27 07:50:28.886291115 +0000 UTC m=+0.632706199 container remove 95f4ef5645d0e05ca02bc432bab5e6cb193f1b45cb4dbb06a35c6983794322e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-27T07:50:29.558 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.304125019 +0000 UTC m=+0.111042754 container create c6735657f1c33e4a660d41ca4498d37bc3e9ec73da4a3b861cc6d79baab84617 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-27T07:50:29.558 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.211609403 +0000 UTC m=+0.018527140 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:50:29.558 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.556926793 +0000 UTC m=+0.363844523 container init c6735657f1c33e4a660d41ca4498d37bc3e9ec73da4a3b861cc6d79baab84617 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-27T07:50:29.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.560274359 +0000 UTC m=+0.367192102 container start c6735657f1c33e4a660d41ca4498d37bc3e9ec73da4a3b861cc6d79baab84617 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=main-c37f63b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-27T07:50:29.843 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.640083014 +0000 UTC m=+0.447000744 container attach c6735657f1c33e4a660d41ca4498d37bc3e9ec73da4a3b861cc6d79baab84617 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:50:30.203 INFO:journalctl@ceph.osd.0.smithi082.stdout:Apr 27 07:50:29 smithi082 podman[147977]: 2024-04-27 07:50:29.859041793 +0000 UTC m=+0.665959524 container died c6735657f1c33e4a660d41ca4498d37bc3e9ec73da4a3b861cc6d79baab84617 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:50:30.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.0.service' 2024-04-27T07:50:30.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:30.553 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-27T07:50:30.553 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-27T07:50:30.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.1 2024-04-27T07:50:30.843 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:30 smithi082 systemd[1]: Stopping Ceph osd.1 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:31.343 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:30 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:50:30.865+0000 7f4ed7305700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:31.343 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:30 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:50:30.865+0000 7f4ed7305700 -1 osd.1 85 *** Got signal Terminated *** 2024-04-27T07:50:31.343 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:30 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1[105628]: 2024-04-27T07:50:30.865+0000 7f4ed7305700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:50:36.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:36 smithi082 podman[148085]: 2024-04-27 07:50:36.302915168 +0000 UTC m=+5.532386672 container died 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:50:36.891 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:36 smithi082 podman[148085]: 2024-04-27 07:50:36.697123441 +0000 UTC m=+5.926594944 container cleanup 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:50:36.891 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:36 smithi082 bash[148085]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1 2024-04-27T07:50:37.320 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:36 smithi082 podman[148102]: 2024-04-27 07:50:36.890256976 +0000 UTC m=+0.582165114 container remove 8b047025c2bb9acd205e883a6265b85d9f19b4d005f0fe528dd5f4c4f24e7c6b (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-27T07:50:37.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.221354884 +0000 UTC m=+0.018436585 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:50:37.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.333105994 +0000 UTC m=+0.130187684 container create dabd2902d5e7bc2362f6c9d665d976c3ba6556f139097985976bfa43fe0234eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:50:37.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.519397017 +0000 UTC m=+0.316478702 container init dabd2902d5e7bc2362f6c9d665d976c3ba6556f139097985976bfa43fe0234eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-27T07:50:37.593 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.522807663 +0000 UTC m=+0.319889356 container start dabd2902d5e7bc2362f6c9d665d976c3ba6556f139097985976bfa43fe0234eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-27T07:50:38.094 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.593891462 +0000 UTC m=+0.390973158 container attach dabd2902d5e7bc2362f6c9d665d976c3ba6556f139097985976bfa43fe0234eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS) 2024-04-27T07:50:38.094 INFO:journalctl@ceph.osd.1.smithi082.stdout:Apr 27 07:50:37 smithi082 podman[148191]: 2024-04-27 07:50:37.814718717 +0000 UTC m=+0.611800392 container died dabd2902d5e7bc2362f6c9d665d976c3ba6556f139097985976bfa43fe0234eb (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-04-27T07:50:38.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.1.service' 2024-04-27T07:50:38.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:38.536 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-27T07:50:38.537 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-27T07:50:38.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.2 2024-04-27T07:50:38.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:38 smithi082 systemd[1]: Stopping Ceph osd.2 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:39.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:38 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:50:38.892+0000 7f1e34dc0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:39.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:38 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:50:38.892+0000 7f1e34dc0700 -1 osd.2 85 *** Got signal Terminated *** 2024-04-27T07:50:39.343 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:38 smithi082 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2[111002]: 2024-04-27T07:50:38.892+0000 7f1e34dc0700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:50:44.503 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:44 smithi082 podman[148299]: 2024-04-27 07:50:44.234869946 +0000 UTC m=+5.476762637 container died 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-27T07:50:44.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:44 smithi082 podman[148299]: 2024-04-27 07:50:44.600575827 +0000 UTC m=+5.842468512 container cleanup 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-27T07:50:44.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:44 smithi082 bash[148299]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2 2024-04-27T07:50:45.226 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:44 smithi082 podman[148318]: 2024-04-27 07:50:44.895108144 +0000 UTC m=+0.653028959 container remove 91932106b4cccb9e9e51b21ef8e9df8bdc2e59217b5367709ace49392c7645c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-27T07:50:45.548 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.128381841 +0000 UTC m=+0.018180296 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:50:45.548 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.236390438 +0000 UTC m=+0.126188925 container create 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:50:45.548 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.463724089 +0000 UTC m=+0.353522534 container init 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-27T07:50:45.549 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.46680785 +0000 UTC m=+0.356606295 container start 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-27T07:50:45.549 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.547150204 +0000 UTC m=+0.436948666 container attach 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-27T07:50:45.843 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:45 smithi082 podman[148406]: 2024-04-27 07:50:45.762229646 +0000 UTC m=+0.652028096 container died 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=main-c37f63b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-27T07:50:46.303 INFO:journalctl@ceph.osd.2.smithi082.stdout:Apr 27 07:50:46 smithi082 podman[148432]: 2024-04-27 07:50:46.284350925 +0000 UTC m=+0.517276591 container remove 3d83022313fb7a03b90ec3bb68ac0de123966856dec004cf6d5acb7fdad79366 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=main-c37f63b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:50:46.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.2.service' 2024-04-27T07:50:46.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:46.346 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-27T07:50:46.346 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-27T07:50:46.346 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.3 2024-04-27T07:50:46.647 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:46 smithi100 systemd[1]: Stopping Ceph osd.3 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:46.917 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:46 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:50:46.645+0000 7f4e241de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:46.917 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:46 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:50:46.645+0000 7f4e241de700 -1 osd.3 85 *** Got signal Terminated *** 2024-04-27T07:50:46.917 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:46 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:50:46.645+0000 7f4e241de700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:50:50.167 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:49 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:49.761+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:51.150 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:50 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:50.750+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:51.416 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:51 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3[89618]: 2024-04-27T07:50:51.149+0000 7f4e207d2700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.366167+0000 front 2024-04-27T07:50:27.366236+0000 (oldest deadline 2024-04-27T07:50:50.866173+0000) 2024-04-27T07:50:52.082 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:51 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:51.713+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:52.372 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 podman[116772]: 2024-04-27 07:50:52.081111514 +0000 UTC m=+5.544735552 container died bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-c37f63b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:50:52.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 podman[116772]: 2024-04-27 07:50:52.371030384 +0000 UTC m=+5.834654420 container cleanup bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-04-27T07:50:52.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 bash[116772]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3 2024-04-27T07:50:52.667 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 podman[116801]: 2024-04-27 07:50:52.614142244 +0000 UTC m=+0.535882371 container remove bb89023ec444ed27d79dcdd743896696986a5d27ebdcbdff5877d9c05ec5f076 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=main-c37f63b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:50:53.092 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:52 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:52.733+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:53.093 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 podman[116893]: 2024-04-27 07:50:52.853319538 +0000 UTC m=+0.018293097 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:50:53.093 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:52 smithi100 podman[116893]: 2024-04-27 07:50:52.965010172 +0000 UTC m=+0.129983718 container create 439394353a62e136cb7c74ab793da654a6e892b2c152ca59f367b97539d5a9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b) 2024-04-27T07:50:53.417 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:53 smithi100 podman[116893]: 2024-04-27 07:50:53.201102631 +0000 UTC m=+0.366076180 container init 439394353a62e136cb7c74ab793da654a6e892b2c152ca59f367b97539d5a9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-27T07:50:53.417 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:53 smithi100 podman[116893]: 2024-04-27 07:50:53.204119015 +0000 UTC m=+0.369092568 container start 439394353a62e136cb7c74ab793da654a6e892b2c152ca59f367b97539d5a9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-27T07:50:53.417 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:53 smithi100 podman[116893]: 2024-04-27 07:50:53.284486314 +0000 UTC m=+0.449459861 container attach 439394353a62e136cb7c74ab793da654a6e892b2c152ca59f367b97539d5a9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=main-c37f63b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-27T07:50:53.732 INFO:journalctl@ceph.osd.3.smithi100.stdout:Apr 27 07:50:53 smithi100 podman[116893]: 2024-04-27 07:50:53.500600233 +0000 UTC m=+0.665573774 container died 439394353a62e136cb7c74ab793da654a6e892b2c152ca59f367b97539d5a9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=main-c37f63b, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-27T07:50:54.064 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:53 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:53.729+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:54.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.3.service' 2024-04-27T07:50:54.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:50:54.172 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-27T07:50:54.172 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-27T07:50:54.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.4 2024-04-27T07:50:54.417 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:54 smithi100 systemd[1]: Stopping Ceph osd.4 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:50:54.417 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:54 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:54.062+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:54.917 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:54 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:54.532+0000 7fcb1926a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:50:54.917 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:54 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:54.532+0000 7fcb1926a700 -1 osd.4 85 *** Got signal Terminated *** 2024-04-27T07:50:54.917 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:54 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:54.532+0000 7fcb1926a700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:50:54.917 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:54 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:54.748+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:55.417 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:55 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:55.049+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:56.004 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:55 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:55.731+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:56.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:56 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:56.002+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:57.015 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:56 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:56.730+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:57.417 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:57 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:57.013+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:58.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:57 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:57.972+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:58.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:57 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:57.744+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:58.168 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:57 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:57.744+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:32.684219+0000 front 2024-04-27T07:50:32.684279+0000 (oldest deadline 2024-04-27T07:50:57.384011+0000) 2024-04-27T07:50:59.170 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:50:58 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:50:58.963+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:50:59.171 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:58 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:58.735+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:23.883428+0000 front 2024-04-27T07:50:23.883418+0000 (oldest deadline 2024-04-27T07:50:49.183293+0000) 2024-04-27T07:50:59.171 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:50:58 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4[94653]: 2024-04-27T07:50:58.735+0000 7fcb11856700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:32.684219+0000 front 2024-04-27T07:50:32.684279+0000 (oldest deadline 2024-04-27T07:50:57.384011+0000) 2024-04-27T07:51:00.336 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:00 smithi100 podman[116999]: 2024-04-27 07:51:00.038425816 +0000 UTC m=+5.645552078 container died bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416) 2024-04-27T07:51:00.336 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:00 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:00.005+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:00.667 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:00 smithi100 podman[116999]: 2024-04-27 07:51:00.416962308 +0000 UTC m=+6.024088568 container cleanup bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-27T07:51:00.667 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:00 smithi100 bash[116999]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4 2024-04-27T07:51:01.003 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:00 smithi100 podman[117018]: 2024-04-27 07:51:00.668105553 +0000 UTC m=+0.622294598 container remove bc48a356d7eab0067fd23b83fd18bd2f56528165e9998d97c1fa84e0820a3073 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-27T07:51:01.323 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:01.019314173 +0000 UTC m=+0.109213141 container create 982665ede1af6708984e414f1322663530c0edf7554ecef33094616d7ef6b8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-27T07:51:01.323 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:00.927744698 +0000 UTC m=+0.017643641 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:51:01.323 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:01.238610054 +0000 UTC m=+0.328508979 container init 982665ede1af6708984e414f1322663530c0edf7554ecef33094616d7ef6b8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-27T07:51:01.323 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:01.241606861 +0000 UTC m=+0.331505801 container start 982665ede1af6708984e414f1322663530c0edf7554ecef33094616d7ef6b8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=main-c37f63b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-27T07:51:01.323 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:01.321740103 +0000 UTC m=+0.411639029 container attach 982665ede1af6708984e414f1322663530c0edf7554ecef33094616d7ef6b8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:51:01.324 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:01 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:01.001+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:01.667 INFO:journalctl@ceph.osd.4.smithi100.stdout:Apr 27 07:51:01 smithi100 podman[117110]: 2024-04-27 07:51:01.535496796 +0000 UTC m=+0.625395730 container died 982665ede1af6708984e414f1322663530c0edf7554ecef33094616d7ef6b8dc (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=main-c37f63b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:51:02.118 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:01 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:01.981+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:02.118 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:01 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:01.981+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:02.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.4.service' 2024-04-27T07:51:02.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:51:02.170 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-27T07:51:02.170 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-27T07:51:02.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.5 2024-04-27T07:51:02.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 systemd[1]: Stopping Ceph osd.5 for ebadc0d6-0466-11ef-bc93-c7b262605968... 2024-04-27T07:51:02.917 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:02.519+0000 7fa41ea12700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-27T07:51:02.917 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:02.519+0000 7fa41ea12700 -1 osd.5 85 *** Got signal Terminated *** 2024-04-27T07:51:02.917 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:02.519+0000 7fa41ea12700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-27T07:51:03.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:02.933+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:03.417 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:02 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:02.933+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:04.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:03 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:03.892+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:04.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:03 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:03.892+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:05.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:04 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:04.853+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:05.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:04 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:04.853+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:06.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:05 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:05.833+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:06.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:05 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:05.833+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:07.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:06 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:06.838+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-04-27T07:50:27.445930+0000 front 2024-04-27T07:50:27.446028+0000 (oldest deadline 2024-04-27T07:50:53.345997+0000) 2024-04-27T07:51:07.167 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:06 smithi100 ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5[99532]: 2024-04-27T07:51:06.838+0000 7fa41b006700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-04-27T07:50:35.646990+0000 front 2024-04-27T07:50:35.646945+0000 (oldest deadline 2024-04-27T07:51:01.546843+0000) 2024-04-27T07:51:08.315 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 podman[117216]: 2024-04-27 07:51:08.01639435 +0000 UTC m=+5.628089971 container died a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-27T07:51:08.664 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 podman[117216]: 2024-04-27 07:51:08.395117415 +0000 UTC m=+6.006813025 container cleanup a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b) 2024-04-27T07:51:08.664 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 bash[117216]: ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5 2024-04-27T07:51:08.916 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 podman[117234]: 2024-04-27 07:51:08.663089184 +0000 UTC m=+0.643541422 container remove a25fdc3db0096a725b64984ccf5c074f7876b8fb91a460887398fd33e8bf7904 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-c37f63b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-27T07:51:09.251 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 podman[117323]: 2024-04-27 07:51:08.87114364 +0000 UTC m=+0.017389602 image pull d1033e2936545a48f92312bd0a1ad98f71fab9d7a0072a738f243fac960d52b3 quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d 2024-04-27T07:51:09.251 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:08 smithi100 podman[117323]: 2024-04-27 07:51:08.972571664 +0000 UTC m=+0.118817654 container create 3d9931df082b165ef29e212533f095851a7d5ae27c51d5be1084faba3b665081 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=main-c37f63b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-27T07:51:09.251 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:09 smithi100 podman[117323]: 2024-04-27 07:51:09.183512991 +0000 UTC m=+0.329758938 container init 3d9931df082b165ef29e212533f095851a7d5ae27c51d5be1084faba3b665081 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-27T07:51:09.251 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:09 smithi100 podman[117323]: 2024-04-27 07:51:09.186578058 +0000 UTC m=+0.332824016 container start 3d9931df082b165ef29e212533f095851a7d5ae27c51d5be1084faba3b665081 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-27T07:51:09.251 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:09 smithi100 podman[117323]: 2024-04-27 07:51:09.250153982 +0000 UTC m=+0.396399931 container attach 3d9931df082b165ef29e212533f095851a7d5ae27c51d5be1084faba3b665081 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-c37f63b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-27T07:51:09.667 INFO:journalctl@ceph.osd.5.smithi100.stdout:Apr 27 07:51:09 smithi100 podman[117323]: 2024-04-27 07:51:09.472856479 +0000 UTC m=+0.619102426 container died 3d9931df082b165ef29e212533f095851a7d5ae27c51d5be1084faba3b665081 (image=quay.ceph.io/ceph-ci/ceph@sha256:f96bd403e19325053f8924c187a603b2347746b3ba1068eb8516cdf83fd3976d, name=ceph-ebadc0d6-0466-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-c37f63b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-27T07:51:10.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ebadc0d6-0466-11ef-bc93-c7b262605968@osd.5.service' 2024-04-27T07:51:10.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-27T07:51:10.129 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-27T07:51:10.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-27T07:51:13.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[74045]: fuse finished with error 0 and tester_r 0 2024-04-27T07:51:34.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-27T07:51:49.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:51:49.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-27T07:51:49.647 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-27T07:51:49.649 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi082/crash 2024-04-27T07:51:49.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash -- . 2024-04-27T07:51:49.689 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-27T07:51:49.689 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-04-27T07:51:49.691 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi100/crash 2024-04-27T07:51:49.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash -- . 2024-04-27T07:51:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-27T07:51:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-04-27T07:51:49.715 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-27T07:51:49.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-27T07:51:49.768 INFO:tasks.cephadm:Compressing logs... 2024-04-27T07:51:49.769 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-27T07:51:49.811 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.bqtewe.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-27T07:51:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log: /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.bqtewe.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-27T07:51:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.vlqbei.log 2024-04-27T07:51:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-27T07:51:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.vlqbei.log: 88.3% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-27T07:51:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi082.hhlhmf.log 2024-04-27T07:51:49.850 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.4% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-27T07:51:49.850 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-27T07:51:49.850 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi082.hhlhmf.log: 91.2% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-27T07:51:49.852 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-27T07:51:49.852 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-04-27T07:51:49.853 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log 2024-04-27T07:51:49.853 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.udlhfn.log 2024-04-27T07:51:49.853 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-27T07:51:49.853 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.udlhfn.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-27T07:51:49.853 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log: /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi100.eparbe.log 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi100.log 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi100.eparbe.log: 88.3% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.kjopce.log 2024-04-27T07:51:49.854 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi100.log: 91.4% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-27T07:51:49.855 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-27T07:51:49.856 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.kjopce.log: gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-27T07:51:49.857 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.2% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-27T07:51:49.858 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi082.log 2024-04-27T07:51:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-27T07:51:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-27T07:51:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi082.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-27T07:51:49.896 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-27T07:51:49.907 INFO:teuthology.orchestra.run.smithi082.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-27T07:51:49.911 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi100.eparbe.log.gz 2024-04-27T07:51:49.912 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-27T07:51:50.246 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mgr.smithi082.hhlhmf.log.gz 2024-04-27T07:51:50.290 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi100.log.gz 2024-04-27T07:51:50.839 INFO:teuthology.orchestra.run.smithi082.stderr: 90.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mon.smithi082.log.gz 2024-04-27T07:51:53.685 INFO:teuthology.orchestra.run.smithi100.stderr: 95.0% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.kjopce.log.gz 2024-04-27T07:51:54.517 INFO:teuthology.orchestra.run.smithi082.stderr: 93.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-27T07:51:54.639 INFO:teuthology.orchestra.run.smithi100.stderr: 93.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-27T07:51:55.022 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-27T07:51:55.308 INFO:teuthology.orchestra.run.smithi082.stderr: 93.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-27T07:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr: 93.6% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-27T07:51:56.559 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-27T07:51:59.619 INFO:teuthology.orchestra.run.smithi082.stderr: 95.1% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.bqtewe.log.gz 2024-04-27T07:52:04.264 INFO:teuthology.orchestra.run.smithi082.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-27T07:52:05.515 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-27T07:52:05.516 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-27T07:52:37.585 INFO:teuthology.orchestra.run.smithi100.stderr: 93.5% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi100.udlhfn.log.gz 2024-04-27T07:52:37.587 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-04-27T07:52:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m47.762s 2024-04-27T07:52:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:user 1m21.975s 2024-04-27T07:52:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m2.416s 2024-04-27T07:52:38.901 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/ebadc0d6-0466-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi082.vlqbei.log.gz 2024-04-27T07:52:38.903 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-04-27T07:52:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m49.079s 2024-04-27T07:52:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:user 1m27.893s 2024-04-27T07:52:38.903 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m2.858s 2024-04-27T07:52:38.904 INFO:tasks.cephadm:Archiving logs... 2024-04-27T07:52:38.904 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi082/log 2024-04-27T07:52:38.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-27T07:52:51.492 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi100/log 2024-04-27T07:52:51.493 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-27T07:53:03.456 INFO:tasks.cephadm:Removing cluster... 2024-04-27T07:53:03.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 --force 2024-04-27T07:53:04.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ebadc0d6-0466-11ef-bc93-c7b262605968 --force 2024-04-27T07:53:04.564 INFO:tasks.cephadm:Removing cephadm ... 2024-04-27T07:53:04.564 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-27T07:53:04.579 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-27T07:53:04.594 INFO:tasks.cephadm:Teardown complete 2024-04-27T07:53:04.595 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-27T07:53:04.608 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-27T07:53:04.608 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-27T07:53:04.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-27T07:53:04.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-27T07:53:04.700 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-27T07:53:04.712 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-27T07:53:04.712 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T07:53:04.715 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-27T07:53:04.727 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-27T07:53:04.729 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-27T07:53:04.731 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T07:53:04.731 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-27T07:53:04.732 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +559us[ +565us] +/- 70ms 2024-04-27T07:53:04.732 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -642us[ -642us] +/- 71ms 2024-04-27T07:53:04.732 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +93us[ +99us] +/- 68ms 2024-04-27T07:53:04.732 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:53:04.732 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-27T07:53:04.733 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-27T07:53:04.733 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +556us[ +564us] +/- 70ms 2024-04-27T07:53:04.733 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -663us[ -663us] +/- 71ms 2024-04-27T07:53:04.733 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +60us[ +60us] +/- 68ms 2024-04-27T07:53:04.733 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-27T07:53:04.734 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-27T07:53:04.747 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-27T07:53:04.749 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-27T07:53:04.768 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-27T07:53:04.847 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-27T07:53:04.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T07:53:04.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:53:04.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-27T07:53:04.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:53:04.972 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-27T07:53:04.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-27T07:53:05.009 INFO:teuthology.task.internal:Duration was 2223.046338 seconds 2024-04-27T07:53:05.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-27T07:53:05.044 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-27T07:53:05.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-27T07:53:05.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-27T07:53:05.080 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T07:53:05.082 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-27T07:53:05.457 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-27T07:53:05.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-27T07:53:05.458 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-27T07:53:05.480 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-04-27T07:53:05.480 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-27T07:53:05.523 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-27T07:53:05.523 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-27T07:53:05.525 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-27T07:53:05.588 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-27T07:53:05.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-27T07:53:05.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-27T07:53:06.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-27T07:53:06.225 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-27T07:53:06.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-27T07:53:06.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-27T07:53:06.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-27T07:53:06.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-27T07:53:06.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-27T07:53:06.346 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-27T07:53:06.349 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-04-27T07:53:06.370 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-27T07:53:06.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:53:06.421 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-27T07:53:06.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:53:06.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-27T07:53:06.448 INFO:teuthology.task.internal:Transferring archived files... 2024-04-27T07:53:06.449 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi082 2024-04-27T07:53:06.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-27T07:53:06.509 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063/remote/smithi100 2024-04-27T07:53:06.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-27T07:53:06.549 INFO:teuthology.task.internal:Removing archive directory... 2024-04-27T07:53:06.549 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-27T07:53:06.552 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-27T07:53:06.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-27T07:53:06.611 INFO:teuthology.task.internal:Not uploading archives. 2024-04-27T07:53:06.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-27T07:53:06.636 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-27T07:53:06.636 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-27T07:53:06.639 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-27T07:53:06.651 INFO:teuthology.orchestra.run.smithi082.stdout: 262213 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 27 07:53 /home/ubuntu/cephtest 2024-04-27T07:53:06.651 INFO:teuthology.orchestra.run.smithi082.stdout: 551215 4 d--------- 2 ubuntu ubuntu 4096 Apr 27 07:31 /home/ubuntu/cephtest/mnt.0 2024-04-27T07:53:06.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-27T07:53:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-27T07:53:06.652 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-27T07:53:06.652 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_4e213a58e787437ff508e6c890ccd5fd32dc96b5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-27T07:53:06.653 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-27T07:53:06.669 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-27T07:53:06.705 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-27T07:53:06.705 INFO:teuthology.nuke:Checking targets against current locks 2024-04-27T07:53:06.730 DEBUG:teuthology.nuke:shortname: smithi082 2024-04-27T07:53:06.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-27T07:53:06.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-27 07:10:12.611062', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMQvfk5z/n4oBsLwJefDFolxd3mzFYuYDWvzXZMkzcD5wQzdFEG410kvrFV5pBgSwHaPKebTZoFh0YOMvFLuVI='} 2024-04-27T07:53:06.757 DEBUG:teuthology.nuke:shortname: smithi100 2024-04-27T07:53:06.757 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-27T07:53:06.779 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_20:24:13-fs-main-distro-default-smithi/7672063', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-27 07:10:12.612792', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK7Y+ghfjsFhcvBWvkk/ZJADSemIyJzj5rOztiAltQf6XQWFu04V0YBkOeUEAeserw2Rz3vrhtlJkRMiuaBc7DU='} 2024-04-27T07:53:06.812 INFO:teuthology.orchestra.console.smithi082:Power off 2024-04-27T07:53:06.812 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-27T07:53:06.827 INFO:teuthology.orchestra.console.smithi100:Power off 2024-04-27T07:53:06.827 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-27T07:53:06.837 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-04-27T07:53:06.837 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:06.850 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-04-27T07:53:06.850 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:06.860 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-27T07:53:06.873 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-27T07:53:10.860 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:10.873 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:10.971 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-27T07:53:10.983 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-27T07:53:14.973 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:14.984 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:15.086 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-27T07:53:15.094 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-27T07:53:15.187 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-04-27T07:53:19.098 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-27T07:53:19.207 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-27T07:53:19.309 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-04-27T07:53:19.414 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2223.0463376045227 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-27T07:53:19.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-27T07:53:19.526 INFO:teuthology.run:FAIL